-- Logs begin at Wed 2022-08-24 02:38:52 UTC, end at Wed 2022-08-24 05:43:17 UTC. -- Aug 24 03:18:50.182543 n-d-846470-15 systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:18:50.195551 n-d-846470-15 devstack@n-api.service[106456]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:18:50 2022] *** Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: nodename: n-d-846470-15 Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: machine: x86_64 Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: clock source: unix Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: pcre jit disabled Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: detected number of CPU cores: 4 Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: current working directory: / Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:18:50.198090 n-d-846470-15 devstack@n-api.service[106456]: your processes number limit is 47680 Aug 24 03:18:50.199192 n-d-846470-15 devstack@n-api.service[106456]: your memory page size is 4096 bytes Aug 24 03:18:50.199192 n-d-846470-15 devstack@n-api.service[106456]: detected max file descriptor number: 2048 Aug 24 03:18:50.199192 n-d-846470-15 devstack@n-api.service[106456]: lock engine: pthread robust mutexes Aug 24 03:18:50.199192 n-d-846470-15 devstack@n-api.service[106456]: thunder lock: enabled Aug 24 03:18:50.199192 n-d-846470-15 devstack@n-api.service[106456]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:18:50.199192 n-d-846470-15 devstack@n-api.service[106456]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:18:50.239468 n-d-846470-15 devstack@n-api.service[106456]: Python main interpreter initialized at 0x5576319999c0 Aug 24 03:18:50.239468 n-d-846470-15 devstack@n-api.service[106456]: python threads support enabled Aug 24 03:18:50.239468 n-d-846470-15 devstack@n-api.service[106456]: your server socket listen backlog is limited to 100 connections Aug 24 03:18:50.239468 n-d-846470-15 devstack@n-api.service[106456]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:18:50.240092 n-d-846470-15 devstack@n-api.service[106456]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:18:50.240092 n-d-846470-15 devstack@n-api.service[106456]: *** Operational MODE: preforking *** Aug 24 03:18:50.240295 n-d-846470-15 devstack@n-api.service[106456]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:18:50.240295 n-d-846470-15 devstack@n-api.service[106456]: spawned uWSGI master process (pid: 106456) Aug 24 03:18:50.240489 n-d-846470-15 systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:18:50.241037 n-d-846470-15 devstack@n-api.service[106456]: spawned uWSGI worker 1 (pid: 106457, cores: 1) Aug 24 03:18:50.241387 n-d-846470-15 devstack@n-api.service[106456]: spawned uWSGI worker 2 (pid: 106458, cores: 1) Aug 24 03:18:50.241518 n-d-846470-15 devstack@n-api.service[106456]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:18:51.392933 n-d-846470-15 devstack@n-api.service[106458]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:18:51.442571 n-d-846470-15 devstack@n-api.service[106457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:18:53.254120 n-d-846470-15 devstack@n-api.service[106458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:18:53.254120 n-d-846470-15 devstack@n-api.service[106458]: from cryptography.utils import int_from_bytes Aug 24 03:18:53.254775 n-d-846470-15 devstack@n-api.service[106458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:18:53.254775 n-d-846470-15 devstack@n-api.service[106458]: from cryptography.utils import int_from_bytes Aug 24 03:18:53.308424 n-d-846470-15 devstack@n-api.service[106457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:18:53.308424 n-d-846470-15 devstack@n-api.service[106457]: from cryptography.utils import int_from_bytes Aug 24 03:18:53.309104 n-d-846470-15 devstack@n-api.service[106457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:18:53.309104 n-d-846470-15 devstack@n-api.service[106457]: from cryptography.utils import int_from_bytes Aug 24 03:18:55.816197 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:18:55.817296 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:18:55.817296 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:18:55.817577 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:18:55.817577 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:18:55.817950 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.818278 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.818598 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.818917 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.819245 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.819556 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.819902 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.820226 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.820571 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.820829 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.821130 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.821448 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846470-15 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.821768 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.821915 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:18:55.822522 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.822641 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:18:55.822772 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.822772 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.823017 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.823138 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:18:55.823272 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.823716 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.823882 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:18:55.824124 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.824299 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:18:55.824567 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.824924 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.825207 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.825364 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.825618 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.825864 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.826005 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.826139 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.826464 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.826605 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.826748 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.827059 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.827291 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.827531 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.827776 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.828000 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846470-15 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.828218 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.828457 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.828688 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.828688 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.829112 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.829338 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.829584 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.829831 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.829831 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.830262 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.830482 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.830717 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.830957 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.830957 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.831385 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.831623 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.831623 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.832075 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846470-15 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.832309 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.832309 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.832752 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.832982 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.833212 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.833442 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.833442 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.833979 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.834199 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.834199 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.834620 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.834850 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.834850 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.835276 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.835512 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.835512 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.836011 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.836231 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.836231 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.836652 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.836885 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.836885 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.836885 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.837537 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.837809 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.837809 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.838270 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.838490 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.838490 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.838913 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.839130 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.839343 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.839578 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.839578 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.840035 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.840370 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.840370 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.840866 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.841103 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.841103 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.841541 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.841793 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.841793 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.842225 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.842452 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.842688 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.842916 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.842916 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.843329 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.843557 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.843557 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.844036 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.844252 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.844252 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.844252 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.844877 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846470-15 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.845104 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.845104 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.845512 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.845741 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.845741 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.846156 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.846755 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.846975 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.847216 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.847216 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.847216 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.847877 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.848098 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.848098 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.848525 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.848744 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.848744 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.849181 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.849417 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.849652 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.849883 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.849883 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.850295 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.850512 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.850512 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.850950 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.851181 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.851181 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.851607 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.851911 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.851911 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.852386 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.852657 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.852657 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.853073 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.853308 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.853308 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.853742 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.853973 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.854188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.854408 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.854408 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.854831 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.855063 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.855063 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.855512 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.855752 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.855752 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.856418 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.856662 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.856662 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.857093 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.857311 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.857311 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.857734 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.857966 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.858205 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.858441 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.858441 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.858852 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.859080 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.859080 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.859508 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.859773 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.859773 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.860189 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.860415 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.860415 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.860855 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.861095 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.861095 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.861095 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.861727 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.861945 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.861945 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.862372 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.862610 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.862610 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.863042 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.863272 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.863272 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.863785 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.864022 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.864271 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.864488 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.864488 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.864925 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.865139 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.865139 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.865586 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.865821 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.865821 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.866241 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.866471 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.866702 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.866928 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.866928 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.867356 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.867584 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.867584 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.868061 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.868291 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.868528 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.868745 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.868745 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.869168 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.869409 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.869409 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.869834 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.870052 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.870052 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.870462 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.870801 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.870801 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.871228 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.871559 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.871802 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.872020 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.872020 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.872020 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.872667 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.872883 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.873101 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.873331 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.873331 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.873743 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.873968 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.873968 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.874377 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.874615 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.874831 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.875048 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.875048 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.875476 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.875760 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.875760 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.876199 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.876431 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.876431 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.876864 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.877079 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.877326 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.877543 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.877543 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.877966 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.878199 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.878199 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.878629 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.878845 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.878845 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.879257 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.879476 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.879729 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.879949 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.879949 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.880387 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.880605 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.880818 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.881068 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.881068 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.881482 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.881700 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.881700 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.882121 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.882351 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.882351 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.882772 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.882989 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.883210 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.883425 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.883425 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.883891 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.884123 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.884123 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.884562 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.884822 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.884822 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.885469 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.885707 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.885927 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.886141 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.886141 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.886565 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.886806 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.886806 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.887385 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.887865 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.887865 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.888553 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.888778 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.889008 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.889224 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.889224 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.889688 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.889922 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.889922 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.890349 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.890582 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.890582 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.891021 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.891239 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.891239 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.891648 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.891899 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.892135 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.892367 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.892367 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.892781 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.893000 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.893000 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.893440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.893672 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.893672 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.894086 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.894303 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.894518 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.894752 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.894752 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.895192 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.895409 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.895409 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.895980 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.896229 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.896229 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.896642 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.896869 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.896869 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.897295 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.897534 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.897933 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.898165 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.898165 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.898582 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.898798 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.898798 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.899242 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.899461 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.899461 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.899916 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.900152 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.900152 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.900601 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.900831 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.900831 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.901245 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.901464 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.901464 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.901911 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.902132 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.902348 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.902564 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.902564 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.903990 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.904258 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.904258 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.904751 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.904987 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.905225 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.905440 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.905440 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.905878 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.906094 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.906094 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.906514 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.906727 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.906727 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.907144 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.907370 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.907588 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.907861 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.907861 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.908248 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.908457 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.908457 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.908878 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.909093 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.909093 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.909503 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.909724 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.909946 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.910189 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.910189 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.910633 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.910881 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.910881 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.911352 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.911600 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.911600 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.912071 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.912349 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.912578 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.912803 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.912803 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.913269 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.913504 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.913504 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.913970 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:18:55.914227 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.914227 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.914700 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.914924 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.914924 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.915367 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.915615 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.915615 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.916105 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.916341 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.916341 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.916829 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.917083 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.917083 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.917635 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.917880 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.918288 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.918583 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.918832 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.919064 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.919300 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.919536 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.919779 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.920037 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.920263 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.920492 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.920492 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.920941 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.921164 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.921410 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.921638 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.921862 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.922080 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.922305 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.922531 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.922770 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.923007 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.923233 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.923458 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.923765 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.923995 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.924231 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.924455 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.924683 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.924916 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.925151 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.925396 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.925638 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.925873 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.926107 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.926329 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.926552 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.926806 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.927027 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.927247 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.927467 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.927713 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.927937 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.928173 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.928406 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.928626 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.928855 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.929077 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.929299 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.929531 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.929768 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.930001 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.930223 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.930447 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.930678 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.930915 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.931135 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.931367 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.931653 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.931941 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.932177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.932395 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.932629 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.932847 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.933068 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.933290 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.933522 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.933745 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.933978 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.934215 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.934437 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.934656 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.934890 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.935121 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.935352 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.935598 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.935866 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.936099 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.936329 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.936550 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.936763 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.936981 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.937208 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.937435 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.937657 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.937888 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.938110 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.938335 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.938587 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.938821 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.939040 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.939260 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.939478 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.939856 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.940098 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.940336 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.940546 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.940705 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.940890 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.941039 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.941039 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.941331 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.941476 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.941630 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.941630 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.941918 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.942104 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.942247 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.942389 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.942530 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.942672 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.942812 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.942965 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.943117 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.943260 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.943401 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.943538 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.943709 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.943898 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.944023 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.944163 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.944300 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.944454 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.944614 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.944753 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.944908 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.945045 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.945176 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.945307 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.945503 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.945629 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.945780 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.945920 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.946062 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.946198 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.946325 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.946464 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.946627 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.946765 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.946903 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.947052 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.947194 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.947346 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.947483 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.947620 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.947779 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.947923 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.948078 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.948227 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.948364 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.948515 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.948654 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.948792 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.948940 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.949097 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.949247 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.949387 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.949525 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.949665 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.949908 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.950049 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.950188 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.950340 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.950505 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.950651 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.950810 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.950950 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.951091 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.951227 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.951362 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.951513 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.951930 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.952073 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.952198 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.952336 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.952473 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.952614 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.952770 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.952909 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.953047 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.953184 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.953324 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.953475 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.953624 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.953760 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.953897 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.954026 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.954163 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.954313 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.954447 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.954567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.954703 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.954841 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.954978 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.955126 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.955263 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.955405 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.955529 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.955643 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.955643 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.955929 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.956069 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.956225 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.956364 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.956505 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.956661 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.956813 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.956951 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.957099 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.957236 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.957373 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.957524 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.957661 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.957798 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.957941 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.958079 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.958215 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.958423 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.958570 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.958708 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.958859 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.959009 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.959148 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.959297 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.959437 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.959577 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.959737 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.959877 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.960036 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.960178 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.960316 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.960462 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.960600 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.960742 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.960894 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.961032 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.961170 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.961320 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.961461 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.961607 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.961761 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.961924 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.962104 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.962230 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.962352 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.962489 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.962645 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.962784 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.962921 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.963061 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.963200 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.963333 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.963464 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.963603 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.963769 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.963909 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.964048 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.964212 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.964782 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.964921 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.965060 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.965060 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.965326 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.965326 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.965726 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.965726 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.966042 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.966195 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.966333 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.966484 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.966636 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.966775 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.966913 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.967049 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.967212 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.967350 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.967511 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.967814 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.967984 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.968122 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.968279 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.968420 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.968561 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.968698 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.968834 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.968973 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.969237 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.969378 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.969515 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.969666 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.969808 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.969955 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.970209 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.970351 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.970488 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.970639 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.970774 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.970774 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.971041 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.971178 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.971703 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.971827 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.971988 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.972134 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.972325 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.972467 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.972622 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.972757 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.972876 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.973023 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.973161 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.973298 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.973434 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.973572 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.973708 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.973864 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.973985 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.974106 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.974256 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.974457 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.974670 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.974862 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.975007 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.975143 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.975275 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.975413 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.975564 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.975737 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.975879 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.976080 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.976238 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.976390 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.976544 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.976681 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.976819 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.976957 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.977095 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.977230 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.977380 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.977528 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.977677 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.977866 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.978012 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.978151 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.978310 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.978457 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.978597 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.978734 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.978874 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.979024 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.979159 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.979307 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.979447 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.979583 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.979792 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.979950 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.980091 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.980232 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.980367 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.980499 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.980648 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.980799 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.980938 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.981124 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.981271 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.981407 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.981554 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.981706 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.981847 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.981981 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.982112 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.982234 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.982385 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.982508 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.982628 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.982768 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.982906 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.983060 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.983208 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.983329 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.983329 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.983560 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.983560 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.983838 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.983996 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.984138 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.984280 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.984415 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.984549 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.984694 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.984899 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.985093 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.985278 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.985464 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.985609 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.985769 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.985908 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.986044 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.986181 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.986321 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.986478 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.986627 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.986769 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.986918 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.987058 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.987194 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.987330 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.987466 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.987619 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.987799 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.987960 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.988083 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.988215 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.988357 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.988512 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.988649 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.988786 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.988926 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.989060 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.989194 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.989345 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.989482 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.989622 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.989758 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.989893 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.990030 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.990030 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.990300 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.990439 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.990578 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.990713 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.990859 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.990997 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.991135 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.991275 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.991413 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.991534 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.991688 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.991827 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.991965 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.992100 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.992253 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.992392 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.992604 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.992780 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.992912 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.993054 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.993195 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.993331 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.993483 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.993622 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.993764 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.993899 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.994035 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.994187 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.994340 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.994478 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.994614 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.994752 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.994888 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.995197 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.995343 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.995481 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.995481 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.995813 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.995971 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.996145 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.996286 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.996426 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.996635 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.996796 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.996951 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.997092 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.997228 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.997365 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.997486 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.997624 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.997830 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.997971 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.998164 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.998311 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.998448 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.998583 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.998735 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.998885 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.999027 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.999163 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.999298 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.999435 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.999599 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.999599 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:55.999976 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.000114 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.000260 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.000414 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.000552 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.000691 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.000817 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.000937 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.001060 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.001222 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.001375 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.001510 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.001646 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.001782 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.001923 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.001923 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.002159 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.002303 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.002446 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.002446 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.002739 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.002739 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.002996 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.003141 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.003275 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.003408 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.003560 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.003722 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.003863 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.004019 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.004156 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.004304 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.004455 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.004596 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.004716 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.004854 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.004993 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.005142 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.005347 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.005536 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.005681 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.005681 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.005936 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.006074 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.006229 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.006377 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.006513 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.006666 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.006819 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.007024 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.007176 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.007328 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.007467 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.007603 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.007764 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.007946 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.008094 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.008231 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.008354 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.008484 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.008623 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.008773 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.008914 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.009051 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.009195 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.009328 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.009467 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.009616 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.009760 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.009896 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.010017 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.010148 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.010302 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.010455 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.010603 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.010736 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.010872 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.011011 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.011210 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.011858 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.012003 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.012465 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.012612 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.012754 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.013024 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.013260 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.013412 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.013553 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.013695 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.013843 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.013982 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.014121 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.014293 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.014448 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.014588 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.014759 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.014903 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.015043 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.015180 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.015319 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.015526 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.015872 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.016022 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.016167 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.016167 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.016437 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.016764 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.016918 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.017081 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.017242 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.017395 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.017543 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.017680 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.017820 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.017957 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.018120 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.018264 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.018386 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.018504 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.018636 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.018636 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.018884 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.019040 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.019167 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.019287 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.019415 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.019553 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.019729 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.019869 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.020009 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.020168 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.020297 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.020436 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.020568 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.020709 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.020850 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.020988 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.021128 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.021283 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.021421 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.021555 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.021692 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.021829 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.021966 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.022125 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.022266 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.022403 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.022544 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.022693 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.022908 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.023049 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.023242 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.023388 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.023527 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.023685 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.023859 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.024000 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.024137 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.024290 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.024431 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.024431 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.024705 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.024705 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.024965 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.025108 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.025264 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.025421 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.025578 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.025705 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.025840 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.026030 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.026174 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.026332 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.026484 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.026625 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.026760 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.026899 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.027041 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.027196 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.027347 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.027488 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.027625 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.027881 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.028029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.028198 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.028345 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.028485 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.028675 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.028822 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.028973 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.029118 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.029257 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.029396 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.029536 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.029686 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.029837 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.029977 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.030116 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.030246 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.030368 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.030491 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.030647 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.030787 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.030922 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.030922 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.031193 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.031356 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.031494 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.031630 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.031869 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.032023 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.032176 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.032326 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.032464 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.032603 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.032742 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.032883 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.033017 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.033225 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.033418 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.033572 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.033710 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.033710 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.033967 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.034118 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.034258 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.034399 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.034539 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.034681 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.034840 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.034993 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.035133 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.035272 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.035409 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.035545 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.035811 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.035958 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.036145 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.036287 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.036445 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.036445 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.036719 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.036856 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.036991 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.037141 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.037279 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.037415 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.037567 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.037705 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.037850 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.037985 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.038135 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.038294 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.038440 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.038580 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.038703 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.038827 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.038950 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.039112 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.039249 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.039386 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.039534 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.039707 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.039853 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.040100 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.040240 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.040381 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.040521 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.040659 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.040810 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.040952 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.041105 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.041242 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.041387 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.041537 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.041688 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.041827 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.041964 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.042111 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.042250 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.042387 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.042539 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.042675 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.042811 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.042962 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.043085 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.043225 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.043375 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.043617 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.043783 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.043954 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.044118 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.044262 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.044414 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.044556 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.044694 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.044833 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.044984 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.045138 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.045273 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.045422 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.045561 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.045712 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.045854 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.046058 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.046198 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.046322 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.046445 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.046595 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.046742 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.047004 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.047145 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.047288 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.047425 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.047560 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.047851 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.048012 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.048156 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.048291 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.048427 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.048562 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.048714 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.048858 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.049067 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.049199 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.049320 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.049448 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.049602 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.049754 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.049890 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.050026 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.050162 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.050300 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.050300 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.050556 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.050697 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.050842 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.050971 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.051097 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.051229 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.051229 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.051474 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.051604 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.051813 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.051975 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.052101 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.052221 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.052359 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.052500 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.052647 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.052801 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.052953 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.053109 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.053248 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.053394 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.053532 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.053737 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.053880 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.054017 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.054157 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.054293 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.054454 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.054593 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.054734 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.054871 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.055008 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.055149 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.055312 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.055451 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.055589 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.055774 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.055918 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.056055 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.056265 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.056452 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.056607 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.056745 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.056883 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.057021 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.057173 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.057309 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.057446 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.057583 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.057725 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.057881 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.058019 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.058158 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.058298 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.058437 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.058576 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.058725 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.058868 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.059045 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.059266 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.059266 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.059540 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.059729 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.059729 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060003 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060143 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060268 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060268 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060489 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060596 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060720 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060859 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.060995 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.061146 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.061287 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.061429 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.061557 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.061676 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.061815 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.061969 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.062149 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.062355 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.062543 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.062721 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.062908 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.063090 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.063090 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.063430 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.063605 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.063802 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.063997 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.064174 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.064348 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.064518 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.064689 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.064877 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.065063 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.065237 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.065764 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.065942 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.066121 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.066372 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.066562 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.066751 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.066925 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.067097 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.067281 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.067468 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.067652 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.067869 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.068043 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.068215 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.068396 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.068572 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.068742 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.068927 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.069100 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.069269 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.069451 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.069451 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.069774 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.069949 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.070117 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.070289 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.070472 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.070472 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.070789 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.070974 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.071147 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.071302 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.071472 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.071646 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.071925 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.072112 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.072288 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.072466 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.072630 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.072805 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.072805 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.073137 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.073323 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.073514 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.073692 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.073871 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.074043 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.074223 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.074400 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.074586 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.074792 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.074967 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.075137 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.075307 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.075477 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.075685 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.075864 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.076035 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.076206 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.076378 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.076682 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.076858 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.077032 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.077241 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.077422 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.077594 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.077594 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.077929 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.077929 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.078268 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.078268 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.078609 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.078809 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.078991 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.080035 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.080181 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.080181 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.080467 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.080614 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.080749 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.080887 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.081024 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.081179 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.081317 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.081449 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.081571 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.081719 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.081860 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.082009 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.082145 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.082294 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.082434 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.082434 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.082681 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.082816 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.082956 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.083097 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.083233 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.083380 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.083535 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.083798 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.083941 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.084078 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.084235 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.084372 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.084522 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.084663 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.084798 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.084936 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.085072 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.085211 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.085364 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.085554 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.085698 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.085844 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.085981 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.086117 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.086270 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.086420 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.086562 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.086699 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.086897 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.087053 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.087194 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.087330 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.087467 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.087616 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.087779 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.087936 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.087936 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.088215 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.088367 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.088508 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.088650 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.088808 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.088948 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.089085 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.089278 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.089462 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.089637 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.089796 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.089937 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.090076 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.090216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.090418 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.090576 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.090711 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.090848 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.090986 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.091138 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.091277 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.091415 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.091537 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.091693 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.091834 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.091971 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.092107 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:18:56.092267 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.092267 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.092267 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.092267 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.092267 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.092267 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.092267 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.092267 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.093216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.093216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.093216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.093216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.093216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.093216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.093216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.093216 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.094188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.094188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.094188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.094188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.094188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.094188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.094188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.094188 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.095177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.095177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.095177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.095177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.095177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.095177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.095177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.095177 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.096668 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.096668 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.096668 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.096668 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.096668 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.096668 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.096668 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.096668 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.097658 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.097658 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.097658 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.097658 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.097658 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.097658 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.097658 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.097658 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.098567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.098567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.098567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.098567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.098567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.098567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.098567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.098567 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.099535 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.099535 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.099535 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.099535 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.099535 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.099535 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.099535 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.099535 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.100440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.100440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.100440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.100440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.100440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.100440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.100440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.100440 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.101282 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.101282 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.101282 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.101282 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.101282 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.101282 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.101282 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.101282 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.102122 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.102122 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.102122 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.102122 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.102122 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.102122 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.102122 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.102122 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.103048 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.103048 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.103048 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.103048 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.103048 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.103048 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.103048 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.103048 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.104029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.104029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.104029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.104029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.104029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.104029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.104029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.104029 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.105010 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.105010 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.105386 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.105768 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.106314 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.106705 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.107114 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.107492 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.107911 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.108297 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.108682 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.109061 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.109456 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.109928 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.110317 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.110711 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.111101 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.111571 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.111987 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.112384 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.112826 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.113210 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.113624 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.114017 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.114401 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.114785 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.115159 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:18:56.115470 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:18:56.229580 n-d-846470-15 devstack@n-api.service[106457]: INFO dbcounter [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Registered counter for database nova_api Aug 24 03:18:56.252435 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:18:56.259794 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writer thread running {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:18:56.280514 n-d-846470-15 devstack@n-api.service[106458]: INFO dbcounter [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Registered counter for database nova_api Aug 24 03:18:56.302121 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_db.sqlalchemy.engines [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:18:56.310005 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writer thread running {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:18:56.318123 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.context [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) {{(pid=106457) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:18:56.322049 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:18:56.322524 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:18:56.324153 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:18:56.324949 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:18:56.325396 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:18:56.327429 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:18:56.329496 n-d-846470-15 devstack@n-api.service[106457]: INFO dbcounter [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Registered counter for database nova_cell0 Aug 24 03:18:56.335385 n-d-846470-15 devstack@n-api.service[106457]: INFO dbcounter [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Registered counter for database nova_cell1 Aug 24 03:18:56.344810 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:18:56.349231 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:18:56.351408 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writer thread running {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:18:56.373424 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.context [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) {{(pid=106458) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:18:56.377732 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_concurrency.lockutils [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:18:56.378313 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_concurrency.lockutils [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:18:56.380022 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_concurrency.lockutils [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:18:56.380856 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_concurrency.lockutils [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:18:56.381383 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_concurrency.lockutils [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:18:56.383498 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_concurrency.lockutils [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:18:56.385731 n-d-846470-15 devstack@n-api.service[106458]: INFO dbcounter [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Registered counter for database nova_cell0 Aug 24 03:18:56.392315 n-d-846470-15 devstack@n-api.service[106458]: INFO dbcounter [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Registered counter for database nova_cell1 Aug 24 03:18:56.400943 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_db.sqlalchemy.engines [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:18:56.404425 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_db.sqlalchemy.engines [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:18:56.408769 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writer thread running {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:18:56.498294 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writer thread running {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:18:56.509761 n-d-846470-15 devstack@n-api.service[106457]: INFO dbcounter [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Registered counter for database nova_cell0 Aug 24 03:18:56.522848 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:18:56.528316 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writer thread running {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:18:56.553995 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writer thread running {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:18:56.564966 n-d-846470-15 devstack@n-api.service[106458]: INFO dbcounter [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Registered counter for database nova_cell0 Aug 24 03:18:56.577451 n-d-846470-15 devstack@n-api.service[106458]: DEBUG oslo_db.sqlalchemy.engines [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:18:56.582674 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writer thread running {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:18:56.874299 n-d-846470-15 devstack@n-api.service[106457]: WARNING keystonemiddleware.auth_token [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:18:56.881730 n-d-846470-15 devstack@n-api.service[106457]: WARNING keystonemiddleware.auth_token [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:18:56.912636 n-d-846470-15 devstack@n-api.service[106458]: WARNING keystonemiddleware.auth_token [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:18:56.921443 n-d-846470-15 devstack@n-api.service[106458]: WARNING keystonemiddleware.auth_token [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:18:57.233050 n-d-846470-15 devstack@n-api.service[106457]: WARNING keystonemiddleware.auth_token [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:18:57.239361 n-d-846470-15 devstack@n-api.service[106457]: WARNING keystonemiddleware.auth_token [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:18:57.244922 n-d-846470-15 devstack@n-api.service[106457]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5576319999c0 pid: 106457 (default app) Aug 24 03:18:57.247249 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:18:57.248516 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002007 Aug 24 03:18:57.248984 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Wed Aug 24 03:18:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:18:57.303525 n-d-846470-15 devstack@n-api.service[106458]: WARNING keystonemiddleware.auth_token [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:18:57.311334 n-d-846470-15 devstack@n-api.service[106458]: WARNING keystonemiddleware.auth_token [None req-686e7c66-a390-4761-864b-fe83f1a31355 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:18:57.319180 n-d-846470-15 devstack@n-api.service[106458]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5576319999c0 pid: 106458 (default app) Aug 24 03:20:26.540968 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:26.541885 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 24 03:20:26.542269 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:20:26.555392 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writing DB stats nova_api:SELECT=3 {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:26.556826 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writing DB stats nova_cell0:SELECT=3 {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:26.557977 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writing DB stats nova_cell1:SELECT=3 {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:26.559453 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writing DB stats nova_cell0:SELECT=3 {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:27.423022 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-9dcc2b2d-7a62-4a0f-8716-14a6d6b685c5 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:27.454856 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-9dcc2b2d-7a62-4a0f-8716-14a6d6b685c5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904875 Aug 24 03:20:27.455649 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:20:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:20:29.851237 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:29.852302 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-4b0a1bd7-9b4b-42cf-9973-99bb518d7682 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 03:20:29.856793 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:30.337595 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-be1fd48c-612a-42d4-8078-241d62baeb6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:30.359610 n-d-846470-15 devstack@n-api.service[106458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:20:30.359610 n-d-846470-15 devstack@n-api.service[106458]: warnings.warn(msg) Aug 24 03:20:30.392694 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-be1fd48c-612a-42d4-8078-241d62baeb6e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533776 Aug 24 03:20:30.393233 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:30.408715 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writing DB stats nova_api:SELECT=3 {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:30.409960 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writing DB stats nova_cell0:SELECT=3 {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:30.411389 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writing DB stats nova_cell1:SELECT=3 {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:30.412852 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:30.627012 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-01be3b02-5309-48ed-a2ee-51a4e171d596 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:30.631992 n-d-846470-15 devstack@n-api.service[106457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:20:30.631992 n-d-846470-15 devstack@n-api.service[106457]: warnings.warn(msg) Aug 24 03:20:30.702772 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-01be3b02-5309-48ed-a2ee-51a4e171d596 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.300682 Aug 24 03:20:30.703822 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 03:20:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:20:33.100152 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-be1fd48c-612a-42d4-8078-241d62baeb6e admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:33.102194 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-be1fd48c-612a-42d4-8078-241d62baeb6e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003054 Aug 24 03:20:33.103265 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:33 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:20:33.892496 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-829b4dae-c892-4385-8584-59b29ad81671 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "vcpus": 1}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:33.913444 n-d-846470-15 devstack@n-api.service[106457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:20:33.913444 n-d-846470-15 devstack@n-api.service[106457]: warnings.warn(msg) Aug 24 03:20:33.937964 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-829b4dae-c892-4385-8584-59b29ad81671 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.827856 Aug 24 03:20:33.938849 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:33.952158 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-73737392-c2ea-48eb-ba82-0f1bc017aa22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:33.956438 n-d-846470-15 devstack@n-api.service[106458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:20:33.956438 n-d-846470-15 devstack@n-api.service[106458]: warnings.warn(msg) Aug 24 03:20:33.998071 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-73737392-c2ea-48eb-ba82-0f1bc017aa22 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050289 Aug 24 03:20:33.999527 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 03:20:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:20:36.662109 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-829b4dae-c892-4385-8584-59b29ad81671 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:36.664003 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-829b4dae-c892-4385-8584-59b29ad81671 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002541 Aug 24 03:20:36.670548 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:36 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:37.180237 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-638a9084-04d9-404a-8895-40f61cd225d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:37.205044 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-638a9084-04d9-404a-8895-40f61cd225d9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.533290 Aug 24 03:20:37.206349 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:20:37.221082 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-2d1cd5d9-35d0-4d4c-8a6d-0dcce4a3de81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:37.262737 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-2d1cd5d9-35d0-4d4c-8a6d-0dcce4a3de81 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045250 Aug 24 03:20:37.271801 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 03:20:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:20:39.819848 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-638a9084-04d9-404a-8895-40f61cd225d9 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:39.820887 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-638a9084-04d9-404a-8895-40f61cd225d9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 24 03:20:39.821287 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:40.381791 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-2a36a147-bc52-4311-89d8-0c2387c34109 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "disk": 10}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:40.409551 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-2a36a147-bc52-4311-89d8-0c2387c34109 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581867 Aug 24 03:20:40.415736 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:40.423418 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-5c0a60ad-65fe-4062-aba6-92dd369bfc6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:40.453601 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-5c0a60ad-65fe-4062-aba6-92dd369bfc6a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034484 Aug 24 03:20:40.454199 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 03:20:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:20:42.888371 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-2a36a147-bc52-4311-89d8-0c2387c34109 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:42.889884 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-2a36a147-bc52-4311-89d8-0c2387c34109 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002255 Aug 24 03:20:42.890514 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:43.455010 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-5065459a-7656-48c9-bdf7-04c3cf1262b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "disk": 20, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:43.483854 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-5065459a-7656-48c9-bdf7-04c3cf1262b0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.583054 Aug 24 03:20:43.485301 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:43.497370 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-dc135145-4a2f-4236-9a0a-7d709b6ff94f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:43.524812 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-dc135145-4a2f-4236-9a0a-7d709b6ff94f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030990 Aug 24 03:20:43.535477 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 24 03:20:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:20:45.956383 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-5065459a-7656-48c9-bdf7-04c3cf1262b0 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:45.957979 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-5065459a-7656-48c9-bdf7-04c3cf1262b0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Aug 24 03:20:45.964001 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:45 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:46.535802 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-546014f9-d86b-4c71-8af7-04099a52092b admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:46.567864 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-546014f9-d86b-4c71-8af7-04099a52092b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.602713 Aug 24 03:20:46.569593 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:20:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:20:49.186676 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-5065459a-7656-48c9-bdf7-04c3cf1262b0 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:49.187834 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-5065459a-7656-48c9-bdf7-04c3cf1262b0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Aug 24 03:20:49.188318 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:20:49.711050 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4a796611-66ef-47e3-aabb-49c1c0da22fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "disk": 1, "vcpus": 1}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:49.734541 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-4a796611-66ef-47e3-aabb-49c1c0da22fa admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.538825 Aug 24 03:20:49.735139 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:49.749149 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-4bca1b43-c7fa-46f1-87b2-eaf57e98db2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:49.783405 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-4bca1b43-c7fa-46f1-87b2-eaf57e98db2f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038321 Aug 24 03:20:49.791686 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 03:20:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:20:52.728016 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4a796611-66ef-47e3-aabb-49c1c0da22fa admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:52.729236 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-4a796611-66ef-47e3-aabb-49c1c0da22fa admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001881 Aug 24 03:20:52.729664 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:53.262434 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-cd3e022b-5224-4c27-92f9-c17e22f7a5ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "ram": 2048}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:53.285979 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-cd3e022b-5224-4c27-92f9-c17e22f7a5ed admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.549662 Aug 24 03:20:53.286539 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:53.299442 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-66379ada-1843-47c5-8f4e-436bdd1a2e28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:53.326234 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-66379ada-1843-47c5-8f4e-436bdd1a2e28 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030521 Aug 24 03:20:53.326897 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 03:20:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:55.688113 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-cd3e022b-5224-4c27-92f9-c17e22f7a5ed admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:55.689120 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-cd3e022b-5224-4c27-92f9-c17e22f7a5ed admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 24 03:20:55.689519 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:56.118290 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-fb7dba05-c1d3-4687-84de-eaac6610d986 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:56.138143 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-fb7dba05-c1d3-4687-84de-eaac6610d986 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.442380 Aug 24 03:20:56.138653 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:56.150934 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-4f9880f3-5b5f-4069-8da9-5d7a60e1ff09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:56.175561 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-4f9880f3-5b5f-4069-8da9-5d7a60e1ff09 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028499 Aug 24 03:20:56.176348 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 03:20:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:20:58.668848 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-fb7dba05-c1d3-4687-84de-eaac6610d986 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:58.669854 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-fb7dba05-c1d3-4687-84de-eaac6610d986 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 24 03:20:58.670260 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:20:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:59.140404 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-504483e5-4c7f-4c50-af49-431312063831 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:59.148597 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:59.162194 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-504483e5-4c7f-4c50-af49-431312063831 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485406 Aug 24 03:20:59.163407 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:20:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:59.175252 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-0af113c2-f556-446e-931b-09346068645e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:59.202732 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-0af113c2-f556-446e-931b-09346068645e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031168 Aug 24 03:20:59.203456 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 03:20:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:21:01.588847 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-504483e5-4c7f-4c50-af49-431312063831 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:01.589887 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-504483e5-4c7f-4c50-af49-431312063831 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 24 03:21:01.590293 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:21:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:02.064509 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-7ef5ac92-c3c2-409f-88da-904d9fae18fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "disk": 160}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:02.087586 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-7ef5ac92-c3c2-409f-88da-904d9fae18fb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.490641 Aug 24 03:21:02.092038 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 24 03:21:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:21:02.100788 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-a6b01383-703e-4ac8-8d60-b25bf822355b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:02.137191 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-a6b01383-703e-4ac8-8d60-b25bf822355b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039985 Aug 24 03:21:02.137784 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 24 03:21:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:21:24.827121 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-7ef5ac92-c3c2-409f-88da-904d9fae18fb admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:24.828187 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-7ef5ac92-c3c2-409f-88da-904d9fae18fb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Aug 24 03:21:24.828634 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:21:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:24.840850 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:25.293408 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-002cf16a-2775-44d8-b74b-b819b260374f admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:25.313454 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-002cf16a-2775-44d8-b74b-b819b260374f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.477112 Aug 24 03:21:25.314141 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:21:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:21:26.506198 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-7ef5ac92-c3c2-409f-88da-904d9fae18fb admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:26.507289 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-7ef5ac92-c3c2-409f-88da-904d9fae18fb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Aug 24 03:21:26.507907 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:27.099761 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-438b5c84-73c4-4007-af08-61e0892168e7 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:27.106582 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.wsgi [None req-438b5c84-73c4-4007-af08-61e0892168e7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-438b5c84-73c4-4007-af08-61e0892168e7 admin admin] Request method failure captured: Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: Accept: application/json Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: Accept-Encoding: gzip, deflate Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: Connection: keep-alive Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: Content-Length: 0 Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: Host: 10.222.0.58 Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: Openstack-Api-Version: compute 2.90 Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: Openstack-System-Scope: None Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: User-Agent: python-novaclient Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Auth-Token: gAAAAABjBZk2pAvfLHONqYjnghrHrjZAonKQWNECxXCSmuCqBSNmNO_Aqie1wioBr5YnDvBj2Sjfc4yhp20AiXTVVQ1WFXjgxjshoU-7_0LtpIlLatnuW3NbFCzheva3i2uYGlATv9YfHAI3yd8D9Ie9sG8ry1uTcU0e_fd1Hou6Zew8og5WTOk Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Domain-Id: None Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Domain-Name: None Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Identity-Status: Confirmed Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Is-Admin-Project: True Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Domain-Id: default Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Domain-Name: Default Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Name: admin Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Role: admin,member,reader Aug 24 03:21:27.110017 n-d-846470-15 devstack@n-api.service[106458]: X-Roles: admin,member,reader Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79840a063f87423fa16837e963b5dd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79840a063f87423fa16837e963b5dd22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant: admin Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant-Name: admin Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-User: admin Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-User-Domain-Id: default Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-User-Domain-Name: Default Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-User-Id: ceb5c6ba777b4eba8d656fcd6b479676 Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: X-User-Name: admin Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: method: > Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: exception: Flavor 42 could not be found. Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: action_args: {'id': '42'} Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:21:27.111686 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:27.112580 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.113966 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-438b5c84-73c4-4007-af08-61e0892168e7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:21:27.115213 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-438b5c84-73c4-4007-af08-61e0892168e7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.429620 Aug 24 03:21:27.115213 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 03:21:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:21:27.122013 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-f24fcb7c-235d-417e-ac4b-5f7dfddebb79 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:27.126365 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:27.146501 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-f24fcb7c-235d-417e-ac4b-5f7dfddebb79 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028162 Aug 24 03:21:27.147103 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 03:21:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:21:27.166542 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-82504abe-cb39-43d8-9f1d-a59076fee1f0 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:27.191649 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-82504abe-cb39-43d8-9f1d-a59076fee1f0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029040 Aug 24 03:21:27.192281 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 03:21:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:21:27.203204 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-9eebaca4-222b-4891-9ba3-d01f7fe3da12 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:27.210009 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.wsgi [None req-9eebaca4-222b-4891-9ba3-d01f7fe3da12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-9eebaca4-222b-4891-9ba3-d01f7fe3da12 admin admin] Request method failure captured: Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: Accept: application/json Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: Accept-Encoding: gzip, deflate Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: Connection: keep-alive Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: Content-Length: 0 Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: Host: 10.222.0.58 Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: Openstack-Api-Version: compute 2.90 Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: Openstack-System-Scope: None Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: User-Agent: python-novaclient Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Auth-Token: gAAAAABjBZk2pAvfLHONqYjnghrHrjZAonKQWNECxXCSmuCqBSNmNO_Aqie1wioBr5YnDvBj2Sjfc4yhp20AiXTVVQ1WFXjgxjshoU-7_0LtpIlLatnuW3NbFCzheva3i2uYGlATv9YfHAI3yd8D9Ie9sG8ry1uTcU0e_fd1Hou6Zew8og5WTOk Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Domain-Id: None Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Domain-Name: None Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Identity-Status: Confirmed Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Is-Admin-Project: True Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Domain-Id: default Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Domain-Name: Default Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Name: admin Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Role: admin,member,reader Aug 24 03:21:27.213378 n-d-846470-15 devstack@n-api.service[106457]: X-Roles: admin,member,reader Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79840a063f87423fa16837e963b5dd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79840a063f87423fa16837e963b5dd22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant: admin Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant-Name: admin Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-User: admin Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-User-Domain-Id: default Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-User-Domain-Name: Default Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-User-Id: ceb5c6ba777b4eba8d656fcd6b479676 Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: X-User-Name: admin Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: method: > Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: exception: Flavor 42 could not be found. Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: action_args: {'id': '42'} Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:21:27.214880 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:27.217099 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:27.218397 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-9eebaca4-222b-4891-9ba3-d01f7fe3da12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:21:27.220010 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-9eebaca4-222b-4891-9ba3-d01f7fe3da12 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016004 Aug 24 03:21:27.220010 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 03:21:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:21:28.198239 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-82504abe-cb39-43d8-9f1d-a59076fee1f0 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:28.199251 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-82504abe-cb39-43d8-9f1d-a59076fee1f0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 24 03:21:28.199652 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:28.748228 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4afab447-5ac7-4114-8854-b315f90d7af9 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:28.753955 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.wsgi [None req-4afab447-5ac7-4114-8854-b315f90d7af9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4afab447-5ac7-4114-8854-b315f90d7af9 admin admin] Request method failure captured: Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: Accept: application/json Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: Accept-Encoding: gzip, deflate Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: Connection: keep-alive Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: Content-Length: 0 Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: Host: 10.222.0.58 Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: Openstack-Api-Version: compute 2.90 Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: Openstack-System-Scope: None Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: User-Agent: python-novaclient Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Auth-Token: gAAAAABjBZk43Hxxk5KjD3J_aHjn7CFzZgWjIdejZ9vnjpF3yvC6Pi53w6AST6ToCXG1zshFp2FOvYgLVLo6GjYOh8nX2i-OS_IHxleec1Tcf_My0TA6rRVizAN_GNpfeWpz9A_iL24tgcvdgQDy4DthW0o28Rc3PmkapamKDJ5xTAon_gFl6ZQ Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Domain-Id: None Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Domain-Name: None Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Identity-Status: Confirmed Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Is-Admin-Project: True Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Domain-Id: default Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Domain-Name: Default Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Name: admin Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Role: admin,member,reader Aug 24 03:21:28.755438 n-d-846470-15 devstack@n-api.service[106457]: X-Roles: admin,member,reader Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79840a063f87423fa16837e963b5dd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79840a063f87423fa16837e963b5dd22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant: admin Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant-Name: admin Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-User: admin Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-User-Domain-Id: default Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-User-Domain-Name: Default Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-User-Id: ceb5c6ba777b4eba8d656fcd6b479676 Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: X-User-Name: admin Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: method: > Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: exception: Flavor 84 could not be found. Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: action_args: {'id': '84'} Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:21:28.757001 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:28.757879 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.759127 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4afab447-5ac7-4114-8854-b315f90d7af9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:21:28.760445 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-4afab447-5ac7-4114-8854-b315f90d7af9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.422663 Aug 24 03:21:28.760445 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 03:21:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:21:28.766966 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-004e2a9a-6970-444b-8219-3bc6f23af7b2 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:28.782033 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-004e2a9a-6970-444b-8219-3bc6f23af7b2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018742 Aug 24 03:21:28.782751 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 03:21:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:21:28.792536 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-f3374f30-d0e7-4709-8e60-3c642efc9677 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:28.808677 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-f3374f30-d0e7-4709-8e60-3c642efc9677 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019676 Aug 24 03:21:28.809228 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 03:21:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:21:28.820043 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-776783c4-fb2e-40d0-851d-5bca1c044369 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:28.827406 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.wsgi [None req-776783c4-fb2e-40d0-851d-5bca1c044369 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-776783c4-fb2e-40d0-851d-5bca1c044369 admin admin] Request method failure captured: Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: Accept: application/json Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: Accept-Encoding: gzip, deflate Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: Connection: keep-alive Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: Content-Length: 0 Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: Host: 10.222.0.58 Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: Openstack-Api-Version: compute 2.90 Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: Openstack-System-Scope: None Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: User-Agent: python-novaclient Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Auth-Token: gAAAAABjBZk43Hxxk5KjD3J_aHjn7CFzZgWjIdejZ9vnjpF3yvC6Pi53w6AST6ToCXG1zshFp2FOvYgLVLo6GjYOh8nX2i-OS_IHxleec1Tcf_My0TA6rRVizAN_GNpfeWpz9A_iL24tgcvdgQDy4DthW0o28Rc3PmkapamKDJ5xTAon_gFl6ZQ Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Domain-Id: None Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Domain-Name: None Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Identity-Status: Confirmed Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Is-Admin-Project: True Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Domain-Id: default Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Domain-Name: Default Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Name: admin Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Role: admin,member,reader Aug 24 03:21:28.829001 n-d-846470-15 devstack@n-api.service[106458]: X-Roles: admin,member,reader Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79840a063f87423fa16837e963b5dd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79840a063f87423fa16837e963b5dd22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant: admin Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant-Name: admin Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-User: admin Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-User-Domain-Id: default Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-User-Domain-Name: Default Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-User-Id: ceb5c6ba777b4eba8d656fcd6b479676 Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: X-User-Name: admin Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: method: > Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: exception: Flavor 84 could not be found. Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: action_args: {'id': '84'} Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:21:28.830492 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:28.831450 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:28.832962 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-776783c4-fb2e-40d0-851d-5bca1c044369 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:21:28.834311 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-776783c4-fb2e-40d0-851d-5bca1c044369 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014986 Aug 24 03:21:28.834311 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 03:21:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:21:29.825622 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-f3374f30-d0e7-4709-8e60-3c642efc9677 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:29.826646 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-f3374f30-d0e7-4709-8e60-3c642efc9677 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 24 03:21:29.827012 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:30.386337 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-b693b389-db76-4c43-947e-0e9830130629 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:30.392370 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.wsgi [None req-b693b389-db76-4c43-947e-0e9830130629 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-b693b389-db76-4c43-947e-0e9830130629 admin admin] Request method failure captured: Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: Accept: application/json Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: Accept-Encoding: gzip, deflate Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: Connection: keep-alive Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: Content-Length: 0 Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: Host: 10.222.0.58 Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: Openstack-Api-Version: compute 2.90 Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: Openstack-System-Scope: None Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: User-Agent: python-novaclient Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Auth-Token: gAAAAABjBZk50rl3uGv-owCl2hX1BFasc_lz_PW6j2ve4KnpKt6DfRCQv7t7P0xcfPwj_CmsywQKEogLF4voHDhS7cxo2AIaRKv6puvCHQnr_fxKhuKlAy3W_wrtu-rOAlDipmiyHiDJVz55tZEsTid1pEA8D9VOJl2KORqhdLvxgYWKoRuNJ9M Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Domain-Id: None Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Domain-Name: None Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Identity-Status: Confirmed Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Is-Admin-Project: True Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Domain-Id: default Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Domain-Name: Default Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Project-Name: admin Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Role: admin,member,reader Aug 24 03:21:30.393854 n-d-846470-15 devstack@n-api.service[106458]: X-Roles: admin,member,reader Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79840a063f87423fa16837e963b5dd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79840a063f87423fa16837e963b5dd22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant: admin Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-Tenant-Name: admin Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-User: admin Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-User-Domain-Id: default Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-User-Domain-Name: Default Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-User-Id: ceb5c6ba777b4eba8d656fcd6b479676 Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: X-User-Name: admin Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: method: > Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: exception: Flavor 451 could not be found. Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: action_args: {'id': '451'} Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:21:30.395496 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:30.396564 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.397905 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-b693b389-db76-4c43-947e-0e9830130629 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:21:30.399239 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-b693b389-db76-4c43-947e-0e9830130629 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.432139 Aug 24 03:21:30.399239 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 03:21:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:21:30.405093 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-166797e4-3389-48fc-8c9e-a7b1c89735d1 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:30.420770 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-166797e4-3389-48fc-8c9e-a7b1c89735d1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019256 Aug 24 03:21:30.421293 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 03:21:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:21:30.431162 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:30.446689 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019094 Aug 24 03:21:30.447272 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 24 03:21:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:21:30.457043 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-27f5ff52-a6f0-4b18-af8e-6e8dfe84454a admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:30.462891 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.wsgi [None req-27f5ff52-a6f0-4b18-af8e-6e8dfe84454a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-27f5ff52-a6f0-4b18-af8e-6e8dfe84454a admin admin] Request method failure captured: Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: Accept: application/json Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: Accept-Encoding: gzip, deflate Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: Connection: keep-alive Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: Content-Length: 0 Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: Host: 10.222.0.58 Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: Openstack-Api-Version: compute 2.90 Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: Openstack-System-Scope: None Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: User-Agent: python-novaclient Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Auth-Token: gAAAAABjBZk50rl3uGv-owCl2hX1BFasc_lz_PW6j2ve4KnpKt6DfRCQv7t7P0xcfPwj_CmsywQKEogLF4voHDhS7cxo2AIaRKv6puvCHQnr_fxKhuKlAy3W_wrtu-rOAlDipmiyHiDJVz55tZEsTid1pEA8D9VOJl2KORqhdLvxgYWKoRuNJ9M Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Domain-Id: None Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Domain-Name: None Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Identity-Status: Confirmed Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Is-Admin-Project: True Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Domain-Id: default Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Domain-Name: Default Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Project-Name: admin Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Role: admin,member,reader Aug 24 03:21:30.464406 n-d-846470-15 devstack@n-api.service[106457]: X-Roles: admin,member,reader Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79840a063f87423fa16837e963b5dd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79840a063f87423fa16837e963b5dd22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79840a063f87423fa16837e963b5dd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant: admin Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant-Id: 79840a063f87423fa16837e963b5dd22 Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-Tenant-Name: admin Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-User: admin Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-User-Domain-Id: default Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-User-Domain-Name: Default Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-User-Id: ceb5c6ba777b4eba8d656fcd6b479676 Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: X-User-Name: admin Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: method: > Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: exception: Flavor 451 could not be found. Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: action_args: {'id': '451'} Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:21:30.465979 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:30.466930 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: ERROR nova.api.openstack.wsgi Aug 24 03:21:30.468329 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-27f5ff52-a6f0-4b18-af8e-6e8dfe84454a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:21:30.469941 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-27f5ff52-a6f0-4b18-af8e-6e8dfe84454a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012371 Aug 24 03:21:30.469941 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 03:21:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:21:31.473368 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:31.474425 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Aug 24 03:21:31.474928 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:32.025438 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-ed5b4185-2883-4901-a2f6-fc1a6a551238 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:32.050681 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-ed5b4185-2883-4901-a2f6-fc1a6a551238 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.440121 Aug 24 03:21:32.051274 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 24 03:21:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:21:33.046849 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:33.048012 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Aug 24 03:21:33.048417 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:33.601253 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-d21ec197-2998-4d18-8bda-ade31f16537f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:33.621527 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-d21ec197-2998-4d18-8bda-ade31f16537f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.438056 Aug 24 03:21:33.622083 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 24 03:21:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:21:34.600544 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:34.601626 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Aug 24 03:21:34.602039 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:35.163912 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-3b5b578c-91bf-4ab4-ad84-14d2f025d5f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:35.185880 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-3b5b578c-91bf-4ab4-ad84-14d2f025d5f1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.444370 Aug 24 03:21:35.186426 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 24 03:21:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:21:36.180085 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:36.181101 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 03:21:36.181497 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:36.742457 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-10b3ad60-e1f6-4206-97d0-f26306c71713 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:36.763298 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-10b3ad60-e1f6-4206-97d0-f26306c71713 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.445436 Aug 24 03:21:36.763881 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 24 03:21:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:21:37.755757 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:37.757379 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Aug 24 03:21:37.757787 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:38.327146 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-6e35b7a4-8990-4e1b-8796-ec897f78ce79 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:38.348646 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-6e35b7a4-8990-4e1b-8796-ec897f78ce79 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.456432 Aug 24 03:21:38.349319 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Wed Aug 24 03:21:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:22:35.020107 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:35.021122 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-fee0001a-655c-4ef8-ab5a-125e9d7c36f2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 24 03:22:35.021502 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 24 03:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:22:35.033468 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:35.480148 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-0c47047c-5108-4a0d-afdb-4130353608bc admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:35.501197 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-0c47047c-5108-4a0d-afdb-4130353608bc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.472680 Aug 24 03:22:35.501746 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:22:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:22:35.523183 n-d-846470-15 devstack@n-api.service[106458]: DEBUG dbcounter [-] [106458] Writing DB stats nova_api:SELECT=14 {{(pid=106458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:35.527028 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-f0fc0dcb-79e5-44a9-89fa-9774825267e7 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:35.535335 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-f0fc0dcb-79e5-44a9-89fa-9774825267e7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013559 Aug 24 03:22:35.535982 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Wed Aug 24 03:22:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:22:35.548187 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-4fa6aad4-7a70-49c7-9c16-764f56d8af16 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:35.556801 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-4fa6aad4-7a70-49c7-9c16-764f56d8af16 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012314 Aug 24 03:22:35.557336 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Wed Aug 24 03:22:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:35.569461 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-f2dd3990-e0e6-4982-8c7f-43f5aab5dc03 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:35.577401 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-f2dd3990-e0e6-4982-8c7f-43f5aab5dc03 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011624 Aug 24 03:22:35.577929 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Wed Aug 24 03:22:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:22:35.592826 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-d12e514d-d159-4e1c-b6dc-cf2b5b985434 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:35.601503 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-d12e514d-d159-4e1c-b6dc-cf2b5b985434 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013364 Aug 24 03:22:35.602066 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Wed Aug 24 03:22:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:57.443087 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-f2dd3990-e0e6-4982-8c7f-43f5aab5dc03 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:57.444185 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-f2dd3990-e0e6-4982-8c7f-43f5aab5dc03 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 24 03:27:57.444626 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:27:57.603297 n-d-846470-15 devstack@n-api.service[106457]: DEBUG dbcounter [-] [106457] Writing DB stats nova_api:SELECT=6 {{(pid=106457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:57.769724 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-39fd40d8-634d-4e4d-aaab-b2a2372dd76a admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:57.772068 n-d-846470-15 devstack@n-api.service[106457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:27:57.772068 n-d-846470-15 devstack@n-api.service[106457]: warnings.warn(msg) Aug 24 03:27:57.773188 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-39fd40d8-634d-4e4d-aaab-b2a2372dd76a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:57.773699 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-39fd40d8-634d-4e4d-aaab-b2a2372dd76a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:57.774116 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-39fd40d8-634d-4e4d-aaab-b2a2372dd76a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:57.774814 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-39fd40d8-634d-4e4d-aaab-b2a2372dd76a admin admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:57.775257 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-39fd40d8-634d-4e4d-aaab-b2a2372dd76a admin admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:57.775657 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-39fd40d8-634d-4e4d-aaab-b2a2372dd76a admin admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:57.818503 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-39fd40d8-634d-4e4d-aaab-b2a2372dd76a admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.218298 Aug 24 03:27:57.819061 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 03:27:57 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:27:58.731094 n-d-846470-15 devstack@n-api.service[106458]: DEBUG nova.api.openstack.wsgi [None req-f2dd3990-e0e6-4982-8c7f-43f5aab5dc03 admin admin] Calling method '>' {{(pid=106458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:58.731854 n-d-846470-15 devstack@n-api.service[106458]: INFO nova.api.openstack.requestlog [None req-f2dd3990-e0e6-4982-8c7f-43f5aab5dc03 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Aug 24 03:27:58.732320 n-d-846470-15 devstack@n-api.service[106458]: [pid: 106458|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 24 03:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:27:58.977016 n-d-846470-15 devstack@n-api.service[106457]: DEBUG nova.api.openstack.wsgi [None req-5b1b2dae-e575-4fc3-89b8-dfe74aac8c89 admin admin] Calling method '>' {{(pid=106457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:58.979766 n-d-846470-15 devstack@n-api.service[106457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:27:58.979766 n-d-846470-15 devstack@n-api.service[106457]: warnings.warn(msg) Aug 24 03:27:58.980885 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-5b1b2dae-e575-4fc3-89b8-dfe74aac8c89 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:58.981871 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-5b1b2dae-e575-4fc3-89b8-dfe74aac8c89 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:58.982297 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-5b1b2dae-e575-4fc3-89b8-dfe74aac8c89 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:58.983021 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-5b1b2dae-e575-4fc3-89b8-dfe74aac8c89 admin admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:58.983456 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-5b1b2dae-e575-4fc3-89b8-dfe74aac8c89 admin admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:58.983970 n-d-846470-15 devstack@n-api.service[106457]: DEBUG oslo_concurrency.lockutils [None req-5b1b2dae-e575-4fc3-89b8-dfe74aac8c89 admin admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:59.010264 n-d-846470-15 devstack@n-api.service[106457]: INFO nova.api.openstack.requestlog [None req-5b1b2dae-e575-4fc3-89b8-dfe74aac8c89 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.090255 Aug 24 03:27:59.010829 n-d-846470-15 devstack@n-api.service[106457]: [pid: 106457|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 03:27:58 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:28:46.269720 n-d-846470-15 devstack@n-api.service[106456]: Wed Aug 24 03:28:46 2022 - graceful shutdown triggered... Aug 24 03:28:46.269835 n-d-846470-15 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 03:28:46.270855 n-d-846470-15 devstack@n-api.service[106458]: Gracefully killing worker 2 (pid: 106458)... Aug 24 03:28:46.271247 n-d-846470-15 devstack@n-api.service[106457]: Gracefully killing worker 1 (pid: 106457)... Aug 24 03:28:47.272039 n-d-846470-15 devstack@n-api.service[106456]: worker 1 buried after 1 seconds Aug 24 03:28:47.272039 n-d-846470-15 devstack@n-api.service[106456]: worker 2 buried after 1 seconds Aug 24 03:28:47.272039 n-d-846470-15 devstack@n-api.service[106456]: goodbye to uWSGI. Aug 24 03:28:47.273748 n-d-846470-15 systemd[1]: devstack@n-api.service: Succeeded. Aug 24 03:28:47.274318 n-d-846470-15 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 03:28:47.277255 n-d-846470-15 systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:28:47.293745 n-d-846470-15 devstack@n-api.service[122527]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:28:47 2022] *** Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: nodename: n-d-846470-15 Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: machine: x86_64 Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: clock source: unix Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: pcre jit disabled Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: detected number of CPU cores: 4 Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: current working directory: / Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: your processes number limit is 47680 Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: your memory page size is 4096 bytes Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: detected max file descriptor number: 2048 Aug 24 03:28:47.319310 n-d-846470-15 devstack@n-api.service[122527]: lock engine: pthread robust mutexes Aug 24 03:28:47.320419 n-d-846470-15 devstack@n-api.service[122527]: thunder lock: enabled Aug 24 03:28:47.320419 n-d-846470-15 devstack@n-api.service[122527]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:28:47.320419 n-d-846470-15 devstack@n-api.service[122527]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:28:47.362552 n-d-846470-15 devstack@n-api.service[122527]: Python main interpreter initialized at 0x55f503e0b9c0 Aug 24 03:28:47.362552 n-d-846470-15 devstack@n-api.service[122527]: python threads support enabled Aug 24 03:28:47.362552 n-d-846470-15 devstack@n-api.service[122527]: your server socket listen backlog is limited to 100 connections Aug 24 03:28:47.362552 n-d-846470-15 devstack@n-api.service[122527]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:28:47.363007 n-d-846470-15 devstack@n-api.service[122527]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:28:47.363007 n-d-846470-15 devstack@n-api.service[122527]: *** Operational MODE: preforking *** Aug 24 03:28:47.363154 n-d-846470-15 devstack@n-api.service[122527]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:28:47.363154 n-d-846470-15 devstack@n-api.service[122527]: spawned uWSGI master process (pid: 122527) Aug 24 03:28:47.363388 n-d-846470-15 systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:28:47.364108 n-d-846470-15 devstack@n-api.service[122527]: spawned uWSGI worker 1 (pid: 122535, cores: 1) Aug 24 03:28:47.371906 n-d-846470-15 devstack@n-api.service[122527]: spawned uWSGI worker 2 (pid: 122536, cores: 1) Aug 24 03:28:47.371906 n-d-846470-15 devstack@n-api.service[122527]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:28:48.026246 n-d-846470-15 devstack@n-api.service[122535]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:28:48.046755 n-d-846470-15 devstack@n-api.service[122536]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:28:49.187691 n-d-846470-15 devstack@n-api.service[122535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:28:49.187691 n-d-846470-15 devstack@n-api.service[122535]: from cryptography.utils import int_from_bytes Aug 24 03:28:49.188401 n-d-846470-15 devstack@n-api.service[122535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:28:49.188401 n-d-846470-15 devstack@n-api.service[122535]: from cryptography.utils import int_from_bytes Aug 24 03:28:49.227997 n-d-846470-15 devstack@n-api.service[122536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:28:49.227997 n-d-846470-15 devstack@n-api.service[122536]: from cryptography.utils import int_from_bytes Aug 24 03:28:49.228626 n-d-846470-15 devstack@n-api.service[122536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:28:49.228626 n-d-846470-15 devstack@n-api.service[122536]: from cryptography.utils import int_from_bytes Aug 24 03:28:51.612387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:28:51.612972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:28:51.613214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:28:51.613483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:28:51.613982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:28:51.614377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.614709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.615032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.615352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.615877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.616190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.616515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.616834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.617135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.617398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.617738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.618056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846470-15 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.618361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.618675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.618982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.619307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.619622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.620032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.620345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.620827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.622363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.622683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.623011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.623378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.623694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.623996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.624339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.624649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.624964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.625284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.625700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846470-15 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.630602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.630602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.630602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.630602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.630602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.630602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.630602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.630602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.631479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.631479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.631479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.631479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.631479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.631479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.631479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.631479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.632283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.632283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.632283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.632283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.632558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.633022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.633281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.633440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.633603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.633844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.634159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.634482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.634781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.635087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.635392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.635712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.636014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.636363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.636683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.636970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.637298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.637613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.637933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.638235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.638550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.638962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.639217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.639515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.639899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.640210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.640514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.640829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.641145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.641449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.642472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.642472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.642472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.643651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.643651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.643651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.643651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.644268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.644268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.644570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.644771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.645059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.645362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.645671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.645961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.646275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.646560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.646886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.647174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.647473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.647792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.647964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:28:51.648463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.648621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:28:51.648776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.648951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:28:51.649095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.649095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.649370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:28:51.649523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.649673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:28:51.649826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.649976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.650128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.650281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.650424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.650587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.650740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.650894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.651044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.651044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.651336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.651515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.651709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.651870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.652028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.652177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.652330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.652480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.652640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.652782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.652937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.653683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.653840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.653991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.654142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846470-15 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.654296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.654453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.654596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.654807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.654957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.655126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.655301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.655476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.655620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.655814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.655983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.656541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.656723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.656900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.657053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.657053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.657340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.657550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.658804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.658965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.659117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.659270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.659270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.659270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.659773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.659927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.660080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.660222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.660373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.660566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.660566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.660867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.660867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.661144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.661285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.661451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.661600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.661747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.661887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.662035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.662232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846470-15 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.662378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.662531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.662680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.662832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.662987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.663173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.663326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.663326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.663604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.663771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.664007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.664152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.664301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.664442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.664636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.664790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.664985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.665139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.665890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.666047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.666217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.666847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.667247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.667403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.667573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.667781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.667980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.668397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.668556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.668713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.668978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.669135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.669286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.669428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.669581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.669733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.669876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.670029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.670171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.670313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.670464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.670616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.670767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.670911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.671059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.671207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.671356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.671511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.671653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.671838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.671992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.671992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.672273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.672422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.672574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.672722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.672874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.673016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.673167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.673408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.673659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.673886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.674083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.674244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.674396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.674660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.674822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.675021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.675177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.675339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.675490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.675646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.675875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.676025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.676188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.676340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.676506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.677167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.677328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.677479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.677629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.677782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.677925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.677925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.678222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.678222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.678805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.678992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.679241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.679388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.679544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.679696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.679868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.680266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.680418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.680551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.680663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.680759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.680862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.680954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.681040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.681132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.681227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.681324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.681418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.681511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.681596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.681686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.681772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.681861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.681976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.682070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.682155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.682245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.682330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.682429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.682526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.682619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.682704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.682787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.682877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.682978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.682978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.683141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.683235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.683333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.683424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.683518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.683611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.683720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.683820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.683920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.683920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.684098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.684191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.684286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.684286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.684446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.684530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.684623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.684719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.684804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.684887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.684983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.685127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.685223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.685321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.685413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.685499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.685584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.685675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.685768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.685861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.685953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.686046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.686138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.686222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.686313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.686414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.686500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.686592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.686688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.686796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.687175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.687268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.687361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.687456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.687550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.687634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.687772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.687860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.687952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.688123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.688211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.688295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.688385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.688665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.688820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.689045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.689298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.689525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.690001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.690100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.690201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.690294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.690390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.690482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.690575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.690668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.690762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.690848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.690942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.691028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.691111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.691111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.691275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.691361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.691453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.691538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.691621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.691721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.691826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.691913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.692004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.692088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.692172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.692269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.692362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.692456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.692548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.692641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.692736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:28:51.692875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.692976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.693183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.693312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.693498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.693661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.693809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.693979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.694116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.694318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.694419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.694657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.694749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.694978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.695078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.695295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.695389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.695615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.695782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.695944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.696044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.696255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.696354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.696568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.696666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.696883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.696997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.697302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.697408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.697510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.697603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.697832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.697931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.698103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.698211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.698407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.698514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.698713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.698853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.699017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.699123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.699323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.699424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.699636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.699787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.699967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.700074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.700281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.700382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.700586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.700677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.700904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.701006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.701212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.701304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.701525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.701616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.701823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.701923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.702132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.702235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.702456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.702548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.702784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.702878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.703089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.703192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.703437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.703594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.703801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.703918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.704102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.704417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.705278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.705436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.705577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.705761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.705938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.706081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.706265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.706418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.706583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.706745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.706898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.707066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.707212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.707383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.707572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.707726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.708047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.708182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.708368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.708507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.708821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.708954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.709133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.709230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.709444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.709573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.709754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.709842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.710058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.710164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.710366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.710891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.711045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.711153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.711357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.711463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.711715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.711821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.712015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.712096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.712319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.712400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.712625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.712708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.712933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.713241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.713371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.713550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.713699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.713875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.714074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.714188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.714383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.714485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.714691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.714790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.715037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.715136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.715370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.715486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.715657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.715781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.716005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.716103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.716311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.716420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.716625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.716735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.716936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.717037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.717245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.717399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.717555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.717655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.717871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.717976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.718200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.718389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.718499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.718666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.718820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.718985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.719161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.719294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.719495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.719595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.719826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.719930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.720152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.720356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.720548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.720756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.721183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.721302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.721403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.721498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.721582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.721666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.721756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.721925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.722046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.722248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.722344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.722630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.722838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.722942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.723172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.723274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.723489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.723586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.723828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.723944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.724139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.724252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.724453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.724557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.724760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.724866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.725064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.725159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.725369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.725473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.725677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.725801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.726005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.726103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.726305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.726405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.726606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.726698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.726914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.727015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.727222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.727331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.727523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.727622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.727869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.727986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.728231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.728622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.728720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.728806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.728894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.728990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.729147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.729248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.729450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.729549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.729764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.729874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.730064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.730166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.730376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.730472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.730679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.730787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.731000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.731137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.731306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.731399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.731611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.731816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.731938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.732053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.732242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.732345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.732579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.732683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.732881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.732982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.733218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.733316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.733542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.733633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.733853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.733944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.734171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.734271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.734471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.734584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.734784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.734886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.735080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.735170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.735381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.735482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.735707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.735873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.736055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.736168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.736378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.736711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.736828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.736975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.737076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.737289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.737397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.737602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.737710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.737907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.738005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.738270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.738384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.738532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.738638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.738881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.738993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.739133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.739239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.739447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.739547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.739806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.739908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.740141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.740245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.740413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.740514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.740730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.740865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.741040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.741173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.741400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.741502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.741703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.741806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.741994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.742096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.742281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.742380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.742559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.742663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.742844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.742942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.743118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.743208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.743412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.743518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.743747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.743855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.744035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.744134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.744346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.744450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.744655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.744757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.744958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.745062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.745261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.745357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.745568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.745691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.745866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.745967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.746156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.746305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.746457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.746611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.746756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.746915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.747070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.747223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.747380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.747537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.747723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.747955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.748112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.748258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.748492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.748654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.748801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.748957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.749107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.749252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.749398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.749565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.749712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.749867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.750013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.750166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.750349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.750507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.750668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.750831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.751053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.751206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.751359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.751830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.752013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.752180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.752335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.752489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.752688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.752841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.753003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.753160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.753306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.753458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.753604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.753758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.753917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.754076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.754233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.754379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.754523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.754677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.754824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.754976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.755137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.755284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.755428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.755651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.755842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.755842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.756142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.756290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.756436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.756596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.756751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.756898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.757055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.757210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.757356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.757513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.757660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.757812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.757969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.758123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.758277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.758431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.758666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.758820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.758986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.759134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.759287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.759441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.759587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.759801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.759937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.760931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.761053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.761207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.761317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.761515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.761620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.761823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.761926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.762120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.762217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.762445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.762585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.762788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.762933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.763083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.763223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.763373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.763521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.763658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.763901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.764004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.764219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.764311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.764527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.764630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.764828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.764928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.765260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.765359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.765572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.765702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.765879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.766017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.766180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.766323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.766487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.766672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.766778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.767026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.767161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.767423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.767790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.767928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.768281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.768376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.768594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.768811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.768902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.769036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.769198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.769377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.769500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.769695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.769795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.770016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.770108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.770329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.770420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.770687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.770815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.770989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.771094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.771289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.771400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.771606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.771725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.771955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.772066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.772275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.772387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.772657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.772773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.772968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.773071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.773277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.773386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.773586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.773702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.773914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.774018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.774234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.774341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.774544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.774663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.774850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.774953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.775190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.775300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.775494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.775617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.775825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.775968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.776111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.776250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.776435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.776589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.776757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.776905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.777068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.777217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.777366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.777503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.777668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.777773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.777985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.778140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.778299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.778491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.778629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.778795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.778939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.779028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.779310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.779406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.779631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.779821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.779982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.780088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.780298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.780399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.780617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.780711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.780922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.781034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.781222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.781325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.781529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.781622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.781831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.781935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.782135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.782238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.782456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.782552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.782824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.783153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.783330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.783545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.783812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.783983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.784162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.784577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.784678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.784898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.785000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.785242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.785395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.785520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.785615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.785831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.785924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.786143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.786254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.786445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.786546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.786768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.786861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.787073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.787176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.787379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.787478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.787706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.787851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.788014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.788117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.788316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.788411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.788618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.788719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.788963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.789079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.789263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.789356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.789580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.789682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.789907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.790009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.790233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.790348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.790539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.790632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.790873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.790970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.791197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.791295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.791515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.791631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.791852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.791948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.792254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.792363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.792473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.792586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.792773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.792889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.793080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.793200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.793378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.793488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.793678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.793780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.793977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.794094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.794279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.794362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.794579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.794680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.794877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.794985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.795176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.795287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.795498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.795609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.795824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.795931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.796142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.796247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.796448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.796542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.796749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.796857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.797047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.797149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.797345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.797446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.797686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.797887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.797993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.798088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.798277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.798406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.798800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.799199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.799308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.799522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.799616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.799879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.799989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.800196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.800298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.800508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.800601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.800821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.800922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.801130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.801224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.801443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.801560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.801751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.801856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.802058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.802193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.802397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.802514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.802679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.802815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.803126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.803260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.803440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.803552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.803778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.803894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.804096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.804190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.804412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.804505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.804717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.804817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.805057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.805159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.805366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.805487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.805675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.805775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.805983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.806075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.806295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.806476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.806611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.806703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.806925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.807024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.807244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.807343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.807577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.807688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.807926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.808018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.808233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.808325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.808543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.808640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.808852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.808942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.809188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.809293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.809505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.809598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.809808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.809910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.810121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.810219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.810437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.810585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.810745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.810897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.811109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.811222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.811360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.811523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.811688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.811871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.812000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.812198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.812298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.812507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.812618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.812822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.812921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.813132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.813234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.813459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.813568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.813783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.813883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.814176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.814744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.814846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.815073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.815172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.815384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.815475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.815737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.815932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.816067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.816248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.816386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.816581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.816714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.816908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.817132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.817231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.817460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.817561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.817797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.817997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.818174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.818348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.818503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.818598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.818728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.818839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.819031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.819133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.819370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.819477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.819630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.819766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.819962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.820055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.820268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.820371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.820568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.820663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.820899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.821110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.821213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.821290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.821493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.821789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.821912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.822094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.822190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.822418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.822521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.822754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.822862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.823051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.823153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.823367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.823540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.823717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.823880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.824031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.824188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.824344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.824446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.824576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.824677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.824887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.824988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.825195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.825296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.825497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.825591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.825799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.825898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.826107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.826200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.826413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.826506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.826718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.826890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.827054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.827204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.827352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.827498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.827648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.827781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.827941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.828037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.828244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.828340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.828548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.828656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.828857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.828961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.829159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.829276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.829481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.829617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.830025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.830332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.830425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.830642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.830735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.830943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.831046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.831249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.831387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.831550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.831658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.831886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.831980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.832193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.832299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.832499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.832602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.832883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.833058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.833204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.833346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.833484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.833638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.833778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.833913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.860640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.860992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.860992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.861960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.862049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.862151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.862151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.862372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.862372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.862658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.862788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.862916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.863040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.863172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.863294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.863409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.863619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.863771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.864065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.864298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.864540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.864961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.865195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.865392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.865553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.865710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.865859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.865994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.866121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.866256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.866256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.866517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.866635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.866806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.866958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.867843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.869229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.869229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.869229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.869229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.869229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.869229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.869229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.870447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.870600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.870600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.870995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.871355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.871611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.871786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.871981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.872138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.872308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.872459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.872583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.872705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.872835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.872953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.873068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.873194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.873314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.873442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.873442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.873785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.873896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.873972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.874948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.875948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.876988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.877987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.878934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.879860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.880980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.881985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.882821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.883312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.883408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.883575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.883692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.883807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.883981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.884975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.885919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.886013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.886104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.887777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.887892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.887974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.888948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:28:51.889760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.889760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.890193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.890582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.890921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.891250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.891590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.891942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.892818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.893042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.893372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.893946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.894290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.894614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.894957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.895294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.895604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.896553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.896869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.897203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.897517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.897830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.898140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.898453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.898764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.899079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.899387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.899716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.900028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.900338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.900653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.900966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.901330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.901569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.901885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.902383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.902539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.902950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.903177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.903499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.903839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.904149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.904458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.904764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.905088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.905420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.905726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.906031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.906472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.906782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.907099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.907417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.907765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.908615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.908948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.909262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.909657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.909969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.910296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.910638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.910968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.911295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.911608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.912027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.912535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.912658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.912961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.913287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.913652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.913870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.914150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.914483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.914784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.915082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.915363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.915688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.915984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.916283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.916569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.916867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.919593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.919944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.922521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.924037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.924526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.924860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.925197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.925529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.925888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.926245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.926601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.926940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.927247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.927578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.927920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.928253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.928586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.928900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.929224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.929565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.929877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.930194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.930513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.930810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.931125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.931441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.931790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.932124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.932434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.932768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.933086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.933407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.933728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.934048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.934378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.934766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.935006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.935315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.935628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.935960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.936279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.936586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.936897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.937213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.937529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.937854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.938183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.938487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.938809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.939204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.939557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.939891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.940235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.940563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.940880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.941190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.941496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:28:51.941744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:28:51.949864 n-d-846470-15 devstack@n-api.service[122535]: INFO dbcounter [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Registered counter for database nova_api Aug 24 03:28:51.971403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_db.sqlalchemy.engines [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:28:51.978584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writer thread running {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:28:52.003852 n-d-846470-15 devstack@n-api.service[122536]: INFO dbcounter [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Registered counter for database nova_api Aug 24 03:28:52.024559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_db.sqlalchemy.engines [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:28:52.031867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writer thread running {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:28:52.035518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.context [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) {{(pid=122535) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:28:52.039634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:52.040165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:52.041761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:52.042497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:52.042943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:52.044991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:52.047026 n-d-846470-15 devstack@n-api.service[122535]: INFO dbcounter [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Registered counter for database nova_cell0 Aug 24 03:28:52.051185 n-d-846470-15 devstack@n-api.service[122535]: INFO dbcounter [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Registered counter for database nova_cell1 Aug 24 03:28:52.059432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_db.sqlalchemy.engines [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:28:52.060201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_db.sqlalchemy.engines [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:28:52.066923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writer thread running {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:28:52.088734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.context [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) {{(pid=122536) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:28:52.092749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:52.093217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:52.094806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:52.095701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:52.096177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:52.098169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:52.100211 n-d-846470-15 devstack@n-api.service[122536]: INFO dbcounter [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Registered counter for database nova_cell0 Aug 24 03:28:52.104233 n-d-846470-15 devstack@n-api.service[122536]: INFO dbcounter [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Registered counter for database nova_cell1 Aug 24 03:28:52.112111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_db.sqlalchemy.engines [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:28:52.114608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_db.sqlalchemy.engines [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:28:52.121618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writer thread running {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:28:52.122908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writer thread running {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:28:52.206699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writer thread running {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:28:52.216624 n-d-846470-15 devstack@n-api.service[122535]: INFO dbcounter [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Registered counter for database nova_cell0 Aug 24 03:28:52.223750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_db.sqlalchemy.engines [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:28:52.229720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writer thread running {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:28:52.276940 n-d-846470-15 devstack@n-api.service[122536]: INFO dbcounter [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Registered counter for database nova_cell0 Aug 24 03:28:52.286576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_db.sqlalchemy.engines [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:28:52.292544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writer thread running {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:28:52.552775 n-d-846470-15 devstack@n-api.service[122535]: WARNING keystonemiddleware.auth_token [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:28:52.560251 n-d-846470-15 devstack@n-api.service[122535]: WARNING keystonemiddleware.auth_token [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:28:52.613932 n-d-846470-15 devstack@n-api.service[122536]: WARNING keystonemiddleware.auth_token [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:28:52.621505 n-d-846470-15 devstack@n-api.service[122536]: WARNING keystonemiddleware.auth_token [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:28:52.909517 n-d-846470-15 devstack@n-api.service[122535]: WARNING keystonemiddleware.auth_token [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:28:52.915774 n-d-846470-15 devstack@n-api.service[122535]: WARNING keystonemiddleware.auth_token [None req-bee1114c-4410-4969-9167-1a148b46c116 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:28:52.921073 n-d-846470-15 devstack@n-api.service[122535]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f503e0b9c0 pid: 122535 (default app) Aug 24 03:28:52.969843 n-d-846470-15 devstack@n-api.service[122536]: WARNING keystonemiddleware.auth_token [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:28:52.976044 n-d-846470-15 devstack@n-api.service[122536]: WARNING keystonemiddleware.auth_token [None req-5b977299-828e-4a79-9688-1121f5b3f90d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:28:52.981294 n-d-846470-15 devstack@n-api.service[122536]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f503e0b9c0 pid: 122536 (default app) Aug 24 03:29:32.062958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:32.064673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:32.065950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:32.067151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:33.731572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '.version_select at 0x7f1031b7c5e0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:33.731572 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:33.731572 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:33.737422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) {{(pid=122535) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 24 03:29:33.738153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:33.738608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:33.739025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:33.765612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:33.766096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:33.766521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:33.779767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:33.780152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:33.780579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:33.787122 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69260b2b-e20d-4c0a-825e-4548b6745608 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.734590 Aug 24 03:29:33.787715 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1/1] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 24 03:29:32 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:33.809184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:33.816465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:33.817408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:33.818145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:34.036736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be9a6928-7d91-49e4-9925-3ffdb5fa8d98 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1878148609", "name": "tempest-test_aggregate-2005811153"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:34.071527 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:34.071527 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:34.072681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-be9a6928-7d91-49e4-9925-3ffdb5fa8d98 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid a9dd2958-1df7-4841-b974-bc4ede2e3399 for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:29:34.159016 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be9a6928-7d91-49e4-9925-3ffdb5fa8d98 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.355756 Aug 24 03:29:34.160218 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1/2] 10.222.0.58 () {60 vars in 1165 bytes} [Wed Aug 24 03:29:33 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:34.171539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5ea3290-f55e-4877-8643-a9305a35466f tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:34.172321 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:34.172321 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:34.187368 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5ea3290-f55e-4877-8643-a9305a35466f tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.020193 Aug 24 03:29:34.187969 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:29:34 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:29:34.199927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc47c86f-eabd-41f2-a19a-64f7d61ba341 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:34.203712 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:34.203712 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:34.224207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc47c86f-eabd-41f2-a19a-64f7d61ba341 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:34.224978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc47c86f-eabd-41f2-a19a-64f7d61ba341 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:34.225562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc47c86f-eabd-41f2-a19a-64f7d61ba341 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:34.454314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a316e17f-4747-4f52-9324-d330783acf91 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1028407883", "ram": 512, "vcpus": 1, "disk": 10, "id": 214037806, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:34.483275 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:34.483275 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:34.517552 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a316e17f-4747-4f52-9324-d330783acf91 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.650414 Aug 24 03:29:34.518530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2/4] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:33 2022] POST /compute/v2.1/flavors => generated 413 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:29:34.533049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e9781faa-1d40-4d58-864e-cb3b4aee6628 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:34.536578 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:34.536578 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:34.591500 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e9781faa-1d40-4d58-864e-cb3b4aee6628 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/214037806/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062616 Aug 24 03:29:34.598189 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3/5] 10.222.0.58 () {60 vars in 1221 bytes} [Wed Aug 24 03:29:34 2022] POST /compute/v2.1/flavors/214037806/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:35.006917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5aaa59b1-db6a-41d9-9df6-c6c9bb479d92 tempest-FlavorsExtraSpecsTestJSON-342686300 tempest-FlavorsExtraSpecsTestJSON-342686300-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:35.028876 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5aaa59b1-db6a-41d9-9df6-c6c9bb479d92 tempest-FlavorsExtraSpecsTestJSON-342686300 tempest-FlavorsExtraSpecsTestJSON-342686300-project] 10.222.0.58 "GET /compute/v2.1/flavors/214037806/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.429342 Aug 24 03:29:35.030037 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 4/6] 10.222.0.58 () {58 vars in 1200 bytes} [Wed Aug 24 03:29:34 2022] GET /compute/v2.1/flavors/214037806/os-extra_specs => generated 66 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:35.041155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-40083ac1-de28-4410-b944-1b05ef773739 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:35.070501 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-40083ac1-de28-4410-b944-1b05ef773739 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/214037806/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033020 Aug 24 03:29:35.071343 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 5/7] 10.222.0.58 () {60 vars in 1221 bytes} [Wed Aug 24 03:29:35 2022] POST /compute/v2.1/flavors/214037806/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:35.082381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8714c3b-1bcf-4acb-b938-44c24b8cbd9c tempest-FlavorsExtraSpecsTestJSON-342686300 tempest-FlavorsExtraSpecsTestJSON-342686300-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:35.093180 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8714c3b-1bcf-4acb-b938-44c24b8cbd9c tempest-FlavorsExtraSpecsTestJSON-342686300 tempest-FlavorsExtraSpecsTestJSON-342686300-project] 10.222.0.58 "GET /compute/v2.1/flavors/214037806/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015847 Aug 24 03:29:35.093756 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 6/8] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:29:35 2022] GET /compute/v2.1/flavors/214037806/os-extra_specs/hw:numa_nodes => generated 22 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:29:35.105180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c484ce32-d909-421e-b483-4defd31e548d tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:35.143171 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c484ce32-d909-421e-b483-4defd31e548d tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/214037806/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042563 Aug 24 03:29:35.144025 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 7/9] 10.222.0.58 () {60 vars in 1221 bytes} [Wed Aug 24 03:29:35 2022] POST /compute/v2.1/flavors/214037806/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:35.468862 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc47c86f-eabd-41f2-a19a-64f7d61ba341 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 316 microversion: 2.1 time: 1.272745 Aug 24 03:29:35.470490 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3/10] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:29:34 2022] POST /compute/v2.1/os-aggregates/1/action => generated 316 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:35.476523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab133eed-2763-43dc-bc76-f51026d4e40c tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:35.498729 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab133eed-2763-43dc-bc76-f51026d4e40c tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/214037806/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026501 Aug 24 03:29:35.499302 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4/11] 10.222.0.58 () {58 vars in 1200 bytes} [Wed Aug 24 03:29:35 2022] GET /compute/v2.1/flavors/214037806/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:35.644594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Calling method '.version_select at 0x7f1031965dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:35.648238 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:35.648238 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:35.649352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.649827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.650412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.667319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.667849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.668282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.705663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.706144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.706583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.717384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.717869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.718298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.730655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.731137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.731627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.738275 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a441bd7-592c-4fd0-8736-d691c8a38aa5 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1575 microversion: 2.53 time: 0.589317 Aug 24 03:29:35.739175 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 8/12] 10.222.0.58 () {60 vars in 1243 bytes} [Wed Aug 24 03:29:35 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1575 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:35.855241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c2938a0-7a95-451b-99b5-5186e3f9734c tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:35.858208 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:35.858208 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:35.859336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c2938a0-7a95-451b-99b5-5186e3f9734c tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.859839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c2938a0-7a95-451b-99b5-5186e3f9734c tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.860263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c2938a0-7a95-451b-99b5-5186e3f9734c tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.861022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c2938a0-7a95-451b-99b5-5186e3f9734c tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.861555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c2938a0-7a95-451b-99b5-5186e3f9734c tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.862240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c2938a0-7a95-451b-99b5-5186e3f9734c tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.895770 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c2938a0-7a95-451b-99b5-5186e3f9734c tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 404 microversion: 2.1 time: 0.395163 Aug 24 03:29:35.896370 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 5/13] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 03:29:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:35.917389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Calling method '.version_select at 0x7f103192fa60>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:35.919791 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:35.919791 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:35.921238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.921726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.922153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.937219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.937710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.938187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.949335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:35.949921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:35.950233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:35.956776 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a221c12f-2ba8-48ab-9d3d-b05f9816ed46 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.216388 Aug 24 03:29:35.957359 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 9/14] 10.222.0.58 () {60 vars in 1208 bytes} [Wed Aug 24 03:29:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:36.030027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53a2a7bd-c6ee-4930-b248-2da8e4336856 tempest-AZAdminNegativeTestJSON-2089114371 tempest-AZAdminNegativeTestJSON-2089114371-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.031227 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.031227 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:36.032291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-53a2a7bd-c6ee-4930-b248-2da8e4336856 tempest-AZAdminNegativeTestJSON-2089114371 tempest-AZAdminNegativeTestJSON-2089114371-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '54645ed8a087457584ef95ebe611a8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fab3bdd1644fd7a96b34d8de8c4fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53a2a7bd-c6ee-4930-b248-2da8e4336856 tempest-AZAdminNegativeTestJSON-2089114371 tempest-AZAdminNegativeTestJSON-2089114371-project] Request method failure captured: Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZscKsyrxZrBgH5WlL3gtcGU6iu_4A3HiM1lGpIwcmxL90mo-7bFYq3niagJSbThiE_nYbtMXfpjntSUThYWAxSHb5mxvApxA4zh5Ll3C3gh-oODTywY-P_3tSMSH6WuWWDHuhiixf2fKihAhD3gdAVfJXiLwFGgCqzfbJMf4tkaezQ Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c2fab3bdd1644fd7a96b34d8de8c4fe8 Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2089114371 Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:29:36.035415 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c2fab3bdd1644fd7a96b34d8de8c4fe8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c2fab3bdd1644fd7a96b34d8de8c4fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c2fab3bdd1644fd7a96b34d8de8c4fe8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c2fab3bdd1644fd7a96b34d8de8c4fe8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AZAdminNegativeTestJSON-2089114371 Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c2fab3bdd1644fd7a96b34d8de8c4fe8 Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2089114371 Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AZAdminNegativeTestJSON-2089114371-project Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 54645ed8a087457584ef95ebe611a8b3 Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AZAdminNegativeTestJSON-2089114371-project Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 03:29:36.036620 n-d-846470-15 devstack@n-api.service[122536]: action_args: {} Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:29:36.037307 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:36.038279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53a2a7bd-c6ee-4930-b248-2da8e4336856 tempest-AZAdminNegativeTestJSON-2089114371 tempest-AZAdminNegativeTestJSON-2089114371-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:36.040883 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53a2a7bd-c6ee-4930-b248-2da8e4336856 tempest-AZAdminNegativeTestJSON-2089114371 tempest-AZAdminNegativeTestJSON-2089114371-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.139537 Aug 24 03:29:36.040883 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 6/15] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 24 03:29:35 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 140 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:36.042489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-140aaa6d-27f0-4161-87ca-9eb65b26fa92 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:36.045262 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.045262 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:36.101528 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-140aaa6d-27f0-4161-87ca-9eb65b26fa92 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/214037806/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.063020 Aug 24 03:29:36.102008 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 7/16] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:29:36 2022] PUT /compute/v2.1/flavors/214037806/os-extra_specs/hw:numa_nodes => generated 22 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:36.178406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d30e688-8c72-48e7-9b61-cd2e0a909123 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Calling method '.version_select at 0x7f103192f670>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.181650 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.181650 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:36.182752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d30e688-8c72-48e7-9b61-cd2e0a909123 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.183330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d30e688-8c72-48e7-9b61-cd2e0a909123 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.183789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d30e688-8c72-48e7-9b61-cd2e0a909123 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.184540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d30e688-8c72-48e7-9b61-cd2e0a909123 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.185070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d30e688-8c72-48e7-9b61-cd2e0a909123 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.185469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d30e688-8c72-48e7-9b61-cd2e0a909123 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.230721 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d30e688-8c72-48e7-9b61-cd2e0a909123 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.272184 Aug 24 03:29:36.231723 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 10/17] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 24 03:29:35 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:36.236663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Calling method '.version_select at 0x7f10318c3160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.240881 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.240881 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:36.242196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.242751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.243248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.257643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.258350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.258929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.273366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.274013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.274548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.285632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.286195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.286692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.291546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-886545808", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "availability_zone": "tempest-test_az-1878148609"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:36.299615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.300340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.300844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.312665 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3eecc184-bee8-4922-870f-9201979fe1b2 tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 267 microversion: 2.53 time: 0.079707 Aug 24 03:29:36.313322 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 11/18] 10.222.0.58 () {60 vars in 1222 bytes} [Wed Aug 24 03:29:36 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:36.317945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b38e5a79-bec2-49a7-ab6d-ca93a2bd0baf tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.326842 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b38e5a79-bec2-49a7-ab6d-ca93a2bd0baf tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/214037806/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012366 Aug 24 03:29:36.327557 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 12/19] 10.222.0.58 () {58 vars in 1200 bytes} [Wed Aug 24 03:29:36 2022] GET /compute/v2.1/flavors/214037806/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:36.333073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.333724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.334242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.335209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.336140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.336540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.342052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e3b456f7-cd97-46ce-997b-c9ed26ea0011 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Calling method '.version_select at 0x7f10318e15e0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.345299 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.345299 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:36.350435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3b456f7-cd97-46ce-997b-c9ed26ea0011 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.350435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3b456f7-cd97-46ce-997b-c9ed26ea0011 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.350435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3b456f7-cd97-46ce-997b-c9ed26ea0011 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.350435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3b456f7-cd97-46ce-997b-c9ed26ea0011 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.350750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3b456f7-cd97-46ce-997b-c9ed26ea0011 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.350750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3b456f7-cd97-46ce-997b-c9ed26ea0011 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.378335 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e3b456f7-cd97-46ce-997b-c9ed26ea0011 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.042628 Aug 24 03:29:36.384794 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 13/20] 10.222.0.58 () {58 vars in 1139 bytes} [Wed Aug 24 03:29:36 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:36.389538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b13efa1d-6630-41af-96fd-504c94099a3b tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Calling method '.version_select at 0x7f10318ced30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.393028 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.393028 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:36.394225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b13efa1d-6630-41af-96fd-504c94099a3b tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.394700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b13efa1d-6630-41af-96fd-504c94099a3b tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.395132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b13efa1d-6630-41af-96fd-504c94099a3b tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.413544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b13efa1d-6630-41af-96fd-504c94099a3b tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.414027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b13efa1d-6630-41af-96fd-504c94099a3b tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.414464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b13efa1d-6630-41af-96fd-504c94099a3b tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.421759 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b13efa1d-6630-41af-96fd-504c94099a3b tempest-HypervisorAdminV253TestBase-447066627 tempest-HypervisorAdminV253TestBase-447066627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/e98da945-9dd1-400c-a290-682fffadaffa" status: 200 len: 793 microversion: 2.53 time: 0.035831 Aug 24 03:29:36.422877 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 14/21] 10.222.0.58 () {60 vars in 1298 bytes} [Wed Aug 24 03:29:36 2022] GET /compute/v2.1/os-hypervisors/e98da945-9dd1-400c-a290-682fffadaffa => generated 793 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:36.428353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b2d1c161-58c3-44da-a7a0-23dd47f8b699 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.429341 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.429341 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:36.462066 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b2d1c161-58c3-44da-a7a0-23dd47f8b699 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/214037806/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.037838 Aug 24 03:29:36.462654 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 15/22] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:29:36 2022] DELETE /compute/v2.1/flavors/214037806/os-extra_specs/hw:numa_nodes => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:29:36.470276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f099155-edd4-401e-b80e-d40593976935 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Calling method '.version_select at 0x7f10318ce700>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.473809 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.473809 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:36.475019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f099155-edd4-401e-b80e-d40593976935 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.475431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f099155-edd4-401e-b80e-d40593976935 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.476283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f099155-edd4-401e-b80e-d40593976935 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.476815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f099155-edd4-401e-b80e-d40593976935 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:36.477284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f099155-edd4-401e-b80e-d40593976935 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:36.477690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f099155-edd4-401e-b80e-d40593976935 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:36.503226 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f099155-edd4-401e-b80e-d40593976935 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.035739 Aug 24 03:29:36.503866 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 16/23] 10.222.0.58 () {58 vars in 1145 bytes} [Wed Aug 24 03:29:36 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:36.512714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-abdf2327-cf9b-4a71-9d30-29d731a410a9 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.513680 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.513680 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:36.536822 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-abdf2327-cf9b-4a71-9d30-29d731a410a9 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/214037806/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.031862 Aug 24 03:29:36.537443 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 17/24] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:29:36 2022] DELETE /compute/v2.1/flavors/214037806/os-extra_specs/hw:cpu_policy => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:29:36.545504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e581b2ce-9b84-4ddc-b836-46db835e21a1 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.550965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:DELETE=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:36.554701 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e581b2ce-9b84-4ddc-b836-46db835e21a1 tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/214037806/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012862 Aug 24 03:29:36.555270 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 18/25] 10.222.0.58 () {58 vars in 1200 bytes} [Wed Aug 24 03:29:36 2022] GET /compute/v2.1/flavors/214037806/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:36.566837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a8b55c97-58ae-47af-bdf4-2bfbdd87e8cc tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.567616 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:36.567616 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:36.600038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a8b55c97-58ae-47af-bdf4-2bfbdd87e8cc tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/214037806" status: 202 len: 0 microversion: 2.1 time: 0.037758 Aug 24 03:29:36.601108 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 19/26] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:29:36 2022] DELETE /compute/v2.1/flavors/214037806 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:29:36.613048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bd54f5e3-9244-422c-96bc-51f599aa552b tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:36.647245 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bd54f5e3-9244-422c-96bc-51f599aa552b tempest-FlavorsExtraSpecsTestJSON-78300183 tempest-FlavorsExtraSpecsTestJSON-78300183-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038968 Aug 24 03:29:36.648130 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 20/27] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:37.123860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:29:37.421474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:29:37.421896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:29:37.422693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:29:37.423113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:29:37.423536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:29:37.443044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:37.443714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:37.444273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:37.445010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:37.445459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:37.446484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:37.492183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Getting quotas for project 1fed55c92e354e3a8b30a9de0e2cf2ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:29:37.500951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Getting quotas for user 7724a8e7ed7645009a19dea05fa5f82f and project 1fed55c92e354e3a8b30a9de0e2cf2ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:29:37.516899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:29:37.521666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:29:37.647964 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd5ac7a3-9ca9-46ff-91bb-380c3c2c3c1d tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544480 Aug 24 03:29:37.648618 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 8/28] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:29:37.662253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41eeaed2-3711-4fd4-a2ad-a7561c2b5295 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:37.663856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41eeaed2-3711-4fd4-a2ad-a7561c2b5295 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:38.526663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41eeaed2-3711-4fd4-a2ad-a7561c2b5295 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:38.546518 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41eeaed2-3711-4fd4-a2ad-a7561c2b5295 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1242 microversion: 2.1 time: 0.889784 Aug 24 03:29:38.547197 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 21/29] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:37 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1242 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:39.434837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7bfcf38-0af8-41ed-b12a-2c953b86d1a6 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1413762135", "id": 331461414, "os-flavor-access:is_public": "False"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:39.439081 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:39.439081 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:39.467242 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7bfcf38-0af8-41ed-b12a-2c953b86d1a6 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.388997 Aug 24 03:29:39.477040 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 9/30] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:39 2022] POST /compute/v2.1/flavors => generated 436 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:39.482237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2976c6d8-fd4d-4cea-94a9-f77f81d209ef tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:39.484793 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:39.484793 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:39.572105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:39.572888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:39.587431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:39.587946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:39.588376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:39.589076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:39.589526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:39.589943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:39.772953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:39.788445 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5ac2d3e-8a8c-4f6f-9679-4c17e620b5a8 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1290 microversion: 2.1 time: 0.220757 Aug 24 03:29:39.793608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 10/31] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:39 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1290 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:39.947905 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2976c6d8-fd4d-4cea-94a9-f77f81d209ef tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/331461414/action" status: 200 len: 96 microversion: 2.1 time: 0.469530 Aug 24 03:29:39.965303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcee1fde-ece7-4d22-8bde-ebdf97a0d513 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:39.969915 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:39.969915 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:39.970446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 22/32] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 24 03:29:39 2022] POST /compute/v2.1/flavors/331461414/action => generated 96 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:40.476088 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-dcee1fde-ece7-4d22-8bde-ebdf97a0d513 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project e0d5d649d5914ea0b08aec3ebebab84e combination. Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcee1fde-ece7-4d22-8bde-ebdf97a0d513 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Request method failure captured: Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/flavors/331461414/action HTTP/1.1 Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 67 Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZshiZNEc1hj4l17nrdmrtOIiS1yCMp0luhXJl4UXDw74Wtuc1_Npaku0d14oUN5MvvgJFikbe1R_sFxBU1wlohLfn7Q1s465xaJJUI0OgVcDQtsDj65uB42uB4d68R9oQp82vo3HMtieyUJTOGoGG6VuMWYvurqBbWmML1rgZuNlv4 Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ddf34bc18f16491688a0d5c96d79337c Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:29:40.491476 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ddf34bc18f16491688a0d5c96d79337c Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2f8218a2c03a417582d80aaa553fc56e Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: {"addTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} Aug 24 03:29:40.492815 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: exception: Flavor access already exists for flavor 16 and project e0d5d649d5914ea0b08aec3ebebab84e combination. Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '331461414', 'body': {'addTenantAccess': {'tenant': 'e0d5d649d5914ea0b08aec3ebebab84e'}}} Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result.read() Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:29:40.493827 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-e0d5d649d5914ea0b08aec3ebebab84e' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:29:40.494858 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:29:40.495901 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:29:40.497064 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result.read() Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-e0d5d649d5914ea0b08aec3ebebab84e' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 3, 29, 40, 465079), 'updated_at': None, 'flavor_id': 16, 'project_id': 'e0d5d649d5914ea0b08aec3ebebab84e'}] Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:40.498175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project e0d5d649d5914ea0b08aec3ebebab84e combination. Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:40.499189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project e0d5d649d5914ea0b08aec3ebebab84e combination. Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:40.500430 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:40.501715 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project e0d5d649d5914ea0b08aec3ebebab84e combination. Aug 24 03:29:40.501715 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:40.503872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcee1fde-ece7-4d22-8bde-ebdf97a0d513 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project e0d5d649d5914ea0b08aec3ebebab84e combination. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:40.504902 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcee1fde-ece7-4d22-8bde-ebdf97a0d513 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/331461414/action" status: 409 len: 152 microversion: 2.1 time: 0.546651 Aug 24 03:29:40.515118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8bc1ffb-c200-4bc1-a1c2-4044279bb231 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:40.519488 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:40.519488 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:40.520001 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 11/33] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 24 03:29:39 2022] POST /compute/v2.1/flavors/331461414/action => generated 152 bytes in 562 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:29:40.810580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:40.811219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:40.822991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:40.823494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:40.823939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:40.824652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:40.825119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:40.825551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:41.048826 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8bc1ffb-c200-4bc1-a1c2-4044279bb231 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/331461414/action" status: 200 len: 21 microversion: 2.1 time: 0.537920 Aug 24 03:29:41.055435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 23/34] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 24 03:29:40 2022] POST /compute/v2.1/flavors/331461414/action => generated 21 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:41.063377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e69d1b66-0469-49ee-8d50-d0ac9f108ce9 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:41.065808 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:41.065808 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:41.093362 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e69d1b66-0469-49ee-8d50-d0ac9f108ce9 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/331461414" status: 202 len: 0 microversion: 2.1 time: 0.036565 Aug 24 03:29:41.096941 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 24/35] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:29:41 2022] DELETE /compute/v2.1/flavors/331461414 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:29:41.106236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bfdfba3d-25f1-4281-a925-39d043186ae0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:41.113496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:41.131970 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bfdfba3d-25f1-4281-a925-39d043186ae0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029840 Aug 24 03:29:41.132863 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 25/36] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:41.134119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cda030e4-f541-4ae7-b364-df6e52fa688e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1296 microversion: 2.1 time: 0.328776 Aug 24 03:29:41.134717 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 12/37] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:40 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1296 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:41.155408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eb2642f8-7086-48d3-b93d-17e145ad8957 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-827630783", "id": 1659481485, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:41.159958 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:41.159958 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:41.181757 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eb2642f8-7086-48d3-b93d-17e145ad8957 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.031663 Aug 24 03:29:41.182698 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 26/38] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:41 2022] POST /compute/v2.1/flavors => generated 437 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:41.196295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3c07f3b-63ed-4a00-a8e4-e8350313bfba tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:41.197084 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:41.197084 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:41.218822 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f3c07f3b-63ed-4a00-a8e4-e8350313bfba tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3c07f3b-63ed-4a00-a8e4-e8350313bfba tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Request method failure captured: Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/flavors/1659481485/os-flavor-access HTTP/1.1 Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZshiZNEc1hj4l17nrdmrtOIiS1yCMp0luhXJl4UXDw74Wtuc1_Npaku0d14oUN5MvvgJFikbe1R_sFxBU1wlohLfn7Q1s465xaJJUI0OgVcDQtsDj65uB42uB4d68R9oQp82vo3HMtieyUJTOGoGG6VuMWYvurqBbWmML1rgZuNlv4 Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ddf34bc18f16491688a0d5c96d79337c Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:29:41.221518 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ddf34bc18f16491688a0d5c96d79337c Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2f8218a2c03a417582d80aaa553fc56e Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: exception: Access list not available for public flavors. Aug 24 03:29:41.222827 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'flavor_id': '1659481485'} Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 24 03:29:41.223437 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:41.225022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3c07f3b-63ed-4a00-a8e4-e8350313bfba tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:41.225022 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3c07f3b-63ed-4a00-a8e4-e8350313bfba tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1659481485/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.031013 Aug 24 03:29:41.225022 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 13/39] 10.222.0.58 () {58 vars in 1209 bytes} [Wed Aug 24 03:29:41 2022] GET /compute/v2.1/flavors/1659481485/os-flavor-access => generated 91 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:29:41.231689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-577fa919-65b9-46ab-9fd6-839d512aed45 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:41.279039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-577fa919-65b9-46ab-9fd6-839d512aed45 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1659481485" status: 202 len: 0 microversion: 2.1 time: 0.050876 Aug 24 03:29:41.279977 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 27/40] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:29:41 2022] DELETE /compute/v2.1/flavors/1659481485 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:29:41.294938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c9cff310-178a-4613-95bc-a849d610c35e tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:41.343763 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c9cff310-178a-4613-95bc-a849d610c35e tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057944 Aug 24 03:29:41.344635 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 14/41] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:41.365325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93d59070-0ad0-4284-b076-7d7087349a22 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1153259146", "id": 1520630887, "os-flavor-access:is_public": "False"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:41.404491 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-93d59070-0ad0-4284-b076-7d7087349a22 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.044127 Aug 24 03:29:41.406030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 28/42] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:41 2022] POST /compute/v2.1/flavors => generated 439 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:42.065559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e367bc21-bcf0-45ad-9bda-f904d7f54e2d tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:42.069118 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:42.069118 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:42.070319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e367bc21-bcf0-45ad-9bda-f904d7f54e2d tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '7d4f9d41c7574021821f816bdc2887ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d5d649d5914ea0b08aec3ebebab84e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e367bc21-bcf0-45ad-9bda-f904d7f54e2d tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] Request method failure captured: Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/flavors/1520630887/action HTTP/1.1 Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 67 Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsgOYeq3WYb3-5JJ_HKp6EaTobhA-0ftFpKYEMojTVAD-B8WP_ZeuD-0uGuDl8gky9jGCUyXDv7XvWKR9ipzJa8iArwjLCiVi9XzoJj0PkCQMQ8HnaOWMHDDbp-BSXtIMu2UDtUDqF7-X0lAtt5ZLsEoDQ8RwAf2iPl-i_ReiUINQU Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: e0d5d649d5914ea0b08aec3ebebab84e Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1645913149 Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:29:42.074567 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0d5d649d5914ea0b08aec3ebebab84e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0d5d649d5914ea0b08aec3ebebab84e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0d5d649d5914ea0b08aec3ebebab84e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0d5d649d5914ea0b08aec3ebebab84e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1645913149 Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: e0d5d649d5914ea0b08aec3ebebab84e Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1645913149 Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsAccessNegativeTestJSON-1645913149-project Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 7d4f9d41c7574021821f816bdc2887ad Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1645913149-project Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: {"addTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} Aug 24 03:29:42.076159 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1520630887', 'body': {'addTenantAccess': {'tenant': 'e0d5d649d5914ea0b08aec3ebebab84e'}}} Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:29:42.077562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 03:29:42.078783 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:42.080988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e367bc21-bcf0-45ad-9bda-f904d7f54e2d tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:42.082007 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e367bc21-bcf0-45ad-9bda-f904d7f54e2d tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] 10.222.0.58 "POST /compute/v2.1/flavors/1520630887/action" status: 403 len: 130 microversion: 2.1 time: 0.667850 Aug 24 03:29:42.095033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1142f173-0516-43ad-b364-c5c4e4da9da8 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:42.101303 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 15/43] 10.222.0.58 () {60 vars in 1200 bytes} [Wed Aug 24 03:29:41 2022] POST /compute/v2.1/flavors/1520630887/action => generated 130 bytes in 686 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:42.135020 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1142f173-0516-43ad-b364-c5c4e4da9da8 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1520630887" status: 202 len: 0 microversion: 2.1 time: 0.044189 Aug 24 03:29:42.138732 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 29/44] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:29:42 2022] DELETE /compute/v2.1/flavors/1520630887 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:29:42.145821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7534914-6c74-4294-8ebe-9eb3fb8703e8 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:42.166778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:42.167784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:42.177121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:42.177628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:42.178071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:42.185270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:42.185270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:42.185270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:42.185634 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d7534914-6c74-4294-8ebe-9eb3fb8703e8 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044471 Aug 24 03:29:42.196398 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 16/45] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:42.209905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3092530e-07a1-4683-970f-4de06d1f363a tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1371758552", "id": 1486180613, "os-flavor-access:is_public": "False"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:42.216348 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:42.216348 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:42.253195 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3092530e-07a1-4683-970f-4de06d1f363a tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.048176 Aug 24 03:29:42.256619 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 17/46] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:42 2022] POST /compute/v2.1/flavors => generated 439 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:42.269581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-98677c7c-287c-4b7c-b473-3c7a632f069f tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:42.504194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:42.521859 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-86f51fc9-c6bd-4584-b6e4-b12cee6d800f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.364886 Aug 24 03:29:42.523110 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 30/47] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:42 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:42.850229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79c4f492-bd0a-44f9-b480-2ecf1e456263 tempest-FlavorsV255TestJSON-475309655 tempest-FlavorsV255TestJSON-475309655-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-226943535", "id": 699939741, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:42.855321 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:42.855321 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:42.876859 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-98677c7c-287c-4b7c-b473-3c7a632f069f tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1486180613/action" status: 200 len: 97 microversion: 2.1 time: 0.612360 Aug 24 03:29:42.879208 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 18/48] 10.222.0.58 () {60 vars in 1200 bytes} [Wed Aug 24 03:29:42 2022] POST /compute/v2.1/flavors/1486180613/action => generated 97 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:29:42.896127 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79c4f492-bd0a-44f9-b480-2ecf1e456263 tempest-FlavorsV255TestJSON-475309655 tempest-FlavorsV255TestJSON-475309655-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.260966 Aug 24 03:29:42.897620 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 31/49] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:29:42 2022] POST /compute/v2.1/flavors => generated 445 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:29:42.898244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae406113-6b7e-4aa8-bef7-95634361a7d5 tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:42.900929 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:42.900929 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:42.901958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ae406113-6b7e-4aa8-bef7-95634361a7d5 tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '7d4f9d41c7574021821f816bdc2887ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d5d649d5914ea0b08aec3ebebab84e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae406113-6b7e-4aa8-bef7-95634361a7d5 tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] Request method failure captured: Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/flavors/1486180613/action HTTP/1.1 Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 70 Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsgOYeq3WYb3-5JJ_HKp6EaTobhA-0ftFpKYEMojTVAD-B8WP_ZeuD-0uGuDl8gky9jGCUyXDv7XvWKR9ipzJa8iArwjLCiVi9XzoJj0PkCQMQ8HnaOWMHDDbp-BSXtIMu2UDtUDqF7-X0lAtt5ZLsEoDQ8RwAf2iPl-i_ReiUINQU Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: e0d5d649d5914ea0b08aec3ebebab84e Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1645913149 Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:29:42.903626 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0d5d649d5914ea0b08aec3ebebab84e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0d5d649d5914ea0b08aec3ebebab84e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0d5d649d5914ea0b08aec3ebebab84e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0d5d649d5914ea0b08aec3ebebab84e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1645913149 Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: e0d5d649d5914ea0b08aec3ebebab84e Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1645913149 Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsAccessNegativeTestJSON-1645913149-project Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 7d4f9d41c7574021821f816bdc2887ad Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1645913149-project Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: {"removeTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} Aug 24 03:29:42.904733 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1486180613', 'body': {'removeTenantAccess': {'tenant': 'e0d5d649d5914ea0b08aec3ebebab84e'}}} Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can( Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:29:42.905403 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 03:29:42.906412 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:42.907450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae406113-6b7e-4aa8-bef7-95634361a7d5 tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:42.907450 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae406113-6b7e-4aa8-bef7-95634361a7d5 tempest-FlavorsAccessNegativeTestJSON-1645913149 tempest-FlavorsAccessNegativeTestJSON-1645913149-project] 10.222.0.58 "POST /compute/v2.1/flavors/1486180613/action" status: 403 len: 133 microversion: 2.1 time: 0.019336 Aug 24 03:29:42.914659 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 19/50] 10.222.0.58 () {60 vars in 1200 bytes} [Wed Aug 24 03:29:42 2022] POST /compute/v2.1/flavors/1486180613/action => generated 133 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:42.920143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bfb236f5-2328-4c6b-a30d-ca99db6c84d0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e0d5d649d5914ea0b08aec3ebebab84e"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:43.142412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57e917f7-5fcf-43a7-b4a3-a67f1d7da73d tempest-FlavorsV255TestJSON-1520137847 tempest-FlavorsV255TestJSON-1520137847-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:43.153025 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-57e917f7-5fcf-43a7-b4a3-a67f1d7da73d tempest-FlavorsV255TestJSON-1520137847 tempest-FlavorsV255TestJSON-1520137847-project] 10.222.0.58 "GET /compute/v2.1/flavors/699939741" status: 200 len: 445 microversion: 2.55 time: 0.243164 Aug 24 03:29:43.163746 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 32/51] 10.222.0.58 () {60 vars in 1196 bytes} [Wed Aug 24 03:29:42 2022] GET /compute/v2.1/flavors/699939741 => generated 445 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:43.168929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-396bb4ca-c889-4a2f-8a55-18855b3ac71e tempest-FlavorsV255TestJSON-475309655 tempest-FlavorsV255TestJSON-475309655-project-admin] Action: 'update', calling method: .version_select at 0x7f1031ec2c10>, body: {"flavor": {"description": "new"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:43.184747 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:43.184747 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:43.223118 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-396bb4ca-c889-4a2f-8a55-18855b3ac71e tempest-FlavorsV255TestJSON-475309655 tempest-FlavorsV255TestJSON-475309655-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/699939741" status: 200 len: 446 microversion: 2.55 time: 0.057306 Aug 24 03:29:43.232838 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 33/52] 10.222.0.58 () {62 vars in 1216 bytes} [Wed Aug 24 03:29:43 2022] PUT /compute/v2.1/flavors/699939741 => generated 446 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:43.242472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5d5201dc-50d6-4811-bb72-e33772c04307 tempest-FlavorsV255TestJSON-1520137847 tempest-FlavorsV255TestJSON-1520137847-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:43.276090 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5d5201dc-50d6-4811-bb72-e33772c04307 tempest-FlavorsV255TestJSON-1520137847 tempest-FlavorsV255TestJSON-1520137847-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.041451 Aug 24 03:29:43.287697 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 34/53] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 24 03:29:43 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:43.390936 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bfb236f5-2328-4c6b-a30d-ca99db6c84d0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1486180613/action" status: 200 len: 21 microversion: 2.1 time: 0.474723 Aug 24 03:29:43.391495 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 20/54] 10.222.0.58 () {60 vars in 1200 bytes} [Wed Aug 24 03:29:42 2022] POST /compute/v2.1/flavors/1486180613/action => generated 21 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:29:43.402955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc3f77a1-0859-4ea7-bdbf-5d566f78cb4b tempest-FlavorsV255TestJSON-1520137847 tempest-FlavorsV255TestJSON-1520137847-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:43.443535 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc3f77a1-0859-4ea7-bdbf-5d566f78cb4b tempest-FlavorsV255TestJSON-1520137847 tempest-FlavorsV255TestJSON-1520137847-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.047038 Aug 24 03:29:43.444145 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 21/55] 10.222.0.58 () {60 vars in 1166 bytes} [Wed Aug 24 03:29:43 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:43.448831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d013cea-8c3e-4993-8e06-9f10b3544618 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:43.449896 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:43.449896 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:43.488289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:43.500298 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d013cea-8c3e-4993-8e06-9f10b3544618 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1486180613" status: 202 len: 0 microversion: 2.1 time: 0.054824 Aug 24 03:29:43.501684 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 22/56] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:29:43 2022] DELETE /compute/v2.1/flavors/1486180613 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:29:43.509363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4478b6f2-cfeb-48e4-a3fa-d2d3b4019a78 tempest-FlavorsV255TestJSON-475309655 tempest-FlavorsV255TestJSON-475309655-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:43.540080 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4478b6f2-cfeb-48e4-a3fa-d2d3b4019a78 tempest-FlavorsV255TestJSON-475309655 tempest-FlavorsV255TestJSON-475309655-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/699939741" status: 202 len: 0 microversion: 2.55 time: 0.036848 Aug 24 03:29:43.543520 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 23/57] 10.222.0.58 () {60 vars in 1199 bytes} [Wed Aug 24 03:29:43 2022] DELETE /compute/v2.1/flavors/699939741 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:29:43.545679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-12f3584a-404a-4493-b9c7-f4c2e1ceb5dc tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:43.563466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-502119112", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:43.582209 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-12f3584a-404a-4493-b9c7-f4c2e1ceb5dc tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040035 Aug 24 03:29:43.582964 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 24/58] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:43.636855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:29:43.663399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72fe6974-b28c-4a78-896a-1e1cd4a57699 tempest-FlavorsV261TestJSON-1336454015 tempest-FlavorsV261TestJSON-1336454015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-608575899", "id": 171381067, "os-flavor-access:is_public": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:43.687008 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72fe6974-b28c-4a78-896a-1e1cd4a57699 tempest-FlavorsV261TestJSON-1336454015 tempest-FlavorsV261TestJSON-1336454015-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.097877 Aug 24 03:29:43.688220 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 25/59] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:29:43 2022] POST /compute/v2.1/flavors => generated 464 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:43.693163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5f5e1a5-bc78-4031-8f4f-f88cbdd47f76 tempest-FlavorsV255TestJSON-475309655 tempest-FlavorsV255TestJSON-475309655-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:43.714810 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5f5e1a5-bc78-4031-8f4f-f88cbdd47f76 tempest-FlavorsV255TestJSON-475309655 tempest-FlavorsV255TestJSON-475309655-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5720 microversion: 2.55 time: 0.025281 Aug 24 03:29:43.728180 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 26/60] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 24 03:29:43 2022] GET /compute/v2.1/flavors/detail => generated 5720 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:43.737711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:43.738654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:43.745139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:43.745848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:43.746444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:43.747306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:43.747951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:43.748651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:43.939038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:43.949962 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0dd7cebb-6802-4276-bf62-8b6310fafe1e tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.220324 Aug 24 03:29:43.950548 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 27/61] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:43 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:43.956222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70a9dc93-64b2-4612-86e4-b113fa172ec9 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-221212979", "id": 620326429, "os-flavor-access:is_public": "False"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:43.961515 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:43.961515 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:43.991972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70a9dc93-64b2-4612-86e4-b113fa172ec9 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.040281 Aug 24 03:29:43.992721 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 28/62] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:43 2022] POST /compute/v2.1/flavors => generated 435 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:44.018960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:29:44.019519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:29:44.020173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:29:44.020468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:29:44.020875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:29:44.048039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:44.053106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:44.055075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:44.056030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:44.056340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:44.056792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:44.097485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Getting quotas for project a8ba1d64bbb64560a57f9d906f0a2de5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:29:44.112080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Getting quotas for user eb6e87b4ab604c7791e4fe61f7be0bf6 and project a8ba1d64bbb64560a57f9d906f0a2de5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:29:44.131344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:29:44.136213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:29:44.159103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-21706116-f7c9-4192-ac9f-859b094f7e9e tempest-FlavorsV261TestJSON-1326016032 tempest-FlavorsV261TestJSON-1326016032-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.171754 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-21706116-f7c9-4192-ac9f-859b094f7e9e tempest-FlavorsV261TestJSON-1326016032 tempest-FlavorsV261TestJSON-1326016032-project] 10.222.0.58 "GET /compute/v2.1/flavors/171381067" status: 200 len: 464 microversion: 2.61 time: 0.177656 Aug 24 03:29:44.172915 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 29/63] 10.222.0.58 () {60 vars in 1196 bytes} [Wed Aug 24 03:29:43 2022] GET /compute/v2.1/flavors/171381067 => generated 464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:44.191473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-388190ba-aa1a-414f-ae69-3705eced6ab0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2efb9524feb54812a636725595095cc3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:44.200104 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:44.200104 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:44.278719 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d4f2811-d11a-4699-b171-c75d6d133d6e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000466 Aug 24 03:29:44.287247 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 35/64] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:29:44.287247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-550e0242-3c8b-4cdf-b49f-d3e96987b4ac tempest-FlavorsV261TestJSON-1336454015 tempest-FlavorsV261TestJSON-1336454015-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:44.288218 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:44.288218 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:44.324419 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-550e0242-3c8b-4cdf-b49f-d3e96987b4ac tempest-FlavorsV261TestJSON-1336454015 tempest-FlavorsV261TestJSON-1336454015-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/171381067" status: 200 len: 465 microversion: 2.61 time: 0.043286 Aug 24 03:29:44.344865 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 36/65] 10.222.0.58 () {62 vars in 1216 bytes} [Wed Aug 24 03:29:44 2022] PUT /compute/v2.1/flavors/171381067 => generated 465 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:44.361226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a1b433f-06cd-414b-9422-dff52f7cab2d tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.365216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a1b433f-06cd-414b-9422-dff52f7cab2d tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:44.382423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=13,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:44.481634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8a1b433f-06cd-414b-9422-dff52f7cab2d tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:44.500395 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a1b433f-06cd-414b-9422-dff52f7cab2d tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1218 microversion: 2.1 time: 0.149591 Aug 24 03:29:44.502459 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 37/66] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:44 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:44.512276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2cbc45f9-7f10-4500-b232-06bd787be5ce tempest-FlavorsV261TestJSON-1326016032 tempest-FlavorsV261TestJSON-1326016032-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.582169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2cbc45f9-7f10-4500-b232-06bd787be5ce tempest-FlavorsV261TestJSON-1326016032 tempest-FlavorsV261TestJSON-1326016032-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.078829 Aug 24 03:29:44.583416 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 38/67] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 24 03:29:44 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:44.605385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf0761d1-45ed-496c-9c96-e36fad1cd923 tempest-FlavorsV261TestJSON-1326016032 tempest-FlavorsV261TestJSON-1326016032-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.617461 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-388190ba-aa1a-414f-ae69-3705eced6ab0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] HTTP exception thrown: Flavor access not found for 22 / 2efb9524feb54812a636725595095cc3 combination. Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-388190ba-aa1a-414f-ae69-3705eced6ab0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Request method failure captured: Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/flavors/620326429/action HTTP/1.1 Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 70 Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZshiZNEc1hj4l17nrdmrtOIiS1yCMp0luhXJl4UXDw74Wtuc1_Npaku0d14oUN5MvvgJFikbe1R_sFxBU1wlohLfn7Q1s465xaJJUI0OgVcDQtsDj65uB42uB4d68R9oQp82vo3HMtieyUJTOGoGG6VuMWYvurqBbWmML1rgZuNlv4 Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ddf34bc18f16491688a0d5c96d79337c Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:29:44.619331 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ddf34bc18f16491688a0d5c96d79337c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ddf34bc18f16491688a0d5c96d79337c Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697 Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2f8218a2c03a417582d80aaa553fc56e Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: {"removeTenantAccess": {"tenant": "2efb9524feb54812a636725595095cc3"}} Aug 24 03:29:44.620757 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: exception: Flavor access not found for 22 / 2efb9524feb54812a636725595095cc3 combination. Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '620326429', 'body': {'removeTenantAccess': {'tenant': '2efb9524feb54812a636725595095cc3'}}} Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 24 03:29:44.621523 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 2efb9524feb54812a636725595095cc3 combination. Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 2efb9524feb54812a636725595095cc3 combination. Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:44.622805 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 2efb9524feb54812a636725595095cc3 combination. Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-388190ba-aa1a-414f-ae69-3705eced6ab0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Returning 404 to user: Flavor access not found for 22 / 2efb9524feb54812a636725595095cc3 combination. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-388190ba-aa1a-414f-ae69-3705eced6ab0 tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/620326429/action" status: 404 len: 124 microversion: 2.1 time: 0.446380 Aug 24 03:29:44.624479 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 30/68] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 24 03:29:44 2022] POST /compute/v2.1/flavors/620326429/action => generated 124 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:44.635570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ec0fc15-00fc-4bc2-97ac-adf0f6f9e50c tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.637031 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:44.637031 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:44.646244 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cf0761d1-45ed-496c-9c96-e36fad1cd923 tempest-FlavorsV261TestJSON-1326016032 tempest-FlavorsV261TestJSON-1326016032-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.044738 Aug 24 03:29:44.649073 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 39/69] 10.222.0.58 () {60 vars in 1166 bytes} [Wed Aug 24 03:29:44 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:44.667537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-92c980f9-365b-40fe-8eed-3ab196152298 tempest-FlavorsV261TestJSON-1336454015 tempest-FlavorsV261TestJSON-1336454015-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.668342 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:44.668342 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:44.670947 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ec0fc15-00fc-4bc2-97ac-adf0f6f9e50c tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/620326429" status: 202 len: 0 microversion: 2.1 time: 0.041570 Aug 24 03:29:44.677196 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 31/70] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:29:44 2022] DELETE /compute/v2.1/flavors/620326429 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:29:44.685762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47a59f2a-1629-430a-9607-fa10744b3f4c tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.707784 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-92c980f9-365b-40fe-8eed-3ab196152298 tempest-FlavorsV261TestJSON-1336454015 tempest-FlavorsV261TestJSON-1336454015-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/171381067" status: 202 len: 0 microversion: 2.61 time: 0.048576 Aug 24 03:29:44.708456 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 40/71] 10.222.0.58 () {60 vars in 1199 bytes} [Wed Aug 24 03:29:44 2022] DELETE /compute/v2.1/flavors/171381067 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:29:44.716982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d42d85b8-1504-4ad3-8cb3-99933f3c06f6 tempest-FlavorsV261TestJSON-1336454015 tempest-FlavorsV261TestJSON-1336454015-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.736590 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47a59f2a-1629-430a-9607-fa10744b3f4c tempest-FlavorsAccessNegativeTestJSON-2142580697 tempest-FlavorsAccessNegativeTestJSON-2142580697-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.056049 Aug 24 03:29:44.740028 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 32/72] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:44 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:44.757000 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d42d85b8-1504-4ad3-8cb3-99933f3c06f6 tempest-FlavorsV261TestJSON-1336454015 tempest-FlavorsV261TestJSON-1336454015-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.043651 Aug 24 03:29:44.757814 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 41/73] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 24 03:29:44 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:29:44.975913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:44.976862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:44.989921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:44.991966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:44.995254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:44.996352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:44.998619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:45.003139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:45.234320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:45.246477 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4269ff6b-78d0-4691-975b-70a5539c2eae tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.274408 Aug 24 03:29:45.247747 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 33/74] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:44 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:45.521018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a8a7bc17-98e5-4012-9895-162b79cef3b1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:45.530443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a8a7bc17-98e5-4012-9895-162b79cef3b1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:45.610733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a8a7bc17-98e5-4012-9895-162b79cef3b1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:45.622684 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a8a7bc17-98e5-4012-9895-162b79cef3b1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1218 microversion: 2.1 time: 0.108407 Aug 24 03:29:45.640169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 42/75] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:45 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:46.277874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:46.279191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:46.305140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:46.305678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:46.306294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:46.307217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:46.310812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:46.315522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:46.570527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:46.582670 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0471cb6-ef60-4d77-b385-6b550eff10c6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.318207 Aug 24 03:29:46.583189 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 34/76] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:46 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:46.649222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:46.650414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:46.659076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:46.664247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:46.666392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:46.668736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:46.670356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:46.671024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:46.862382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:46.873230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bd137a3e-71b3-4c1b-8172-7ef467e60689 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1278 microversion: 2.1 time: 0.229832 Aug 24 03:29:46.883165 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 43/77] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:46 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:47.608655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:47.609551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:47.619239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:47.622062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:47.627424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:47.629258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:47.631355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:47.636606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:47.637292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:47.638030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:47.907291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:47.909396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:47.937197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:47.937952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:47.938537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:47.941608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:47.942901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:47.945570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:48.134674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:48.157832 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c4e8db7a-9c1d-47cf-8ba7-42c9ffe545a0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.545872 Aug 24 03:29:48.161948 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 35/78] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:47 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:48.663753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:48.688951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c13f0cf1-b8ca-4cc3-80b1-969c0f5b3726 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1276 microversion: 2.1 time: 0.786151 Aug 24 03:29:48.707703 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 44/79] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:47 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1276 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:49.203223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:49.204814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:49.213228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:49.213905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:49.214500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:49.215555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:49.216199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:49.216915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:49.504305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:49.523230 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-801951cf-3661-402f-96db-b572701a5eaf tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.324522 Aug 24 03:29:49.529426 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 36/80] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:49 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:49.721416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:49.723965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:49.740074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:49.752452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:49.753155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:49.754073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:49.754682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:49.755327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:50.341586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:50.359947 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a7b570d-cbab-4402-8657-783f964db3d1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.641331 Aug 24 03:29:50.361440 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 45/81] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:49 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:50.549283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:50.551282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:50.567837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:50.568877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:50.569862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:50.570850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:50.571564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:50.572211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:51.276776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:51.324243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-54e08dea-3e2d-4c04-9d6c-a0c9e72baea1 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.778965 Aug 24 03:29:51.333314 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 37/82] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:50 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:51.388802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:51.391808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:51.429097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:51.442336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:51.444915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:51.446512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:51.456245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:51.468371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:51.657515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Calling method '.version_select at 0x7f1031869670>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:51.660386 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:51.660386 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:51.666209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:51.668146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:51.671910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:51.697805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:51.698497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:51.699262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:51.715417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:51.716244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:51.716951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:51.726769 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c12850d8-2667-49db-8b7f-e5f6c2bf1450 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.455360 Aug 24 03:29:51.727990 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 46/83] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 24 03:29:51 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:51.741254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b1993cd-b51d-4a4a-b02f-c5016463f290 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Calling method '.version_select at 0x7f10318693a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:51.742048 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:51.742048 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:51.746400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1993cd-b51d-4a4a-b02f-c5016463f290 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:51.747129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1993cd-b51d-4a4a-b02f-c5016463f290 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:51.747909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1993cd-b51d-4a4a-b02f-c5016463f290 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:51.814238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1993cd-b51d-4a4a-b02f-c5016463f290 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:51.814626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1993cd-b51d-4a4a-b02f-c5016463f290 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:51.818658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1993cd-b51d-4a4a-b02f-c5016463f290 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:51.848726 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b1993cd-b51d-4a4a-b02f-c5016463f290 tempest-HypervisorAdminV228Test-566169879 tempest-HypervisorAdminV228Test-566169879-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.113742 Aug 24 03:29:51.856627 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 47/84] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 03:29:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:52.146788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:52.160637 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6ff4bd22-9d22-474c-a378-265cd6107f6f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.778261 Aug 24 03:29:52.172506 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 38/85] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:51 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:52.370177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:52.371366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:52.387961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:52.392220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:52.393058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:52.398067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:52.401436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:52.404062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:52.751301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:52.769779 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-34adb7f0-772c-46a3-90fa-46f920793cfe tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.396663 Aug 24 03:29:52.770698 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 48/86] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:52 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:52.886330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-191d2f97-c155-4352-81c6-d31c98f6f3ea req-5816126d-7099-4d54-969f-8d611e00032f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e7689b-98e3-43b7-95fe-13da2470a128", "tag": "63e8bdec-b4cc-4181-877e-cc78876ed9b0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:52.917968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-191d2f97-c155-4352-81c6-d31c98f6f3ea req-5816126d-7099-4d54-969f-8d611e00032f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:52.918812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-191d2f97-c155-4352-81c6-d31c98f6f3ea req-5816126d-7099-4d54-969f-8d611e00032f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:52.919486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-191d2f97-c155-4352-81c6-d31c98f6f3ea req-5816126d-7099-4d54-969f-8d611e00032f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:52.969759 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-191d2f97-c155-4352-81c6-d31c98f6f3ea req-5816126d-7099-4d54-969f-8d611e00032f service nova] Creating event network-changed:63e8bdec-b4cc-4181-877e-cc78876ed9b0 for instance c6e7689b-98e3-43b7-95fe-13da2470a128 on n-h2-846470-15 Aug 24 03:29:52.970596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-191d2f97-c155-4352-81c6-d31c98f6f3ea req-5816126d-7099-4d54-969f-8d611e00032f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:29:52.971177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-191d2f97-c155-4352-81c6-d31c98f6f3ea req-5816126d-7099-4d54-969f-8d611e00032f service nova] Acquired lock "compute-rpcapi-router" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:29:52.972835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:52.976860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:52.977556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:52.978490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:52.984781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:52.985479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:53.009748 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.compute.rpcapi [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:29:53.011950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] Releasing lock "compute-rpcapi-router" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:29:53.060848 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7dac208-29be-4c2d-857e-824b4f14eb27 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.504895 Aug 24 03:29:53.062044 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 39/87] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:29:53.125552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d14e231e-4b7a-4d5e-aa90-fc76d7b1995a req-7198aeb7-3ae5-43b9-a21e-3d30aa2402f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b52cd68-411a-43f1-8409-db901889da20", "tag": "7b057865-d7af-4e62-9540-3715df5d28eb"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:53.157303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d14e231e-4b7a-4d5e-aa90-fc76d7b1995a req-7198aeb7-3ae5-43b9-a21e-3d30aa2402f9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:53.158783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d14e231e-4b7a-4d5e-aa90-fc76d7b1995a req-7198aeb7-3ae5-43b9-a21e-3d30aa2402f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:53.159621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d14e231e-4b7a-4d5e-aa90-fc76d7b1995a req-7198aeb7-3ae5-43b9-a21e-3d30aa2402f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:53.185010 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d14e231e-4b7a-4d5e-aa90-fc76d7b1995a req-7198aeb7-3ae5-43b9-a21e-3d30aa2402f9 service nova] Creating event network-changed:7b057865-d7af-4e62-9540-3715df5d28eb for instance 4b52cd68-411a-43f1-8409-db901889da20 on n-h1-846470-15 Aug 24 03:29:53.185922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d14e231e-4b7a-4d5e-aa90-fc76d7b1995a req-7198aeb7-3ae5-43b9-a21e-3d30aa2402f9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:29:53.186179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:53.187031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d14e231e-4b7a-4d5e-aa90-fc76d7b1995a req-7198aeb7-3ae5-43b9-a21e-3d30aa2402f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:29:53.187157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:53.188846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:53.189560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:53.190153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:53.191055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:53.192587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:53.193494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:53.197980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:53.198718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:53.199298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:53.200223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:53.200974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:53.201734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:53.204484 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.rpcapi [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:29:53.205650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] Releasing lock "compute-rpcapi-router" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:29:53.236241 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-920f85d8-9c69-419e-8b9a-63a4dc60c0c9 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.454728 Aug 24 03:29:53.237189 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 49/88] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:53.794483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:53.796183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:53.803696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:53.804436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:53.805081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:53.807383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:53.808421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:53.809256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:53.930488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:53.942824 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a1a4d35-008f-4d4d-8502-205e201ac28c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.761436 Aug 24 03:29:53.962431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 40/89] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:53 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:54.030889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:54.042034 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a1f1e4a-c2d7-4bd7-89b2-cd2f13b20cab tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.253444 Aug 24 03:29:54.057647 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 50/90] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:53 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:54.976884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:54.978666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:54.989945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:54.992548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:54.994201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:54.997454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:54.998506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:54.999212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:55.251759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-69c60380-aaab-4afe-8ee1-a3746fa64b48 tempest-QuotaClassesAdmin257Test-1961319625 tempest-QuotaClassesAdmin257Test-1961319625-project-admin] Calling method '.version_select at 0x7f1023c3a0d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:55.253094 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:55.253094 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:55.280335 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-69c60380-aaab-4afe-8ee1-a3746fa64b48 tempest-QuotaClassesAdmin257Test-1961319625 tempest-QuotaClassesAdmin257Test-1961319625-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.585307 Aug 24 03:29:55.286059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 41/91] 10.222.0.58 () {60 vars in 1226 bytes} [Wed Aug 24 03:29:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:55.298664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:55.298664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:55.317251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:55.317756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:55.318190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:55.318912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:55.319369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:55.319973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:55.518003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:55.524440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:55.540412 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9fd49c05-388f-46f5-80cb-6e8c4df10336 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.563427 Aug 24 03:29:55.541114 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 51/92] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:54 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:55.556021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8eac077d-6995-43d3-81c2-27546cd31aad tempest-QuotaClassesAdmin257Test-1961319625 tempest-QuotaClassesAdmin257Test-1961319625-project-admin] Action: 'update', calling method: .version_select at 0x7f10306878b0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:55.561052 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:55.561052 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:55.637928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:55.653617 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef9d0a8b-3191-4b13-91ca-0b634e5df47a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.366210 Aug 24 03:29:55.655031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 42/93] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:55 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:55.936318 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8eac077d-6995-43d3-81c2-27546cd31aad tempest-QuotaClassesAdmin257Test-1961319625 tempest-QuotaClassesAdmin257Test-1961319625-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.392383 Aug 24 03:29:55.936848 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 52/94] 10.222.0.58 () {62 vars in 1247 bytes} [Wed Aug 24 03:29:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:55.948467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14de4009-0730-421c-b7ad-4619fa630d76 tempest-QuotaClassesAdmin257Test-1961319625 tempest-QuotaClassesAdmin257Test-1961319625-project-admin] Calling method '.version_select at 0x7f1023cb6310>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:55.949633 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:55.949633 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:55.962071 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14de4009-0730-421c-b7ad-4619fa630d76 tempest-QuotaClassesAdmin257Test-1961319625 tempest-QuotaClassesAdmin257Test-1961319625-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.017337 Aug 24 03:29:55.968983 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 43/95] 10.222.0.58 () {60 vars in 1226 bytes} [Wed Aug 24 03:29:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:55.974694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e24d6a49-663e-4c99-a1d9-8c293a775a16 tempest-QuotaClassesAdmin257Test-1961319625 tempest-QuotaClassesAdmin257Test-1961319625-project-admin] Action: 'update', calling method: .version_select at 0x7f1030687dc0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:56.139648 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e24d6a49-663e-4c99-a1d9-8c293a775a16 tempest-QuotaClassesAdmin257Test-1961319625 tempest-QuotaClassesAdmin257Test-1961319625-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.166593 Aug 24 03:29:56.140369 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 53/96] 10.222.0.58 () {62 vars in 1247 bytes} [Wed Aug 24 03:29:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:56.568590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:56.570014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:56.577576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:56.578565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:56.579449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:56.581735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:56.582587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:56.583227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:56.676599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:56.678772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:56.691137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:56.696347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:56.696818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:56.697669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:56.698150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:56.698581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:56.906805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:56.925332 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70d2f1da-00e0-4ddd-a06f-4c0cf78ef847 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.358403 Aug 24 03:29:56.926786 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 44/97] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:56 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:57.182140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:57.201418 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81601b5d-d9d8-4652-9895-a9b4602a2e59 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.529586 Aug 24 03:29:57.202766 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 54/98] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:56 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:57.950794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:57.952127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:57.977543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:57.978392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:57.979037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:57.980135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:57.981581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:57.982494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:58.230155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:58.230682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:58.244255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:58.250839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:58.253530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:58.258847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:58.260396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:58.262789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:58.338826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:58.351784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ee76af5-b5a8-4bcf-875a-d32136f22841 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.406236 Aug 24 03:29:58.353011 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 45/99] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:57 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:58.598359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:58.608504 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9eea2299-a90d-4dcc-a083-d3c3065068d0 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.382563 Aug 24 03:29:58.609099 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 55/100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:58 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:58.964226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d79335aa-3a55-4dd5-a8fb-b5b72e93dfa8 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Calling method '.version_select at 0x7f1023bf14c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:58.965026 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:58.965026 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:58.966384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d79335aa-3a55-4dd5-a8fb-b5b72e93dfa8 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '2c4b824036d445bcb2e6993389fa323f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f452ffbf3ea4122a8da5db2d63d101f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d79335aa-3a55-4dd5-a8fb-b5b72e93dfa8 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Request method failure captured: Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs1DFkck6KXDbOFqKUgkJ0Y8msJqvi3YZoP-M7TXsXFztbcmxb2zSVAgCJ5gqaQ6OtuNh6KZodF-Rljsn4MSu0f6-8Z2F3zSFcjGzYQB3-ExdeLsndnwlD4omP4KAaMI9xcXsuDRMBvoyb78OXivfxZTz2UDxa_GDzMm-uzDKb2aaw Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:29:58.968589 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2c4b824036d445bcb2e6993389fa323f Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: action_args: {} Aug 24 03:29:58.969766 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:29:58.970904 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 03:29:58.972138 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:58.979864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d79335aa-3a55-4dd5-a8fb-b5b72e93dfa8 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:58.981032 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d79335aa-3a55-4dd5-a8fb-b5b72e93dfa8 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.380902 Aug 24 03:29:58.986377 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 46/101] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 24 03:29:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 387 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:29:58.991345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b981c4c7-8c6b-4e66-8b41-5c91ff23db39 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Calling method '.version_select at 0x7f1030662670>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:58.992172 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:58.992172 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:58.993635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b981c4c7-8c6b-4e66-8b41-5c91ff23db39 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '2c4b824036d445bcb2e6993389fa323f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f452ffbf3ea4122a8da5db2d63d101f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b981c4c7-8c6b-4e66-8b41-5c91ff23db39 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Request method failure captured: Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs1DFkck6KXDbOFqKUgkJ0Y8msJqvi3YZoP-M7TXsXFztbcmxb2zSVAgCJ5gqaQ6OtuNh6KZodF-Rljsn4MSu0f6-8Z2F3zSFcjGzYQB3-ExdeLsndnwlD4omP4KAaMI9xcXsuDRMBvoyb78OXivfxZTz2UDxa_GDzMm-uzDKb2aaw Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:29:58.996984 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 2c4b824036d445bcb2e6993389fa323f Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: action_args: {} Aug 24 03:29:58.998200 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:29:58.998876 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 03:29:58.999868 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.003370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b981c4c7-8c6b-4e66-8b41-5c91ff23db39 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:59.004459 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b981c4c7-8c6b-4e66-8b41-5c91ff23db39 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.016979 Aug 24 03:29:59.005426 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 56/102] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:58 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:59.014202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-392b437c-b200-4d8a-b467-e896a2721800 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Calling method '.version_select at 0x7f1023c755e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.015147 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:59.015147 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:59.016513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-392b437c-b200-4d8a-b467-e896a2721800 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '2c4b824036d445bcb2e6993389fa323f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f452ffbf3ea4122a8da5db2d63d101f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-392b437c-b200-4d8a-b467-e896a2721800 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Request method failure captured: Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs1DFkck6KXDbOFqKUgkJ0Y8msJqvi3YZoP-M7TXsXFztbcmxb2zSVAgCJ5gqaQ6OtuNh6KZodF-Rljsn4MSu0f6-8Z2F3zSFcjGzYQB3-ExdeLsndnwlD4omP4KAaMI9xcXsuDRMBvoyb78OXivfxZTz2UDxa_GDzMm-uzDKb2aaw Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:29:59.018318 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2c4b824036d445bcb2e6993389fa323f Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: action_args: {} Aug 24 03:29:59.019517 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:29:59.020199 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 03:29:59.021157 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.023821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-392b437c-b200-4d8a-b467-e896a2721800 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:59.024897 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-392b437c-b200-4d8a-b467-e896a2721800 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.014618 Aug 24 03:29:59.033037 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 47/103] 10.222.0.58 () {58 vars in 1179 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:59.214962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Calling method '.version_select at 0x7f1031895c10>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.217216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.218523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.220476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.252315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.254013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.254611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.278114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.278835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.279918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.287451 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f129a4b4-db1c-448c-8da2-cf462defde0e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.256458 Aug 24 03:29:59.289589 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 57/104] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:59.301174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10fea845-c537-42ca-a686-444fd6b91672 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Calling method '.version_select at 0x7f10300988b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.302302 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:59.302302 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:59.303701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10fea845-c537-42ca-a686-444fd6b91672 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '2c4b824036d445bcb2e6993389fa323f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f452ffbf3ea4122a8da5db2d63d101f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10fea845-c537-42ca-a686-444fd6b91672 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Request method failure captured: Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs1DFkck6KXDbOFqKUgkJ0Y8msJqvi3YZoP-M7TXsXFztbcmxb2zSVAgCJ5gqaQ6OtuNh6KZodF-Rljsn4MSu0f6-8Z2F3zSFcjGzYQB3-ExdeLsndnwlD4omP4KAaMI9xcXsuDRMBvoyb78OXivfxZTz2UDxa_GDzMm-uzDKb2aaw Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:29:59.305459 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2c4b824036d445bcb2e6993389fa323f Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1'} Aug 24 03:29:59.306728 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:29:59.307420 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 03:29:59.308431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.309342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10fea845-c537-42ca-a686-444fd6b91672 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:59.309342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10fea845-c537-42ca-a686-444fd6b91672 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.010541 Aug 24 03:29:59.316629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e120f389-5cab-43f6-b67d-ceb4b3e0abcf tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Calling method '.version_select at 0x7f1030edee50>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.317438 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:59.317438 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:29:59.318630 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e120f389-5cab-43f6-b67d-ceb4b3e0abcf tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] HTTP exception thrown: Hypervisor with ID '8295a440-fcf4-48b4-898c-b3b99125cf09' could not be found. Aug 24 03:29:59.320553 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 48/105] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e120f389-5cab-43f6-b67d-ceb4b3e0abcf tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Request method failure captured: Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hypervisors/8295a440-fcf4-48b4-898c-b3b99125cf09/uptime HTTP/1.1 Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs2B1j2JJ5vBSWu5jZ72KWdzRbgqcOmaYtIKS-pE87TDFhBpc7gwMJF8HPZQXasalIuT30vVLXTEJLGsug27RpWqniL3Cpuy5qNn6LHJ_azfuDH6gNZBOv1WUMwdE8bkgybQkSqtwcK48QlKLgC_14RJpes0o66ym4w3PA1NEbJFVE Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d6e5288abd15445fb3625a3ed815b085 Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1561256930 Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:29:59.327951 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d6e5288abd15445fb3625a3ed815b085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d6e5288abd15445fb3625a3ed815b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d6e5288abd15445fb3625a3ed815b085"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d6e5288abd15445fb3625a3ed815b085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1561256930 Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d6e5288abd15445fb3625a3ed815b085 Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1561256930 Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5b9b0fe2c0374b3090d64e8e2410191c Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: exception: Hypervisor with ID '8295a440-fcf4-48b4-898c-b3b99125cf09' could not be found. Aug 24 03:29:59.329159 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '8295a440-fcf4-48b4-898c-b3b99125cf09'} Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8295a440-fcf4-48b4-898c-b3b99125cf09' Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 24 03:29:59.329819 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8295a440-fcf4-48b4-898c-b3b99125cf09' could not be found. Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.330941 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.334169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.334169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.334169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.334169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:59.334169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:59.334169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8295a440-fcf4-48b4-898c-b3b99125cf09' could not be found. Aug 24 03:29:59.334169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.336961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e120f389-5cab-43f6-b67d-ceb4b3e0abcf tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Returning 404 to user: Hypervisor with ID '8295a440-fcf4-48b4-898c-b3b99125cf09' could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:59.337906 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e120f389-5cab-43f6-b67d-ceb4b3e0abcf tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/8295a440-fcf4-48b4-898c-b3b99125cf09/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025183 Aug 24 03:29:59.342981 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 58/106] 10.222.0.58 () {58 vars in 1278 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/os-hypervisors/8295a440-fcf4-48b4-898c-b3b99125cf09/uptime => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:59.349312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Calling method '.version_select at 0x7f1023bf1940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.350250 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:59.350250 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:59.357194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) {{(pid=122536) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 24 03:29:59.358023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.358853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.358991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.376502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.378813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:59.391870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=3,nova_api:UPDATE=14,nova_api:INSERT=7 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:59.394276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.394935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.395853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.396714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.397353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.397950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.401491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.402017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.402431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.436399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.441401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.442146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.450680 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5139fdf7-1697-4973-a208-0ce39dea1f9e tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.105970 Aug 24 03:29:59.451710 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 49/107] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:59.463382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5a57f1a-4b3e-4f74-96d0-aa567bc8a608 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Calling method '.version_select at 0x7f1023bf13a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.464479 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:59.464479 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:29:59.465698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f5a57f1a-4b3e-4f74-96d0-aa567bc8a608 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '2c4b824036d445bcb2e6993389fa323f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f452ffbf3ea4122a8da5db2d63d101f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5a57f1a-4b3e-4f74-96d0-aa567bc8a608 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Request method failure captured: Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs1DFkck6KXDbOFqKUgkJ0Y8msJqvi3YZoP-M7TXsXFztbcmxb2zSVAgCJ5gqaQ6OtuNh6KZodF-Rljsn4MSu0f6-8Z2F3zSFcjGzYQB3-ExdeLsndnwlD4omP4KAaMI9xcXsuDRMBvoyb78OXivfxZTz2UDxa_GDzMm-uzDKb2aaw Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:29:59.467557 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f452ffbf3ea4122a8da5db2d63d101f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6f452ffbf3ea4122a8da5db2d63d101f Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123 Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2c4b824036d445bcb2e6993389fa323f Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1098856123-project Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1'} Aug 24 03:29:59.468752 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:29:59.469449 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 03:29:59.470703 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.473779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5a57f1a-4b3e-4f74-96d0-aa567bc8a608 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:59.477637 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f5a57f1a-4b3e-4f74-96d0-aa567bc8a608 tempest-HypervisorAdminNegativeTestJSON-1098856123 tempest-HypervisorAdminNegativeTestJSON-1098856123-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016242 Aug 24 03:29:59.484072 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 50/108] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:59.489872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb09a160-49f5-4240-8162-620589542328 tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Calling method '.version_select at 0x7f1023c1e700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.492200 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-bb09a160-49f5-4240-8162-620589542328 tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] HTTP exception thrown: Hypervisor with ID '3da882d5-b738-4355-8b73-cb90ee0d0ccc' could not be found. Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb09a160-49f5-4240-8162-620589542328 tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Request method failure captured: Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hypervisors/3da882d5-b738-4355-8b73-cb90ee0d0ccc HTTP/1.1 Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs2B1j2JJ5vBSWu5jZ72KWdzRbgqcOmaYtIKS-pE87TDFhBpc7gwMJF8HPZQXasalIuT30vVLXTEJLGsug27RpWqniL3Cpuy5qNn6LHJ_azfuDH6gNZBOv1WUMwdE8bkgybQkSqtwcK48QlKLgC_14RJpes0o66ym4w3PA1NEbJFVE Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: d6e5288abd15445fb3625a3ed815b085 Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1561256930 Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:29:59.496037 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d6e5288abd15445fb3625a3ed815b085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d6e5288abd15445fb3625a3ed815b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d6e5288abd15445fb3625a3ed815b085"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d6e5288abd15445fb3625a3ed815b085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1561256930 Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: d6e5288abd15445fb3625a3ed815b085 Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1561256930 Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5b9b0fe2c0374b3090d64e8e2410191c Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: exception: Hypervisor with ID '3da882d5-b738-4355-8b73-cb90ee0d0ccc' could not be found. Aug 24 03:29:59.497296 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '3da882d5-b738-4355-8b73-cb90ee0d0ccc'} Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3da882d5-b738-4355-8b73-cb90ee0d0ccc' Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 24 03:29:59.497948 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:29:59.499085 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3da882d5-b738-4355-8b73-cb90ee0d0ccc' could not be found. Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3da882d5-b738-4355-8b73-cb90ee0d0ccc' could not be found. Aug 24 03:29:59.500113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:29:59.502779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb09a160-49f5-4240-8162-620589542328 tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] Returning 404 to user: Hypervisor with ID '3da882d5-b738-4355-8b73-cb90ee0d0ccc' could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:59.505556 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bb09a160-49f5-4240-8162-620589542328 tempest-HypervisorAdminNegativeTestJSON-1561256930 tempest-HypervisorAdminNegativeTestJSON-1561256930-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/3da882d5-b738-4355-8b73-cb90ee0d0ccc" status: 404 len: 123 microversion: 2.1 time: 0.020067 Aug 24 03:29:59.506405 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 51/109] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/os-hypervisors/3da882d5-b738-4355-8b73-cb90ee0d0ccc => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:29:59.633779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.634718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:59.647071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.647728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.648513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.649937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:59.651155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:59.651853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:59.658287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:59.767047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:59.779127 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0cfc38f8-54fc-4f7f-9dce-3d8035231c96 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.407618 Aug 24 03:29:59.783411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 59/110] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:59.891017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:59.904517 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6de1c6a4-f17f-4de0-8813-9845a1e53b24 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.276711 Aug 24 03:29:59.922467 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 52/111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:00.805522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:00.806760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:00.816610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:00.817853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:00.818449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:00.819305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:00.819784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:00.820711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:00.927137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:00.927760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:00.936572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:00.940538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:00.942486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:00.945147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:00.945638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:00.951653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:01.104638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:01.125978 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-21d58fa8-1886-4bd2-8a14-8cac5e506f2a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.322649 Aug 24 03:30:01.130275 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 60/112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:00 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:01.213159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:01.224116 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6182570c-0a26-4ac1-b4e5-445d8907a7cc tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.300947 Aug 24 03:30:01.225486 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 53/113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:00 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:02.154733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:02.156180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:02.165476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:02.166969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:02.167398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:02.168287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:02.168740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:02.169354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:02.249183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:02.249788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:02.265412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:02.265895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:02.266326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:02.267071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:02.267621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:02.268216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:02.646326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:02.662369 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b80ffd49-6b6d-4a6c-bacd-3629087e994f tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.416890 Aug 24 03:30:02.665693 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 54/114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:02 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:02.733575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:02.743569 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5bf18ca9-ec67-4eed-a446-576bb48e23a1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.591837 Aug 24 03:30:02.745148 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 61/115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:02 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:02.876477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9958ffc5-4890-4c18-98ab-e5fca52904a5 req-d4a0c003-bdf5-4354-95c1-83c83a27660f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e7689b-98e3-43b7-95fe-13da2470a128", "name": "network-vif-plugged", "status": "completed", "tag": "63e8bdec-b4cc-4181-877e-cc78876ed9b0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:02.901469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9958ffc5-4890-4c18-98ab-e5fca52904a5 req-d4a0c003-bdf5-4354-95c1-83c83a27660f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:02.903422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9958ffc5-4890-4c18-98ab-e5fca52904a5 req-d4a0c003-bdf5-4354-95c1-83c83a27660f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:02.903764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9958ffc5-4890-4c18-98ab-e5fca52904a5 req-d4a0c003-bdf5-4354-95c1-83c83a27660f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:02.922682 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9958ffc5-4890-4c18-98ab-e5fca52904a5 req-d4a0c003-bdf5-4354-95c1-83c83a27660f service nova] Creating event network-vif-plugged:63e8bdec-b4cc-4181-877e-cc78876ed9b0 for instance c6e7689b-98e3-43b7-95fe-13da2470a128 on n-h2-846470-15 Aug 24 03:30:02.928886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9958ffc5-4890-4c18-98ab-e5fca52904a5 req-d4a0c003-bdf5-4354-95c1-83c83a27660f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261293 Aug 24 03:30:02.930174 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 55/116] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:03.688083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:03.689495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:03.692896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=10 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:03.713859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:03.714857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:03.716589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:03.717593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:03.718256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:03.718904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:03.763773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:03.768499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:03.769405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:03.776798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:03.777801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:03.778443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:03.779346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:03.780102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:03.780738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:03.945915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:03.956781 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2dc5b2f6-0409-4d45-837c-235cd9175bbd tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.193860 Aug 24 03:30:03.958385 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 56/117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:03 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:04.134263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:04.144643 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d25aeca4-9635-48b9-97d0-8e277896cdf6 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 0.460616 Aug 24 03:30:04.148725 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 62/118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:03 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:04.979920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:04.982797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:04.993307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:04.994089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:04.995794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:04.999353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:05.000989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:05.002932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:05.380033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1818878c-6aad-49af-9c0b-ae3dfd437a68 tempest-InstanceUsageAuditLogTestJSON-658461936 tempest-InstanceUsageAuditLogTestJSON-658461936-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:05.380880 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:05.380880 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:05.407115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:05.415722 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ae5ce8c-0431-44be-a786-fc59a889806f tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.440928 Aug 24 03:30:05.420770 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1818878c-6aad-49af-9c0b-ae3dfd437a68 tempest-InstanceUsageAuditLogTestJSON-658461936 tempest-InstanceUsageAuditLogTestJSON-658461936-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24 03:30:04" status: 200 len: 318 microversion: 2.1 time: 0.592463 Aug 24 03:30:05.421365 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 57/119] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2003%3A30%3A04 => generated 318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:05.422443 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 63/120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:04 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:05.447957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:05.449047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:05.452195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d13eebe8-3417-40c5-982c-12f15455e7a7 tempest-InstanceUsageAuditLogTestJSON-658461936 tempest-InstanceUsageAuditLogTestJSON-658461936-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:05.453309 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:05.453309 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:05.468671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:05.469446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:05.470504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:05.471396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:05.472188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:05.472689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:05.478697 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d13eebe8-3417-40c5-982c-12f15455e7a7 tempest-InstanceUsageAuditLogTestJSON-658461936 tempest-InstanceUsageAuditLogTestJSON-658461936-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.045993 Aug 24 03:30:05.479492 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 58/121] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 24 03:30:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:06.120585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.443753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:06.445072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:06.458419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:06.462376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:06.464323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:06.471715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:06.472739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:06.473198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:06.805175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:06.817788 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dbd8b6c1-4da2-4e0e-ab46-73725824730c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.378155 Aug 24 03:30:06.828810 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 59/122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:06 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:06.930886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:06.946235 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d80ab051-1d7b-47e7-a67f-f3307c03ceff tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1338 microversion: 2.1 time: 1.518879 Aug 24 03:30:06.950644 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 64/123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:05 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1338 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:07.327238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-76410880", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:07.448119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:07.846725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:07.847954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:07.854750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:07.855422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:07.856070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:07.856911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:07.865923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:07.866401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:07.904788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:07.905294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:07.905766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:07.906176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:07.906584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:07.934015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:07.934673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:07.936710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:07.937664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:07.938323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:07.940486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:07.981813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:07.994382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:08.025849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:08.030841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:08.131207 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86f07744-d0e8-4808-8f8e-147055c12172 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061225 Aug 24 03:30:08.131898 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 60/124] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:30:08.148633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:08.149516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:08.160235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:08.161041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:08.161946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:08.164252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:08.165300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:08.165998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:08.330523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:08.343032 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b18e7cba-c47f-4ca9-874d-3b81b0381293 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.500319 Aug 24 03:30:08.343878 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 65/125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:07 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:08.356110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bea8aa5e-b33b-4c92-9746-38b1f85a6174 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:08.356830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bea8aa5e-b33b-4c92-9746-38b1f85a6174 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:08.490970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bea8aa5e-b33b-4c92-9746-38b1f85a6174 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:08.503855 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bea8aa5e-b33b-4c92-9746-38b1f85a6174 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1215 microversion: 2.1 time: 0.154410 Aug 24 03:30:08.505101 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 66/126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:08 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:08.591108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:08.605798 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec00bb23-c6c8-45ec-a46e-c61a7d2e5b85 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1487 microversion: 2.1 time: 0.470412 Aug 24 03:30:08.608855 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 61/127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:08 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1487 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:08.634468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:08.635874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:08.646454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:08.647057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:08.647713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:08.648991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:08.649668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:08.650578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.285981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d7278ac-5b2a-4a0f-8dc6-e5ba83593f4e tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1640 microversion: 2.1 time: 0.656757 Aug 24 03:30:09.287463 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 67/128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:08 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1640 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:09.317438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:09.318156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:09.320450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:09.331179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:09.337133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:09.337603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.338363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:09.338830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:09.339259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.365354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:09.366371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:09.376353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:09.379001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:09.379634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.382325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:09.382811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:09.383244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.393843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:30:09.661314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:09.672802 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f9bd4628-de4c-4d3e-b452-76d461475ce6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.311346 Aug 24 03:30:09.700582 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 68/129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:09 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:09.711577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:09.716890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:09.726669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:09.727428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:09.728192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.729057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:09.729968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:09.730615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.734478 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d85293dc-baed-42a2-8b64-c8457c43a010 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 204 len: 0 microversion: 2.1 time: 0.420651 Aug 24 03:30:09.738558 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 62/130] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:30:09 2022] DELETE /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:30:09.768242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:09.769245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:09.783964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:09.786817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:09.787948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.792249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:09.792958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:09.793582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:09.860209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:09.873965 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8bb52595-fecc-434f-a99d-787685e4a48d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1289 microversion: 2.1 time: 0.171818 Aug 24 03:30:09.879793 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 69/131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:09 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1289 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:10.099954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:10.114879 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70285935-9693-45a5-b78e-f4925e125a3a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1493 microversion: 2.1 time: 0.373163 Aug 24 03:30:10.115487 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 63/132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:09 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1493 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:10.696839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:10.698230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:10.705089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:10.707486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:10.707921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:10.708642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:10.709105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:10.709487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:10.879756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ad8b3e28-fdd2-43f5-84f9-ad71d37e5dbc req-e6b899a2-b4a5-4531-a393-87d9d5590905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b52cd68-411a-43f1-8409-db901889da20", "name": "network-vif-plugged", "status": "completed", "tag": "7b057865-d7af-4e62-9540-3715df5d28eb"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:10.885217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:10.899609 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84582d6b-68d5-4be5-a677-c7f9c7563651 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.206946 Aug 24 03:30:10.909711 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 70/133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:10 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:10.912046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad8b3e28-fdd2-43f5-84f9-ad71d37e5dbc req-e6b899a2-b4a5-4531-a393-87d9d5590905 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:10.912885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad8b3e28-fdd2-43f5-84f9-ad71d37e5dbc req-e6b899a2-b4a5-4531-a393-87d9d5590905 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:10.913633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad8b3e28-fdd2-43f5-84f9-ad71d37e5dbc req-e6b899a2-b4a5-4531-a393-87d9d5590905 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:10.927795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:10.929523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:10.931031 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ad8b3e28-fdd2-43f5-84f9-ad71d37e5dbc req-e6b899a2-b4a5-4531-a393-87d9d5590905 service nova] Creating event network-vif-plugged:7b057865-d7af-4e62-9540-3715df5d28eb for instance 4b52cd68-411a-43f1-8409-db901889da20 on n-h1-846470-15 Aug 24 03:30:10.946116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:10.946614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:10.947047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:10.949421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:10.950751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:10.951265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:10.951796 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ad8b3e28-fdd2-43f5-84f9-ad71d37e5dbc req-e6b899a2-b4a5-4531-a393-87d9d5590905 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078596 Aug 24 03:30:10.955545 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 64/134] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:11.048569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:11.059754 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7bb6ed29-5ecc-4afc-9e12-b5bfa4b0d159 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1289 microversion: 2.1 time: 0.148855 Aug 24 03:30:11.062475 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 71/135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:10 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:11.293905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3c89794-d3bb-417e-abdf-1aa7c5face8f tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Action: 'create', calling method: .version_select at 0x7f1023bd2280>, body: {"keypair": {"name": "tempest-keypair-945808795", "type": "ssh", "user_id": "25786e32c8ce470d8c02e4560dfa8393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGyYl7wqHgLnWarbxTCOw7mu2o0iDgAFnHcgcPB2ZQDMBGXUNEtNp9s/Mf4/Aqbl0XFJkfP9Yeo6tbexFZNCbU7LN5CjPwQOoEcNHcWS5mkq4YIsDn8snisO2Pv511zEw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:11.356948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a3c89794-d3bb-417e-abdf-1aa7c5face8f tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Getting quotas for project 0c63eb4ec8164ab7bcdbe454281a78d4. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:11.368630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a3c89794-d3bb-417e-abdf-1aa7c5face8f tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Getting quotas for user 88252a4aa3bd4a14bd29e2a89cbe0721 and project 0c63eb4ec8164ab7bcdbe454281a78d4. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:11.418143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-926458687", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7cea5f7b-959c-4b39-9ec6-22b9a1e6db87"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:11.433235 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3c89794-d3bb-417e-abdf-1aa7c5face8f tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.458005 Aug 24 03:30:11.434333 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 65/136] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 03:30:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 461 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 03:30:11.439279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:11.447504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:11.463451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:11.467137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:11.468012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:11.468995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:11.472357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:11.473105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:11.569719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] validate_networks() for [('7cea5f7b-959c-4b39-9ec6-22b9a1e6db87', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:11.757613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:11.769521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-18c47445-7241-40ba-896b-de8292e92c5a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1493 microversion: 2.1 time: 0.331597 Aug 24 03:30:11.771940 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 66/137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:11 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1493 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:11.791158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3deecb9-99d2-42c6-9d0e-f4630d7919b9 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Action: 'create', calling method: .version_select at 0x7f1023aecb80>, body: {"keypair": {"name": "tempest-keypair-1025341755", "type": "ssh", "user_id": "25786e32c8ce470d8c02e4560dfa8393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDu26x315KqNudsjmzwR3Hwb25RpEAlxee1KfClASacdtKR3kSaRdh2ywn5lDiMcCV6C3I2qJ5kGHuJdnx1ueuNVPfsy4xwjVmnTlc8bq7rGWr1eETKRC2HbkNzIRnqEw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:11.819205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f3deecb9-99d2-42c6-9d0e-f4630d7919b9 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Getting quotas for project 0c63eb4ec8164ab7bcdbe454281a78d4. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:11.827552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f3deecb9-99d2-42c6-9d0e-f4630d7919b9 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Getting quotas for user 88252a4aa3bd4a14bd29e2a89cbe0721 and project 0c63eb4ec8164ab7bcdbe454281a78d4. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:11.871069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3deecb9-99d2-42c6-9d0e-f4630d7919b9 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.093718 Aug 24 03:30:11.871933 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 67/138] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 03:30:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:11.887476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-abd41c7d-fac4-41b3-94f7-6a68b6d510af tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Calling method '.version_select at 0x7f1023b52f70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:11.905064 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-abd41c7d-fac4-41b3-94f7-6a68b6d510af tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-945808795?user_id=25786e32c8ce470d8c02e4560dfa8393" status: 200 len: 511 microversion: 2.10 time: 0.018479 Aug 24 03:30:11.915900 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 68/139] 10.222.0.58 () {60 vars in 1337 bytes} [Wed Aug 24 03:30:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-945808795?user_id=25786e32c8ce470d8c02e4560dfa8393 => generated 511 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:11.921360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd1f9a9e-98bb-448c-9ccb-d207d1144b4a tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Action: 'create', calling method: .version_select at 0x7f1023c1e700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-955740033", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfs3idlZZF6+29vOMXUEawuu2/7KAsyJscHfDTYEcVl+MJT/iJQ67x73wuSXzUP4IpPmCI9Sdrxk1ZwnYM7Pl5Rs7Q/EArWzjj3E2kQgGdAeI38nE6I76Ju/nR6+WH8gA=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:11.948400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fd1f9a9e-98bb-448c-9ccb-d207d1144b4a tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Getting quotas for project 0c63eb4ec8164ab7bcdbe454281a78d4. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:11.962886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fd1f9a9e-98bb-448c-9ccb-d207d1144b4a tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Getting quotas for user 88252a4aa3bd4a14bd29e2a89cbe0721 and project 0c63eb4ec8164ab7bcdbe454281a78d4. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:12.007554 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd1f9a9e-98bb-448c-9ccb-d207d1144b4a tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.089767 Aug 24 03:30:12.009406 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 69/140] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 03:30:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:12.018898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.020107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:12.028977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:12.029778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:12.030559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:12.032139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:12.032959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:12.034041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:12.405800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:12.422315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91040777-b27b-4426-96a7-f70dda1ddbf9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.409749 Aug 24 03:30:12.432194 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 70/141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:12 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:12.440749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5b20c34-80e0-47e0-b9bd-96d6231145c3 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Calling method '.version_select at 0x7f1023b52dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.445084 n-d-846470-15 devstack@n-api.service[122536]: WARNING oslo_db.sqlalchemy.utils [None req-d5b20c34-80e0-47e0-b9bd-96d6231145c3 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 03:30:12.453385 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5b20c34-80e0-47e0-b9bd-96d6231145c3 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs?user_id=25786e32c8ce470d8c02e4560dfa8393" status: 200 len: 725 microversion: 2.10 time: 0.026535 Aug 24 03:30:12.454643 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 71/142] 10.222.0.58 () {60 vars in 1259 bytes} [Wed Aug 24 03:30:12 2022] GET /compute/v2.1/os-keypairs?user_id=25786e32c8ce470d8c02e4560dfa8393 => generated 725 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:12.465995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.467021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:12.479934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:12.480438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:12.481129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:12.482229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:12.483114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:12.483928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:12.631843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:12.675029 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a14c8816-9218-4082-9beb-ca1f02127662 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1295 microversion: 2.1 time: 0.215194 Aug 24 03:30:12.678965 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 72/143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:12 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1295 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:12.716124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-19503458-fd06-4511-9120-f4402f3462e3 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Calling method '.version_select at 0x7f1023b524c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.747845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-19503458-fd06-4511-9120-f4402f3462e3 tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-955740033" status: 204 len: 0 microversion: 2.10 time: 0.058319 Aug 24 03:30:12.748673 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 73/144] 10.222.0.58 () {60 vars in 1322 bytes} [Wed Aug 24 03:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-955740033 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:30:12.773026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0660e56b-d35e-4ed3-8e08-597589f8d8cd tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Calling method '.version_select at 0x7f1023afc4c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.876802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0660e56b-d35e-4ed3-8e08-597589f8d8cd tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025341755?user_id=25786e32c8ce470d8c02e4560dfa8393" status: 204 len: 0 microversion: 2.10 time: 0.112897 Aug 24 03:30:12.877567 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 74/145] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025341755?user_id=25786e32c8ce470d8c02e4560dfa8393 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:30:12.900199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.901013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:12.911019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:12.911990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:12.912556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:12.913812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:12.914480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:12.915247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:13.106293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:13.106865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:13.107533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:13.108069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:13.108607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:13.122371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:13.123037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:13.123561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:13.124627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:13.125174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:13.125791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:13.156950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724a8e7ed7645009a19dea05fa5f82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fed55c92e354e3a8b30a9de0e2cf2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:13.158856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:13.172237 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9a602a3-c4a3-482f-93d1-d15746e95998 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 200 len: 1451 microversion: 2.1 time: 0.293586 Aug 24 03:30:13.173050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for user 6d8976135cf9461e8a0eda1658abeec9 and project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:13.186192 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 75/146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:12 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 1451 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:13.191854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f7ee0ec0-302a-4217-835f-bec5c82f5f4a tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] Calling method '.version_select at 0x7f1023afcaf0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:13.202874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:13.211205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:13.218906 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f7ee0ec0-302a-4217-835f-bec5c82f5f4a tempest-KeyPairsV210TestJSON-1024060002 tempest-KeyPairsV210TestJSON-1024060002-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-945808795?user_id=25786e32c8ce470d8c02e4560dfa8393" status: 204 len: 0 microversion: 2.10 time: 0.031468 Aug 24 03:30:13.221688 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 76/147] 10.222.0.58 () {60 vars in 1340 bytes} [Wed Aug 24 03:30:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-945808795?user_id=25786e32c8ce470d8c02e4560dfa8393 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:30:13.234274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-858e696a-3fd0-4e7e-946b-ee497b6070b9 req-1d56582f-cdf2-4fec-a208-158cb1ae8dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e7689b-98e3-43b7-95fe-13da2470a128", "name": "network-vif-deleted", "tag": "63e8bdec-b4cc-4181-877e-cc78876ed9b0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:13.271690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-858e696a-3fd0-4e7e-946b-ee497b6070b9 req-1d56582f-cdf2-4fec-a208-158cb1ae8dda service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:13.273839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-858e696a-3fd0-4e7e-946b-ee497b6070b9 req-1d56582f-cdf2-4fec-a208-158cb1ae8dda service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:13.278056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-858e696a-3fd0-4e7e-946b-ee497b6070b9 req-1d56582f-cdf2-4fec-a208-158cb1ae8dda service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:13.306212 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-858e696a-3fd0-4e7e-946b-ee497b6070b9 req-1d56582f-cdf2-4fec-a208-158cb1ae8dda service nova] Creating event network-vif-deleted:63e8bdec-b4cc-4181-877e-cc78876ed9b0 for instance c6e7689b-98e3-43b7-95fe-13da2470a128 on n-h2-846470-15 Aug 24 03:30:13.319228 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-858e696a-3fd0-4e7e-946b-ee497b6070b9 req-1d56582f-cdf2-4fec-a208-158cb1ae8dda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091461 Aug 24 03:30:13.319879 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 77/148] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:13.339185 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-20d868aa-5799-4d39-a220-92bc82834261 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.215368 Aug 24 03:30:13.351336 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 72/149] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:30:13.364441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72b1772c-6ffc-4e96-8ae3-e71cc1321fb3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:13.368433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72b1772c-6ffc-4e96-8ae3-e71cc1321fb3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:13.446854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:13.447594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:13.458964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72b1772c-6ffc-4e96-8ae3-e71cc1321fb3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:13.463003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:13.468258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:13.478506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:13.479368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:13.479730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72b1772c-6ffc-4e96-8ae3-e71cc1321fb3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:13.480688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:13.481802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:13.481917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72b1772c-6ffc-4e96-8ae3-e71cc1321fb3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:13.483005 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72b1772c-6ffc-4e96-8ae3-e71cc1321fb3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1261 microversion: 2.25 time: 0.126182 Aug 24 03:30:13.489334 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 78/150] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:13 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1261 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:13.704169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:13.705196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:13.714673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:13.716515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:13.720490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:13.725377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:13.726256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:13.729164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:13.800603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:13.822091 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53f8768e-5acf-4b54-b2f8-c3343dc3fb65 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1318 microversion: 2.1 time: 0.376884 Aug 24 03:30:13.823998 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 73/151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:13 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:14.194694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:14.195382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:14.209424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.211950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.213526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:14.214774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:14.215948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.217918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.218700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:14.226873 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3c56ffc9-6c17-40a3-af24-0e2b31d8b50a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1337 microversion: 2.1 time: 0.529078 Aug 24 03:30:14.227701 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 79/152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:13 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1337 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:14.258079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.260011 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] HTTP exception thrown: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Request method failure captured: Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 HTTP/1.1 Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsZ3TrmA229g8pXm4agGZZo8a5iLzigT_1jTA9cvPyhvg0aQAnJeaLbPf_rfWYuA1MmTF_GtGk0_EWmRH2zYPs_VPDSom6PhtpaC7bdLmD9CcjsrIJNSOIvaoKqCf12nIntca0nQ9tocGpuOweEJEu7IsI7QZeH3mvZ6ixM5EPNRIc Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1fed55c92e354e3a8b30a9de0e2cf2ee Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:14.279698 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1fed55c92e354e3a8b30a9de0e2cf2ee Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AggregatesAdminTestJSON-1953818519-project Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 7724a8e7ed7645009a19dea05fa5f82f Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AggregatesAdminTestJSON-1953818519-project Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:14.281163 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'c6e7689b-98e3-43b7-95fe-13da2470a128'} Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:14.281863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:14.283801 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:14.290798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Returning 404 to user: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:14.291840 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-695af04b-f6c0-4b1e-a310-58dad744729a tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 404 len: 111 microversion: 2.1 time: 0.102573 Aug 24 03:30:14.295853 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 74/153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:14 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:14.304837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d6db5e8-71c7-4cb8-ab17-84b58843f6d3 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:14.308387 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:14.308387 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:14.319949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d6db5e8-71c7-4cb8-ab17-84b58843f6d3 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.320788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d6db5e8-71c7-4cb8-ab17-84b58843f6d3 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.321373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d6db5e8-71c7-4cb8-ab17-84b58843f6d3 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:14.514183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:14.516612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:14.540893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.547761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.551014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:14.554840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.558563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.559972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:14.563344 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d6db5e8-71c7-4cb8-ab17-84b58843f6d3 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.263684 Aug 24 03:30:14.585093 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 80/154] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:14.604716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed0510fd-3759-420c-ad75-1f92e4b29020 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:14.606042 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:14.606042 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:14.657932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:14.664049 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed0510fd-3759-420c-ad75-1f92e4b29020 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.076935 Aug 24 03:30:14.668987 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 81/155] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:14 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:14.683243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:14.685050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:14.685469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ebc92f84-2263-4406-ab91-a0bccd498b11 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2018211277"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:14.686921 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89872297-1fff-4ccc-821e-0b5df2167859 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1279 microversion: 2.25 time: 0.180048 Aug 24 03:30:14.688158 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 75/156] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:14 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:14.700595 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:14.700595 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:14.702358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-ebc92f84-2263-4406-ab91-a0bccd498b11 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid 72de83e3-6972-44a7-beca-fffe9fc15c2e for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:14.733379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d02dca38-06b7-4ed7-b8fd-d933089c7c50 req-09a35faf-607f-4dad-83dc-62b1d5cdbc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4", "tag": "58bc2fa4-f5ed-4c39-b48d-4711daf944d9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:14.754523 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ebc92f84-2263-4406-ab91-a0bccd498b11 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077353 Aug 24 03:30:14.755797 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 82/157] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:14.771196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-919d7b9d-080c-447d-ae79-111191437aa6 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:14.780636 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:14.780636 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:14.790828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.796295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d02dca38-06b7-4ed7-b8fd-d933089c7c50 req-09a35faf-607f-4dad-83dc-62b1d5cdbc77 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.802354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-919d7b9d-080c-447d-ae79-111191437aa6 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.802900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d02dca38-06b7-4ed7-b8fd-d933089c7c50 req-09a35faf-607f-4dad-83dc-62b1d5cdbc77 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.803173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-919d7b9d-080c-447d-ae79-111191437aa6 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.804623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-919d7b9d-080c-447d-ae79-111191437aa6 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:14.805345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d02dca38-06b7-4ed7-b8fd-d933089c7c50 req-09a35faf-607f-4dad-83dc-62b1d5cdbc77 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:14.821999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.834549 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d02dca38-06b7-4ed7-b8fd-d933089c7c50 req-09a35faf-607f-4dad-83dc-62b1d5cdbc77 service nova] Creating event network-changed:58bc2fa4-f5ed-4c39-b48d-4711daf944d9 for instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 on n-h2-846470-15 Aug 24 03:30:14.842743 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d02dca38-06b7-4ed7-b8fd-d933089c7c50 req-09a35faf-607f-4dad-83dc-62b1d5cdbc77 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112235 Aug 24 03:30:14.843837 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 76/158] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:14.849760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:14.851232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:14.860030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.861188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.861785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:14.863304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:14.869499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:14.870258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.073970 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-919d7b9d-080c-447d-ae79-111191437aa6 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.310475 Aug 24 03:30:15.074970 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 83/159] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:14 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:15.086380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:15.088032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4886d60b-1200-405f-a61e-356e729e4d1f tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:15.090420 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:15.090420 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:15.100338 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-57cc9a9d-bf92-448f-bc6e-8b35989e2f33 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1468 microversion: 2.1 time: 0.254975 Aug 24 03:30:15.101288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 77/160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:14 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1468 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:15.110105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4886d60b-1200-405f-a61e-356e729e4d1f tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.026935 Aug 24 03:30:15.110745 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 84/161] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:30:15 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:15.132605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-09d0cabb-ef9a-4cc8-bbcc-8328a2446485 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:15.135708 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:15.135708 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:15.146626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d0cabb-ef9a-4cc8-bbcc-8328a2446485 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.147271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d0cabb-ef9a-4cc8-bbcc-8328a2446485 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.147920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d0cabb-ef9a-4cc8-bbcc-8328a2446485 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.322434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-09d0cabb-ef9a-4cc8-bbcc-8328a2446485 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.191707 Aug 24 03:30:15.325147 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 85/162] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:15 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:15.342081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:15.342878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:15.369181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.372448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.375304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.377481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.379838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.379838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.699651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-761697321", "block_migration": true, "disk_over_commit": false}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:15.703971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:15.713056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.713551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.714106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.714806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.715513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.716354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.748962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:15.757140 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4591d123-f243-44d7-87de-b69b11829afe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1315 microversion: 2.1 time: 0.430813 Aug 24 03:30:15.761106 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 86/163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:15 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:15.772326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc2791f8-55b2-4f57-b15b-4fabf1d6797f tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:15.773545 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:15.773545 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:15.820220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc2791f8-55b2-4f57-b15b-4fabf1d6797f tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.057537 Aug 24 03:30:15.821320 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 87/164] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:15 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:15.829869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:15.830846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:15.844566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lazy-loading 'flavor' on Instance uuid 4b52cd68-411a-43f1-8409-db901889da20 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:30:15.847066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.847575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.848031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.848742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:15.849194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:15.849616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:15.979694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:15.990822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:15.992890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:15.994298 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16c97172-efcd-4737-9647-c4976097ef9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1319 microversion: 2.25 time: 0.171779 Aug 24 03:30:15.995046 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 88/165] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:15 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:16.004101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-43299f3e-ad5c-4e3f-98de-09a4f541cda5 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1338421925"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:16.010052 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:16.010052 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:16.011431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-43299f3e-ad5c-4e3f-98de-09a4f541cda5 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid 6b785b18-62ce-41ce-87ab-b9d861bd4f8f for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:16.058352 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-43299f3e-ad5c-4e3f-98de-09a4f541cda5 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062058 Aug 24 03:30:16.059803 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 89/166] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.083833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8af8eca1-f127-4e63-a910-76d8b479aa2d tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:16.090842 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:16.090842 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:16.115594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8af8eca1-f127-4e63-a910-76d8b479aa2d tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.116117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8af8eca1-f127-4e63-a910-76d8b479aa2d tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.116548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8af8eca1-f127-4e63-a910-76d8b479aa2d tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.120164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Going to try to live migrate instance to tempest-host-761697321 {{(pid=122535) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:30:16.132826 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] HTTP exception thrown: Compute host tempest-host-761697321 could not be found. Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Request method failure captured: Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20/action HTTP/1.1 Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 106 Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsm1JaS0SeIBIHtB5UbwVCJsISNkuGNgwLdkdqC_J6FgxA7_ZY1FrKRMkwi81Z9hAEGoSXIqA4ZmcWbEDhLex0XOAS7FfAlsgqJFA99JAKnHY_JVkP-7DtG9Pg9tYUkGDKg-Vriu_VasTOtm9ujP3YJFWb-z8C8IezuIEyK-ZaiHZM Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 03331eb6d122450fa5ea8e8d73e84553 Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-LiveMigrationNegativeTest-1156016911 Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:16.140815 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_03331eb6d122450fa5ea8e8d73e84553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/03331eb6d122450fa5ea8e8d73e84553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/03331eb6d122450fa5ea8e8d73e84553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/03331eb6d122450fa5ea8e8d73e84553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-LiveMigrationNegativeTest-1156016911 Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 03331eb6d122450fa5ea8e8d73e84553 Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1156016911 Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-LiveMigrationNegativeTest-1156016911-project-admin Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 58d3f7cb751e4d119c7237d5bf24c549 Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-LiveMigrationNegativeTest-1156016911-project-admin Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: {"os-migrateLive": {"host": "tempest-host-761697321", "block_migration": true, "disk_over_commit": false}} Aug 24 03:30:16.142405 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: exception: Compute host tempest-host-761697321 could not be found. Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '4b52cd68-411a-43f1-8409-db901889da20', 'body': {'os-migrateLive': {'host': 'tempest-host-761697321', 'block_migration': True, 'disk_over_commit': False}}} Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:30:16.143219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5483, in live_migrate Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-761697321 could not be found. Aug 24 03:30:16.144427 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-761697321 could not be found. Aug 24 03:30:16.145550 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-761697321 could not be found. Aug 24 03:30:16.146775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:16.148403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Returning 400 to user: Compute host tempest-host-761697321 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:16.149450 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d17a784b-8d82-418f-a82e-289568b96be0 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20/action" status: 400 len: 99 microversion: 2.1 time: 1.020753 Aug 24 03:30:16.153751 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 78/167] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 24 03:30:15 2022] POST /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20/action => generated 99 bytes in 1025 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:16.161695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.162610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:16.171191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.172002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.172588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.174043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.174849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.175444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.302020 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8af8eca1-f127-4e63-a910-76d8b479aa2d tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.230124 Aug 24 03:30:16.310641 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 90/168] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:16 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.316525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4439b406-41d6-41c9-b46b-2fe1641df2ee tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.317328 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:16.317328 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:16.329890 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4439b406-41d6-41c9-b46b-2fe1641df2ee tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.017364 Aug 24 03:30:16.330482 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 91/169] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:30:16 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.344295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-742b45a8-19ff-427d-802f-e02800940c62 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:16.347648 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:16.347648 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:16.358985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-742b45a8-19ff-427d-802f-e02800940c62 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.359841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-742b45a8-19ff-427d-802f-e02800940c62 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.360588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-742b45a8-19ff-427d-802f-e02800940c62 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.522865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:16.539601 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4067301-8db8-4edf-85cf-79554b6ad6e9 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1468 microversion: 2.1 time: 0.382957 Aug 24 03:30:16.540947 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 79/170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:16 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1468 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:16.550938 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-742b45a8-19ff-427d-802f-e02800940c62 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.210863 Aug 24 03:30:16.552067 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 92/171] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:16 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.567182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-55fee100-445e-4874-b8b8-cb4b9d88e366 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.568571 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:16.568571 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:16.693675 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-55fee100-445e-4874-b8b8-cb4b9d88e366 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.132170 Aug 24 03:30:16.694475 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 80/172] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:16 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:16.705481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29a17f17-b884-4066-8dcd-bb5d6c137143 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1005632786"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:16.708295 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:16.708295 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:16.711301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-29a17f17-b884-4066-8dcd-bb5d6c137143 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid 4cab3c01-7f2c-47bf-87c7-e3b3e5b640d7 for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:16.740030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1932648822", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:16.751163 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29a17f17-b884-4066-8dcd-bb5d6c137143 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049771 Aug 24 03:30:16.752848 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 93/173] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.765059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-769f48bd-529d-4758-9ee5-9a3aa8672513 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:16.771828 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:16.771828 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:16.787332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-769f48bd-529d-4758-9ee5-9a3aa8672513 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.789878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-769f48bd-529d-4758-9ee5-9a3aa8672513 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.790365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-769f48bd-529d-4758-9ee5-9a3aa8672513 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.849497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:16.959055 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-769f48bd-529d-4758-9ee5-9a3aa8672513 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.198942 Aug 24 03:30:16.966782 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 94/174] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.970604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.971236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:16.978138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.978640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.979064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.979831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.980277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.980702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:17.207329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:17.224195 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0fa11c50-3fb1-4b35-81dc-3647c28f09f6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1315 microversion: 2.1 time: 0.262499 Aug 24 03:30:17.224950 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 95/175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:16 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:17.232512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-57897351-451e-4045-829f-b18f24608175 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:17.235966 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.235966 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:17.245782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57897351-451e-4045-829f-b18f24608175 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:17.246698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57897351-451e-4045-829f-b18f24608175 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:17.247382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57897351-451e-4045-829f-b18f24608175 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:17.276990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:17.277626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:17.278172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:17.279433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:17.279943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:17.303459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:17.304183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:17.304632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:17.305393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:17.305850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:17.309272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:17.365067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Getting quotas for project a8ba1d64bbb64560a57f9d906f0a2de5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:17.374287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Getting quotas for user eb6e87b4ab604c7791e4fe61f7be0bf6 and project a8ba1d64bbb64560a57f9d906f0a2de5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:17.398030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:17.400754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:17.424067 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-57897351-451e-4045-829f-b18f24608175 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.197763 Aug 24 03:30:17.425714 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 96/176] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:17 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:17.431956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.432873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:17.440911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:17.441586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:17.442021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:17.443160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:17.443849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:17.444429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:17.461789 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a72152aa-b070-4b55-ac1f-dd2449cf6ec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726239 Aug 24 03:30:17.462896 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 81/177] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:30:17.467831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec3277b8-bb41-4659-b88e-516d0ca7f154 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.468900 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.468900 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:17.527428 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ec3277b8-bb41-4659-b88e-516d0ca7f154 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.062860 Aug 24 03:30:17.531277 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 82/178] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:17 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:17.546001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7eb473bf-a516-4de5-a28c-23289fdd14ef tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.548046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7eb473bf-a516-4de5-a28c-23289fdd14ef tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:17.613241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7eb473bf-a516-4de5-a28c-23289fdd14ef tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:17.621684 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7eb473bf-a516-4de5-a28c-23289fdd14ef tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1219 microversion: 2.1 time: 0.088386 Aug 24 03:30:17.630595 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 83/179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:17 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:17.635431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d5442af-3606-414d-9574-0f3923298005 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-445860319"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:17.638128 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.638128 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:17.639237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.aggregate [None req-7d5442af-3606-414d-9574-0f3923298005 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid 9fe7b0d2-2826-4a1a-8611-73bf10c6a5fa for aggregate {{(pid=122535) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:17.676854 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d5442af-3606-414d-9574-0f3923298005 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045980 Aug 24 03:30:17.677472 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 84/180] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:17 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:17.688039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a4871e4-8db4-4c3d-abf2-9c6cc08c6f12 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2085780637"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:17.691236 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.691236 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:17.692469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.aggregate [None req-5a4871e4-8db4-4c3d-abf2-9c6cc08c6f12 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid 3d7d4c47-1aed-4ae8-a456-73863fad1445 for aggregate {{(pid=122535) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:17.701773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:17.712439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:17.714689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:17.716198 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-648a1beb-eff0-4286-ab13-8a95baada352 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1361 microversion: 2.25 time: 0.289219 Aug 24 03:30:17.716756 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 97/181] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:17 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:17.725204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a4871e4-8db4-4c3d-abf2-9c6cc08c6f12 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046636 Aug 24 03:30:17.725787 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 85/182] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:17.738150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a987bc6e-ea32-49cb-a52e-6b991c31cadc tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.738476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3de195c7-7ff5-42c1-a3c4-e96b10bf1d1b tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:17.738928 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.738928 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:17.743015 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.743015 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:17.753913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3de195c7-7ff5-42c1-a3c4-e96b10bf1d1b tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:17.754408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3de195c7-7ff5-42c1-a3c4-e96b10bf1d1b tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:17.754854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3de195c7-7ff5-42c1-a3c4-e96b10bf1d1b tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:17.762264 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a987bc6e-ea32-49cb-a52e-6b991c31cadc tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.029663 Aug 24 03:30:17.764002 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 98/183] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:17 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:17.771555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:17.773445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d60865b9-f28f-4746-adaf-37657f126da7 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.774667 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.774667 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:17.784139 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d60865b9-f28f-4746-adaf-37657f126da7 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d60865b9-f28f-4746-adaf-37657f126da7 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Request method failure captured: Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsb7rbhsCSqLsur_qcXD-9itF2XvgseNVtcvqoVHnxtCSaaiH7qOWzlMavgowsZmFP4CdrjHGzfzwJTKq_TkWTsLBwWf84TiLKLtBgPVDbDat3YwOzpkb3hbgQVaqCfKlILYb3ig8co8Mbr97QAwbMtF2HEwHN18KO8wnZuzix72fg Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 97ae83992601497dbe089e13cd9830d5 Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:17.800132 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_97ae83992601497dbe089e13cd9830d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 97ae83992601497dbe089e13cd9830d5 Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminTestJSON-1644037779-project-admin Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0e247f07cde2432a82ecf7e4716ce81a Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminTestJSON-1644037779-project-admin Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: exception: Aggregate 5 could not be found. Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5'} Aug 24 03:30:17.801604 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.802393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 24 03:30:17.803504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.804581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d60865b9-f28f-4746-adaf-37657f126da7 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:17.804581 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d60865b9-f28f-4746-adaf-37657f126da7 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.033714 Aug 24 03:30:17.804581 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 99/184] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:30:17 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:30:17.817932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf2d2b4c-9c3d-4334-a0e6-f41953621d5c tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.818827 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.818827 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:17.841290 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-bf2d2b4c-9c3d-4334-a0e6-f41953621d5c tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf2d2b4c-9c3d-4334-a0e6-f41953621d5c tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Request method failure captured: Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsb7rbhsCSqLsur_qcXD-9itF2XvgseNVtcvqoVHnxtCSaaiH7qOWzlMavgowsZmFP4CdrjHGzfzwJTKq_TkWTsLBwWf84TiLKLtBgPVDbDat3YwOzpkb3hbgQVaqCfKlILYb3ig8co8Mbr97QAwbMtF2HEwHN18KO8wnZuzix72fg Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 97ae83992601497dbe089e13cd9830d5 Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:17.848440 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_97ae83992601497dbe089e13cd9830d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 97ae83992601497dbe089e13cd9830d5 Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminTestJSON-1644037779-project-admin Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0e247f07cde2432a82ecf7e4716ce81a Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminTestJSON-1644037779-project-admin Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: exception: Aggregate 5 could not be found. Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5'} Aug 24 03:30:17.850016 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:17.850869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.852813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:17.854292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:17.854292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:17.854292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:17.854292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 24 03:30:17.854292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.854292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf2d2b4c-9c3d-4334-a0e6-f41953621d5c tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:17.854292 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf2d2b4c-9c3d-4334-a0e6-f41953621d5c tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.039848 Aug 24 03:30:17.858308 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 100/185] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:17 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:30:17.862373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e8c1978f-38ae-47bd-ac99-8c28d1233ab6 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-140202103", "name": "tempest-test_aggregate-1906777610"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:17.866600 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.866600 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:17.867732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-e8c1978f-38ae-47bd-ac99-8c28d1233ab6 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid 47741eac-2793-4f19-ba53-1c41d210b18b for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:17.906617 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e8c1978f-38ae-47bd-ac99-8c28d1233ab6 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.047781 Aug 24 03:30:17.908292 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 101/186] 10.222.0.58 () {60 vars in 1165 bytes} [Wed Aug 24 03:30:17 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:17.926530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3fd6f359-dc2a-401e-a8aa-a527c38155eb tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.927633 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.927633 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:17.965099 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3fd6f359-dc2a-401e-a8aa-a527c38155eb tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.044831 Aug 24 03:30:17.967873 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 102/187] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:17 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:17.973747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:17.989326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b125503e-db1b-4de4-82ef-6ab9e8b1cae1 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.990557 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:17.990557 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:18.000653 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b125503e-db1b-4de4-82ef-6ab9e8b1cae1 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b125503e-db1b-4de4-82ef-6ab9e8b1cae1 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Request method failure captured: Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsb7rbhsCSqLsur_qcXD-9itF2XvgseNVtcvqoVHnxtCSaaiH7qOWzlMavgowsZmFP4CdrjHGzfzwJTKq_TkWTsLBwWf84TiLKLtBgPVDbDat3YwOzpkb3hbgQVaqCfKlILYb3ig8co8Mbr97QAwbMtF2HEwHN18KO8wnZuzix72fg Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 97ae83992601497dbe089e13cd9830d5 Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:18.023220 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_97ae83992601497dbe089e13cd9830d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 97ae83992601497dbe089e13cd9830d5 Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminTestJSON-1644037779-project-admin Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0e247f07cde2432a82ecf7e4716ce81a Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminTestJSON-1644037779-project-admin Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: exception: Aggregate 7 could not be found. Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '7'} Aug 24 03:30:18.024593 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.025290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 24 03:30:18.026329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.028920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b125503e-db1b-4de4-82ef-6ab9e8b1cae1 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:18.028920 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b125503e-db1b-4de4-82ef-6ab9e8b1cae1 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.052896 Aug 24 03:30:18.029269 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 103/188] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:30:17 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:30:18.040387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89ba702e-6df6-4de6-bd5a-e83dc20af308 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:18.041513 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:18.041513 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:18.046806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:18.058895 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-89ba702e-6df6-4de6-bd5a-e83dc20af308 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89ba702e-6df6-4de6-bd5a-e83dc20af308 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Request method failure captured: Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsb7rbhsCSqLsur_qcXD-9itF2XvgseNVtcvqoVHnxtCSaaiH7qOWzlMavgowsZmFP4CdrjHGzfzwJTKq_TkWTsLBwWf84TiLKLtBgPVDbDat3YwOzpkb3hbgQVaqCfKlILYb3ig8co8Mbr97QAwbMtF2HEwHN18KO8wnZuzix72fg Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 97ae83992601497dbe089e13cd9830d5 Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:18.063776 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_97ae83992601497dbe089e13cd9830d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/97ae83992601497dbe089e13cd9830d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 97ae83992601497dbe089e13cd9830d5 Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1644037779 Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminTestJSON-1644037779-project-admin Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0e247f07cde2432a82ecf7e4716ce81a Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminTestJSON-1644037779-project-admin Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: exception: Aggregate 7 could not be found. Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '7'} Aug 24 03:30:18.065601 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:18.066293 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.067285 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:18.068676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:18.068676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:18.068676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:18.068676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 24 03:30:18.068676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.068676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89ba702e-6df6-4de6-bd5a-e83dc20af308 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:18.069834 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-89ba702e-6df6-4de6-bd5a-e83dc20af308 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.033008 Aug 24 03:30:18.070732 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 104/189] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:30:18.089635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9d4f94f-cd61-40db-b339-ced189b7bfa8 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1993013586"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:18.104372 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:18.104372 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:18.106235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-d9d4f94f-cd61-40db-b339-ced189b7bfa8 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid a44bbc1a-c835-4229-b899-9cc5c71d8b17 for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:18.154979 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d9d4f94f-cd61-40db-b339-ced189b7bfa8 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076381 Aug 24 03:30:18.156333 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 105/190] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:18.168830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6628a3cd-a4ff-43c3-8bbd-f3b19b2985d8 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:18.171041 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:18.171041 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:18.196895 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6628a3cd-a4ff-43c3-8bbd-f3b19b2985d8 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.033220 Aug 24 03:30:18.197450 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 106/191] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:30:18 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:18.209402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b5de797-9642-4cf2-8ea2-4d2df5fd44ed tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:18.213674 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:18.213674 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:18.254907 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b5de797-9642-4cf2-8ea2-4d2df5fd44ed tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.049732 Aug 24 03:30:18.258361 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 107/192] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:18 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:18.267951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:18.269600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:18.292646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:18.293598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:18.295437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:18.296443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:18.298502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:18.299598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:18.451154 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3de195c7-7ff5-42c1-a3c4-e96b10bf1d1b tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 243 microversion: 2.1 time: 0.716499 Aug 24 03:30:18.452260 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 86/193] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:17 2022] POST /compute/v2.1/os-aggregates/6/action => generated 243 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:18.464909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15f086d5-5e96-4112-989e-e34e179c9e10 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:18.466050 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:18.466050 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:18.486407 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15f086d5-5e96-4112-989e-e34e179c9e10 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.032702 Aug 24 03:30:18.492690 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 87/194] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:30:18 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:18.525438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4aedca1-e98b-452f-a40b-2e0dac4c5294 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:18.536015 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:18.536015 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:18.557378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aedca1-e98b-452f-a40b-2e0dac4c5294 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:18.558118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aedca1-e98b-452f-a40b-2e0dac4c5294 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:18.558813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aedca1-e98b-452f-a40b-2e0dac4c5294 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:18.602050 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f4aedca1-e98b-452f-a40b-2e0dac4c5294 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-846470-15. Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4aedca1-e98b-452f-a40b-2e0dac4c5294 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Request method failure captured: Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 40 Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsftBZsFYckGp2S59pM_ZziDAvdnzTTbseZQSFZYdkFRIseimbM2wGFZ8YF-1g7zCYjjhOZ4Iwi11j7mc5LheTdaWx4BC-5Y_bEJ9l6icZbWXDq-pNWLAmCqDzxdHZuxRUbQvT1lRQDbAmSsec1ona0WgV82tgdkSMlGpRoMpd2CL8 Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:18.635307 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c16c4d0ea8704538b7fe3307a84f492e Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: {"add_host": {"host": "n-h2-846470-15"}} Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:18.636627 n-d-846470-15 devstack@n-api.service[122535]: exception: Aggregate 6 already has host n-h2-846470-15. Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-846470-15'}}} Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result.read() Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:30:18.637405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-846470-15-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:30:18.638717 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:30:18.640631 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:30:18.642751 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result.read() Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-846470-15-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 3, 30, 18, 584547), 'updated_at': None, 'host': 'n-h2-846470-15', 'aggregate_id': 6}] Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.645363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in add_host_to_aggregate Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-846470-15. Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.647114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-846470-15. Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:18.649924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:18.652608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-846470-15. Aug 24 03:30:18.652608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:18.652608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4aedca1-e98b-452f-a40b-2e0dac4c5294 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-846470-15. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:18.652608 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4aedca1-e98b-452f-a40b-2e0dac4c5294 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 96 microversion: 2.1 time: 0.135782 Aug 24 03:30:18.652608 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 88/195] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:18 2022] POST /compute/v2.1/os-aggregates/6/action => generated 96 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 24 03:30:18.661982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18a777b9-2329-4ca2-a9b5-3caa1ca24204 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:18.661982 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:18.661982 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:18.685767 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-18a777b9-2329-4ca2-a9b5-3caa1ca24204 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.042078 Aug 24 03:30:18.691186 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 89/196] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:18 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:18.699027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:18.708540 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f4563b8-dcc2-43e3-b8b2-e5a44f9376e4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1315 microversion: 2.1 time: 0.448717 Aug 24 03:30:18.709959 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 108/197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:18 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:18.727100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:18.731127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:18.739945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:18.740445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:18.740884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:18.741755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:18.742220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:18.742651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:18.839781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:18.852408 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb9b4435-f80a-419a-9ba5-48093f3d372e tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1271 microversion: 2.1 time: 0.138709 Aug 24 03:30:18.866096 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 109/198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:18 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:18.866096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b21c195-373f-49fe-8d7b-1306b5924931 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:18.866096 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:18.866096 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:18.874029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b21c195-373f-49fe-8d7b-1306b5924931 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:18.875304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b21c195-373f-49fe-8d7b-1306b5924931 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:18.875790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b21c195-373f-49fe-8d7b-1306b5924931 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.010227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e1742190-1e89-4067-aa09-3b559bc05576 tempest-NetworksTest-442455853 tempest-NetworksTest-442455853-project-admin] Calling method '.version_select at 0x7f103012e940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.037861 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b21c195-373f-49fe-8d7b-1306b5924931 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.182351 Aug 24 03:30:19.038397 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 110/199] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 24 03:30:18 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.050541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0408b014-f4bc-420d-9647-402254bbb5f2 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-124384852", "availability_zone": "tempest-test_az-57617129"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:19.053485 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.053485 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:19.054492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-0408b014-f4bc-420d-9647-402254bbb5f2 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid 095eeb22-a255-4257-bc35-12d6a390db17 for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:19.093446 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0408b014-f4bc-420d-9647-402254bbb5f2 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.047355 Aug 24 03:30:19.094451 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 111/200] 10.222.0.58 () {60 vars in 1165 bytes} [Wed Aug 24 03:30:19 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.105302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.106499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:19.115835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.116595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.117082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.117921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.118369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.118853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.280350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:19.289692 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e1742190-1e89-4067-aa09-3b559bc05576 tempest-NetworksTest-442455853 tempest-NetworksTest-442455853-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 3322 microversion: 2.1 time: 0.600860 Aug 24 03:30:19.291278 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 90/201] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:30:18 2022] GET /compute/v2.1/os-networks => generated 3322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:19.292467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:19.295252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:19.296073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0024a829-96dd-4c6e-82bb-767665efcb34 req-b5bf48da-c763-4059-b594-e2796fda24ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b47212e-05a1-45a2-9cb6-0cc6b445ada0", "tag": "9cdcacd1-2971-4051-893c-f6ada06261b9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:19.296449 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c2adb85-91b5-42ae-91f0-e2999fa5819a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1361 microversion: 2.25 time: 0.199993 Aug 24 03:30:19.304710 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 112/202] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:19.309844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6469612e-5a0b-4754-ad63-f38d9a5451d5 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.310735 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.310735 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:19.318453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0024a829-96dd-4c6e-82bb-767665efcb34 req-b5bf48da-c763-4059-b594-e2796fda24ff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.319197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0024a829-96dd-4c6e-82bb-767665efcb34 req-b5bf48da-c763-4059-b594-e2796fda24ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.319945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0024a829-96dd-4c6e-82bb-767665efcb34 req-b5bf48da-c763-4059-b594-e2796fda24ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.337447 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0024a829-96dd-4c6e-82bb-767665efcb34 req-b5bf48da-c763-4059-b594-e2796fda24ff service nova] Creating event network-changed:9cdcacd1-2971-4051-893c-f6ada06261b9 for instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 on n-h2-846470-15 Aug 24 03:30:19.339170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6469612e-5a0b-4754-ad63-f38d9a5451d5 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.033009 Aug 24 03:30:19.339783 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 113/203] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:19 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:19.345469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-749aeeb3-bd9f-46a3-96fd-8fdf91abb2ab tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-124384852_new", "availability_zone": "tempest-test_az-57617129_new"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:19.346500 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0024a829-96dd-4c6e-82bb-767665efcb34 req-b5bf48da-c763-4059-b594-e2796fda24ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053923 Aug 24 03:30:19.347096 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 91/204] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.352237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2db32a5-0625-49e7-8d19-ac391e607d07 tempest-NetworksTest-442455853 tempest-NetworksTest-442455853-project-admin] Calling method '.version_select at 0x7f103012e790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.574594 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.574594 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:19.597814 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2db32a5-0625-49e7-8d19-ac391e607d07 tempest-NetworksTest-442455853 tempest-NetworksTest-442455853-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks/675efafd-0e2c-48c3-ab9a-d342ba711621" status: 200 len: 652 microversion: 2.1 time: 0.249255 Aug 24 03:30:19.598403 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 92/205] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-networks/675efafd-0e2c-48c3-ab9a-d342ba711621 => generated 652 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.603361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74e57671-5b0c-4da8-a9ca-319e30f86e18 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-595792393"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:19.606341 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.606341 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:19.607413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.aggregate [None req-74e57671-5b0c-4da8-a9ca-319e30f86e18 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid e00d6c69-5601-4a0b-8cda-9099d279bc19 for aggregate {{(pid=122535) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:19.611249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-749aeeb3-bd9f-46a3-96fd-8fdf91abb2ab tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.611958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-749aeeb3-bd9f-46a3-96fd-8fdf91abb2ab tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.612711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-749aeeb3-bd9f-46a3-96fd-8fdf91abb2ab tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.633767 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74e57671-5b0c-4da8-a9ca-319e30f86e18 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034288 Aug 24 03:30:19.634757 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 93/206] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.639367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc29feaa-4e38-49e9-93d1-c3a0c817f2c6 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Calling method '.version_select at 0x7f103013c1f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.642088 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.642088 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:19.643593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc29feaa-4e38-49e9-93d1-c3a0c817f2c6 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.644198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc29feaa-4e38-49e9-93d1-c3a0c817f2c6 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.644691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc29feaa-4e38-49e9-93d1-c3a0c817f2c6 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.645477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc29feaa-4e38-49e9-93d1-c3a0c817f2c6 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.645999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc29feaa-4e38-49e9-93d1-c3a0c817f2c6 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.646514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc29feaa-4e38-49e9-93d1-c3a0c817f2c6 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.671044 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-749aeeb3-bd9f-46a3-96fd-8fdf91abb2ab tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 331 microversion: 2.1 time: 0.329751 Aug 24 03:30:19.671712 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 114/207] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:30:19 2022] PUT /compute/v2.1/os-aggregates/9 => generated 331 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.672497 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bc29feaa-4e38-49e9-93d1-c3a0c817f2c6 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.036490 Aug 24 03:30:19.673450 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 94/208] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.683761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-616ccaf0-862b-4f25-b35c-a237ffcffe6e tempest-NetworksTest-442455853 tempest-NetworksTest-442455853-project-admin] Calling method '.version_select at 0x7f1023aecdc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.807043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16552a28-395c-4080-9a35-fa2bbb708a08 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:19.809716 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.809716 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:19.810731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16552a28-395c-4080-9a35-fa2bbb708a08 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '5ff2e2e1e9664602a026dcf7c01a1a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6959ddd5ceb45efb2bda0fea49a898c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:19.811081 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-616ccaf0-862b-4f25-b35c-a237ffcffe6e tempest-NetworksTest-442455853 tempest-NetworksTest-442455853-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 3322 microversion: 2.1 time: 0.138178 Aug 24 03:30:19.811909 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 115/209] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-networks => generated 3322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16552a28-395c-4080-9a35-fa2bbb708a08 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Request method failure captured: Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 40 Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsce0Y6rWcpgGz3syG3urg0GSTgrTPNqoHWPfN3katuYGKHOBwAn4e0AMPUjjHUOZATeLTJs8OIg9fEMwNp9BOsS58RaVV8YZY0CrUCX5qk4UNZ6pJJeZqFsn47gw9IxfUI2aCXQj4P1hyEdhpM53W8yLdz2wekz1tNsl5W1FMfPi0 Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:19.812909 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5ff2e2e1e9664602a026dcf7c01a1a82 Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: {"add_host": {"host": "n-h2-846470-15"}} Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:19.814512 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-846470-15'}}} Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:19.815309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 03:30:19.816774 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:19.819968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16552a28-395c-4080-9a35-fa2bbb708a08 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:19.821017 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16552a28-395c-4080-9a35-fa2bbb708a08 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.146500 Aug 24 03:30:19.821133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-506173c9-cdb5-4827-b01b-fd27a25f87dd tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.821817 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.821817 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:19.822560 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 95/210] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 03:30:19 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 148 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:19.828916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61e95c9c-43a9-4859-a8b1-cd8610f0c99c tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Calling method '.version_select at 0x7f103013c3a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.831912 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.831912 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:19.833147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61e95c9c-43a9-4859-a8b1-cd8610f0c99c tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.833450 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-506173c9-cdb5-4827-b01b-fd27a25f87dd tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 548 microversion: 2.1 time: 0.020121 Aug 24 03:30:19.833747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61e95c9c-43a9-4859-a8b1-cd8610f0c99c tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.834258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61e95c9c-43a9-4859-a8b1-cd8610f0c99c tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.835007 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 116/211] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-aggregates => generated 548 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.835125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61e95c9c-43a9-4859-a8b1-cd8610f0c99c tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.835535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61e95c9c-43a9-4859-a8b1-cd8610f0c99c tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.836650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61e95c9c-43a9-4859-a8b1-cd8610f0c99c tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.840735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.841790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:19.849923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.850676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.851188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.852000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.852527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.853255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.866373 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-61e95c9c-43a9-4859-a8b1-cd8610f0c99c tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.042283 Aug 24 03:30:19.868959 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 96/212] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.876642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-274e8f3b-7f69-4863-b126-f62896f53916 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.877781 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.877781 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:19.911023 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-274e8f3b-7f69-4863-b126-f62896f53916 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.040503 Aug 24 03:30:19.911988 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 97/213] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:19 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:19.925731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff413428-3aa2-41f6-b21e-d5759c55e910 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.927155 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:19.927155 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:19.964469 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff413428-3aa2-41f6-b21e-d5759c55e910 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.044247 Aug 24 03:30:19.965141 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 98/214] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:19 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:19.974831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.977117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:19.985974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.988420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.989371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.990226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.990756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.992319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.042193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:20.055852 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9594c72e-2127-47b4-940f-b3565cb04f77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1315 microversion: 2.1 time: 0.215095 Aug 24 03:30:20.056932 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 117/215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:20.061954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f323ab6-e1c9-40b1-bcc3-1a2763d04694 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Calling method '.version_select at 0x7f1023ab8a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.081245 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.081245 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.082837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f323ab6-e1c9-40b1-bcc3-1a2763d04694 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.083497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f323ab6-e1c9-40b1-bcc3-1a2763d04694 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.084212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f323ab6-e1c9-40b1-bcc3-1a2763d04694 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.085364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f323ab6-e1c9-40b1-bcc3-1a2763d04694 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.086446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f323ab6-e1c9-40b1-bcc3-1a2763d04694 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.087083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f323ab6-e1c9-40b1-bcc3-1a2763d04694 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.115757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:20.134499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4614028-b552-4e9c-9d0f-d5103ef4ec54 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1277 microversion: 2.1 time: 0.168188 Aug 24 03:30:20.135958 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f323ab6-e1c9-40b1-bcc3-1a2763d04694 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.077680 Aug 24 03:30:20.136636 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 99/216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:20.142709 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 118/217] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.151561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-56a21f1a-ae9a-4203-922a-bacc229712e3 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-182424995"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.151844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6d38052-7efe-4b8a-ab16-e26490498725 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-237437199"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.154212 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.154212 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.154591 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.154591 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:20.155206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-56a21f1a-ae9a-4203-922a-bacc229712e3 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Generated uuid 775f34a0-0830-4c58-ab61-94c587f7199f for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:20.155486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.aggregate [None req-d6d38052-7efe-4b8a-ab16-e26490498725 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid 7d9b9a6a-82a2-4e56-b5d2-9c36c405c077 for aggregate {{(pid=122535) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:20.191389 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-56a21f1a-ae9a-4203-922a-bacc229712e3 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.046616 Aug 24 03:30:20.195659 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6d38052-7efe-4b8a-ab16-e26490498725 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054629 Aug 24 03:30:20.201159 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 119/218] 10.222.0.58 () {62 vars in 1205 bytes} [Wed Aug 24 03:30:20 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:20.203055 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 100/219] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.207157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b4c2ba32-a999-464d-a0c5-7c0e6b79b7f8 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-165160868"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.209332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47e12d67-fc70-4529-9b38-20c6d219971f tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Calling method '.version_select at 0x7f103013c430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.210542 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.210542 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:20.216309 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.216309 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.217357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-b4c2ba32-a999-464d-a0c5-7c0e6b79b7f8 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Generated uuid ee46de59-31a2-4d74-88f4-4e2152f6162c for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:20.218217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47e12d67-fc70-4529-9b38-20c6d219971f tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.218948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47e12d67-fc70-4529-9b38-20c6d219971f tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.219543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47e12d67-fc70-4529-9b38-20c6d219971f tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.235509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47e12d67-fc70-4529-9b38-20c6d219971f tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.236453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47e12d67-fc70-4529-9b38-20c6d219971f tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.237053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47e12d67-fc70-4529-9b38-20c6d219971f tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.260964 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b4c2ba32-a999-464d-a0c5-7c0e6b79b7f8 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058453 Aug 24 03:30:20.262029 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 120/220] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.271088 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47e12d67-fc70-4529-9b38-20c6d219971f tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h2-846470-15" status: 200 len: 603 microversion: 2.1 time: 0.066494 Aug 24 03:30:20.271710 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 101/221] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-hosts/n-h2-846470-15 => generated 603 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.273693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d24efee-b196-48fe-989c-de6070ef91ae tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1117482827"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.276766 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.276766 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.282802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1356858132"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.288599 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.288599 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:20.309872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.310375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.310816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.324587 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d24efee-b196-48fe-989c-de6070ef91ae tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.056477 Aug 24 03:30:20.325450 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 121/222] 10.222.0.58 () {62 vars in 1213 bytes} [Wed Aug 24 03:30:20 2022] PUT /compute/v2.1/os-aggregates/11 => generated 300 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:20.336900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.337359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.338480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20b38d40-592c-4c4a-8c10-6c4ca72670d9 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.340292 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.340292 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.343888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.351778 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20b38d40-592c-4c4a-8c10-6c4ca72670d9 tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 683 microversion: 2.1 time: 0.025105 Aug 24 03:30:20.352578 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 122/223] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-aggregates => generated 683 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.358136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba74e8be-75b1-48b5-8a01-fd8feff9ec38 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Calling method '.version_select at 0x7f1023ab85e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.359180 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.359180 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.362950 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1356858132 could not be found. Aug 24 03:30:20.367748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba74e8be-75b1-48b5-8a01-fd8feff9ec38 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.368434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba74e8be-75b1-48b5-8a01-fd8feff9ec38 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.369660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba74e8be-75b1-48b5-8a01-fd8feff9ec38 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Request method failure captured: Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 58 Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsftBZsFYckGp2S59pM_ZziDAvdnzTTbseZQSFZYdkFRIseimbM2wGFZ8YF-1g7zCYjjhOZ4Iwi11j7mc5LheTdaWx4BC-5Y_bEJ9l6icZbWXDq-pNWLAmCqDzxdHZuxRUbQvT1lRQDbAmSsec1ona0WgV82tgdkSMlGpRoMpd2CL8 Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:20.375471 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c16c4d0ea8704538b7fe3307a84f492e Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: {"add_host": {"host": "tempest-nonexist_host-1356858132"}} Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:20.377255 n-d-846470-15 devstack@n-api.service[122535]: exception: Compute host tempest-nonexist_host-1356858132 could not be found. Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-1356858132'}}} Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1356858132' is not mapped to any cell Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.377948 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6616, in add_host_to_aggregate Aug 24 03:30:20.379461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1356858132 could not be found. Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1356858132 could not be found. Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.380769 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1356858132 could not be found. Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1356858132 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bc6de823-3d29-4ff9-82ae-f71e5ff35ebf tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.104667 Aug 24 03:30:20.382471 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 102/224] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 03:30:20 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:20.398040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba74e8be-75b1-48b5-8a01-fd8feff9ec38 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.399180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba74e8be-75b1-48b5-8a01-fd8feff9ec38 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.399942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba74e8be-75b1-48b5-8a01-fd8feff9ec38 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.401259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.401882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:20.410552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.411051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.411681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.412547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.413009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.413434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.441737 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba74e8be-75b1-48b5-8a01-fd8feff9ec38 tempest-HostsAdminTestJSON-351958781 tempest-HostsAdminTestJSON-351958781-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h1-846470-15" status: 200 len: 471 microversion: 2.1 time: 0.087470 Aug 24 03:30:20.442622 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 123/225] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-hosts/n-h1-846470-15 => generated 471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.448313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4bf242eb-eb0b-4e4e-a871-81d3ae02aafc tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.449573 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.449573 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.466072 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4bf242eb-eb0b-4e4e-a871-81d3ae02aafc tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.021314 Aug 24 03:30:20.466988 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 124/226] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-aggregates/11 => generated 300 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:20.474406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2d79ac68-3095-4f62-9b41-14fe0a7073be tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.475235 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.475235 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.521191 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2d79ac68-3095-4f62-9b41-14fe0a7073be tempest-AggregatesAdminTestJSON-1644037779 tempest-AggregatesAdminTestJSON-1644037779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.052953 Aug 24 03:30:20.522295 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 125/227] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:20 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:20.535522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6f00743-f823-4828-9a80-3389dee1528a tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.536592 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.536592 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.569635 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6f00743-f823-4828-9a80-3389dee1528a tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.043926 Aug 24 03:30:20.570997 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 126/228] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:20 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:20.580451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a1c62377-4454-431c-b574-a7020f5c0efd tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.585284 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.585284 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:20.595999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:UPDATE=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:20.604445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1c62377-4454-431c-b574-a7020f5c0efd tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.605449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1c62377-4454-431c-b574-a7020f5c0efd tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.606123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1c62377-4454-431c-b574-a7020f5c0efd tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.665546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:20.688062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:20.697920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:20.702299 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7e836623-f357-4dd1-a765-dd597dd17dcd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1361 microversion: 2.25 time: 0.311568 Aug 24 03:30:20.702741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 103/229] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1361 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:20.711220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.712061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:20.732470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.733223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.734947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.737232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.737869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.738543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.771220 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] HTTP exception thrown: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Request method failure captured: Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 HTTP/1.1 Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsZ3TrmA229g8pXm4agGZZo8a5iLzigT_1jTA9cvPyhvg0aQAnJeaLbPf_rfWYuA1MmTF_GtGk0_EWmRH2zYPs_VPDSom6PhtpaC7bdLmD9CcjsrIJNSOIvaoKqCf12nIntca0nQ9tocGpuOweEJEu7IsI7QZeH3mvZ6ixM5EPNRIc Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1fed55c92e354e3a8b30a9de0e2cf2ee Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:20.772852 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1fed55c92e354e3a8b30a9de0e2cf2ee Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AggregatesAdminTestJSON-1953818519-project Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 7724a8e7ed7645009a19dea05fa5f82f Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AggregatesAdminTestJSON-1953818519-project Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.774242 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'c6e7689b-98e3-43b7-95fe-13da2470a128'} Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:20.774985 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.776077 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.784407 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a1c62377-4454-431c-b574-a7020f5c0efd tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 316 microversion: 2.41 time: 0.211792 Aug 24 03:30:20.785066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Returning 404 to user: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:20.785810 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 127/230] 10.222.0.58 () {62 vars in 1235 bytes} [Wed Aug 24 03:30:20 2022] POST /compute/v2.1/os-aggregates/11/action => generated 316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:20.786372 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b85a9d89-77dd-483d-9be7-86d1c78b4403 tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 404 len: 111 microversion: 2.1 time: 0.081696 Aug 24 03:30:20.789288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 104/231] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:30:20 2022] DELETE /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:20.796181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66f515cc-c26a-48c2-ac04-5adf5bf4ca29 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.803639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5be2434a-1288-4d7b-80ac-d93bbb7c9735 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.807987 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:20.807987 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66f515cc-c26a-48c2-ac04-5adf5bf4ca29 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Request method failure captured: Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 283 Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsftBZsFYckGp2S59pM_ZziDAvdnzTTbseZQSFZYdkFRIseimbM2wGFZ8YF-1g7zCYjjhOZ4Iwi11j7mc5LheTdaWx4BC-5Y_bEJ9l6icZbWXDq-pNWLAmCqDzxdHZuxRUbQvT1lRQDbAmSsec1ona0WgV82tgdkSMlGpRoMpd2CL8 Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:20.817057 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c16c4d0ea8704538b7fe3307a84f492e Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:20.819336 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:30:20.820078 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:20.820993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.824554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.825632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:30:20.825632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:30:20.825632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:30:20.825632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.825632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66f515cc-c26a-48c2-ac04-5adf5bf4ca29 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:20.826039 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66f515cc-c26a-48c2-ac04-5adf5bf4ca29 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031951 Aug 24 03:30:20.826039 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 128/232] 10.222.0.58 () {60 vars in 1165 bytes} [Wed Aug 24 03:30:20 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:30:20.831319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be2434a-1288-4d7b-80ac-d93bbb7c9735 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.832343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be2434a-1288-4d7b-80ac-d93bbb7c9735 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.833048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be2434a-1288-4d7b-80ac-d93bbb7c9735 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.837953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.847174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] [instance: c6e7689b-98e3-43b7-95fe-13da2470a128] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:20.882407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.892813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.893432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.894261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:20.894651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:20.895085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:20.947063 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] HTTP exception thrown: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Request method failure captured: Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 HTTP/1.1 Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsZ3TrmA229g8pXm4agGZZo8a5iLzigT_1jTA9cvPyhvg0aQAnJeaLbPf_rfWYuA1MmTF_GtGk0_EWmRH2zYPs_VPDSom6PhtpaC7bdLmD9CcjsrIJNSOIvaoKqCf12nIntca0nQ9tocGpuOweEJEu7IsI7QZeH3mvZ6ixM5EPNRIc Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 1fed55c92e354e3a8b30a9de0e2cf2ee Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:20.951712 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1fed55c92e354e3a8b30a9de0e2cf2ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 1fed55c92e354e3a8b30a9de0e2cf2ee Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1953818519 Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminTestJSON-1953818519-project Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 7724a8e7ed7645009a19dea05fa5f82f Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminTestJSON-1953818519-project Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.953206 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c6e7689b-98e3-43b7-95fe-13da2470a128'} Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:20.954165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. Aug 24 03:30:20.955332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.958038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] Returning 404 to user: Instance c6e7689b-98e3-43b7-95fe-13da2470a128 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:20.961931 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b2d01079-c938-400e-87b7-a9919849445b tempest-AggregatesAdminTestJSON-1953818519 tempest-AggregatesAdminTestJSON-1953818519-project] 10.222.0.58 "GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128" status: 404 len: 111 microversion: 2.1 time: 0.140985 Aug 24 03:30:20.965223 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 129/233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/servers/c6e7689b-98e3-43b7-95fe-13da2470a128 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:20.978003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1474e7e7-91c7-40fb-b079-e11d35e80114 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1474e7e7-91c7-40fb-b079-e11d35e80114 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Request method failure captured: Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 27 Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsftBZsFYckGp2S59pM_ZziDAvdnzTTbseZQSFZYdkFRIseimbM2wGFZ8YF-1g7zCYjjhOZ4Iwi11j7mc5LheTdaWx4BC-5Y_bEJ9l6icZbWXDq-pNWLAmCqDzxdHZuxRUbQvT1lRQDbAmSsec1ona0WgV82tgdkSMlGpRoMpd2CL8 Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:20.995567 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c16c4d0ea8704538b7fe3307a84f492e Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: {"aggregate": {"name": ""}} Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:20.997075 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi '' Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:20.997954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:30:20.999428 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.000727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1474e7e7-91c7-40fb-b079-e11d35e80114 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:21.007074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1474e7e7-91c7-40fb-b079-e11d35e80114 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.036798 Aug 24 03:30:21.008266 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 130/234] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:20 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:30:21.031969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9105182a-8564-4992-8b26-749705b65452 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-182044920"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:21.051457 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:21.051457 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:21.053147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9105182a-8564-4992-8b26-749705b65452 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '5ff2e2e1e9664602a026dcf7c01a1a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6959ddd5ceb45efb2bda0fea49a898c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:21.062423 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5be2434a-1288-4d7b-80ac-d93bbb7c9735 tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 300 microversion: 2.41 time: 0.267770 Aug 24 03:30:21.073597 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 105/235] 10.222.0.58 () {62 vars in 1235 bytes} [Wed Aug 24 03:30:20 2022] POST /compute/v2.1/os-aggregates/11/action => generated 300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9105182a-8564-4992-8b26-749705b65452 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Request method failure captured: Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 59 Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsce0Y6rWcpgGz3syG3urg0GSTgrTPNqoHWPfN3katuYGKHOBwAn4e0AMPUjjHUOZATeLTJs8OIg9fEMwNp9BOsS58RaVV8YZY0CrUCX5qk4UNZ6pJJeZqFsn47gw9IxfUI2aCXQj4P1hyEdhpM53W8yLdz2wekz1tNsl5W1FMfPi0 Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:21.075697 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5ff2e2e1e9664602a026dcf7c01a1a82 Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: {"aggregate": {"name": "tempest-test_aggregate-182044920"}} Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:21.077102 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-182044920'}}} Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:21.077918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:21.079222 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 03:30:21.080573 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.085347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9105182a-8564-4992-8b26-749705b65452 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:21.088917 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9105182a-8564-4992-8b26-749705b65452 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.068400 Aug 24 03:30:21.093876 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 131/236] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:21 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:21.107739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c68f62da-80c3-47fb-9805-7b44d1942d3c tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.108843 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:21.108843 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:21.121067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.123254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:21.152687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:21.154975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:21.155744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:21.156836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:21.157750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:21.158487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:21.185944 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c68f62da-80c3-47fb-9805-7b44d1942d3c tempest-AggregatesAdminTestV241-239416268 tempest-AggregatesAdminTestV241-239416268-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.103225 Aug 24 03:30:21.187050 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 106/237] 10.222.0.58 () {60 vars in 1196 bytes} [Wed Aug 24 03:30:21 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:21.200766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-677e55e4-9a00-45da-8652-70eb7284d7a8 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1731793682"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:21.209173 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:21.209173 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:21.215094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.aggregate [None req-677e55e4-9a00-45da-8652-70eb7284d7a8 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid 77febe80-f8d1-489e-aefe-e5fba4f5810f for aggregate {{(pid=122535) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:21.264497 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-677e55e4-9a00-45da-8652-70eb7284d7a8 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.076034 Aug 24 03:30:21.267037 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 107/238] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:21.277503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.281568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:21.300876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:21.301517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:21.303387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:21.309192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:21.313141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:21.318185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:21.749488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:21.762416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5067c789-671e-4de6-b2b2-4a411a48a633 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1319 microversion: 2.1 time: 0.490735 Aug 24 03:30:21.783764 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 108/239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:21 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:21.790020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f49bcfba-77ea-4f87-95d9-192e504e34f2 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1731793682"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:21.792646 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:21.792646 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:21.793906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.aggregate [None req-f49bcfba-77ea-4f87-95d9-192e504e34f2 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid e09becbd-df91-4e42-8261-a7e319423fb2 for aggregate {{(pid=122535) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:21.796183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:21.805046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-49a95155-e9a0-489c-88c1-7786e10c9a6a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1315 microversion: 2.1 time: 0.699657 Aug 24 03:30:21.821190 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f49bcfba-77ea-4f87-95d9-192e504e34f2 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1731793682 already exists. Aug 24 03:30:21.822832 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 132/240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:21 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f49bcfba-77ea-4f87-95d9-192e504e34f2 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Request method failure captured: Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 60 Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsftBZsFYckGp2S59pM_ZziDAvdnzTTbseZQSFZYdkFRIseimbM2wGFZ8YF-1g7zCYjjhOZ4Iwi11j7mc5LheTdaWx4BC-5Y_bEJ9l6icZbWXDq-pNWLAmCqDzxdHZuxRUbQvT1lRQDbAmSsec1ona0WgV82tgdkSMlGpRoMpd2CL8 Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:21.823297 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c16c4d0ea8704538b7fe3307a84f492e Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: {"aggregate": {"name": "tempest-test_aggregate-1731793682"}} Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:21.824674 n-d-846470-15 devstack@n-api.service[122535]: exception: Aggregate tempest-test_aggregate-1731793682 already exists. Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1731793682'}}} Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6453, in create_aggregate Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 24 03:30:21.825394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1731793682 already exists. Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:21.826466 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1731793682 already exists. Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1731793682 already exists. Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f49bcfba-77ea-4f87-95d9-192e504e34f2 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1731793682 already exists. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:21.827523 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f49bcfba-77ea-4f87-95d9-192e504e34f2 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.039208 Aug 24 03:30:21.828432 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 109/241] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:21 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:30:21.834366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-884bd66c-4a68-41cb-881c-f26b23f599c0 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.835293 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:21.835293 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:21.835479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.849285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:21.863507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:21.864048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:21.864495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:21.865215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:21.865672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:21.866102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:21.870346 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-884bd66c-4a68-41cb-881c-f26b23f599c0 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.039772 Aug 24 03:30:21.875938 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 133/242] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:21 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:21.884776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8386ff57-20f8-4711-a3b5-61c9a9816c85 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1881098756"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:21.888022 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:21.888022 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:21.889221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-8386ff57-20f8-4711-a3b5-61c9a9816c85 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid e44df69b-9514-43fa-b37d-ccc3f7bd9164 for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:21.919971 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8386ff57-20f8-4711-a3b5-61c9a9816c85 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039953 Aug 24 03:30:21.921863 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 134/243] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:21.935332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c30b3c4f-f9ce-4ecc-aa8e-e64e86cadd5b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.936150 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:21.936150 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:21.937051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c30b3c4f-f9ce-4ecc-aa8e-e64e86cadd5b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '5ff2e2e1e9664602a026dcf7c01a1a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6959ddd5ceb45efb2bda0fea49a898c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c30b3c4f-f9ce-4ecc-aa8e-e64e86cadd5b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Request method failure captured: Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsce0Y6rWcpgGz3syG3urg0GSTgrTPNqoHWPfN3katuYGKHOBwAn4e0AMPUjjHUOZATeLTJs8OIg9fEMwNp9BOsS58RaVV8YZY0CrUCX5qk4UNZ6pJJeZqFsn47gw9IxfUI2aCXQj4P1hyEdhpM53W8yLdz2wekz1tNsl5W1FMfPi0 Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:21.938755 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5ff2e2e1e9664602a026dcf7c01a1a82 Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 03:30:21.940057 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '15'} Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:21.940745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:21.941850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c30b3c4f-f9ce-4ecc-aa8e-e64e86cadd5b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:21.942801 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c30b3c4f-f9ce-4ecc-aa8e-e64e86cadd5b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.010938 Aug 24 03:30:21.945056 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 135/244] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:21 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:21.950304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca32cdd1-ce22-407a-9891-24e06bc9fea8 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.994857 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca32cdd1-ce22-407a-9891-24e06bc9fea8 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.048619 Aug 24 03:30:21.995980 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 136/245] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:21 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:22.008409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1518b12-8e3b-4012-8050-c107adab9961 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.010127 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.010127 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.025353 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b1518b12-8e3b-4012-8050-c107adab9961 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1518b12-8e3b-4012-8050-c107adab9961 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Request method failure captured: Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsftBZsFYckGp2S59pM_ZziDAvdnzTTbseZQSFZYdkFRIseimbM2wGFZ8YF-1g7zCYjjhOZ4Iwi11j7mc5LheTdaWx4BC-5Y_bEJ9l6icZbWXDq-pNWLAmCqDzxdHZuxRUbQvT1lRQDbAmSsec1ona0WgV82tgdkSMlGpRoMpd2CL8 Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:22.027767 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c16c4d0ea8704538b7fe3307a84f492e Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: exception: Aggregate -1 could not be found. Aug 24 03:30:22.029228 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '-1'} Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 03:30:22.030572 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.031978 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.033197 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.033197 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.033197 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:22.033197 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:22.033197 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 24 03:30:22.033197 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.033197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1518b12-8e3b-4012-8050-c107adab9961 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:22.034742 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1518b12-8e3b-4012-8050-c107adab9961 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.030862 Aug 24 03:30:22.035809 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 137/246] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:22 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:30:22.050766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15d74227-96bc-43b1-ae86-9cb70e56bea1 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1299580479"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:22.057652 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.057652 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.063221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-15d74227-96bc-43b1-ae86-9cb70e56bea1 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid d619ef7b-5735-44f7-bba5-a9e10078a67e for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:22.126218 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15d74227-96bc-43b1-ae86-9cb70e56bea1 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.084168 Aug 24 03:30:22.134078 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 138/247] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:22.140822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-21b5dfd0-a177-4d83-845f-1c5c435b2374 req-0916163f-9a20-4ab1-bf18-7dc22bfe4d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab485dc-1794-4a5b-869d-828cd355a9a0", "tag": "203f9ffa-fc6d-41fe-9aef-42ec4f2e3ba7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:22.175266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-21b5dfd0-a177-4d83-845f-1c5c435b2374 req-0916163f-9a20-4ab1-bf18-7dc22bfe4d07 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:22.175792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-21b5dfd0-a177-4d83-845f-1c5c435b2374 req-0916163f-9a20-4ab1-bf18-7dc22bfe4d07 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:22.176192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-21b5dfd0-a177-4d83-845f-1c5c435b2374 req-0916163f-9a20-4ab1-bf18-7dc22bfe4d07 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:22.200399 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-21b5dfd0-a177-4d83-845f-1c5c435b2374 req-0916163f-9a20-4ab1-bf18-7dc22bfe4d07 service nova] Creating event network-changed:203f9ffa-fc6d-41fe-9aef-42ec4f2e3ba7 for instance aab485dc-1794-4a5b-869d-828cd355a9a0 on n-h1-846470-15 Aug 24 03:30:22.206136 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-21b5dfd0-a177-4d83-845f-1c5c435b2374 req-0916163f-9a20-4ab1-bf18-7dc22bfe4d07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070648 Aug 24 03:30:22.207241 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 139/248] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:22.214559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-170ecc47-0ea9-46a1-8a0f-61450b8fe248 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.215581 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.215581 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.216650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-170ecc47-0ea9-46a1-8a0f-61450b8fe248 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '5ff2e2e1e9664602a026dcf7c01a1a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6959ddd5ceb45efb2bda0fea49a898c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-170ecc47-0ea9-46a1-8a0f-61450b8fe248 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Request method failure captured: Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsce0Y6rWcpgGz3syG3urg0GSTgrTPNqoHWPfN3katuYGKHOBwAn4e0AMPUjjHUOZATeLTJs8OIg9fEMwNp9BOsS58RaVV8YZY0CrUCX5qk4UNZ6pJJeZqFsn47gw9IxfUI2aCXQj4P1hyEdhpM53W8yLdz2wekz1tNsl5W1FMfPi0 Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:22.220087 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5ff2e2e1e9664602a026dcf7c01a1a82 Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 03:30:22.221754 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '16'} Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:22.222505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.223518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-170ecc47-0ea9-46a1-8a0f-61450b8fe248 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:22.226268 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-170ecc47-0ea9-46a1-8a0f-61450b8fe248 tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.013808 Aug 24 03:30:22.226268 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 140/249] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:22 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:22.234041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed93ff88-979a-4de0-9965-e4bce8e12dcb tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.234041 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.234041 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.284865 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed93ff88-979a-4de0-9965-e4bce8e12dcb tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.057369 Aug 24 03:30:22.287389 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 141/250] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:22 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:22.296935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fef61e81-9c39-4f8c-950b-ff0185220621 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.298312 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.298312 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.304822 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-fef61e81-9c39-4f8c-950b-ff0185220621 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fef61e81-9c39-4f8c-950b-ff0185220621 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Request method failure captured: Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsftBZsFYckGp2S59pM_ZziDAvdnzTTbseZQSFZYdkFRIseimbM2wGFZ8YF-1g7zCYjjhOZ4Iwi11j7mc5LheTdaWx4BC-5Y_bEJ9l6icZbWXDq-pNWLAmCqDzxdHZuxRUbQvT1lRQDbAmSsec1ona0WgV82tgdkSMlGpRoMpd2CL8 Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:22.306923 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c16c4d0ea8704538b7fe3307a84f492e Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: exception: Aggregate -1 could not be found. Aug 24 03:30:22.308394 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '-1'} Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.309247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 24 03:30:22.310592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.312115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fef61e81-9c39-4f8c-950b-ff0185220621 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:22.312115 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fef61e81-9c39-4f8c-950b-ff0185220621 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.015651 Aug 24 03:30:22.312115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 142/251] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:30:22 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:30:22.324078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45753512-fda6-4f62-a3ad-0730ea338a0b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.325282 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.325282 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.329288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-45753512-fda6-4f62-a3ad-0730ea338a0b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '5ff2e2e1e9664602a026dcf7c01a1a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6959ddd5ceb45efb2bda0fea49a898c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45753512-fda6-4f62-a3ad-0730ea338a0b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Request method failure captured: Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsce0Y6rWcpgGz3syG3urg0GSTgrTPNqoHWPfN3katuYGKHOBwAn4e0AMPUjjHUOZATeLTJs8OIg9fEMwNp9BOsS58RaVV8YZY0CrUCX5qk4UNZ6pJJeZqFsn47gw9IxfUI2aCXQj4P1hyEdhpM53W8yLdz2wekz1tNsl5W1FMfPi0 Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:22.331656 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5ff2e2e1e9664602a026dcf7c01a1a82 Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 03:30:22.332963 n-d-846470-15 devstack@n-api.service[122536]: action_args: {} Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:22.333686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 03:30:22.334720 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.340435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45753512-fda6-4f62-a3ad-0730ea338a0b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:22.341542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-45753512-fda6-4f62-a3ad-0730ea338a0b tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.022566 Aug 24 03:30:22.348460 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 143/252] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:30:22 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:22.360116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0968ff22-5f0d-41a3-b8a2-5945518857be tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-632750749"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:22.363642 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.363642 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.364815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-0968ff22-5f0d-41a3-b8a2-5945518857be tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid 38565558-aee9-417d-8ab2-b83b20febd1d for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:22.404146 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0968ff22-5f0d-41a3-b8a2-5945518857be tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048620 Aug 24 03:30:22.415119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 144/253] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:22.421753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8d5b338-067f-4ab6-8109-fd931d0b3c2d tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:22.426726 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.426726 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.449386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5b338-067f-4ab6-8109-fd931d0b3c2d tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:22.450314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5b338-067f-4ab6-8109-fd931d0b3c2d tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:22.451194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5b338-067f-4ab6-8109-fd931d0b3c2d tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:22.463239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:22.646038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:22.674286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:22.680579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:22.683239 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-609b962f-9b98-46c8-a342-889cb678ff94 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1361 microversion: 2.25 time: 0.854414 Aug 24 03:30:22.700957 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 110/254] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:21 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1361 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:22.727796 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8d5b338-067f-4ab6-8109-fd931d0b3c2d tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.310787 Aug 24 03:30:22.728383 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 145/255] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 03:30:22 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:22.743007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1133d05f-2d8f-4f11-8516-d96648358ffd tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:22.747435 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.747435 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:22.749564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1133d05f-2d8f-4f11-8516-d96648358ffd tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '5ff2e2e1e9664602a026dcf7c01a1a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6959ddd5ceb45efb2bda0fea49a898c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1133d05f-2d8f-4f11-8516-d96648358ffd tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Request method failure captured: Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 43 Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsce0Y6rWcpgGz3syG3urg0GSTgrTPNqoHWPfN3katuYGKHOBwAn4e0AMPUjjHUOZATeLTJs8OIg9fEMwNp9BOsS58RaVV8YZY0CrUCX5qk4UNZ6pJJeZqFsn47gw9IxfUI2aCXQj4P1hyEdhpM53W8yLdz2wekz1tNsl5W1FMfPi0 Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:22.754416 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6959ddd5ceb45efb2bda0fea49a898c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: f6959ddd5ceb45efb2bda0fea49a898c Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-804443998 Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5ff2e2e1e9664602a026dcf7c01a1a82 Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-804443998-project Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: {"remove_host": {"host": "n-h2-846470-15"}} Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:22.755760 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-846470-15'}}} Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:22.756497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 03:30:22.757503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.761916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1133d05f-2d8f-4f11-8516-d96648358ffd tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:22.764730 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1133d05f-2d8f-4f11-8516-d96648358ffd tempest-AggregatesAdminNegativeTestJSON-804443998 tempest-AggregatesAdminNegativeTestJSON-804443998-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.026670 Aug 24 03:30:22.766617 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 111/256] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 03:30:22 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:22.774293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-441421ba-0e55-4352-b528-a36dd5761d76 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:22.778542 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:22.778542 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:22.789074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.790348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:22.800329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-441421ba-0e55-4352-b528-a36dd5761d76 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:22.800853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-441421ba-0e55-4352-b528-a36dd5761d76 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:22.802419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:22.806340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-441421ba-0e55-4352-b528-a36dd5761d76 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:22.807168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:22.807832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:22.809252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:22.810256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:22.812055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.034830 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-441421ba-0e55-4352-b528-a36dd5761d76 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.264630 Aug 24 03:30:23.036431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 146/257] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 03:30:22 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:23.054930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:23.058052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:23.084633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.085140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.085581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.086650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.087101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.087523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.329692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:23.346955 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9745ef2f-53eb-42d0-9ad4-4f0dbd9b02bb tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1319 microversion: 2.1 time: 0.561441 Aug 24 03:30:23.359989 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 112/258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:22 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:23.359989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1cbc4aa8-b255-4337-85b7-a819f2be78bb req-24e7b8b2-d2e6-4fd2-af7d-b1048c8c9b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4", "name": "network-vif-plugged", "status": "completed", "tag": "58bc2fa4-f5ed-4c39-b48d-4711daf944d9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:23.386047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1cbc4aa8-b255-4337-85b7-a819f2be78bb req-24e7b8b2-d2e6-4fd2-af7d-b1048c8c9b48 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.386529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1cbc4aa8-b255-4337-85b7-a819f2be78bb req-24e7b8b2-d2e6-4fd2-af7d-b1048c8c9b48 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.387031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1cbc4aa8-b255-4337-85b7-a819f2be78bb req-24e7b8b2-d2e6-4fd2-af7d-b1048c8c9b48 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.404854 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1cbc4aa8-b255-4337-85b7-a819f2be78bb req-24e7b8b2-d2e6-4fd2-af7d-b1048c8c9b48 service nova] Creating event network-vif-plugged:58bc2fa4-f5ed-4c39-b48d-4711daf944d9 for instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 on n-h2-846470-15 Aug 24 03:30:23.412409 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1cbc4aa8-b255-4337-85b7-a819f2be78bb req-24e7b8b2-d2e6-4fd2-af7d-b1048c8c9b48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061560 Aug 24 03:30:23.413067 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 113/259] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:23.424559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-42d953f4-d545-4cb6-924b-3ca3228747e4 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:23.425573 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:23.425573 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:23.474933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=32 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:23.493203 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-42d953f4-d545-4cb6-924b-3ca3228747e4 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.077193 Aug 24 03:30:23.498311 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 114/260] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:23 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:23.509591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06b93825-f2d8-4c29-9599-ffa0175d2cb1 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2098006852"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:23.512831 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:23.512831 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:23.514108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.aggregate [None req-06b93825-f2d8-4c29-9599-ffa0175d2cb1 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Generated uuid 8b05e0f3-c022-4a88-a812-85d654c4956f for aggregate {{(pid=122535) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 03:30:23.551028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=11 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:23.572621 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06b93825-f2d8-4c29-9599-ffa0175d2cb1 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067333 Aug 24 03:30:23.585299 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 115/261] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 03:30:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:23.591807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:23.594391 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:23.594391 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:23.604763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.605262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.605700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.613506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.613979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.614601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.624480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.compute.aggregates [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 24 03:30:23.625224 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Request method failure captured: Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 42 Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZsftBZsFYckGp2S59pM_ZziDAvdnzTTbseZQSFZYdkFRIseimbM2wGFZ8YF-1g7zCYjjhOZ4Iwi11j7mc5LheTdaWx4BC-5Y_bEJ9l6icZbWXDq-pNWLAmCqDzxdHZuxRUbQvT1lRQDbAmSsec1ona0WgV82tgdkSMlGpRoMpd2CL8 Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:23.628157 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2dea3d92dd61402e9f57e7bbfe43bb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2dea3d92dd61402e9f57e7bbfe43bb0d Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-919798897 Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c16c4d0ea8704538b7fe3307a84f492e Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: {"remove_host": {"host": "nonexist_host"}} Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:23.629401 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 24 03:30:23.630152 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6678, in remove_host_from_aggregate Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 24 03:30:23.631350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.633204 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:23.634337 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:23.634337 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:23.634337 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:23.634337 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:23.634337 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 24 03:30:23.634337 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:23.635823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:23.637525 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4fd5ef15-2e28-492d-a35f-8cb9207ca599 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.049642 Aug 24 03:30:23.642667 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 116/262] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 03:30:23 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:30:23.648877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a7aafa28-fed0-44f0-bf10-bb022429a321 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:23.650370 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:23.650370 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:23.684801 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a7aafa28-fed0-44f0-bf10-bb022429a321 tempest-AggregatesAdminNegativeTestJSON-919798897 tempest-AggregatesAdminNegativeTestJSON-919798897-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.039382 Aug 24 03:30:23.685422 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 117/263] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:23 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 03:30:23.711360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:23.712150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:23.729069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.729839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.730875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.731810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.732425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.732993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.734086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:23.743199 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8370b654-c595-448b-bc13-c0fb016094e0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1315 microversion: 2.1 time: 0.705698 Aug 24 03:30:23.744186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 147/264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:23 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:23.933255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:23.950067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:23.952186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:23.953905 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7b402871-554e-417f-92f9-75cfd4cf0eb0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1361 microversion: 2.25 time: 0.247608 Aug 24 03:30:23.955448 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 118/265] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:23 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:30:24.370969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:24.372799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:24.390967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:24.392731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:24.395526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:24.396917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:24.397681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:24.398336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:24.682150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:24.704252 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fbfac112-3107-470a-90e2-9bc572da77f6 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1319 microversion: 2.1 time: 0.339511 Aug 24 03:30:24.706265 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 148/266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:24 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:24.772365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:24.774526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:24.788882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:24.789529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:24.790094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:24.790991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:24.792991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:24.793839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:24.823085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:24.986285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:24.990326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:25.014167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:25.016690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:25.019823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:25.022721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:25.023622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:25.025925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:25.058701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:25.069901 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-38bdb432-50b5-463d-b821-b478164238f7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1315 microversion: 2.1 time: 0.308116 Aug 24 03:30:25.073523 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 119/267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:24 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:25.441945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:25.457009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:25.459873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:25.462127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44b1524b-2b44-47e3-b915-a7fc7dbcac50 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1361 microversion: 2.25 time: 0.486465 Aug 24 03:30:25.472199 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 149/268] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:24 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:30:25.732970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:25.733820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:25.740257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:25.740936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:25.741354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:25.742233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:25.743095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:25.743619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:25.889404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:25.898002 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01e915fb-3e77-4e02-9b46-99d0367f0152 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1319 microversion: 2.1 time: 0.169126 Aug 24 03:30:25.898582 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 120/269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:25 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:26.094532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:26.096307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:26.102568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.103231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.104246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:26.105168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.105755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.106041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:26.309887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:26.320157 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcb8d2b5-5141-47b7-8e59-9ad2e3524f36 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1465 microversion: 2.1 time: 0.229489 Aug 24 03:30:26.321974 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 150/270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:26 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1465 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:26.491680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:26.492318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:26.506157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.506900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.507353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:26.510101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.510706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.511141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:26.742978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:26.754814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:26.759658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:26.761154 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4dbb8f85-3622-4b0d-8ad4-19e4e9f0c33c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1361 microversion: 2.25 time: 0.273255 Aug 24 03:30:26.775972 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 151/271] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:26 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:26.801880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-85c5d485-1833-419a-bb0d-58077eafc925 req-d7063d61-e8d2-49e4-af7f-fcc441720f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b47212e-05a1-45a2-9cb6-0cc6b445ada0", "name": "network-vif-plugged", "status": "completed", "tag": "9cdcacd1-2971-4051-893c-f6ada06261b9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:26.829547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85c5d485-1833-419a-bb0d-58077eafc925 req-d7063d61-e8d2-49e4-af7f-fcc441720f08 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.830354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85c5d485-1833-419a-bb0d-58077eafc925 req-d7063d61-e8d2-49e4-af7f-fcc441720f08 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.830642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85c5d485-1833-419a-bb0d-58077eafc925 req-d7063d61-e8d2-49e4-af7f-fcc441720f08 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:26.856048 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-85c5d485-1833-419a-bb0d-58077eafc925 req-d7063d61-e8d2-49e4-af7f-fcc441720f08 service nova] Creating event network-vif-plugged:9cdcacd1-2971-4051-893c-f6ada06261b9 for instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 on n-h2-846470-15 Aug 24 03:30:26.868704 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-85c5d485-1833-419a-bb0d-58077eafc925 req-d7063d61-e8d2-49e4-af7f-fcc441720f08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071994 Aug 24 03:30:26.873928 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 152/272] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:26.923189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:26.923988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:26.944835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.946373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.947184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:26.956206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.957031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.957654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:27.141172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:27.142311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:27.158053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:27.178785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:27.180565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:27.186352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:27.187085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:27.189510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:27.347898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:27.361336 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f7ce2610-b273-4e72-a91f-c38fa943eec7 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1319 microversion: 2.1 time: 0.443841 Aug 24 03:30:27.362472 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 153/273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:26 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:27.617760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=16 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:27.790141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:27.791360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:27.802214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:27.804994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:27.805653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:27.808024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:27.808695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:27.809416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:28.141371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:28.162152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:28.166156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:28.168672 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07f968c4-d0f9-439f-89a5-e601761797b4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1361 microversion: 2.25 time: 0.382798 Aug 24 03:30:28.181886 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 154/274] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:27 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:30:28.220368 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5655e585-dfc8-43de-a01f-72a78b03bb2f tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1618 microversion: 2.1 time: 1.875308 Aug 24 03:30:28.222901 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 121/275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:26 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1618 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:28.253407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba37a5a6-4d4f-447f-be42-5be9eb3cf038 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Action: 'create', calling method: .version_select at 0x7f102394c670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1700834373", "policies": ["affinity"]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:28.284717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ba37a5a6-4d4f-447f-be42-5be9eb3cf038 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:28.291945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ba37a5a6-4d4f-447f-be42-5be9eb3cf038 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:28.321433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:28.369534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ba37a5a6-4d4f-447f-be42-5be9eb3cf038 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:28.374951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ba37a5a6-4d4f-447f-be42-5be9eb3cf038 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:28.389777 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba37a5a6-4d4f-447f-be42-5be9eb3cf038 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.140547 Aug 24 03:30:28.391283 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 155/276] 10.222.0.58 () {60 vars in 1174 bytes} [Wed Aug 24 03:30:28 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:28.394038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:28.396876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:28.410910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:28.414826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:28.419049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:28.420726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:28.422025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:28.424071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:28.726874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:28.745261 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5fea1710-479c-4315-b178-affb5b1c5c83 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1319 microversion: 2.1 time: 0.362276 Aug 24 03:30:28.753394 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 122/277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:28 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:28.811372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-70301949", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6786a6c6-ae09-42a1-a032-6f0f14215e75"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:28.922604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:29.199307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:29.201390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:29.226330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.229056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.230455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.240999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.243521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.245242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.528965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:29.529952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:29.531812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:29.534063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:29.536392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:29.556178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:29.586667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:29.589704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:29.591885 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef391922-d170-4b33-9909-bb0c6bdccb05 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1558 microversion: 2.25 time: 0.396479 Aug 24 03:30:29.612845 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 123/278] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:29 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1558 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:29.636777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d9c13048-961d-4847-8df1-8266d8a18aee req-6af9f723-b102-4ef6-9bcb-cfeb6458991c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab485dc-1794-4a5b-869d-828cd355a9a0", "name": "network-vif-plugged", "status": "completed", "tag": "203f9ffa-fc6d-41fe-9aef-42ec4f2e3ba7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:29.655317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d9c13048-961d-4847-8df1-8266d8a18aee req-6af9f723-b102-4ef6-9bcb-cfeb6458991c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.655937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d9c13048-961d-4847-8df1-8266d8a18aee req-6af9f723-b102-4ef6-9bcb-cfeb6458991c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.656393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d9c13048-961d-4847-8df1-8266d8a18aee req-6af9f723-b102-4ef6-9bcb-cfeb6458991c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.656827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.657488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.657914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.659090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.659829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.660457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.673109 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d9c13048-961d-4847-8df1-8266d8a18aee req-6af9f723-b102-4ef6-9bcb-cfeb6458991c service nova] Creating event network-vif-plugged:203f9ffa-fc6d-41fe-9aef-42ec4f2e3ba7 for instance aab485dc-1794-4a5b-869d-828cd355a9a0 on n-h1-846470-15 Aug 24 03:30:29.679588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d9c13048-961d-4847-8df1-8266d8a18aee req-6af9f723-b102-4ef6-9bcb-cfeb6458991c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064532 Aug 24 03:30:29.684766 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 124/279] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:29.688904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:29.695389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:29.724520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Going to run 2 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:29.730697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:29.848353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122536) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 24 03:30:29.891581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:29.900826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:30.019469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:30.041733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:30.094385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=4d7aa936-21eb-4c3a-8829-a29d00b4814d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:30.218969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:30.244256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:30.353477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:30.367532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:30.424464 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-312b2bca-eb9e-4380-bd33-bb3161554e12 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.617704 Aug 24 03:30:30.425618 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 156/280] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1620 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:30:30.432333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:30.434858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:30.447255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:30.447971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:30.448800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:30.449735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:30.450214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:30.450781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:30.740771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:30.741755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:30.766873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:30.767456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:30.767938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:30.786423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:30.793235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:30.794199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:31.224916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:30:31.342716 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ad96cca-327b-4137-8ea4-6852625bdee7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 2052 microversion: 2.25 time: 1.656474 Aug 24 03:30:31.345437 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 125/281] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:29 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 2052 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:31.353324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:31.362226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:31.368552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:31.373632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Searching by: {'deleted': False, 'project_id': 'd347f85e59734622a091e80dbf0d9521'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:30:31.375590 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0d51a03e-0049-4b30-87f0-0f354d009823 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1319 microversion: 2.1 time: 0.948720 Aug 24 03:30:31.376417 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 157/282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:30 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1319 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:31.401924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:31.403936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:31.405082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:31.411302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:31.412471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:31.413391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:31.704208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:30:31.994650 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-816ec444-d9d9-460e-ac6d-20ef9c448c51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 998 microversion: 2.1 time: 0.645090 Aug 24 03:30:31.999845 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 126/283] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 03:30:31 2022] GET /compute/v2.1/servers => generated 998 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:32.318650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ee7e7011-496a-4a99-afce-212ec6200353 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Calling method '.version_select at 0x7f10238d2f70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:32.783878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Calling method '.version_select at 0x7f1030098820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:32.785144 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:32.785144 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:32.786709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:32.787394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:32.788013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:32.822592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:32.823572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:32.824620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:32.860986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:32.861527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:32.863807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:32.879007 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67f8a5c8-bcb9-4d5f-9fab-291ac718329f tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.877630 Aug 24 03:30:32.881305 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 127/284] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:32 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:33.123548 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ee7e7011-496a-4a99-afce-212ec6200353 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 371 microversion: 2.1 time: 1.730235 Aug 24 03:30:33.130310 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 158/285] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:30:31 2022] GET /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 371 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:33.158101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:33.163812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:33.197216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:33.199790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:33.200815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:33.203259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:33.204424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:33.205489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:33.483433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b1232e5-db50-419e-9c73-b502f873a4c0 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1483407353", "ram": 512, "vcpus": 1, "disk": 10, "id": 1580746863, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:33.487855 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:33.487855 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:33.527112 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1b1232e5-db50-419e-9c73-b502f873a4c0 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.646017 Aug 24 03:30:33.527748 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 128/286] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:32 2022] POST /compute/v2.1/flavors => generated 416 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:33.557590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:33.576217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:33.597315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:33.597805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:33.598242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:33.598967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:33.599419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:33.616053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:33.731729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:33.748489 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-385436f6-cfc5-41b1-92ef-9a3b6218ce23 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1269 microversion: 2.1 time: 0.219612 Aug 24 03:30:33.751329 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 129/287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:33 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1269 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:33.756762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:33.757658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:33.767031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:33.768126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:33.768570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:33.770008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:33.770484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:33.770922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:33.779534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:30:33.856925 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-46218977-900e-4c2f-bb4f-e6fd9ba5d98a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 2052 microversion: 2.25 time: 0.718874 Aug 24 03:30:33.882584 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 159/288] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:33 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 2052 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:34.142801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:34.160820 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4391146c-ede8-4246-86e7-e340ecd1abe1 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1469 microversion: 2.1 time: 0.408029 Aug 24 03:30:34.172181 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 130/289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:33 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1469 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:34.184862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2074299-9169-46b3-9c5c-5a65441ad7aa tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Action: 'update', calling method: .version_select at 0x7f102b70c9d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:34.442108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b63870f3-91d2-4204-94fa-de9eb73a6523 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] Calling method '.version_select at 0x7f10238e5700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:34.452405 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:34.452405 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:34.455243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b63870f3-91d2-4204-94fa-de9eb73a6523 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '4626a9dc98e04e828ccd832934f258f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa82b13bde5c4512b6ac85451b6350af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b63870f3-91d2-4204-94fa-de9eb73a6523 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] Request method failure captured: Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hypervisors/n-h2-846470-15/search HTTP/1.1 Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtTW-mqD9LVGfFTifoFI9cyldfJwVUW8AGQV88EajO6NdhsCrH-A0ERFujOg4kbrpqM7FHG3SQEWBDHaG3G0GdmpmmnSK1UY3oPuGjgNfh-LPKVD4Gm24iUWHAmN1ZKOiML6R7YI2J8NPrUplYf7O6OUXYMVdNqVVd2-gFbyYQCJ04 Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fa82b13bde5c4512b6ac85451b6350af Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-157178756 Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:34.457412 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fa82b13bde5c4512b6ac85451b6350af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fa82b13bde5c4512b6ac85451b6350af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fa82b13bde5c4512b6ac85451b6350af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fa82b13bde5c4512b6ac85451b6350af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-157178756 Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fa82b13bde5c4512b6ac85451b6350af Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-157178756 Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-157178756-project Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 4626a9dc98e04e828ccd832934f258f0 Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-157178756-project Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 03:30:34.458758 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'n-h2-846470-15'} Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:34.459533 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 03:30:34.460695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:34.464326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b63870f3-91d2-4204-94fa-de9eb73a6523 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:34.465448 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b63870f3-91d2-4204-94fa-de9eb73a6523 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-846470-15/search" status: 403 len: 117 microversion: 2.1 time: 0.580316 Aug 24 03:30:34.466263 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 160/290] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 24 03:30:33 2022] GET /compute/v2.1/os-hypervisors/n-h2-846470-15/search => generated 117 bytes in 583 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:34.595777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4aee54df-7958-42f4-922e-0761f0c94476 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:34.604678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aee54df-7958-42f4-922e-0761f0c94476 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:34.605641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aee54df-7958-42f4-922e-0761f0c94476 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:34.608276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aee54df-7958-42f4-922e-0761f0c94476 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:34.611261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aee54df-7958-42f4-922e-0761f0c94476 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:34.611261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aee54df-7958-42f4-922e-0761f0c94476 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:34.611607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aee54df-7958-42f4-922e-0761f0c94476 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:34.628816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2074299-9169-46b3-9c5c-5a65441ad7aa tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:34.628816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2074299-9169-46b3-9c5c-5a65441ad7aa tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:34.628816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2074299-9169-46b3-9c5c-5a65441ad7aa tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:34.629823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2074299-9169-46b3-9c5c-5a65441ad7aa tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:34.629935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2074299-9169-46b3-9c5c-5a65441ad7aa tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:34.630646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2074299-9169-46b3-9c5c-5a65441ad7aa tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:34.647160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=15 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:34.702336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:34.722542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4aee54df-7958-42f4-922e-0761f0c94476 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.254887 Aug 24 03:30:34.723705 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 161/291] 10.222.0.58 () {58 vars in 1164 bytes} [Wed Aug 24 03:30:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:30:34.800620 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2074299-9169-46b3-9c5c-5a65441ad7aa tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 328 microversion: 2.1 time: 0.624848 Aug 24 03:30:34.817263 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 131/292] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:30:34 2022] PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 328 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:34.827050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a13e1d5-ad15-4cfc-86f9-f647cf3b3fe7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:34.849509 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:34.849509 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:34.859036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a13e1d5-ad15-4cfc-86f9-f647cf3b3fe7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:34.862316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a13e1d5-ad15-4cfc-86f9-f647cf3b3fe7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:34.865770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a13e1d5-ad15-4cfc-86f9-f647cf3b3fe7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:34.869134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a13e1d5-ad15-4cfc-86f9-f647cf3b3fe7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:34.870485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a13e1d5-ad15-4cfc-86f9-f647cf3b3fe7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:34.871101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a13e1d5-ad15-4cfc-86f9-f647cf3b3fe7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:34.962855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d4ef9ab-04d1-4909-a6b7-e9d01c8928aa tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:34.983749 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5d4ef9ab-04d1-4909-a6b7-e9d01c8928aa tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] HTTP exception thrown: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d4ef9ab-04d1-4909-a6b7-e9d01c8928aa tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Request method failure captured: Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/flavors/1580746863/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtTZfrfzMBmEGQjQYNESMmUQ-JV_6o5FAQzULVA-YsPFMFgcGuyXbwGuSqFUpvnKP8PcKoXZaeAmjLXbL1mLeK6v8C23IwgIdPA4j9ANwKOBw2N-YP9K64_ztEElphe2XqHp_2hR7sCU1xrR_-78vDmc53JqOzRFLUOxAiqMfRDyjo Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 1799a41a98f2402d9d0be6299378c82e Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:34.992746 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 1799a41a98f2402d9d0be6299378c82e Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: feb1538f3fd84e2e999c52183a896172 Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:34.994224 n-d-846470-15 devstack@n-api.service[122536]: exception: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'flavor_id': '1580746863', 'id': 'hw:cpu_thread_policy'} Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:34.995003 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:34.996511 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:34.996511 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:34.996511 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:34.996511 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:34.996511 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:34.996511 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. Aug 24 03:30:34.996511 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:34.998004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d4ef9ab-04d1-4909-a6b7-e9d01c8928aa tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Returning 404 to user: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:35.004116 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d4ef9ab-04d1-4909-a6b7-e9d01c8928aa tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] 10.222.0.58 "GET /compute/v2.1/flavors/1580746863/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.273937 Aug 24 03:30:35.005087 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 162/293] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:30:34 2022] GET /compute/v2.1/flavors/1580746863/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:35.010285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:35.015047 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a13e1d5-ad15-4cfc-86f9-f647cf3b3fe7 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.196581 Aug 24 03:30:35.015724 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 132/294] 10.222.0.58 () {60 vars in 1217 bytes} [Wed Aug 24 03:30:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:35.023499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:35.025914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1cade645-2d39-4e78-af5e-f51caa614104 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Calling method '.version_select at 0x7f102b6f08b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:35.032866 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:35.032866 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:35.034459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cade645-2d39-4e78-af5e-f51caa614104 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.037865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cade645-2d39-4e78-af5e-f51caa614104 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.038545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cade645-2d39-4e78-af5e-f51caa614104 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.056653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.057549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.059730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.065346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.065924 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1cade645-2d39-4e78-af5e-f51caa614104 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 03:30:35.067751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.070135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1cade645-2d39-4e78-af5e-f51caa614104 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Request method failure captured: Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtW77Uk7XuBwckxns9G7sA96M7UkN-r-Doidp2o9JaPEA7-GaO9oMEUJHGJEH8hE0NUdg8elXkQJaGU5_Jk2-5YG_dbtcKGFsQ7B6ptr_VI6iCcDx83U4SuovLXGniw7OeGJxtRWBBGHkil8kQVtQJ7bdkgTsgNi_eP9vf93x9_xYs Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 87f06ec8daf2451fb0db92c97f20b29e Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1326257468 Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:35.084747 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_87f06ec8daf2451fb0db92c97f20b29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/87f06ec8daf2451fb0db92c97f20b29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/87f06ec8daf2451fb0db92c97f20b29e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/87f06ec8daf2451fb0db92c97f20b29e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1326257468 Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 87f06ec8daf2451fb0db92c97f20b29e Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1326257468 Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 54803023231840feac40170846b2e62f Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 03:30:35.086687 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:35.088332 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:35.090230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:35.090230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:35.090230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:35.090230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 03:30:35.090230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:35.094400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1cade645-2d39-4e78-af5e-f51caa614104 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:35.100695 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1cade645-2d39-4e78-af5e-f51caa614104 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.080217 Aug 24 03:30:35.107055 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 133/295] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:35 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:35.141935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a535640f-2560-48a2-a0b6-e35856a6dad8 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:35.146399 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:35.146399 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:35.151001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a535640f-2560-48a2-a0b6-e35856a6dad8 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.151711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a535640f-2560-48a2-a0b6-e35856a6dad8 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.155927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a535640f-2560-48a2-a0b6-e35856a6dad8 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.158850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a535640f-2560-48a2-a0b6-e35856a6dad8 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.163053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a535640f-2560-48a2-a0b6-e35856a6dad8 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.165657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a535640f-2560-48a2-a0b6-e35856a6dad8 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.220109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lazy-loading 'flavor' on Instance uuid aab485dc-1794-4a5b-869d-828cd355a9a0 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:30:35.242288 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a535640f-2560-48a2-a0b6-e35856a6dad8 tempest-AZAdminV2TestJSON-624388084 tempest-AZAdminV2TestJSON-624388084-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.114581 Aug 24 03:30:35.259455 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 134/296] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 24 03:30:35 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:35.275524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:35.277730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:35.294101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.296023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.297431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.298930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.301472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.314184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.425612 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c34a66b-6aba-4417-b450-f56067eee345 tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0/action" status: 202 len: 0 microversion: 2.1 time: 0.417515 Aug 24 03:30:35.427422 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 163/297] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:30:35 2022] POST /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:35.435686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f9754fe-593b-4517-83fd-5a44a67f68fc tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:35.440275 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:35.440275 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:35.442674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f9754fe-593b-4517-83fd-5a44a67f68fc tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'feb1538f3fd84e2e999c52183a896172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1799a41a98f2402d9d0be6299378c82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f9754fe-593b-4517-83fd-5a44a67f68fc tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Request method failure captured: Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/flavors/1580746863/os-extra_specs HTTP/1.1 Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 66 Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtTZfrfzMBmEGQjQYNESMmUQ-JV_6o5FAQzULVA-YsPFMFgcGuyXbwGuSqFUpvnKP8PcKoXZaeAmjLXbL1mLeK6v8C23IwgIdPA4j9ANwKOBw2N-YP9K64_ztEElphe2XqHp_2hR7sCU1xrR_-78vDmc53JqOzRFLUOxAiqMfRDyjo Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 1799a41a98f2402d9d0be6299378c82e Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:35.446546 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 1799a41a98f2402d9d0be6299378c82e Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: feb1538f3fd84e2e999c52183a896172 Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 24 03:30:35.448215 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'flavor_id': '1580746863', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:35.448955 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 03:30:35.450143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:35.455018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f9754fe-593b-4517-83fd-5a44a67f68fc tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:35.456485 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f9754fe-593b-4517-83fd-5a44a67f68fc tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] 10.222.0.58 "POST /compute/v2.1/flavors/1580746863/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.027112 Aug 24 03:30:35.458428 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 164/298] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 24 03:30:35 2022] POST /compute/v2.1/flavors/1580746863/os-extra_specs => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:35.470940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846470-15", "block_migration": "auto"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:35.475831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:35.487818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.488552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.489800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.490786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.491487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.492158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.545110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:35.568905 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de79e541-6c2c-4320-86e7-9358c92777cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1275 microversion: 2.1 time: 0.307871 Aug 24 03:30:35.573562 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 135/299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:35 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:35.588155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Calling method '.version_select at 0x7f102b6858b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:35.591826 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:35.591826 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:35.595544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.599562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.600809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.648049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.648704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.656513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.682910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.684575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.685535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.713752 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4f8707f3-93aa-4aa2-b99f-234e13e031f2 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.138232 Aug 24 03:30:35.726411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 136/300] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:35 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:36.233782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-100446888", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:36.347599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:36.374957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'flavor' on Instance uuid 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:30:36.414129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Going to try to live migrate instance to n-h1-846470-15 {{(pid=122536) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:30:36.522051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:36.817677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:36.818724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:36.819216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:36.819625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:36.820088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:36.837793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:36.838279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:36.838710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:36.839433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:36.840827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:36.841440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:36.866513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Getting quotas for project 5133f7b150e746218ddd8d5bbc3dfa28. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:36.873434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Getting quotas for user b79f649eb1e4427d92b8221dfec3d779 and project 5133f7b150e746218ddd8d5bbc3dfa28. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:36.899628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.utils [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] cores quota exceeded for 5133f7b150e746218ddd8d5bbc3dfa28, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122535) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 03:30:36.900853 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Request method failure captured: Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 144 Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtSXUamwjEz4M7JnT3GzaVvO8jeV6WiSspEWZHNhq1EzqegamkZZ-Go5LoK9c9NxaCGxBkImxPdCTRmcRYAWdXhGUm9iJEb-bt3hkPP2iYR4zmMGwpu1yFnjdchU1AK4RyJKHnDRWcqxnLTeEETU4L_7O_m0-dZxs9abCcoC5ApAgM Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 5133f7b150e746218ddd8d5bbc3dfa28 Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:36.904959 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 5133f7b150e746218ddd8d5bbc3dfa28 Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-QuotasAdminNegativeTest-2102187627-project Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: b79f649eb1e4427d92b8221dfec3d779 Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-QuotasAdminNegativeTest-2102187627-project Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-100446888", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} Aug 24 03:30:36.906448 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-100446888', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452'}}} Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 03:30:36.907305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:36.908360 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:36.909656 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:36.911115 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:36.911115 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:36.911115 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:36.911115 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:36.911115 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 03:30:36.911115 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:36.912597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:36.913762 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-86208feb-f8c7-414f-8d36-5dda91efe2b5 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.185693 Aug 24 03:30:36.914583 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 137/301] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:35 2022] POST /compute/v2.1/servers => generated 111 bytes in 1187 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:36.920077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:36.921048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:36.932764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:36.933661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:36.934390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:36.936140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:36.936878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:36.937542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:37.335074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:37.357718 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf6e3364-382b-4aea-aafa-38d8042a390a tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1460 microversion: 2.1 time: 0.441836 Aug 24 03:30:37.372884 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 138/302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:36 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1460 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:37.381841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-80a25939-92da-4e9c-93c9-60743f16cb1c tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:37.384942 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:37.384942 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:37.430969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:37.457418 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-80a25939-92da-4e9c-93c9-60743f16cb1c tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1580746863/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.082917 Aug 24 03:30:37.464182 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 139/303] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 24 03:30:37 2022] POST /compute/v2.1/flavors/1580746863/os-extra_specs => generated 66 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:30:37.471286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-982ccb53-ea18-42c3-b407-b2367f174855 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] Calling method '.version_select at 0x7f102b620040>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:37.472623 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:37.472623 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:37.474880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-982ccb53-ea18-42c3-b407-b2367f174855 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '4626a9dc98e04e828ccd832934f258f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa82b13bde5c4512b6ac85451b6350af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-982ccb53-ea18-42c3-b407-b2367f174855 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] Request method failure captured: Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtTW-mqD9LVGfFTifoFI9cyldfJwVUW8AGQV88EajO6NdhsCrH-A0ERFujOg4kbrpqM7FHG3SQEWBDHaG3G0GdmpmmnSK1UY3oPuGjgNfh-LPKVD4Gm24iUWHAmN1ZKOiML6R7YI2J8NPrUplYf7O6OUXYMVdNqVVd2-gFbyYQCJ04 Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: fa82b13bde5c4512b6ac85451b6350af Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-157178756 Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:37.477033 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fa82b13bde5c4512b6ac85451b6350af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fa82b13bde5c4512b6ac85451b6350af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fa82b13bde5c4512b6ac85451b6350af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fa82b13bde5c4512b6ac85451b6350af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-157178756 Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: fa82b13bde5c4512b6ac85451b6350af Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-157178756 Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-157178756-project Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 4626a9dc98e04e828ccd832934f258f0 Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-157178756-project Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 03:30:37.478365 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '1'} Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:37.479196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 03:30:37.480503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:37.481782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-982ccb53-ea18-42c3-b407-b2367f174855 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:37.481782 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-982ccb53-ea18-42c3-b407-b2367f174855 tempest-HypervisorAdminNegativeUnderV252Test-157178756 tempest-HypervisorAdminNegativeUnderV252Test-157178756-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013215 Aug 24 03:30:37.485112 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 140/304] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 03:30:37 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:37.495328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:37.500144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:37.544998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:37.545747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:37.546536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:37.549169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:37.549825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:37.550726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:37.689758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:37.702416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ed9d695d-b184-4d90-8b43-d19751181f62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1275 microversion: 2.1 time: 0.215290 Aug 24 03:30:37.703029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 141/305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:37 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1275 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:37.729144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5c96dbeb-9453-42ff-b697-48ac3510c360 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Action: 'update', calling method: .version_select at 0x7f102b6204c0>, body: {"quota_set": {"cores": 20}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:38.147310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c96dbeb-9453-42ff-b697-48ac3510c360 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.149554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c96dbeb-9453-42ff-b697-48ac3510c360 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.153138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c96dbeb-9453-42ff-b697-48ac3510c360 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.154896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c96dbeb-9453-42ff-b697-48ac3510c360 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.157804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c96dbeb-9453-42ff-b697-48ac3510c360 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.159070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c96dbeb-9453-42ff-b697-48ac3510c360 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.421848 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5c96dbeb-9453-42ff-b697-48ac3510c360 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 329 microversion: 2.1 time: 0.715052 Aug 24 03:30:38.427570 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 142/306] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:30:37 2022] PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 329 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:38.442164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:38.457321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:38.494332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.496530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.500470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.504605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.506857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.510450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.524529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:39.036873 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d02a2765-cfef-4650-ad5a-e4d0b0d57eec tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1613 microversion: 2.1 time: 0.605911 Aug 24 03:30:39.039879 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 143/307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:38 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1613 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:39.050358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-553a30d3-360c-441a-8913-7e6abce70e60 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:39.052643 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:39.052643 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:39.055538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-553a30d3-360c-441a-8913-7e6abce70e60 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'feb1538f3fd84e2e999c52183a896172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1799a41a98f2402d9d0be6299378c82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-553a30d3-360c-441a-8913-7e6abce70e60 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Request method failure captured: Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtTZfrfzMBmEGQjQYNESMmUQ-JV_6o5FAQzULVA-YsPFMFgcGuyXbwGuSqFUpvnKP8PcKoXZaeAmjLXbL1mLeK6v8C23IwgIdPA4j9ANwKOBw2N-YP9K64_ztEElphe2XqHp_2hR7sCU1xrR_-78vDmc53JqOzRFLUOxAiqMfRDyjo Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1799a41a98f2402d9d0be6299378c82e Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:39.070938 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1799a41a98f2402d9d0be6299378c82e Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: feb1538f3fd84e2e999c52183a896172 Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:39.072549 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'flavor_id': '1580746863', 'id': 'hw:numa_nodes'} Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:39.073281 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:39.074636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-553a30d3-360c-441a-8913-7e6abce70e60 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:39.075924 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-553a30d3-360c-441a-8913-7e6abce70e60 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] 10.222.0.58 "DELETE /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023340 Aug 24 03:30:39.075924 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 144/308] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:30:39 2022] DELETE /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:39.096663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3755eacb-8f25-451e-b510-8d8b7e2a7f07 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Calling method '.version_select at 0x7f102b620940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:39.098687 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:39.098687 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:39.104474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3755eacb-8f25-451e-b510-8d8b7e2a7f07 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:39.105926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3755eacb-8f25-451e-b510-8d8b7e2a7f07 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:39.110945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3755eacb-8f25-451e-b510-8d8b7e2a7f07 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:39.129848 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3755eacb-8f25-451e-b510-8d8b7e2a7f07 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] HTTP exception thrown: No hypervisor matching 'e0f2d79b-4414-45af-b2c4-32a3678e1e79' could be found. Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3755eacb-8f25-451e-b510-8d8b7e2a7f07 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Request method failure captured: Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hypervisors/e0f2d79b-4414-45af-b2c4-32a3678e1e79/servers HTTP/1.1 Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtW77Uk7XuBwckxns9G7sA96M7UkN-r-Doidp2o9JaPEA7-GaO9oMEUJHGJEH8hE0NUdg8elXkQJaGU5_Jk2-5YG_dbtcKGFsQ7B6ptr_VI6iCcDx83U4SuovLXGniw7OeGJxtRWBBGHkil8kQVtQJ7bdkgTsgNi_eP9vf93x9_xYs Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 87f06ec8daf2451fb0db92c97f20b29e Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1326257468 Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:39.131247 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_87f06ec8daf2451fb0db92c97f20b29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/87f06ec8daf2451fb0db92c97f20b29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/87f06ec8daf2451fb0db92c97f20b29e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/87f06ec8daf2451fb0db92c97f20b29e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1326257468 Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 87f06ec8daf2451fb0db92c97f20b29e Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1326257468 Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 54803023231840feac40170846b2e62f Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: exception: No hypervisor matching 'e0f2d79b-4414-45af-b2c4-32a3678e1e79' could be found. Aug 24 03:30:39.132576 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e0f2d79b-4414-45af-b2c4-32a3678e1e79'} Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'e0f2d79b-4414-45af-b2c4-32a3678e1e79' could be found. Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:39.133276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:39.134409 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:39.134409 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:39.134409 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:39.134409 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:39.134409 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'e0f2d79b-4414-45af-b2c4-32a3678e1e79' could be found. Aug 24 03:30:39.134409 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:39.134409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3755eacb-8f25-451e-b510-8d8b7e2a7f07 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] Returning 404 to user: No hypervisor matching 'e0f2d79b-4414-45af-b2c4-32a3678e1e79' could be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:39.134409 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3755eacb-8f25-451e-b510-8d8b7e2a7f07 tempest-HypervisorAdminNegativeUnderV252Test-1326257468 tempest-HypervisorAdminNegativeUnderV252Test-1326257468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/e0f2d79b-4414-45af-b2c4-32a3678e1e79/servers" status: 404 len: 123 microversion: 2.1 time: 0.063558 Aug 24 03:30:39.140306 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 145/309] 10.222.0.58 () {58 vars in 1281 bytes} [Wed Aug 24 03:30:39 2022] GET /compute/v2.1/os-hypervisors/e0f2d79b-4414-45af-b2c4-32a3678e1e79/servers => generated 123 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:39.149072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5436a42b-9204-429d-a139-35142276b44e tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Calling method '.version_select at 0x7f102b70c8b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:39.811223 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5436a42b-9204-429d-a139-35142276b44e tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 371 microversion: 2.1 time: 0.667950 Aug 24 03:30:39.815129 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 146/310] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:30:39 2022] GET /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 371 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:39.833704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:39.834909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:39.856180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:39.856668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:39.860041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:39.863903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:39.865016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:39.865965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:40.753502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:40.765028 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab352475-0875-40ef-95e8-5b47c2a8db77 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.947953 Aug 24 03:30:40.770253 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 147/311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:39 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:40.802483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d4455392-881e-418f-878a-f11dfa0d9e3d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:40.817797 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:40.817797 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:40.834038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4455392-881e-418f-878a-f11dfa0d9e3d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:40.834914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4455392-881e-418f-878a-f11dfa0d9e3d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:40.840010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4455392-881e-418f-878a-f11dfa0d9e3d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:40.842292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4455392-881e-418f-878a-f11dfa0d9e3d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:40.848964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4455392-881e-418f-878a-f11dfa0d9e3d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:40.851275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4455392-881e-418f-878a-f11dfa0d9e3d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:40.924477 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d4455392-881e-418f-878a-f11dfa0d9e3d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.132667 Aug 24 03:30:40.939482 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 148/312] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 03:30:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:40.947510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69ff8b8b-b01d-4ce1-a044-48cb72131cbf tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:40.953860 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:40.953860 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:41.010053 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69ff8b8b-b01d-4ce1-a044-48cb72131cbf tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1580746863/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069037 Aug 24 03:30:41.024083 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 149/313] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 24 03:30:40 2022] POST /compute/v2.1/flavors/1580746863/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:30:41.031149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-30a91fdd-aaa9-442d-b3e0-b8b13ba0c5b2 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Action: 'update', calling method: .version_select at 0x7f102b63a5e0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:41.632602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30a91fdd-aaa9-442d-b3e0-b8b13ba0c5b2 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:41.636121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30a91fdd-aaa9-442d-b3e0-b8b13ba0c5b2 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:41.637902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30a91fdd-aaa9-442d-b3e0-b8b13ba0c5b2 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:41.639126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30a91fdd-aaa9-442d-b3e0-b8b13ba0c5b2 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:41.640148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30a91fdd-aaa9-442d-b3e0-b8b13ba0c5b2 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:41.640805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30a91fdd-aaa9-442d-b3e0-b8b13ba0c5b2 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:41.735896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1ec5312-0090-4b56-a2cf-5a2bcab7e3a6 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0/action" status: 202 len: 0 microversion: 2.25 time: 6.274629 Aug 24 03:30:41.740534 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 165/314] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:30:35 2022] POST /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0/action => generated 0 bytes in 6278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:30:41.749410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846470-15", "block_migration": true, "disk_over_commit": false}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:41.756038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-30a91fdd-aaa9-442d-b3e0-b8b13ba0c5b2 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 328 microversion: 2.1 time: 0.730468 Aug 24 03:30:41.757892 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 150/315] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:30:41 2022] PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 328 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:41.762998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:41.839608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-782c0659-baf8-41ff-9bc6-3e10f09b9294 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:41.855214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:41.856121 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:41.856121 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:41.860025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:41.860523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:41.861300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:41.861776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:41.866343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-782c0659-baf8-41ff-9bc6-3e10f09b9294 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'feb1538f3fd84e2e999c52183a896172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1799a41a98f2402d9d0be6299378c82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:41.875490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-782c0659-baf8-41ff-9bc6-3e10f09b9294 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Request method failure captured: Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 22 Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtTZfrfzMBmEGQjQYNESMmUQ-JV_6o5FAQzULVA-YsPFMFgcGuyXbwGuSqFUpvnKP8PcKoXZaeAmjLXbL1mLeK6v8C23IwgIdPA4j9ANwKOBw2N-YP9K64_ztEElphe2XqHp_2hR7sCU1xrR_-78vDmc53JqOzRFLUOxAiqMfRDyjo Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1799a41a98f2402d9d0be6299378c82e Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:41.883691 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1799a41a98f2402d9d0be6299378c82e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1799a41a98f2402d9d0be6299378c82e Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: feb1538f3fd84e2e999c52183a896172 Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: {"hw:numa_nodes": "1"} Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:41.885272 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'flavor_id': '1580746863', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:41.886129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 03:30:41.887376 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:41.888615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-782c0659-baf8-41ff-9bc6-3e10f09b9294 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:41.889701 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-782c0659-baf8-41ff-9bc6-3e10f09b9294 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064 tempest-FlavorsExtraSpecsNegativeTestJSON-339132064-project] 10.222.0.58 "PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.126279 Aug 24 03:30:41.899731 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 151/316] 10.222.0.58 () {60 vars in 1265 bytes} [Wed Aug 24 03:30:41 2022] PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes => generated 124 bytes in 136 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:41.929937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:41.933586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:41.990806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:41.991506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:42.003007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:42.006183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:42.006706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:42.007155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:42.037543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Lazy-loading 'flavor' on Instance uuid aab485dc-1794-4a5b-869d-828cd355a9a0 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:30:42.117126 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance aab485dc-1794-4a5b-869d-828cd355a9a0 while it is in vm_state suspended Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Request method failure captured: Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0/action HTTP/1.1 Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 98 Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZsm1JaS0SeIBIHtB5UbwVCJsISNkuGNgwLdkdqC_J6FgxA7_ZY1FrKRMkwi81Z9hAEGoSXIqA4ZmcWbEDhLex0XOAS7FfAlsgqJFA99JAKnHY_JVkP-7DtG9Pg9tYUkGDKg-Vriu_VasTOtm9ujP3YJFWb-z8C8IezuIEyK-ZaiHZM Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 03331eb6d122450fa5ea8e8d73e84553 Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-LiveMigrationNegativeTest-1156016911 Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:42.128816 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_03331eb6d122450fa5ea8e8d73e84553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/03331eb6d122450fa5ea8e8d73e84553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/03331eb6d122450fa5ea8e8d73e84553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/03331eb6d122450fa5ea8e8d73e84553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-LiveMigrationNegativeTest-1156016911 Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 03331eb6d122450fa5ea8e8d73e84553 Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1156016911 Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-LiveMigrationNegativeTest-1156016911-project-admin Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 58d3f7cb751e4d119c7237d5bf24c549 Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-LiveMigrationNegativeTest-1156016911-project-admin Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: {"os-migrateLive": {"host": "n-h2-846470-15", "block_migration": true, "disk_over_commit": false}} Aug 24 03:30:42.130330 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: exception: Cannot 'os-migrateLive' instance aab485dc-1794-4a5b-869d-828cd355a9a0 while it is in vm_state suspended Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'aab485dc-1794-4a5b-869d-828cd355a9a0', 'body': {'os-migrateLive': {'host': 'n-h2-846470-15', 'block_migration': True, 'disk_over_commit': False}}} Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 03:30:42.131194 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aab485dc-1794-4a5b-869d-828cd355a9a0 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:42.132429 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance aab485dc-1794-4a5b-869d-828cd355a9a0 while it is in vm_state suspended Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance aab485dc-1794-4a5b-869d-828cd355a9a0 while it is in vm_state suspended Aug 24 03:30:42.133753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.135801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance aab485dc-1794-4a5b-869d-828cd355a9a0 while it is in vm_state suspended {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:42.141150 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65ba723f-8b78-40b3-9a9c-3623eee2a83d tempest-LiveMigrationNegativeTest-1156016911 tempest-LiveMigrationNegativeTest-1156016911-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0/action" status: 409 len: 155 microversion: 2.1 time: 0.400485 Aug 24 03:30:42.150130 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 166/317] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:30:41 2022] POST /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0/action => generated 155 bytes in 412 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:30:42.156297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:42.157483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:42.164879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:42.166506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:42.167168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:42.168079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:42.169063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:42.169511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:42.819120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:42.839223 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e108dfa6-fea9-4cc5-8932-686bfbee498c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.687612 Aug 24 03:30:42.840872 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 167/318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:42 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:42.848870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-10f62266-d7a5-4722-9efa-9fa2c744cdc5 req-f14bc73d-6f51-4543-a753-68662a305c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7aa936-21eb-4c3a-8829-a29d00b4814d", "tag": "6a883dd7-0669-479f-8f71-6ce06bf55747"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:42.877409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-10f62266-d7a5-4722-9efa-9fa2c744cdc5 req-f14bc73d-6f51-4543-a753-68662a305c89 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:42.878822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-10f62266-d7a5-4722-9efa-9fa2c744cdc5 req-f14bc73d-6f51-4543-a753-68662a305c89 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:42.879631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-10f62266-d7a5-4722-9efa-9fa2c744cdc5 req-f14bc73d-6f51-4543-a753-68662a305c89 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:42.908509 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-10f62266-d7a5-4722-9efa-9fa2c744cdc5 req-f14bc73d-6f51-4543-a753-68662a305c89 service nova] Creating event network-changed:6a883dd7-0669-479f-8f71-6ce06bf55747 for instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d on n-h2-846470-15 Aug 24 03:30:42.916740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-10f62266-d7a5-4722-9efa-9fa2c744cdc5 req-f14bc73d-6f51-4543-a753-68662a305c89 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072411 Aug 24 03:30:42.919197 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 168/319] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:42.927152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8af97140-d4bc-46c3-b480-c2609d0e7a54 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:42.929445 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:42.929445 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:42.968939 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-8af97140-d4bc-46c3-b480-c2609d0e7a54 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] HTTP exception thrown: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8af97140-d4bc-46c3-b480-c2609d0e7a54 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Request method failure captured: Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/flavors/1580746863/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtX_BVM5H6H1JjJg0YzomyTirjBHMZLPk4hJpKLacWbJ3BGdgEwzBPNJ9YPFuwRsiC4CHAZAibjtrUeHj7Ow7gGijEsaLS6zcKuUxjTjUGnb0aAyNrmwwgzzc0XsNZ2Jyry-3xuYKE4c8Wyw4VT74F3WODFQX4jQviZBvw0EhGSbtk Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 5f925482709c4f3b9f40936b5da10c0a Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:30:42.980317 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 5f925482709c4f3b9f40936b5da10c0a Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0e999ca4735b4c88b9e2aaada872f387 Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:42.981776 n-d-846470-15 devstack@n-api.service[122536]: exception: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'flavor_id': '1580746863', 'id': 'hw:cpu_thread_policy'} Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:42.982547 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.984075 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:42.984075 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:42.984075 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:42.984075 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:42.984075 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:42.984075 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. Aug 24 03:30:42.984075 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:42.985060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8af97140-d4bc-46c3-b480-c2609d0e7a54 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Returning 404 to user: Flavor 1580746863 has no extra specs with key hw:cpu_thread_policy. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:42.987439 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8af97140-d4bc-46c3-b480-c2609d0e7a54 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1580746863/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.066550 Aug 24 03:30:42.990214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 169/320] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:30:42 2022] DELETE /compute/v2.1/flavors/1580746863/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:43.013784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1935771933", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:43.042010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:43.056600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:43.058176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:43.059379 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0f70fbc6-0454-4698-8cc9-246e759174c2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 1.164346 Aug 24 03:30:43.088536 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 152/321] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:41 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:43.100244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:43.100779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:43.113603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:43.114096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:43.114558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=32 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:43.119092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:43.120230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:43.120716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:43.121152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:43.173802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:43.176484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:30:43.473456 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-70612d8c-fd7a-4558-870a-bab22cf12dcf tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 204 len: 0 microversion: 2.1 time: 0.383193 Aug 24 03:30:43.474601 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 153/322] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:30:43 2022] DELETE /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:30:43.484473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0145bd46-5daa-4e1a-ac6c-177d9a6b0b96 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:43.490536 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:43.490536 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:43.492368 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-0145bd46-5daa-4e1a-ac6c-177d9a6b0b96 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0145bd46-5daa-4e1a-ac6c-177d9a6b0b96 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Request method failure captured: Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 27 Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtX_BVM5H6H1JjJg0YzomyTirjBHMZLPk4hJpKLacWbJ3BGdgEwzBPNJ9YPFuwRsiC4CHAZAibjtrUeHj7Ow7gGijEsaLS6zcKuUxjTjUGnb0aAyNrmwwgzzc0XsNZ2Jyry-3xuYKE4c8Wyw4VT74F3WODFQX4jQviZBvw0EhGSbtk Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 5f925482709c4f3b9f40936b5da10c0a Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:43.494754 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 5f925482709c4f3b9f40936b5da10c0a Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0e999ca4735b4c88b9e2aaada872f387 Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: {"hw:cpu_policy": "shared"} Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:43.496104 n-d-846470-15 devstack@n-api.service[122535]: exception: Request body and URI mismatch Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'flavor_id': '1580746863', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:43.496863 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:43.499282 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:43.499282 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:43.499282 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 24 03:30:43.499282 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:43.502622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0145bd46-5daa-4e1a-ac6c-177d9a6b0b96 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:43.504027 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0145bd46-5daa-4e1a-ac6c-177d9a6b0b96 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.027902 Aug 24 03:30:43.504891 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 154/323] 10.222.0.58 () {60 vars in 1265 bytes} [Wed Aug 24 03:30:43 2022] PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:43.930230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:43.931872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:43.932733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:43.933412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:43.933972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:43.948746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:43.949674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:43.950372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:43.951454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:43.952715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:43.953455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:43.976213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Getting quotas for project 5133f7b150e746218ddd8d5bbc3dfa28. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:43.983161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Getting quotas for user b79f649eb1e4427d92b8221dfec3d779 and project 5133f7b150e746218ddd8d5bbc3dfa28. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:44.004237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.utils [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] instances quota exceeded for 5133f7b150e746218ddd8d5bbc3dfa28, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122536) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 03:30:44.005473 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Request method failure captured: Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 145 Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtSXUamwjEz4M7JnT3GzaVvO8jeV6WiSspEWZHNhq1EzqegamkZZ-Go5LoK9c9NxaCGxBkImxPdCTRmcRYAWdXhGUm9iJEb-bt3hkPP2iYR4zmMGwpu1yFnjdchU1AK4RyJKHnDRWcqxnLTeEETU4L_7O_m0-dZxs9abCcoC5ApAgM Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 5133f7b150e746218ddd8d5bbc3dfa28 Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:44.009427 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 5133f7b150e746218ddd8d5bbc3dfa28 Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-QuotasAdminNegativeTest-2102187627-project Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: b79f649eb1e4427d92b8221dfec3d779 Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-QuotasAdminNegativeTest-2102187627-project Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1935771933", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} Aug 24 03:30:44.010709 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1935771933', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452'}}} Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 03:30:44.011432 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:44.017168 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.018318 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-805c4b06-416d-4e07-a125-6b1180dd6de9 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.014158 Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 170/324] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:42 2022] POST /compute/v2.1/servers => generated 119 bytes in 1021 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:44.019441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.022019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:44.025948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.026445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.026880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.027706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.028125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.028547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.159348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a5e720c4-7c22-440b-8679-bb55d0020a7f tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2095463274", "id": 854214085, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:44.162775 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:44.162775 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:44.201159 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a5e720c4-7c22-440b-8679-bb55d0020a7f tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.694964 Aug 24 03:30:44.202375 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 155/325] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:43 2022] POST /compute/v2.1/flavors => generated 427 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:44.218272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4379e298-6333-4808-b26b-140bd9726a0d tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4379e298-6333-4808-b26b-140bd9726a0d tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Request method failure captured: Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 49 Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtX_BVM5H6H1JjJg0YzomyTirjBHMZLPk4hJpKLacWbJ3BGdgEwzBPNJ9YPFuwRsiC4CHAZAibjtrUeHj7Ow7gGijEsaLS6zcKuUxjTjUGnb0aAyNrmwwgzzc0XsNZ2Jyry-3xuYKE4c8Wyw4VT74F3WODFQX4jQviZBvw0EhGSbtk Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 5f925482709c4f3b9f40936b5da10c0a Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:30:44.225456 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f925482709c4f3b9f40936b5da10c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 5f925482709c4f3b9f40936b5da10c0a Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0e999ca4735b4c88b9e2aaada872f387 Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 24 03:30:44.226975 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'flavor_id': '1580746863', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance: Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 24 03:30:44.227771 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.229209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:44.230474 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:44.230474 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:44.230474 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:30:44.230474 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:30:44.230474 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 03:30:44.230474 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:44.230474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4379e298-6333-4808-b26b-140bd9726a0d tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:44.231431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:44.236283 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4379e298-6333-4808-b26b-140bd9726a0d tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.023551 Aug 24 03:30:44.240679 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66a0bd56-9797-4f22-b2ce-52da0f79c096 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1466 microversion: 2.1 time: 0.226564 Aug 24 03:30:44.241227 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 156/326] 10.222.0.58 () {60 vars in 1265 bytes} [Wed Aug 24 03:30:44 2022] PUT /compute/v2.1/flavors/1580746863/os-extra_specs/hw:numa_nodes => generated 117 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:30:44.242110 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 171/327] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:44 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1466 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:44.246046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6c320f81-a6bd-4c48-9b55-3b52209f1206 req-9783b717-9753-4228-8432-217f1359becb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adea76d3-8c1f-4645-a7ba-5ede9ac10799", "tag": "cb73f79b-76ad-496f-888b-ae6a7e36c8af"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:44.248057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.248979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:44.256733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.257373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.257836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.258885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.259303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.260068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.270051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c320f81-a6bd-4c48-9b55-3b52209f1206 req-9783b717-9753-4228-8432-217f1359becb service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.270533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c320f81-a6bd-4c48-9b55-3b52209f1206 req-9783b717-9753-4228-8432-217f1359becb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.270962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c320f81-a6bd-4c48-9b55-3b52209f1206 req-9783b717-9753-4228-8432-217f1359becb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.287600 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6c320f81-a6bd-4c48-9b55-3b52209f1206 req-9783b717-9753-4228-8432-217f1359becb service nova] Creating event network-changed:cb73f79b-76ad-496f-888b-ae6a7e36c8af for instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 on n-h2-846470-15 Aug 24 03:30:44.292699 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6c320f81-a6bd-4c48-9b55-3b52209f1206 req-9783b717-9753-4228-8432-217f1359becb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050138 Aug 24 03:30:44.293611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 157/328] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:44.300613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9df51459-d176-407d-950a-d8279170e636 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Action: 'update', calling method: .version_select at 0x7f102b595ca0>, body: {"quota_set": {"instances": 10}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:44.476721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:44.485534 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-580c25bf-9feb-4b4c-863d-2e918e0a9dbf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.242062 Aug 24 03:30:44.486824 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 172/329] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:44 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:44.517314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.518953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:44.528490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.529417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.530353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.532080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.533681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.534771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.676307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9df51459-d176-407d-950a-d8279170e636 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.678602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9df51459-d176-407d-950a-d8279170e636 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.680722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9df51459-d176-407d-950a-d8279170e636 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.682282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9df51459-d176-407d-950a-d8279170e636 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.684433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9df51459-d176-407d-950a-d8279170e636 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.695498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9df51459-d176-407d-950a-d8279170e636 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.783210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:44.812554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:44.815989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:44.821379 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d80103dd-2130-4b6c-a103-3757242021b1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.331304 Aug 24 03:30:44.822217 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 173/330] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:44 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:44.865362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d5bb981-49e9-45f1-b2ce-afe0e635ff9b tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.867154 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:44.867154 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:44.893310 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9df51459-d176-407d-950a-d8279170e636 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 329 microversion: 2.1 time: 0.594993 Aug 24 03:30:44.893310 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 158/331] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:30:44 2022] PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 329 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:44.897317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc21a41e-ac6b-48d4-a822-e231fc1fe24a tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.898390 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:44.898390 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:44.924680 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc21a41e-ac6b-48d4-a822-e231fc1fe24a tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1580746863" status: 202 len: 0 microversion: 2.1 time: 0.031495 Aug 24 03:30:44.925747 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 159/332] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:30:44 2022] DELETE /compute/v2.1/flavors/1580746863 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:44.934940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57e8586f-ebfe-45c9-8eb4-9a3faea64558 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Calling method '.version_select at 0x7f102b63ac10>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.941894 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d5bb981-49e9-45f1-b2ce-afe0e635ff9b tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/854214085" status: 202 len: 0 microversion: 2.1 time: 0.117959 Aug 24 03:30:44.946367 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 174/333] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:30:44 2022] DELETE /compute/v2.1/flavors/854214085 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:44.956559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d9ab7ed-23a1-4126-b36b-bc365d426b7f tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.979390 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d9ab7ed-23a1-4126-b36b-bc365d426b7f tempest-FlavorsExtraSpecsNegativeTestJSON-545851630 tempest-FlavorsExtraSpecsNegativeTestJSON-545851630-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031711 Aug 24 03:30:44.980369 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 175/334] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:44.986488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2937b24b-5cda-44fc-8628-f7b888bfd5bf tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:45.017463 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2937b24b-5cda-44fc-8628-f7b888bfd5bf tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035652 Aug 24 03:30:45.018056 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 176/335] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:45.039543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52fc9dd1-5a40-481d-910b-3a34a44aaa3d tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1787953797", "id": 1823157341, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:45.043211 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:45.043211 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:45.069510 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-52fc9dd1-5a40-481d-910b-3a34a44aaa3d tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.034025 Aug 24 03:30:45.070320 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 177/336] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:45 2022] POST /compute/v2.1/flavors => generated 417 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:45.088822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1b03ee01-6cb8-4e02-8aa3-708cba87382c tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:45.113670 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1b03ee01-6cb8-4e02-8aa3-708cba87382c tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.030383 Aug 24 03:30:45.124906 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 178/337] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:45 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:45.134918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-736985c4-a552-4420-8c07-e35006f62157 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:45.163271 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-736985c4-a552-4420-8c07-e35006f62157 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1823157341" status: 202 len: 0 microversion: 2.1 time: 0.031866 Aug 24 03:30:45.167499 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 179/338] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:30:45 2022] DELETE /compute/v2.1/flavors/1823157341 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:45.174199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed7486d7-1a8f-4df5-aa0f-3b2a4f3515b6 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:45.223523 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed7486d7-1a8f-4df5-aa0f-3b2a4f3515b6 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054352 Aug 24 03:30:45.235696 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 180/339] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:45.244874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e480d26e-65db-4f4e-b9d4-4c5d3318d265 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1929182003", "id": 1325203578, "os-flavor-access:is_public": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:45.272017 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e480d26e-65db-4f4e-b9d4-4c5d3318d265 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.032120 Aug 24 03:30:45.275706 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 181/340] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:45 2022] POST /compute/v2.1/flavors => generated 429 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:45.288118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:45.289134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:45.297047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:45.298076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:45.298469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:45.299229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:45.299724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:45.300283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:45.471868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:45.474629 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-57e8586f-ebfe-45c9-8eb4-9a3faea64558 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 371 microversion: 2.1 time: 0.547684 Aug 24 03:30:45.475637 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 160/341] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:30:44 2022] GET /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 371 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:45.483006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-912c7f83-1ceb-4641-b35a-90100f019abd tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:45.520258 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-912c7f83-1ceb-4641-b35a-90100f019abd tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1325203578" status: 202 len: 0 microversion: 2.1 time: 0.043244 Aug 24 03:30:45.521595 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 161/342] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:30:45 2022] DELETE /compute/v2.1/flavors/1325203578 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:45.530672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29a392c4-404f-45b1-9bcf-79accc7adb28 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Action: 'update', calling method: .version_select at 0x7f102b620e50>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:45.960281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29a392c4-404f-45b1-9bcf-79accc7adb28 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:45.960770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29a392c4-404f-45b1-9bcf-79accc7adb28 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:45.961567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29a392c4-404f-45b1-9bcf-79accc7adb28 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:45.962300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29a392c4-404f-45b1-9bcf-79accc7adb28 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:45.964607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29a392c4-404f-45b1-9bcf-79accc7adb28 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:45.969435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29a392c4-404f-45b1-9bcf-79accc7adb28 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:46.105214 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-29a392c4-404f-45b1-9bcf-79accc7adb28 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 325 microversion: 2.1 time: 0.578487 Aug 24 03:30:46.106210 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 162/343] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:30:45 2022] PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 325 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:46.121662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:46.122172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:46.128557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:46.131657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:46.132150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:46.132885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:46.133348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:46.133775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:46.136328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:46.153775 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be6e443e-7002-48d1-84df-5ecf4408bd48 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1466 microversion: 2.1 time: 0.878566 Aug 24 03:30:46.163959 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 182/344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:45 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1466 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:46.180732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5bdf1302-751c-414f-b878-32222aea17b9 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:46.229624 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5bdf1302-751c-414f-b878-32222aea17b9 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064162 Aug 24 03:30:46.241155 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 183/345] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:46.267145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:46.268551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:46.275610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:46.276542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:46.277219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:46.278158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:46.278833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:46.279861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:46.742278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:46.751541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:46.753088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:46.764750 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-150705fa-7c70-4eca-8132-41b00bff4341 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.515336 Aug 24 03:30:46.780359 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 184/346] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:46 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:46.785492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6587ba44-2c0e-4aa1-9875-8d227164e660 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-3787209", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:46.789179 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:46.789179 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:46.823461 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6587ba44-2c0e-4aa1-9875-8d227164e660 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 504 microversion: 2.1 time: 0.040079 Aug 24 03:30:46.825225 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 185/347] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:46 2022] POST /compute/v2.1/flavors => generated 504 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:46.832627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-657443388", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:46.930806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:47.289377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:47.300395 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5f6c3aa-c913-47aa-9dd9-9225a57d2599 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 1.193501 Aug 24 03:30:47.312588 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 163/348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:46 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:47.321507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a9cc539-c3af-4253-991b-290fe24d1674 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:47.322284 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:47.322284 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:47.384277 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a9cc539-c3af-4253-991b-290fe24d1674 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/b4fccde1-b0b4-41bd-8715-01a35edd41b6" status: 202 len: 0 microversion: 2.1 time: 0.078780 Aug 24 03:30:47.386704 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 164/349] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:30:47 2022] DELETE /compute/v2.1/flavors/b4fccde1-b0b4-41bd-8715-01a35edd41b6 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:47.393393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:47.393978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:47.412326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:47.417605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:47.418274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:47.425145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:47.425893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:47.426488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:47.526379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:47.529039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:47.531015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:47.531693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:47.532528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:47.548517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:47.550835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:47.551762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:47.553208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:47.556243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:47.557262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:47.590851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Getting quotas for project 5133f7b150e746218ddd8d5bbc3dfa28. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:47.603861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Getting quotas for user b79f649eb1e4427d92b8221dfec3d779 and project 5133f7b150e746218ddd8d5bbc3dfa28. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:47.624684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.utils [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] ram quota exceeded for 5133f7b150e746218ddd8d5bbc3dfa28, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122536) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 03:30:47.625713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Request method failure captured: Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 144 Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtSXUamwjEz4M7JnT3GzaVvO8jeV6WiSspEWZHNhq1EzqegamkZZ-Go5LoK9c9NxaCGxBkImxPdCTRmcRYAWdXhGUm9iJEb-bt3hkPP2iYR4zmMGwpu1yFnjdchU1AK4RyJKHnDRWcqxnLTeEETU4L_7O_m0-dZxs9abCcoC5ApAgM Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 5133f7b150e746218ddd8d5bbc3dfa28 Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:47.630401 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 5133f7b150e746218ddd8d5bbc3dfa28 Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-QuotasAdminNegativeTest-2102187627-project Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: b79f649eb1e4427d92b8221dfec3d779 Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-QuotasAdminNegativeTest-2102187627-project Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-657443388", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} Aug 24 03:30:47.631832 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-657443388', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452'}}} Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 03:30:47.632520 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:47.633552 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:47.634753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:47.636033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:47.636033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:47.636033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:47.636033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:47.636033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 03:30:47.636033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:47.640808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:47.643627 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e9a70c66-5987-44ef-b746-3d46edb92d13 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.817189 Aug 24 03:30:47.653416 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 186/350] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:46 2022] POST /compute/v2.1/servers => generated 110 bytes in 827 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:47.661811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92b59eaf-db16-4b44-9526-cb0d25e27ab9 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:47.705203 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92b59eaf-db16-4b44-9526-cb0d25e27ab9 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050673 Aug 24 03:30:47.722094 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 187/351] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:47.728261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6d40b933-c4f2-4269-adc9-261848dca279 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Action: 'update', calling method: .version_select at 0x7f102373a700>, body: {"quota_set": {"ram": 51200}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:48.011193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d40b933-c4f2-4269-adc9-261848dca279 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.011782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d40b933-c4f2-4269-adc9-261848dca279 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.012866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d40b933-c4f2-4269-adc9-261848dca279 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.013988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d40b933-c4f2-4269-adc9-261848dca279 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.014519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d40b933-c4f2-4269-adc9-261848dca279 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.015241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d40b933-c4f2-4269-adc9-261848dca279 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.027087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=11 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:48.055922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:48.123795 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6d40b933-c4f2-4269-adc9-261848dca279 tempest-QuotasAdminNegativeTest-248043564 tempest-QuotasAdminNegativeTest-248043564-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 200 len: 329 microversion: 2.1 time: 0.400419 Aug 24 03:30:48.124948 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 188/352] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:30:47 2022] PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 329 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:48.135971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4eff247a-6af2-483d-b097-725b06a5a830 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1797428179", "id": "78e777dc-d8fa-4fa6-bc9d-2293c963b857", "os-flavor-access:is_public": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:48.139789 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:48.139789 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:48.190658 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4eff247a-6af2-483d-b097-725b06a5a830 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.060640 Aug 24 03:30:48.190897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:48.192537 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 189/353] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:48 2022] POST /compute/v2.1/flavors => generated 507 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:48.207096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:48.209038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:48.209789 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a03a9c28-5a77-4a4a-a533-ea62ef4b6d68 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1466 microversion: 2.1 time: 0.821051 Aug 24 03:30:48.214174 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 165/354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:47 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1466 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:48.238088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.238584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.239015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.239763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.240215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.240635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.318623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8800684c-68c7-45bd-b9ee-779ab42415e3 tempest-QuotaClassesAdminTestJSON-10366158 tempest-QuotaClassesAdminTestJSON-10366158-project-admin] Calling method '.version_select at 0x7f102b5ae700>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:48.319417 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:48.319417 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:48.338801 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8800684c-68c7-45bd-b9ee-779ab42415e3 tempest-QuotaClassesAdminTestJSON-10366158 tempest-QuotaClassesAdminTestJSON-10366158-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.122714 Aug 24 03:30:48.340130 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 166/355] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 24 03:30:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:48.365122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51140c95-5a9b-4674-b9ad-457ebd735473 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Action: 'update', calling method: .version_select at 0x7f102b5aef70>, body: {"quota_set": {"ram": 0}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:48.375088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51140c95-5a9b-4674-b9ad-457ebd735473 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b79f649eb1e4427d92b8221dfec3d779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5133f7b150e746218ddd8d5bbc3dfa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51140c95-5a9b-4674-b9ad-457ebd735473 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Request method failure captured: Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 HTTP/1.1 Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 25 Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtSXUamwjEz4M7JnT3GzaVvO8jeV6WiSspEWZHNhq1EzqegamkZZ-Go5LoK9c9NxaCGxBkImxPdCTRmcRYAWdXhGUm9iJEb-bt3hkPP2iYR4zmMGwpu1yFnjdchU1AK4RyJKHnDRWcqxnLTeEETU4L_7O_m0-dZxs9abCcoC5ApAgM Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 5133f7b150e746218ddd8d5bbc3dfa28 Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:30:48.378303 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5133f7b150e746218ddd8d5bbc3dfa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 5133f7b150e746218ddd8d5bbc3dfa28 Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2102187627 Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-QuotasAdminNegativeTest-2102187627-project Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: b79f649eb1e4427d92b8221dfec3d779 Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-QuotasAdminNegativeTest-2102187627-project Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: {"quota_set": {"ram": 0}} Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 03:30:48.379516 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '5133f7b150e746218ddd8d5bbc3dfa28', 'body': {'quota_set': {'ram': 0}}} Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:48.380305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:48.381336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:48.382430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:48.382430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:48.382430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:30:48.382430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:30:48.382430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 03:30:48.382430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:30:48.388069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51140c95-5a9b-4674-b9ad-457ebd735473 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:48.389342 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-51140c95-5a9b-4674-b9ad-457ebd735473 tempest-QuotasAdminNegativeTest-2102187627 tempest-QuotasAdminNegativeTest-2102187627-project] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28" status: 403 len: 116 microversion: 2.1 time: 0.047899 Aug 24 03:30:48.396336 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 167/356] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:30:48 2022] PUT /compute/v2.1/os-quota-sets/5133f7b150e746218ddd8d5bbc3dfa28 => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:48.405619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-439fb44c-d9bc-4b97-b969-640e286fa71f tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:48.407097 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:48.407097 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:48.469744 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-439fb44c-d9bc-4b97-b969-640e286fa71f tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/78e777dc-d8fa-4fa6-bc9d-2293c963b857" status: 202 len: 0 microversion: 2.1 time: 0.070145 Aug 24 03:30:48.471245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 168/357] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:30:48 2022] DELETE /compute/v2.1/flavors/78e777dc-d8fa-4fa6-bc9d-2293c963b857 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:48.472446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:48.478718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:48.479688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:48.488321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:48.494707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:48.496453 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1ca6a97-b24d-4770-b749-ea8bf13268a5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.301719 Aug 24 03:30:48.507977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.507977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.507977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.507977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.508451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.508451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.508696 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 190/358] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:48 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:48.515503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8be3dcd2-2561-4aad-9567-2c6e434395f7 tempest-QuotaClassesAdminTestJSON-10366158 tempest-QuotaClassesAdminTestJSON-10366158-project-admin] Action: 'update', calling method: .version_select at 0x7f1023613ee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:48.532755 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:48.532755 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:49.038974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8be3dcd2-2561-4aad-9567-2c6e434395f7 tempest-QuotaClassesAdminTestJSON-10366158 tempest-QuotaClassesAdminTestJSON-10366158-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.528525 Aug 24 03:30:49.044539 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 191/359] 10.222.0.58 () {60 vars in 1206 bytes} [Wed Aug 24 03:30:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:49.056764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d36c7f7-8e58-4bb9-a194-9bcd2e515f58 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:49.107481 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d36c7f7-8e58-4bb9-a194-9bcd2e515f58 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061510 Aug 24 03:30:49.110923 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 192/360] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:49.119863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d90f8519-2c7c-4651-b535-35ad98e9e161 req-99a0aa0c-8048-40c0-a661-fe12a3ff7fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab485dc-1794-4a5b-869d-828cd355a9a0", "name": "network-vif-deleted", "tag": "203f9ffa-fc6d-41fe-9aef-42ec4f2e3ba7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:49.139121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d90f8519-2c7c-4651-b535-35ad98e9e161 req-99a0aa0c-8048-40c0-a661-fe12a3ff7fd0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:49.139627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d90f8519-2c7c-4651-b535-35ad98e9e161 req-99a0aa0c-8048-40c0-a661-fe12a3ff7fd0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:49.140112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d90f8519-2c7c-4651-b535-35ad98e9e161 req-99a0aa0c-8048-40c0-a661-fe12a3ff7fd0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:49.166175 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d90f8519-2c7c-4651-b535-35ad98e9e161 req-99a0aa0c-8048-40c0-a661-fe12a3ff7fd0 service nova] Creating event network-vif-deleted:203f9ffa-fc6d-41fe-9aef-42ec4f2e3ba7 for instance aab485dc-1794-4a5b-869d-828cd355a9a0 on n-h1-846470-15 Aug 24 03:30:49.172535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:49.178117 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d90f8519-2c7c-4651-b535-35ad98e9e161 req-99a0aa0c-8048-40c0-a661-fe12a3ff7fd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066403 Aug 24 03:30:49.178719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 193/361] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:49.183805 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-610333c2-142c-4aba-b6f5-ad9d93bf7c40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.710855 Aug 24 03:30:49.195624 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 169/362] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:48 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:49.195624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c5624b3-13db-4f2e-a88f-7f0e8e312f10 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-299388155", "id": 525054086, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:49.196390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-09aa3da4-ef0b-4acc-9cdb-20229ebb5cca tempest-QuotaClassesAdminTestJSON-10366158 tempest-QuotaClassesAdminTestJSON-10366158-project-admin] Calling method '.version_select at 0x7f1023613310>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:49.196560 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:49.196560 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:49.202896 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:49.202896 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:49.218652 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-09aa3da4-ef0b-4acc-9cdb-20229ebb5cca tempest-QuotaClassesAdminTestJSON-10366158 tempest-QuotaClassesAdminTestJSON-10366158-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.033236 Aug 24 03:30:49.219701 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 194/363] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 24 03:30:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:49.235573 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c5624b3-13db-4f2e-a88f-7f0e8e312f10 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.048124 Aug 24 03:30:49.237021 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 170/364] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:49 2022] POST /compute/v2.1/flavors => generated 410 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:49.242225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:49.243014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-30df74a8-ca94-4a41-a0ea-5d57e4fe0cf1 tempest-QuotaClassesAdminTestJSON-10366158 tempest-QuotaClassesAdminTestJSON-10366158-project-admin] Action: 'update', calling method: .version_select at 0x7f10239b63a0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:49.243537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:49.250927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:49.251436 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:49.251436 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:49.252066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:49.252897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:49.253817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:49.254594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:49.255423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:49.324367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:49.324977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:49.325336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:49.325798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lazy-loading 'fault' on Instance uuid aab485dc-1794-4a5b-869d-828cd355a9a0 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:30:49.441281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:49.457194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4f2c820f-7251-4e75-a700-146090b17428 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 200 len: 1309 microversion: 2.1 time: 0.218776 Aug 24 03:30:49.457843 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 171/365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:49 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 1309 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:49.462566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-95716a89-bfed-476d-ba1a-bd154872c6b8 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:49.470114 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-95716a89-bfed-476d-ba1a-bd154872c6b8 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/525054086" status: 200 len: 410 microversion: 2.1 time: 0.011249 Aug 24 03:30:49.471212 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 172/366] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:49 2022] GET /compute/v2.1/flavors/525054086 => generated 410 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:49.490238 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-30df74a8-ca94-4a41-a0ea-5d57e4fe0cf1 tempest-QuotaClassesAdminTestJSON-10366158 tempest-QuotaClassesAdminTestJSON-10366158-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.260081 Aug 24 03:30:49.499747 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 195/367] 10.222.0.58 () {60 vars in 1206 bytes} [Wed Aug 24 03:30:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:49.570992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:49.571984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:49.582990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:49.583454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:49.598066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:49.599852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:49.600352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:49.601005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.003280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:50.028533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:50.038560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:50.043325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a0ea88b9-4b8b-4e1d-9ddc-39129dc7de0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.517905 Aug 24 03:30:50.051262 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 196/368] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:49 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:50.118070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e314a341-d493-4acc-b3a1-0b7d42e3fc4f tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.186019 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e314a341-d493-4acc-b3a1-0b7d42e3fc4f tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.704342 Aug 24 03:30:50.189716 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 173/369] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:49 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:50.217748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7dc298d3-c8a9-44b5-bb33-79049d9a7d6a tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.218585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.219734 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:50.219734 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:50.221635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:50.228653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9,nova_api:UPDATE=25 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:50.243970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.244487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.247897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.248759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.249251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.253044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.298621 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7dc298d3-c8a9-44b5-bb33-79049d9a7d6a tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/525054086" status: 202 len: 0 microversion: 2.1 time: 0.096057 Aug 24 03:30:50.302667 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 197/370] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:30:50 2022] DELETE /compute/v2.1/flavors/525054086 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:50.315131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-560879ab-08c9-4206-a6f8-ff3e678f723e tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.404201 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-560879ab-08c9-4206-a6f8-ff3e678f723e tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097135 Aug 24 03:30:50.405269 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 198/371] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:50.433137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a86378b2-25f6-4e77-8246-483cd469efe0 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1471231089", "id": 845256805, "os-flavor-access:is_public": "False"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:50.439842 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:50.439842 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:50.467720 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a86378b2-25f6-4e77-8246-483cd469efe0 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.042961 Aug 24 03:30:50.476523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 199/372] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:50 2022] POST /compute/v2.1/flavors => generated 427 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:50.488279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.489243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: aab485dc-1794-4a5b-869d-828cd355a9a0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:50.496926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.497671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.498380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.499265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.500025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.500755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.550315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] HTTP exception thrown: Instance aab485dc-1794-4a5b-869d-828cd355a9a0 could not be found. Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Request method failure captured: Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 HTTP/1.1 Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZskO8cupKpwCFLALTm6o9eIlfp4_XcnIRXEgANQSErsYamu0uLav4VmN2jzCj9LYbIQRFOfTse8Jv3y9iVNox1n4MXupsUE3Im_Qi38iHRiDXqh-CMMMIBj_R7wHyJMd7ntZEqMTPU8AvC7DX4PkIRCnytFinnMnp58rpO9cdYwoLs Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a8ba1d64bbb64560a57f9d906f0a2de5 Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-LiveMigrationNegativeTest-365783343 Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:50.552709 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8ba1d64bbb64560a57f9d906f0a2de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8ba1d64bbb64560a57f9d906f0a2de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ba1d64bbb64560a57f9d906f0a2de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ba1d64bbb64560a57f9d906f0a2de5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-LiveMigrationNegativeTest-365783343 Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a8ba1d64bbb64560a57f9d906f0a2de5 Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-365783343 Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-LiveMigrationNegativeTest-365783343-project Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: eb6e87b4ab604c7791e4fe61f7be0bf6 Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-LiveMigrationNegativeTest-365783343-project Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance aab485dc-1794-4a5b-869d-828cd355a9a0 could not be found. Aug 24 03:30:50.554559 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'aab485dc-1794-4a5b-869d-828cd355a9a0'} Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab485dc-1794-4a5b-869d-828cd355a9a0 could not be found. Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:50.555632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab485dc-1794-4a5b-869d-828cd355a9a0 could not be found. Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab485dc-1794-4a5b-869d-828cd355a9a0 could not be found. Aug 24 03:30:50.557288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.559013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Returning 404 to user: Instance aab485dc-1794-4a5b-869d-828cd355a9a0 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:50.566279 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2730f1b6-d5e8-43b9-be96-79bd120d7a13 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0" status: 404 len: 111 microversion: 2.1 time: 0.079283 Aug 24 03:30:50.567111 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 200/373] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:50 2022] GET /compute/v2.1/servers/aab485dc-1794-4a5b-869d-828cd355a9a0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:30:50.572846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3de39598-463c-4cd3-bbd9-0c5c8a3e0ed1 tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "845256805"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:50.613334 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-3de39598-463c-4cd3-bbd9-0c5c8a3e0ed1 tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] HTTP exception thrown: Flavor 845256805 could not be found. Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3de39598-463c-4cd3-bbd9-0c5c8a3e0ed1 tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] Request method failure captured: Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 106 Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZthf3q4PjlqFUcQjRuzEGWSNfuesfZT79mrIfFhnFeUXCqcK7PImvsrQY0LTXriPR3YZc2iWcHm5m8Y5iVPOYaqWAOCg_Wq00GnUoSowyfCdnn1IhMhf9bArfu09WPaCB9RPrwKWvrCRlEFgj-a_tOw6-bfY2UWe1BemvkC1hpNiiQ Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 1e61792b504c4ccc871d5bf55b03e1b0 Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsAdminTestJSON-183828062 Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:50.620957 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1e61792b504c4ccc871d5bf55b03e1b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1e61792b504c4ccc871d5bf55b03e1b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1e61792b504c4ccc871d5bf55b03e1b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1e61792b504c4ccc871d5bf55b03e1b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsAdminTestJSON-183828062 Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 1e61792b504c4ccc871d5bf55b03e1b0 Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-183828062 Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsAdminTestJSON-183828062-project Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: eaeff98b627442e7ae15b3adf2f42e26 Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsAdminTestJSON-183828062-project Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "test", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "845256805"}} Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:50.622468 n-d-846470-15 devstack@n-api.service[122536]: exception: Flavor 845256805 could not be found. Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '845256805'}}} Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 845256805 could not be found. Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.623415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 845256805 could not be found. Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:50.624802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:50.626088 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:50.626088 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:50.626088 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:50.626088 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 845256805 could not be found. Aug 24 03:30:50.626088 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:50.629626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3de39598-463c-4cd3-bbd9-0c5c8a3e0ed1 tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] Returning 400 to user: Flavor 845256805 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:50.630891 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3de39598-463c-4cd3-bbd9-0c5c8a3e0ed1 tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.062203 Aug 24 03:30:50.638442 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 201/374] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:50 2022] POST /compute/v2.1/servers => generated 80 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:50.648773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.650202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:50.658230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.658729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.659508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.660431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.661176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.661753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.705459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:30:50.803815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:50.820342 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0f837065-04e8-4665-8f91-21e2e11a0c1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.611426 Aug 24 03:30:50.821306 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 174/375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:50 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:50.836202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d272179-1a71-4696-b0a9-a683cd5efe33 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.836964 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:50.836964 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:50.876154 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3d272179-1a71-4696-b0a9-a683cd5efe33 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/845256805" status: 202 len: 0 microversion: 2.1 time: 0.053616 Aug 24 03:30:50.880514 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 175/376] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:30:50 2022] DELETE /compute/v2.1/flavors/845256805 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:50.885863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3cfa7d78-624c-4ea7-ad6a-e1be30055f85 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.944308 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bb02336-23e7-407e-9911-ca22404ac05c tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 204 len: 0 microversion: 2.1 time: 0.300807 Aug 24 03:30:50.948185 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 202/377] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:30:50 2022] DELETE /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:30:50.951356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3cfa7d78-624c-4ea7-ad6a-e1be30055f85 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068021 Aug 24 03:30:50.953717 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 176/378] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:50.967905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.970377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:50.973657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7fc239b2-ac48-4767-af14-b6c458de987c tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-482125899", "id": 1325157426, "os-flavor-access:is_public": "False"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:50.977121 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:50.977121 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:50.994281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.994281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.994281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.994281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.994800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.996397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.029029 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7fc239b2-ac48-4767-af14-b6c458de987c tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.059907 Aug 24 03:30:51.029746 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 177/379] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:50 2022] POST /compute/v2.1/flavors => generated 414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:51.042149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9c54056d-f553-4fc6-b93b-ff6867ce55f1 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-618098834", "id": 365067235, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:51.090247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9c54056d-f553-4fc6-b93b-ff6867ce55f1 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.052287 Aug 24 03:30:51.091955 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 178/380] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:51 2022] POST /compute/v2.1/flavors => generated 410 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:51.098178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.100490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:51.108106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.108939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.109667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.111026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.111761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.112456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.349604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:51.358134 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-539c02ea-8b03-4df7-b3af-f5fd25ca60c5 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1474 microversion: 2.1 time: 0.405634 Aug 24 03:30:51.362444 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 203/381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:50 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1474 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:51.369008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-85393497-acc6-4dda-b76e-ddd6660c0fc9 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.410045 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-85393497-acc6-4dda-b76e-ddd6660c0fc9 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.044681 Aug 24 03:30:51.419804 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 204/382] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:51.425315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-fdd24f1e-ed30-4f1b-89f6-b8024359f9e3 req-78798774-e7f4-4dbc-9dc0-b40dc936c661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b47212e-05a1-45a2-9cb6-0cc6b445ada0", "name": "network-vif-unplugged", "status": "completed", "tag": "9cdcacd1-2971-4051-893c-f6ada06261b9"}, {"name": "network-changed", "server_uuid": "9b47212e-05a1-45a2-9cb6-0cc6b445ada0", "tag": "9cdcacd1-2971-4051-893c-f6ada06261b9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:51.448437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fdd24f1e-ed30-4f1b-89f6-b8024359f9e3 req-78798774-e7f4-4dbc-9dc0-b40dc936c661 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.458666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fdd24f1e-ed30-4f1b-89f6-b8024359f9e3 req-78798774-e7f4-4dbc-9dc0-b40dc936c661 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.459330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fdd24f1e-ed30-4f1b-89f6-b8024359f9e3 req-78798774-e7f4-4dbc-9dc0-b40dc936c661 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.504686 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fdd24f1e-ed30-4f1b-89f6-b8024359f9e3 req-78798774-e7f4-4dbc-9dc0-b40dc936c661 service nova] Creating event network-vif-unplugged:9cdcacd1-2971-4051-893c-f6ada06261b9 for instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 on n-h2-846470-15 Aug 24 03:30:51.505191 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fdd24f1e-ed30-4f1b-89f6-b8024359f9e3 req-78798774-e7f4-4dbc-9dc0-b40dc936c661 service nova] Creating event network-changed:9cdcacd1-2971-4051-893c-f6ada06261b9 for instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 on n-h2-846470-15 Aug 24 03:30:51.519077 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-fdd24f1e-ed30-4f1b-89f6-b8024359f9e3 req-78798774-e7f4-4dbc-9dc0-b40dc936c661 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.097658 Aug 24 03:30:51.520327 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 205/383] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:51.531828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-59e676c9-e74b-4fb8-bf80-4e1a211690c9 req-9c34aca7-8cac-440e-b6cd-00ef254b98aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7aa936-21eb-4c3a-8829-a29d00b4814d", "name": "network-vif-plugged", "status": "completed", "tag": "6a883dd7-0669-479f-8f71-6ce06bf55747"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:51.554210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-59e676c9-e74b-4fb8-bf80-4e1a211690c9 req-9c34aca7-8cac-440e-b6cd-00ef254b98aa service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.557907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-59e676c9-e74b-4fb8-bf80-4e1a211690c9 req-9c34aca7-8cac-440e-b6cd-00ef254b98aa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.558923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-59e676c9-e74b-4fb8-bf80-4e1a211690c9 req-9c34aca7-8cac-440e-b6cd-00ef254b98aa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.576150 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-59e676c9-e74b-4fb8-bf80-4e1a211690c9 req-9c34aca7-8cac-440e-b6cd-00ef254b98aa service nova] Creating event network-vif-plugged:6a883dd7-0669-479f-8f71-6ce06bf55747 for instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d on n-h2-846470-15 Aug 24 03:30:51.582880 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-59e676c9-e74b-4fb8-bf80-4e1a211690c9 req-9c34aca7-8cac-440e-b6cd-00ef254b98aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060646 Aug 24 03:30:51.583814 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 206/384] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:51.591534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a08a9c86-b97c-466a-9bc5-e087fc8f6d52 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.608835 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a08a9c86-b97c-466a-9bc5-e087fc8f6d52 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.023584 Aug 24 03:30:51.610632 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 207/385] 10.222.0.58 () {58 vars in 1177 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:51.624263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32fdf93c-834d-45d2-adce-a7392ee01fd6 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.641514 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32fdf93c-834d-45d2-adce-a7392ee01fd6 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.022140 Aug 24 03:30:51.642718 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 208/386] 10.222.0.58 () {58 vars in 1171 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:51.657890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f0cf629-519d-4775-8690-e6a5f50afdff tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.671175 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f0cf629-519d-4775-8690-e6a5f50afdff tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.018067 Aug 24 03:30:51.672553 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 209/387] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:51.685024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20d5a7d4-d073-47f3-8c8a-ba3b53ba108a tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.769221 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20d5a7d4-d073-47f3-8c8a-ba3b53ba108a tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.079959 Aug 24 03:30:51.770644 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 210/388] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:51.797288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a43393bb-1817-4b20-8909-36fc6dbf0a3c tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.865689 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a43393bb-1817-4b20-8909-36fc6dbf0a3c tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.076453 Aug 24 03:30:51.868480 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 211/389] 10.222.0.58 () {58 vars in 1175 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:51.878011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.879930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:51.886804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:51.888223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.889793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.890411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.891770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.892400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.892981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.904181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:51.906092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:51.907570 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11b5c8f5-b372-4085-a25f-dd9d64b7be45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.814391 Aug 24 03:30:51.908658 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 179/390] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:51.913285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db8b2126-7b1f-464f-abc3-1ca86d9e711e tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.953720 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db8b2126-7b1f-464f-abc3-1ca86d9e711e tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.043827 Aug 24 03:30:51.955075 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 180/391] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:51.973033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-35e8c90e-7105-4367-89a6-9d4b8b6137ff tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.038169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-35e8c90e-7105-4367-89a6-9d4b8b6137ff tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.067640 Aug 24 03:30:52.040415 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 181/392] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:52.060540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-564805d5-d4ab-41f7-9f5f-0637d4135783 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.061731 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:52.061731 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:52.107824 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-564805d5-d4ab-41f7-9f5f-0637d4135783 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/365067235" status: 202 len: 0 microversion: 2.1 time: 0.050055 Aug 24 03:30:52.109766 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 182/393] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:30:52 2022] DELETE /compute/v2.1/flavors/365067235 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:52.122150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d8a7486-73b9-4c3a-b67c-59a41d6215a4 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.158937 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d8a7486-73b9-4c3a-b67c-59a41d6215a4 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040717 Aug 24 03:30:52.160827 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 183/394] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:52.204127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d188aa5-215c-4dc5-a119-a071cb5cd811 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.271987 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3d188aa5-215c-4dc5-a119-a071cb5cd811 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1325157426" status: 202 len: 0 microversion: 2.1 time: 0.098579 Aug 24 03:30:52.277811 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 184/395] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:30:52 2022] DELETE /compute/v2.1/flavors/1325157426 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:30:52.284372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c99190e1-9875-45d6-953f-b7882490dfe0 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.292286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=18,nova_api:INSERT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:52.310122 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c99190e1-9875-45d6-953f-b7882490dfe0 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030619 Aug 24 03:30:52.312407 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 185/396] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:52.332470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:52.334979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-feec57fa-9198-41d2-8003-0217952b7968 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1843784981", "id": 734474124, "os-flavor-access:is_public": "False"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:52.340809 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:52.340809 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:52.344382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:52.356721 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-805283c9-7892-462c-aa47-29c98eb4d1a2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.484473 Aug 24 03:30:52.362062 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 212/397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:52.378296 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-feec57fa-9198-41d2-8003-0217952b7968 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.047564 Aug 24 03:30:52.379820 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 186/398] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:52 2022] POST /compute/v2.1/flavors => generated 412 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:52.381874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.382617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:52.395917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f7d76d9-c984-4b26-8ab2-89ce3df7e2a0 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.396092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.397259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.398149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.399074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.399314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.399758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.448120 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f7d76d9-c984-4b26-8ab2-89ce3df7e2a0 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060451 Aug 24 03:30:52.450312 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 187/399] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:52.468677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c363993d-3b69-4f4f-a58a-f5f2307debf3 tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.519432 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c363993d-3b69-4f4f-a58a-f5f2307debf3 tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055409 Aug 24 03:30:52.522328 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 188/400] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:52.544441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b0dc9e8-4923-41f8-b085-d1c39bcc6233 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.582274 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b0dc9e8-4923-41f8-b085-d1c39bcc6233 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/734474124" status: 202 len: 0 microversion: 2.1 time: 0.041418 Aug 24 03:30:52.583509 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 189/401] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:30:52 2022] DELETE /compute/v2.1/flavors/734474124 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:52.591813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a58e6586-7a7d-46ad-8cf5-b188338416ef tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.636439 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a58e6586-7a7d-46ad-8cf5-b188338416ef tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048468 Aug 24 03:30:52.638265 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 190/402] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:52.657783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-66239a3c-1017-4fef-89ed-ec17727a997c tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1129289058", "id": 1302214452, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:52.692137 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-66239a3c-1017-4fef-89ed-ec17727a997c tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.038877 Aug 24 03:30:52.692795 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 191/403] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:52 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:52.705485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2501223d-3b93-4e0d-8642-d09e836c930f tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.755860 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2501223d-3b93-4e0d-8642-d09e836c930f tempest-FlavorsAdminTestJSON-183828062 tempest-FlavorsAdminTestJSON-183828062-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.054898 Aug 24 03:30:52.761409 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 192/404] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:52.780084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-73668aef-9258-422d-b266-e554342d2da0 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.815137 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-73668aef-9258-422d-b266-e554342d2da0 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1302214452" status: 202 len: 0 microversion: 2.1 time: 0.038742 Aug 24 03:30:52.816512 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 193/405] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:30:52 2022] DELETE /compute/v2.1/flavors/1302214452 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:30:52.824709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31c6cbb8-e65b-45ce-8bb1-b202b69d3407 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.861561 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31c6cbb8-e65b-45ce-8bb1-b202b69d3407 tempest-FlavorsAdminTestJSON-2025631986 tempest-FlavorsAdminTestJSON-2025631986-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040786 Aug 24 03:30:52.864772 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 194/406] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:52.931625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.933388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:52.946235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.949887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.950694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.954062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.955171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.957946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.960255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:52.969325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b25d2a03-8fe3-4300-ba61-e1357d0c1cea tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1474 microversion: 2.1 time: 0.592109 Aug 24 03:30:52.969909 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 213/407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1474 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:53.382471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:53.383443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:53.392547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:53.395787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:53.401077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:53.402096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:53.402735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:53.404039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:53.544217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:53.557728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:53.561918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:53.566413 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b59de3ac-3dce-4003-bc98-f0b6ad803095 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.639826 Aug 24 03:30:53.569762 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 195/408] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:30:53.748082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:53.759281 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a79c3c8d-2290-447e-9ce7-a7de96c851d8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.380765 Aug 24 03:30:53.760467 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 214/409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:53 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:53.995057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:53.995615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:54.012835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.013639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.014698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.017331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.021722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.022485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.525837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:54.541160 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2e3c0af0-de1e-4201-b47d-373b629d5360 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1474 microversion: 2.1 time: 0.549933 Aug 24 03:30:54.542506 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 196/410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:53 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1474 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:54.598301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:54.599298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:54.607029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.612476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.612985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.613804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.614331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.614731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.009118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Calling method '.version_select at 0x7f10235e64c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:55.010037 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:55.010037 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:30:55.011176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.011690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.012299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.041368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.041877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.042318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.066935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.067423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.069338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.082225 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8881a20-28fe-48bf-b2d2-a38c1df3bd3a tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.642478 Aug 24 03:30:55.082831 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 215/411] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:55.096129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:55.097325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:55.107873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.108851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.109598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.110743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.111486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.112078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.364481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:55.371289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:55.376287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:55.379352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:55.381006 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a98c7eb-cd83-4fdc-809b-375500bf7c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.787642 Aug 24 03:30:55.382088 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 197/412] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:54 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:55.389160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Calling method '.version_select at 0x7f102b5955e0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:55.397175 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:55.397175 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:55.399253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.405832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.410539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.443342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.445611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.447895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.452700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:55.465650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-507cd396-ac43-4d25-a599-90e201c5db25 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.375446 Aug 24 03:30:55.466506 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 216/413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:55 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:55.501354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e37dffb5-f003-4a9a-bfff-cfba7810593f req-0853448b-bc5d-447e-8ba9-d7bc781628e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adea76d3-8c1f-4645-a7ba-5ede9ac10799", "name": "network-vif-plugged", "status": "completed", "tag": "cb73f79b-76ad-496f-888b-ae6a7e36c8af"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:55.537870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e37dffb5-f003-4a9a-bfff-cfba7810593f req-0853448b-bc5d-447e-8ba9-d7bc781628e1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.539367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e37dffb5-f003-4a9a-bfff-cfba7810593f req-0853448b-bc5d-447e-8ba9-d7bc781628e1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.540544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.541222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.541611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e37dffb5-f003-4a9a-bfff-cfba7810593f req-0853448b-bc5d-447e-8ba9-d7bc781628e1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.542059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.549902 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4865768-a743-49d7-8198-77d990536cf3 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-846470-15/servers" status: 200 len: 434 microversion: 2.1 time: 0.166399 Aug 24 03:30:55.550905 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 198/414] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 24 03:30:55 2022] GET /compute/v2.1/os-hypervisors/n-h2-846470-15/servers => generated 434 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:55.556072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-febbfed9-fa35-4624-bf09-5422c9494caf req-d1aae27e-39b7-4a51-b07d-64c1deb57927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b52cd68-411a-43f1-8409-db901889da20", "name": "network-vif-deleted", "tag": "7b057865-d7af-4e62-9540-3715df5d28eb"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:55.571899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-febbfed9-fa35-4624-bf09-5422c9494caf req-d1aae27e-39b7-4a51-b07d-64c1deb57927 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.572792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-febbfed9-fa35-4624-bf09-5422c9494caf req-d1aae27e-39b7-4a51-b07d-64c1deb57927 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.574081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-febbfed9-fa35-4624-bf09-5422c9494caf req-d1aae27e-39b7-4a51-b07d-64c1deb57927 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.592455 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-febbfed9-fa35-4624-bf09-5422c9494caf req-d1aae27e-39b7-4a51-b07d-64c1deb57927 service nova] Creating event network-vif-deleted:7b057865-d7af-4e62-9540-3715df5d28eb for instance 4b52cd68-411a-43f1-8409-db901889da20 on n-h1-846470-15 Aug 24 03:30:55.599161 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-febbfed9-fa35-4624-bf09-5422c9494caf req-d1aae27e-39b7-4a51-b07d-64c1deb57927 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046515 Aug 24 03:30:55.600768 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 199/415] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:55.614273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Calling method '.version_select at 0x7f102b610ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:55.616093 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:55.616093 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:55.618240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.619203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.619896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.631225 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e37dffb5-f003-4a9a-bfff-cfba7810593f req-0853448b-bc5d-447e-8ba9-d7bc781628e1 service nova] Creating event network-vif-plugged:cb73f79b-76ad-496f-888b-ae6a7e36c8af for instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 on n-h2-846470-15 Aug 24 03:30:55.638447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.639563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.640239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.657459 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e37dffb5-f003-4a9a-bfff-cfba7810593f req-0853448b-bc5d-447e-8ba9-d7bc781628e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170364 Aug 24 03:30:55.668586 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 217/416] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:55.669344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.670049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.670767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.686204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8c237954-47d0-4421-97e6-840bbe493fd2 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.082377 Aug 24 03:30:55.687637 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 200/417] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:30:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:55.697570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9783b53b-4513-4830-a243-4abcda9d8916 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Calling method '.version_select at 0x7f102b610790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:55.698190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:55.698904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:55.699339 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:55.699339 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:55.700989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9783b53b-4513-4830-a243-4abcda9d8916 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.702419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9783b53b-4513-4830-a243-4abcda9d8916 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.703200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9783b53b-4513-4830-a243-4abcda9d8916 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.718639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9783b53b-4513-4830-a243-4abcda9d8916 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.719771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9783b53b-4513-4830-a243-4abcda9d8916 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.722690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9783b53b-4513-4830-a243-4abcda9d8916 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.738396 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9783b53b-4513-4830-a243-4abcda9d8916 tempest-HypervisorAdminUnderV252Test-611685202 tempest-HypervisorAdminUnderV252Test-611685202-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-846470-15/search" status: 200 len: 105 microversion: 2.1 time: 0.044497 Aug 24 03:30:55.747004 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 201/418] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 24 03:30:55 2022] GET /compute/v2.1/os-hypervisors/n-h2-846470-15/search => generated 105 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:55.751340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.751529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.751962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.764037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.764657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.765114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.092509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6e87b4ab604c7791e4fe61f7be0bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ba1d64bbb64560a57f9d906f0a2de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:56.127808 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29c5d0fe-06dc-4bb9-ac26-7b3ca0a3461b tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 200 len: 1303 microversion: 2.1 time: 0.450867 Aug 24 03:30:56.159760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 218/419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:55 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 1303 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:56.406645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:56.408692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:56.414642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=17 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:56.420066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:56.421927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:56.426771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.427896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:56.428839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:56.430251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.516292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:56.531444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:56.564310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:56.565337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:56.566835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.568003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:56.569878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:56.570858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.984218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:56.993015 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e79c610c-98c2-44d6-bafd-e1adb92deae2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1317 microversion: 2.1 time: 0.510405 Aug 24 03:30:57.007470 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 219/420] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:56 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:57.019406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:57.041562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:57.043543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:57.045015 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-18810d24-a66e-49f5-ba6e-9cd1cb9eab93 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.642420 Aug 24 03:30:57.046108 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 202/421] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:56 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:57.155179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.155902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] [instance: 4b52cd68-411a-43f1-8409-db901889da20] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:57.165761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.165761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.166217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.166932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.167388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.167844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.207315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] HTTP exception thrown: Instance 4b52cd68-411a-43f1-8409-db901889da20 could not be found. Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Request method failure captured: Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 HTTP/1.1 Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZskO8cupKpwCFLALTm6o9eIlfp4_XcnIRXEgANQSErsYamu0uLav4VmN2jzCj9LYbIQRFOfTse8Jv3y9iVNox1n4MXupsUE3Im_Qi38iHRiDXqh-CMMMIBj_R7wHyJMd7ntZEqMTPU8AvC7DX4PkIRCnytFinnMnp58rpO9cdYwoLs Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a8ba1d64bbb64560a57f9d906f0a2de5 Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-LiveMigrationNegativeTest-365783343 Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:30:57.211773 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8ba1d64bbb64560a57f9d906f0a2de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8ba1d64bbb64560a57f9d906f0a2de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ba1d64bbb64560a57f9d906f0a2de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ba1d64bbb64560a57f9d906f0a2de5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-LiveMigrationNegativeTest-365783343 Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a8ba1d64bbb64560a57f9d906f0a2de5 Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-365783343 Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-LiveMigrationNegativeTest-365783343-project Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: eb6e87b4ab604c7791e4fe61f7be0bf6 Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-LiveMigrationNegativeTest-365783343-project Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 4b52cd68-411a-43f1-8409-db901889da20 could not be found. Aug 24 03:30:57.213457 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '4b52cd68-411a-43f1-8409-db901889da20'} Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b52cd68-411a-43f1-8409-db901889da20 could not be found. Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:57.214886 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b52cd68-411a-43f1-8409-db901889da20 could not be found. Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b52cd68-411a-43f1-8409-db901889da20 could not be found. Aug 24 03:30:57.216468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:30:57.217831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] Returning 404 to user: Instance 4b52cd68-411a-43f1-8409-db901889da20 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:57.217831 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b2968e26-069e-47e4-8995-916f35798c89 tempest-LiveMigrationNegativeTest-365783343 tempest-LiveMigrationNegativeTest-365783343-project] 10.222.0.58 "GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20" status: 404 len: 111 microversion: 2.1 time: 0.063146 Aug 24 03:30:57.217831 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 220/422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/servers/4b52cd68-411a-43f1-8409-db901889da20 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:58.007206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-372507358", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:58.038076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:58.080393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:58.336919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=52 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:58.392343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:58.392758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:58.393282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:58.393797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:58.394211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:58.414687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.415176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.415616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.416358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.416821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.417252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.457002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Getting quotas for project ca9864cf1adf435fb032759a1518cb8a. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:58.471825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Getting quotas for user b6330d9fee114b469aad491bf5af477d and project ca9864cf1adf435fb032759a1518cb8a. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:58.490155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:58.493225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:58.560636 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b14c442-1fbb-4920-98b3-81cb9616791e tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016872 Aug 24 03:30:58.561906 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 203/423] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:30:58.566927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:58.568098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:58.579954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.580652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.581264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.582311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.584368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.584805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.616629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca2ab933-2e21-4fb6-9538-063cbe876e48 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:58.633039 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca2ab933-2e21-4fb6-9538-063cbe876e48 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.746825 Aug 24 03:30:58.641996 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 221/424] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:58.658429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:58.659932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:58.670510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.675822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.677113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.678962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.680318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.682568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.795975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:58.808069 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8edc5064-4603-4c13-8527-3ea74df9f205 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1467 microversion: 2.1 time: 0.244909 Aug 24 03:30:58.809123 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 204/425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:58 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1467 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:58.818416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3b71b638-37d3-413b-9aaa-38a16f1f75bf tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:58.819259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3b71b638-37d3-413b-9aaa-38a16f1f75bf tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:58.918608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3b71b638-37d3-413b-9aaa-38a16f1f75bf tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:58.945424 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3b71b638-37d3-413b-9aaa-38a16f1f75bf tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1222 microversion: 2.1 time: 0.134195 Aug 24 03:30:58.958834 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 205/426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:58 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:59.011911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:59.022687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:59.027577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:59.030497 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b2acab95-4926-4b0d-b693-2141ee40c31e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.387122 Aug 24 03:30:59.036398 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 222/427] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:30:58 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:59.043321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:59.046123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:59.061308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.063233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.064593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.067440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.072257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.073274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.461932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd0932d5-967d-4e5b-9b5f-a8fd3cb34f06 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1209972528", "id": 400945594, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:59.465840 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:30:59.465840 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:30:59.490353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=47,nova_cell0:UPDATE=7 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:59.510059 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd0932d5-967d-4e5b-9b5f-a8fd3cb34f06 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.562568 Aug 24 03:30:59.518301 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 206/428] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:58 2022] POST /compute/v2.1/flavors => generated 422 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:59.524406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-415945a4-fd01-4bf8-8238-e46a6bd88432 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:59.534523 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-415945a4-fd01-4bf8-8238-e46a6bd88432 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014388 Aug 24 03:30:59.540014 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 207/429] 10.222.0.58 () {58 vars in 1182 bytes} [Wed Aug 24 03:30:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:30:59.556844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f0e93fc7-e633-479d-ae5a-08d86ce42ce7 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-845397356", "id": 197574864, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:59.594255 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f0e93fc7-e633-479d-ae5a-08d86ce42ce7 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.052736 Aug 24 03:30:59.602095 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 208/430] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:59 2022] POST /compute/v2.1/flavors => generated 421 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:59.606862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5108b08b-8927-4381-be5d-e15cf181e7ea tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:59.629914 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5108b08b-8927-4381-be5d-e15cf181e7ea tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026635 Aug 24 03:30:59.632797 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 209/431] 10.222.0.58 () {58 vars in 1182 bytes} [Wed Aug 24 03:30:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:30:59.658157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f10ac4b9-910e-4145-b8a5-286d249964ac tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Action: 'create', calling method: .version_select at 0x7f102b559a60>, body: {"keypair": {"name": "tempest-keypair-1091403419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLxOZASpKRWBE7aPw+TXN0g/1JPK+kndimfKzg9UYOupnVnDdDZ6ZZYOCQJRveGNEyfOK8n2VMDNf0hnDV84zfI0wSDVxQhx0qmlJz+TKMLS281e0pnrHywi+Fo5OO5KA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:59.708132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f10ac4b9-910e-4145-b8a5-286d249964ac tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Getting quotas for project 808a68a19ba646a29463d4cba0379351. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:59.719040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f10ac4b9-910e-4145-b8a5-286d249964ac tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Getting quotas for user 842bb125a58946649e7a150e35eca5bb and project 808a68a19ba646a29463d4cba0379351. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:59.731376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:59.731501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:59.750467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a1a46d3a-7594-4a03-8692-fec6ea8fd6a8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d" status: 200 len: 1467 microversion: 2.1 time: 0.710171 Aug 24 03:30:59.752665 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 223/432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:59 2022] GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d => generated 1467 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:59.771689 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f10ac4b9-910e-4145-b8a5-286d249964ac tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123924 Aug 24 03:30:59.779160 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 210/433] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:30:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:59.784747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:59.798843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:59.800608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Searching by: {'reservation_id': 'r-wjj9vv1b', 'deleted': False, 'project_id': 'd347f85e59734622a091e80dbf0d9521'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:30:59.808564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.809548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.811017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.812305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.813151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.813765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.967921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:59.968539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:59.977608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.980346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.982236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.984836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.985552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.991893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.033879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:31:00.189238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:00.200459 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4860b65-65e6-4120-a086-807ae0733d43 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1274 microversion: 2.1 time: 0.234657 Aug 24 03:31:00.201421 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 211/434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:59 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:00.206570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:00.220747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:00.228436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:00.228951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:00.229378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.230267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:00.231003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:00.234657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.343878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:00.351870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:00.352353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:00.352783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.795967 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2eeb72c4-00e8-47fa-a287-34e402e908be tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-wjj9vv1b" status: 200 len: 2927 microversion: 2.1 time: 1.027027 Aug 24 03:31:00.797643 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 224/435] 10.222.0.58 () {58 vars in 1197 bytes} [Wed Aug 24 03:30:59 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wjj9vv1b => generated 2927 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:00.819028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a59c131-a2ee-42f3-9639-c7a744a0d52e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:00.859208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.compute.server_groups [None req-6a59c131-a2ee-42f3-9639-c7a744a0d52e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Querying cell a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) for 2 instances {{(pid=122536) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 03:31:00.863873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a59c131-a2ee-42f3-9639-c7a744a0d52e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:00.864618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a59c131-a2ee-42f3-9639-c7a744a0d52e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:00.864845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a59c131-a2ee-42f3-9639-c7a744a0d52e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.898205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:00.911137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:00.914047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:00.926029 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c42e2b09-d8d5-4945-9a40-5986c3af1c04 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.723254 Aug 24 03:31:00.926693 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 212/436] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:00 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:00.987921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6a59c131-a2ee-42f3-9639-c7a744a0d52e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/6786a6c6-ae09-42a1-a032-6f0f14215e75" status: 200 len: 266 microversion: 2.1 time: 0.172632 Aug 24 03:31:00.995353 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 225/437] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:31:00 2022] GET /compute/v2.1/os-server-groups/6786a6c6-ae09-42a1-a032-6f0f14215e75 => generated 266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:01.001753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:01.002715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:01.015516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.016318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.030454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.032401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.035501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.036128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.224930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:01.225432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:01.239337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.239863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.240304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.241009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.246822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.248443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.525816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5baa9452-eeb7-45b6-9985-a0c7f9a6c24b tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1620 microversion: 2.1 time: 0.529860 Aug 24 03:31:01.544322 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 213/438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:00 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1620 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:01.547337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:01.557213 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-80704e3e-4595-4019-9289-af60b06bb41b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1280 microversion: 2.1 time: 0.339305 Aug 24 03:31:01.557801 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 226/439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:01 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1280 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:01.575954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:01.582410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:01.598594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.599072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.599501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.600386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.606777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.607522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.896092 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aebaa264-ad67-4e0f-bd08-bf6f42716eae tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d" status: 200 len: 1620 microversion: 2.1 time: 0.331236 Aug 24 03:31:01.897743 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 227/440] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:01 2022] GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d => generated 1620 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:01.927998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe381e4c-012e-4d20-8880-123ef864a260 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Action: 'create', calling method: .version_select at 0x7f10235e6160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1542910305", "policies": ["anti-affinity"]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:01.967337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fe381e4c-012e-4d20-8880-123ef864a260 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:01.977059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b000ee6e-6c68-46e6-8a7e-486704df5b8d tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] Action: 'create', calling method: .version_select at 0x7f102b559310>, body: {"security_group": {"name": "tempest-securitygroup-201171410", "description": "tempest-description-1562609395"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:01.988024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fe381e4c-012e-4d20-8880-123ef864a260 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:02.094240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:02.124292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fe381e4c-012e-4d20-8880-123ef864a260 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:02.140123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fe381e4c-012e-4d20-8880-123ef864a260 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:02.184696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe381e4c-012e-4d20-8880-123ef864a260 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.265253 Aug 24 03:31:02.185310 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 228/441] 10.222.0.58 () {60 vars in 1174 bytes} [Wed Aug 24 03:31:01 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:02.227338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:02.228003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:02.243048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:02.243536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:02.250352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:02.251219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:02.251979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:02.252097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:02.743386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:02.754567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:02.758462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:02.759716 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3826f134-d586-4027-89b7-fad66a723b1e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1568 microversion: 2.25 time: 0.555945 Aug 24 03:31:02.762881 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 229/442] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:02 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1568 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:02.775528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-645582841", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1ff4f6e9-c8a8-405a-adf4-1623460f9374"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:02.878167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:03.246037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:03.246644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:03.247183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:03.247848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:03.248415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:03.279939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.282742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.283720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.283964 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b000ee6e-6c68-46e6-8a7e-486704df5b8d tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.737472 Aug 24 03:31:03.284625 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 214/443] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:31:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:03.287570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.291917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.292571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.293316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:03.294435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:03.322219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.323118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.323576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.328639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.331878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.335035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.342983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:03.350360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:03.387393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Going to run 2 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:03.389806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:03.494670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:03.504906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:03.558646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:03.570885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:03.600125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=f0ef8b75-d1d1-455b-94fd-0c27e607f2f5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:03.686432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:03.706104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:03.780904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:03.788834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:03.815543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:03.826565 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ace4d4e2-4e9a-4e8a-b901-baaa7285ac89 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1322 microversion: 2.1 time: 0.539674 Aug 24 03:31:03.828029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 215/444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:03 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:03.834146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6381e661-c191-4cea-b113-bcfae620d012 tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] Action: 'create', calling method: .version_select at 0x7f102b6203a0>, body: {"security_group": {"name": "tempest-securitygroup-1472821938", "description": "tempest-description-1689355458"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:03.864333 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f462f48f-32af-4c54-bd75-ee6b01ea8e83 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.094680 Aug 24 03:31:03.866030 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 230/445] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:31:04.197642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3583cbb0-848b-42af-b165-4743f8b570d7 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Action: 'update', calling method: .version_select at 0x7f10235e60d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:04.419498 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6381e661-c191-4cea-b113-bcfae620d012 tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.588379 Aug 24 03:31:04.421232 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 216/446] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:31:03 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:04.429425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-483158874", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "197574864", "adminPass": "***", "networks": [{"uuid": "b4290256-1ad8-4c5b-b78c-eaa28264c1e8"}], "security_groups": [{"name": "tempest-securitygroup--1654990478"}], "key_name": "tempest-keypair-1091403419", "user_data": "}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:04.665270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3583cbb0-848b-42af-b165-4743f8b570d7 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:04.665800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3583cbb0-848b-42af-b165-4743f8b570d7 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:04.666210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3583cbb0-848b-42af-b165-4743f8b570d7 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:04.666941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3583cbb0-848b-42af-b165-4743f8b570d7 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:04.667464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3583cbb0-848b-42af-b165-4743f8b570d7 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:04.667923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3583cbb0-848b-42af-b165-4743f8b570d7 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:04.719959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] validate_networks() for [('b4290256-1ad8-4c5b-b78c-eaa28264c1e8', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:04.734753 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3583cbb0-848b-42af-b165-4743f8b570d7 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/81a0362ce1af4215b192e4db82fdceb0" status: 200 len: 240 microversion: 2.36 time: 0.867055 Aug 24 03:31:04.735577 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 231/447] 10.222.0.58 () {62 vars in 1303 bytes} [Wed Aug 24 03:31:03 2022] PUT /compute/v2.1/os-quota-sets/81a0362ce1af4215b192e4db82fdceb0 => generated 240 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:31:04.745108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:04.745723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:04.752346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:04.752839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:04.753283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:04.753985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:04.754437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:04.755048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:04.903402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:04.919723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:04.921256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:04.923363 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3feec823-bf98-49f6-a11b-f5b23c952254 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1558 microversion: 2.25 time: 0.185748 Aug 24 03:31:04.924642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 232/448] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:04 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:04.935435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:04.942859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:04.943732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Searching by: {'deleted': False, 'project_id': 'd347f85e59734622a091e80dbf0d9521'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:31:04.952577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:04.964443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:04.965418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:04.965799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:04.966766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:04.968020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:04.969142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.082305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Listed batch of 5 results from cell out of 999 limit. Returned 5 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:31:05.100341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:05.156031 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9e38ed1b-2257-4d22-811b-0907b05d0ae1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1658 microversion: 2.1 time: 0.229893 Aug 24 03:31:05.157022 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 233/449] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 03:31:04 2022] GET /compute/v2.1/servers => generated 1658 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:05.338727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Action: 'update', calling method: .version_select at 0x7f1023551940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:05.342027 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:05.342027 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:05.343565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.344777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.345455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.355910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.356658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.357258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.365740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] HTTP exception thrown: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Request method failure captured: Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: request: PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d HTTP/1.1 Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 56 Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZt4LUOGmvIAOqcpx5krM-jxlxD14RwV4Xb_VdoPGrRfxICYw5e1_C-unIrAfaVvur0O5WEkezM6jPfXBuJAZUkExT3mE3ss30mnXNEWlJeYBrtGEZ4mUnDT6w9JSE5Mt1nz0a2yOVGznUXtJaPrsiUISSP1mjZRndDhQgGtSZ3wm1I Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2a2fb815ff36447fa85f5b69573a8fcf Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:31:05.368233 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2a2fb815ff36447fa85f5b69573a8fcf Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 94dd4218cf224f8d851c7b6ddf57e3b5 Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:31:05.369620 n-d-846470-15 devstack@n-api.service[122536]: exception: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9e1e17b9-2ddd-4927-a647-514cd4ce3b5d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:05.370387 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:05.371542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:05.376081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:05.376081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:05.376081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:05.376081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Returning 404 to user: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:05.376081 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c880788c-13d4-4a21-bc86-1c6d651b6d01 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d" status: 404 len: 110 microversion: 2.53 time: 0.211459 Aug 24 03:31:05.377232 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 234/450] 10.222.0.58 () {62 vars in 1309 bytes} [Wed Aug 24 03:31:05 2022] PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d => generated 110 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:31:05.513019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:05.513484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:05.513910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:05.514352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:05.514744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:05.527585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.528111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.528546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.529271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.529728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.530148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.539158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93f6c4c2-e1c4-4e93-bfff-6504b0d03141 tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] Action: 'create', calling method: .version_select at 0x7f102367eaf0>, body: {"security_group": {"name": "tempest-securitygroup-801863840", "description": "tempest-description-1915443491"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:05.576940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Getting quotas for project 808a68a19ba646a29463d4cba0379351. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:05.584526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Getting quotas for user 842bb125a58946649e7a150e35eca5bb and project 808a68a19ba646a29463d4cba0379351. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:05.598991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:05.601228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:05.658799 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a53516a3-d1c1-4197-899d-7c03b245c7a2 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.235941 Aug 24 03:31:05.665682 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 217/451] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:31:05.669828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ebdbe9d-e181-4877-ab23-c830c4737635 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Calling method '.version_select at 0x7f102b559b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:05.739355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ebdbe9d-e181-4877-ab23-c830c4737635 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.739882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ebdbe9d-e181-4877-ab23-c830c4737635 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.740310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ebdbe9d-e181-4877-ab23-c830c4737635 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.741020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ebdbe9d-e181-4877-ab23-c830c4737635 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.741465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ebdbe9d-e181-4877-ab23-c830c4737635 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.741909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ebdbe9d-e181-4877-ab23-c830c4737635 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.765038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ebdbe9d-e181-4877-ab23-c830c4737635 tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/81a0362ce1af4215b192e4db82fdceb0/detail" status: 200 len: 672 microversion: 2.36 time: 0.103840 Aug 24 03:31:05.766281 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 218/452] 10.222.0.58 () {60 vars in 1304 bytes} [Wed Aug 24 03:31:05 2022] GET /compute/v2.1/os-quota-sets/81a0362ce1af4215b192e4db82fdceb0/detail => generated 672 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:31:05.780903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:05.781820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:05.799694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.800190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.800743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.801333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.802093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.802492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.863075 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93f6c4c2-e1c4-4e93-bfff-6504b0d03141 tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.485021 Aug 24 03:31:05.863776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 235/453] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:31:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:05.869964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2bb20202-bdb2-4654-bdf3-85170cb56482 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '.version_select at 0x7f1023548790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:05.886824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bb20202-bdb2-4654-bdf3-85170cb56482 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.888668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bb20202-bdb2-4654-bdf3-85170cb56482 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.902254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bb20202-bdb2-4654-bdf3-85170cb56482 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.938162 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2bb20202-bdb2-4654-bdf3-85170cb56482 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 440 microversion: 2.25 time: 0.073087 Aug 24 03:31:05.950237 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 236/454] 10.222.0.58 () {60 vars in 1184 bytes} [Wed Aug 24 03:31:05 2022] GET /compute/v2.1/os-migrations => generated 440 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:31:05.961530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-0777634a-99ce-4dae-a8d4-e8954a1aaf03 req-b712aeb8-0b7c-4517-8b0c-25b5c72d1f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf50224-1e50-4491-9e04-c28f568b6044", "tag": "89562e24-eacc-4e9e-93fc-a13ac1739f96"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:05.977459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0777634a-99ce-4dae-a8d4-e8954a1aaf03 req-b712aeb8-0b7c-4517-8b0c-25b5c72d1f1a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.988238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0777634a-99ce-4dae-a8d4-e8954a1aaf03 req-b712aeb8-0b7c-4517-8b0c-25b5c72d1f1a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.988238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0777634a-99ce-4dae-a8d4-e8954a1aaf03 req-b712aeb8-0b7c-4517-8b0c-25b5c72d1f1a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.026142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-0777634a-99ce-4dae-a8d4-e8954a1aaf03 req-b712aeb8-0b7c-4517-8b0c-25b5c72d1f1a service nova] Creating event network-changed:89562e24-eacc-4e9e-93fc-a13ac1739f96 for instance eaf50224-1e50-4491-9e04-c28f568b6044 on n-h1-846470-15 Aug 24 03:31:06.044723 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-0777634a-99ce-4dae-a8d4-e8954a1aaf03 req-b712aeb8-0b7c-4517-8b0c-25b5c72d1f1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085634 Aug 24 03:31:06.046844 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 237/455] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:06.059638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:06.061380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:06.082789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.083711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.084322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.085422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.087769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.088927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:06.089567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.097108 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c561865b-9d8d-4aa9-b5b0-b43b96200077 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1322 microversion: 2.1 time: 0.320416 Aug 24 03:31:06.112024 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 219/456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:05 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:06.117390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Action: 'update', calling method: .version_select at 0x7f102b500d30>, body: {"status": "disabled"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:06.120238 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:06.120238 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:31:06.121576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.122220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.122812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.131048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.133413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.133914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.141896 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] HTTP exception thrown: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Request method failure captured: Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d HTTP/1.1 Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 22 Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZt4LUOGmvIAOqcpx5krM-jxlxD14RwV4Xb_VdoPGrRfxICYw5e1_C-unIrAfaVvur0O5WEkezM6jPfXBuJAZUkExT3mE3ss30mnXNEWlJeYBrtGEZ4mUnDT6w9JSE5Mt1nz0a2yOVGznUXtJaPrsiUISSP1mjZRndDhQgGtSZ3wm1I Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2a2fb815ff36447fa85f5b69573a8fcf Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:31:06.144026 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2a2fb815ff36447fa85f5b69573a8fcf Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 94dd4218cf224f8d851c7b6ddf57e3b5 Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: {"status": "disabled"} Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: exception: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.145534 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9e1e17b9-2ddd-4927-a647-514cd4ce3b5d', 'body': {'status': 'disabled'}} Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:06.146416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:06.147904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:06.149231 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.149231 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.149231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Returning 404 to user: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:06.149231 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f26416b-498f-481b-9891-b18137d2fd76 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d" status: 404 len: 110 microversion: 2.53 time: 0.032095 Aug 24 03:31:06.149231 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 220/457] 10.222.0.58 () {62 vars in 1309 bytes} [Wed Aug 24 03:31:06 2022] PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:31:06.155573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a289a18-a194-41ba-a557-2c110a1943ab tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:06.157890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a289a18-a194-41ba-a557-2c110a1943ab tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:06.186800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:06.195738 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9c7dee1-4c60-4d92-92ae-e2c18c21ed51 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1270 microversion: 2.1 time: 0.147028 Aug 24 03:31:06.196519 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 238/458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:06 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:06.201878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2480d5f2-6780-47bd-aa18-5d72e21d345e tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] Action: 'create', calling method: .version_select at 0x7f1023305940>, body: {"security_group": {"name": "tempest-securitygroup-2067375215", "description": "tempest-description-781061089"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:06.244530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8a289a18-a194-41ba-a557-2c110a1943ab tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:06.252974 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a289a18-a194-41ba-a557-2c110a1943ab tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1262 microversion: 2.1 time: 0.103249 Aug 24 03:31:06.253826 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 221/459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:06 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1262 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:06.258576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:06.259169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:06.266358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.267129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.267562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.268286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.268892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.269325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.399865 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2480d5f2-6780-47bd-aa18-5d72e21d345e tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.202082 Aug 24 03:31:06.400652 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 239/460] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:31:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:06.405908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Action: 'update', calling method: .version_select at 0x7f1023305a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:06.466522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:06.489983 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50f9fef0-302a-4164-b13c-49450b3e5671 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 2052 microversion: 2.25 time: 0.234855 Aug 24 03:31:06.491342 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 222/461] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:06 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 2052 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:06.497333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Action: 'update', calling method: .version_select at 0x7f102b5ae670>, body: {"status": "enabled"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:06.500597 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:06.500597 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:31:06.503296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.503874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.504563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.510541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.518415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.519725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.525462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] HTTP exception thrown: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Request method failure captured: Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d HTTP/1.1 Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 21 Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZt4LUOGmvIAOqcpx5krM-jxlxD14RwV4Xb_VdoPGrRfxICYw5e1_C-unIrAfaVvur0O5WEkezM6jPfXBuJAZUkExT3mE3ss30mnXNEWlJeYBrtGEZ4mUnDT6w9JSE5Mt1nz0a2yOVGznUXtJaPrsiUISSP1mjZRndDhQgGtSZ3wm1I Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2a2fb815ff36447fa85f5b69573a8fcf Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:31:06.527245 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a2fb815ff36447fa85f5b69573a8fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2a2fb815ff36447fa85f5b69573a8fcf Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205 Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 94dd4218cf224f8d851c7b6ddf57e3b5 Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: {"status": "enabled"} Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: exception: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.528693 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9e1e17b9-2ddd-4927-a647-514cd4ce3b5d', 'body': {'status': 'enabled'}} Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:06.529598 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:06.530872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:06.532367 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. Aug 24 03:31:06.532367 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:06.532527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.533248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.533657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.534491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.535854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.536286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.537165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Returning 404 to user: Service 9e1e17b9-2ddd-4927-a647-514cd4ce3b5d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:06.538221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8fb07a6-8921-462e-ab01-af276e502162 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d" status: 404 len: 110 microversion: 2.53 time: 0.045677 Aug 24 03:31:06.538963 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 223/462] 10.222.0.58 () {62 vars in 1309 bytes} [Wed Aug 24 03:31:06 2022] PUT /compute/v2.1/os-services/9e1e17b9-2ddd-4927-a647-514cd4ce3b5d => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:31:06.545557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81313ee7-ef57-4708-8c45-28953a484fe2 tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] Calling method '.version_select at 0x7f102b4c05e0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:06.617260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.617758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.618195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.618918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.619371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.619855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.697508 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ccd74033-f28e-4fb0-9888-9c389b6fc02b tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/81a0362ce1af4215b192e4db82fdceb0?user_id=10b5dfb7666b49ceb0f21ecba6522776" status: 200 len: 240 microversion: 2.36 time: 0.295408 Aug 24 03:31:06.698760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 240/463] 10.222.0.58 () {62 vars in 1384 bytes} [Wed Aug 24 03:31:06 2022] PUT /compute/v2.1/os-quota-sets/81a0362ce1af4215b192e4db82fdceb0?user_id=10b5dfb7666b49ceb0f21ecba6522776 => generated 240 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:31:06.706361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-283b15d3-140d-438b-9c7e-430312559418 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:06.709388 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:06.709388 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:06.710568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-283b15d3-140d-438b-9c7e-430312559418 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.711634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-283b15d3-140d-438b-9c7e-430312559418 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.712100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-283b15d3-140d-438b-9c7e-430312559418 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.712880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-283b15d3-140d-438b-9c7e-430312559418 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.713334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-283b15d3-140d-438b-9c7e-430312559418 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.713753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-283b15d3-140d-438b-9c7e-430312559418 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.747423 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-283b15d3-140d-438b-9c7e-430312559418 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.047543 Aug 24 03:31:06.748267 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 241/464] 10.222.0.58 () {60 vars in 1178 bytes} [Wed Aug 24 03:31:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:06.753129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-56b03a9f-4eba-4f1d-80e9-3d5718a1fbbc tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] Calling method '.version_select at 0x7f1023305700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:06.827973 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-56b03a9f-4eba-4f1d-80e9-3d5718a1fbbc tempest-QuotasAdminTestV236-558492868 tempest-QuotasAdminTestV236-558492868-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/81a0362ce1af4215b192e4db82fdceb0?user_id=10b5dfb7666b49ceb0f21ecba6522776" status: 200 len: 282 microversion: 2.36 time: 0.078576 Aug 24 03:31:06.829633 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 242/465] 10.222.0.58 () {60 vars in 1364 bytes} [Wed Aug 24 03:31:06 2022] GET /compute/v2.1/os-quota-sets/81a0362ce1af4215b192e4db82fdceb0?user_id=10b5dfb7666b49ceb0f21ecba6522776 => generated 282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:31:06.834597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1761166056", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7cea5f7b-959c-4b39-9ec6-22b9a1e6db87"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:06.897094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] validate_networks() for [('7cea5f7b-959c-4b39-9ec6-22b9a1e6db87', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:07.497404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:07.497986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:07.498775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:07.499192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:07.499602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:07.511227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.511994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.512518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:07.513578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.514101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.514612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:07.533757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:07.541643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for user 6d8976135cf9461e8a0eda1658abeec9 and project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:07.566844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:07.569919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:07.686214 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8140e45-a9ca-4431-80b5-36c76ded23bb tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.854793 Aug 24 03:31:07.690469 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 243/466] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:31:07.709966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c38a0974-628e-406a-b19b-feba44688e17 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:07.713221 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:07.713221 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:07.716509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c38a0974-628e-406a-b19b-feba44688e17 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.717105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c38a0974-628e-406a-b19b-feba44688e17 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.725478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c38a0974-628e-406a-b19b-feba44688e17 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:07.726524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c38a0974-628e-406a-b19b-feba44688e17 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.727123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c38a0974-628e-406a-b19b-feba44688e17 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.736386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c38a0974-628e-406a-b19b-feba44688e17 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:07.780194 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c38a0974-628e-406a-b19b-feba44688e17 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.088448 Aug 24 03:31:07.781027 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 244/467] 10.222.0.58 () {60 vars in 1211 bytes} [Wed Aug 24 03:31:07 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:07.786391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:07.787175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:07.798053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.798875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.799506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:07.800468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.801102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.801706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:08.070146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:08.082107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-84908803-0f35-4d2a-9c6d-0f0743f4c90f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1322 microversion: 2.1 time: 0.299831 Aug 24 03:31:08.086634 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 245/468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:07 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:08.091336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:08.091972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:08.107795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:08.113126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:08.116352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:08.117356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:08.119323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:08.120872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:08.702521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:08.722136 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dc68636e-386c-4af6-8a3a-91ac7c22ffd3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1318 microversion: 2.1 time: 0.634197 Aug 24 03:31:08.726107 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 246/469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:08 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:08.737948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:08.741774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:08.752996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:08.753493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:08.754233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:08.755311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:08.755908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:08.756521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:08.858142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:08.867282 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c591dcf-3fc3-432e-9b2e-8be46262ac68 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1320 microversion: 2.1 time: 0.139598 Aug 24 03:31:08.867989 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 247/470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:08 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1320 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:08.873169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:08.874026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:08.880863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:08.881437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:08.881964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:08.882732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:08.883430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:08.884071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:08.989162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:09.008529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:09.013803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:09.014977 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db850cd3-f3eb-4c00-b12e-b3d2274b0663 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1266 microversion: 2.25 time: 0.145993 Aug 24 03:31:09.032720 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 248/471] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:08 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:09.044267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65299de2-0bfa-4955-be37-a100f7e0c8e6 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:09.048905 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:09.048905 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:09.050178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65299de2-0bfa-4955-be37-a100f7e0c8e6 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:09.050672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65299de2-0bfa-4955-be37-a100f7e0c8e6 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:09.051108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65299de2-0bfa-4955-be37-a100f7e0c8e6 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:09.051859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65299de2-0bfa-4955-be37-a100f7e0c8e6 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:09.052312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65299de2-0bfa-4955-be37-a100f7e0c8e6 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:09.052731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65299de2-0bfa-4955-be37-a100f7e0c8e6 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:09.090769 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65299de2-0bfa-4955-be37-a100f7e0c8e6 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.056581 Aug 24 03:31:09.092653 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 249/472] 10.222.0.58 () {60 vars in 1178 bytes} [Wed Aug 24 03:31:09 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:09.341088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-306666cc-2973-4f2c-a0dd-6c56df3f467a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Calling method '.version_select at 0x7f1023313d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:09.498642 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-306666cc-2973-4f2c-a0dd-6c56df3f467a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/4df93337d0ad457fa832526f4b0de98c" status: 200 len: 371 microversion: 2.1 time: 0.404644 Aug 24 03:31:09.500552 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 250/473] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:31:09 2022] GET /compute/v2.1/os-quota-sets/4df93337d0ad457fa832526f4b0de98c => generated 371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:09.515621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63f98f71-f64c-431f-bab4-f9d99afe6b81 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:09.523516 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:09.523516 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:09.527338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63f98f71-f64c-431f-bab4-f9d99afe6b81 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:09.529269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63f98f71-f64c-431f-bab4-f9d99afe6b81 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:09.531384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63f98f71-f64c-431f-bab4-f9d99afe6b81 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:09.532220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63f98f71-f64c-431f-bab4-f9d99afe6b81 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:09.533559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63f98f71-f64c-431f-bab4-f9d99afe6b81 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:09.533996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63f98f71-f64c-431f-bab4-f9d99afe6b81 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:09.614722 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63f98f71-f64c-431f-bab4-f9d99afe6b81 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-846470-15&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.112115 Aug 24 03:31:09.623455 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 251/474] 10.222.0.58 () {60 vars in 1237 bytes} [Wed Aug 24 03:31:09 2022] GET /compute/v2.1/os-services?host=n-d-846470-15&binary=xxx => generated 16 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:09.630472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:09.631309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:09.644277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:09.645123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:09.645935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:09.647059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:09.647757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:09.648407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:09.993884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:10.008667 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b679041-61e4-4dcc-a804-703ace841c9b tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1322 microversion: 2.1 time: 0.383136 Aug 24 03:31:10.010074 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 252/475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:09 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:10.021272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6ff0a602-4a3b-43ea-9f9c-d8658ea2d92b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Action: 'update', calling method: .version_select at 0x7f1023313dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:10.389740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff0a602-4a3b-43ea-9f9c-d8658ea2d92b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.390376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff0a602-4a3b-43ea-9f9c-d8658ea2d92b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.390849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff0a602-4a3b-43ea-9f9c-d8658ea2d92b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.391844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff0a602-4a3b-43ea-9f9c-d8658ea2d92b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.392294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff0a602-4a3b-43ea-9f9c-d8658ea2d92b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.392714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff0a602-4a3b-43ea-9f9c-d8658ea2d92b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.460060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6ff0a602-4a3b-43ea-9f9c-d8658ea2d92b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/4df93337d0ad457fa832526f4b0de98c" status: 200 len: 328 microversion: 2.1 time: 0.445592 Aug 24 03:31:10.461574 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 253/476] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:31:10 2022] PUT /compute/v2.1/os-quota-sets/4df93337d0ad457fa832526f4b0de98c => generated 328 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:10.467538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bb29b23-9b21-4398-a656-8e8303a7d263 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:10.470526 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:10.470526 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:10.471943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb29b23-9b21-4398-a656-8e8303a7d263 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.472628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb29b23-9b21-4398-a656-8e8303a7d263 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.473244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb29b23-9b21-4398-a656-8e8303a7d263 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.474157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb29b23-9b21-4398-a656-8e8303a7d263 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.474669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb29b23-9b21-4398-a656-8e8303a7d263 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.475173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb29b23-9b21-4398-a656-8e8303a7d263 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.500208 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bb29b23-9b21-4398-a656-8e8303a7d263 tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.037279 Aug 24 03:31:10.500909 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 254/477] 10.222.0.58 () {60 vars in 1178 bytes} [Wed Aug 24 03:31:10 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:10.514661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-29756452-2162-4075-9e4d-0a30e35c08f5 req-6045356e-fea6-4052-ab56-e44f871d8995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d757e37-d39b-4278-a2c7-21ad1996a360", "tag": "6fa961ae-33e4-4648-a84d-8be61eb2e505"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:10.521828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:10.528454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-29756452-2162-4075-9e4d-0a30e35c08f5 req-6045356e-fea6-4052-ab56-e44f871d8995 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.529002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-29756452-2162-4075-9e4d-0a30e35c08f5 req-6045356e-fea6-4052-ab56-e44f871d8995 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.529683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-29756452-2162-4075-9e4d-0a30e35c08f5 req-6045356e-fea6-4052-ab56-e44f871d8995 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.555926 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-29756452-2162-4075-9e4d-0a30e35c08f5 req-6045356e-fea6-4052-ab56-e44f871d8995 service nova] Creating event network-changed:6fa961ae-33e4-4648-a84d-8be61eb2e505 for instance 5d757e37-d39b-4278-a2c7-21ad1996a360 on n-h2-846470-15 Aug 24 03:31:10.564406 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-29756452-2162-4075-9e4d-0a30e35c08f5 req-6045356e-fea6-4052-ab56-e44f871d8995 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061852 Aug 24 03:31:10.565969 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 255/478] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:10.571577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:10.573135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:10.581142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.581999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.582793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.583791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.584831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.585820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.982421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:10.991746 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-34ebce8b-a604-4af6-be07-fe71af0d1482 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1318 microversion: 2.1 time: 0.424194 Aug 24 03:31:10.992706 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 256/479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:10 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:10.998008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:10.998851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:11.007858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.009166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.009755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.010833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.011469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.011936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.357211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:11.372439 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-40df96d3-7790-439c-9408-2d7037713bff tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1388 microversion: 2.1 time: 0.377760 Aug 24 03:31:11.373388 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 257/480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:10 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1388 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:11.378605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:11.379502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:11.386373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.387012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.387733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.389848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.390427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.390975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.429973 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81313ee7-ef57-4708-8c45-28953a484fe2 tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9684 microversion: 2.1 time: 4.889402 Aug 24 03:31:11.432359 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 224/481] 10.222.0.58 () {58 vars in 1191 bytes} [Wed Aug 24 03:31:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9684 bytes in 4892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:11.437711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-936ae4be-feea-4ff5-8fc0-8acac5e8bbf3 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:11.469591 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-936ae4be-feea-4ff5-8fc0-8acac5e8bbf3 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-quota-sets/4df93337d0ad457fa832526f4b0de98c" status: 202 len: 0 microversion: 2.1 time: 0.035105 Aug 24 03:31:11.470645 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 225/482] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:31:11 2022] DELETE /compute/v2.1/os-quota-sets/4df93337d0ad457fa832526f4b0de98c => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:11.476449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad8fa164-72ae-4544-9dd0-2c43fd4e273a tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:11.480506 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:11.480506 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:31:11.485001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8fa164-72ae-4544-9dd0-2c43fd4e273a tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.487633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8fa164-72ae-4544-9dd0-2c43fd4e273a tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.490145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8fa164-72ae-4544-9dd0-2c43fd4e273a tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.491236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8fa164-72ae-4544-9dd0-2c43fd4e273a tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.492188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8fa164-72ae-4544-9dd0-2c43fd4e273a tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.494023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8fa164-72ae-4544-9dd0-2c43fd4e273a tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.528940 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad8fa164-72ae-4544-9dd0-2c43fd4e273a tempest-ServicesAdminNegativeV253TestJSON-1794074205 tempest-ServicesAdminNegativeV253TestJSON-1794074205-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.056864 Aug 24 03:31:11.538338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 226/483] 10.222.0.58 () {60 vars in 1239 bytes} [Wed Aug 24 03:31:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:11.545289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7cffef25-44ee-4b2a-8357-3b7fbfd415b0 req-df63cff0-9311-4f55-a49d-ab1b8dfa9f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19c423f-0e82-4d93-b79d-7fdc5d3cdf42", "tag": "8dda5d94-0df8-484c-a955-1bd7d4c92098"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:11.558007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7cffef25-44ee-4b2a-8357-3b7fbfd415b0 req-df63cff0-9311-4f55-a49d-ab1b8dfa9f1b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.558948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7cffef25-44ee-4b2a-8357-3b7fbfd415b0 req-df63cff0-9311-4f55-a49d-ab1b8dfa9f1b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.559707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7cffef25-44ee-4b2a-8357-3b7fbfd415b0 req-df63cff0-9311-4f55-a49d-ab1b8dfa9f1b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.572234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7cffef25-44ee-4b2a-8357-3b7fbfd415b0 req-df63cff0-9311-4f55-a49d-ab1b8dfa9f1b service nova] Creating event network-changed:8dda5d94-0df8-484c-a955-1bd7d4c92098 for instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 on n-h2-846470-15 Aug 24 03:31:11.577904 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7cffef25-44ee-4b2a-8357-3b7fbfd415b0 req-df63cff0-9311-4f55-a49d-ab1b8dfa9f1b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038002 Aug 24 03:31:11.579351 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 227/484] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:11.585396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:11.586787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:11.595206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.596014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.596672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.597920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.598692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.599327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.607331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:11.620264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:11.632625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:11.633802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65aece8a-beba-4033-8441-308ec67997ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1320 microversion: 2.25 time: 0.259158 Aug 24 03:31:11.634608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 258/485] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:11 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:11.659966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e8f1e971-e5e1-4c95-94f3-ac4047c3e821 tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] Calling method '.version_select at 0x7f10234388b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:11.854856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:11.877064 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a3558593-9a10-403b-81b6-eb74e7194af9 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1322 microversion: 2.1 time: 0.296167 Aug 24 03:31:11.879475 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 228/486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:11 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:11.897677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-021fe1f4-0f46-455a-ab61-a143544390f4 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Calling method '.version_select at 0x7f102b620040>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:12.257609 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e8f1e971-e5e1-4c95-94f3-ac4047c3e821 tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.606805 Aug 24 03:31:12.258200 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 259/487] 10.222.0.58 () {58 vars in 1191 bytes} [Wed Aug 24 03:31:11 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:12.435182 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-021fe1f4-0f46-455a-ab61-a143544390f4 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/4df93337d0ad457fa832526f4b0de98c" status: 200 len: 371 microversion: 2.1 time: 0.552972 Aug 24 03:31:12.438131 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 229/488] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:31:11 2022] GET /compute/v2.1/os-quota-sets/4df93337d0ad457fa832526f4b0de98c => generated 371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:12.451462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-601d7456-6f1c-441a-8d60-132bb5329b45 req-610f1d2e-0a43-48ea-a8b5-4198656bf49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf50224-1e50-4491-9e04-c28f568b6044", "name": "network-vif-plugged", "status": "completed", "tag": "89562e24-eacc-4e9e-93fc-a13ac1739f96"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:12.465371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-601d7456-6f1c-441a-8d60-132bb5329b45 req-610f1d2e-0a43-48ea-a8b5-4198656bf49a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:12.465883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-601d7456-6f1c-441a-8d60-132bb5329b45 req-610f1d2e-0a43-48ea-a8b5-4198656bf49a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:12.466338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-601d7456-6f1c-441a-8d60-132bb5329b45 req-610f1d2e-0a43-48ea-a8b5-4198656bf49a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:12.479323 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-601d7456-6f1c-441a-8d60-132bb5329b45 req-610f1d2e-0a43-48ea-a8b5-4198656bf49a service nova] Creating event network-vif-plugged:89562e24-eacc-4e9e-93fc-a13ac1739f96 for instance eaf50224-1e50-4491-9e04-c28f568b6044 on n-h1-846470-15 Aug 24 03:31:12.487031 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-601d7456-6f1c-441a-8d60-132bb5329b45 req-610f1d2e-0a43-48ea-a8b5-4198656bf49a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045771 Aug 24 03:31:12.488841 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 230/489] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:12.496756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:12.499124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:12.518623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:12.521248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:12.523383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:12.524940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:12.527735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:12.528391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:12.757520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b76a839b-559a-4d2a-80fa-b3c119a0167d tempest-ServicesAdminNegativeV253TestJSON-1976286163 tempest-ServicesAdminNegativeV253TestJSON-1976286163-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:12.760821 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:12.760821 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:12.762242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b76a839b-559a-4d2a-80fa-b3c119a0167d tempest-ServicesAdminNegativeV253TestJSON-1976286163 tempest-ServicesAdminNegativeV253TestJSON-1976286163-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e6f14e8a36d64b658a00abc7e3346c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce42fa0f27c43dc9eb0250c67b6dd8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b76a839b-559a-4d2a-80fa-b3c119a0167d tempest-ServicesAdminNegativeV253TestJSON-1976286163 tempest-ServicesAdminNegativeV253TestJSON-1976286163-project] Request method failure captured: Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZt2A0uy3sbtj_GAlp6wVlNnZAkOza38_XzM_xs_vs9EkAcxxTbfiXe6tvecUtnp7ZX8Hzym7ypZnP2Yd48LJIHIwanlgjLRZAk6CAN59gpWtnEpB4TgpHSYITIJzaQU39-2ydq_0Js1Gco0fB9-z7ldDIZcx_HdQ0qh5V-Boh2mGjU Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 8ce42fa0f27c43dc9eb0250c67b6dd8e Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1976286163 Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:31:12.764536 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ce42fa0f27c43dc9eb0250c67b6dd8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ce42fa0f27c43dc9eb0250c67b6dd8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ce42fa0f27c43dc9eb0250c67b6dd8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ce42fa0f27c43dc9eb0250c67b6dd8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1976286163 Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 8ce42fa0f27c43dc9eb0250c67b6dd8e Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1976286163 Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1976286163-project Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: e6f14e8a36d64b658a00abc7e3346c91 Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1976286163-project Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 03:31:12.766190 n-d-846470-15 devstack@n-api.service[122536]: action_args: {} Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:31:12.767019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 03:31:12.768441 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:12.770524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b76a839b-559a-4d2a-80fa-b3c119a0167d tempest-ServicesAdminNegativeV253TestJSON-1976286163 tempest-ServicesAdminNegativeV253TestJSON-1976286163-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:12.771504 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b76a839b-559a-4d2a-80fa-b3c119a0167d tempest-ServicesAdminNegativeV253TestJSON-1976286163 tempest-ServicesAdminNegativeV253TestJSON-1976286163-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.512396 Aug 24 03:31:12.773453 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 260/490] 10.222.0.58 () {60 vars in 1178 bytes} [Wed Aug 24 03:31:12 2022] GET /compute/v2.1/os-services => generated 112 bytes in 515 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:31:12.780675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b1cc0f2-05d3-4105-a573-51354d90a30d tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] Calling method '.version_select at 0x7f102343b280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:12.929474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:12.939277 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bd4fcb0c-a29c-4db4-8d4d-b360bb1c78ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1318 microversion: 2.1 time: 0.449189 Aug 24 03:31:12.958677 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 231/491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:12 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:12.959389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:12.959519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:12.978075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:12.978627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:12.979056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:12.981761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:12.983366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:12.986219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:12.997755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:13.221562 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b1cc0f2-05d3-4105-a573-51354d90a30d tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/7f697464-5883-4ddb-ae82-c15c33641ef7" status: 202 len: 0 microversion: 2.1 time: 0.446417 Aug 24 03:31:13.226062 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 261/492] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:31:12 2022] DELETE /compute/v2.1/os-security-groups/7f697464-5883-4ddb-ae82-c15c33641ef7 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:13.231443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:13.232615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:13.242524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:13.243451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:13.244091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:13.245069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:13.245522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:13.246093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:13.301175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:13.315708 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be67c8dd-76e6-4174-84dc-b31bd516569b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1388 microversion: 2.1 time: 0.368202 Aug 24 03:31:13.335151 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 232/493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:12 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1388 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:13.350170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9c6cb55d-eb5b-4ac5-8907-445c83bbfca8 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Calling method '.version_select at 0x7f102b63a790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:13.504083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:13.520570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:13.525953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:13.528426 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-877352b5-bc73-4924-a6c0-c74be222617e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.301122 Aug 24 03:31:13.529239 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 262/494] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:13 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:13.556254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:13.557011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:13.565062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:13.565555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:13.566178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:13.567057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:13.568000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:13.568614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:13.611567 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9c6cb55d-eb5b-4ac5-8907-445c83bbfca8 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/73e645f68d084a7e8915cb3637871ba0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.271669 Aug 24 03:31:13.614048 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 233/495] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:31:13 2022] GET /compute/v2.1/os-quota-sets/73e645f68d084a7e8915cb3637871ba0/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:13.620927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1be428b9-490b-421e-9cbd-b3f801a2d736 req-2c121112-fcdd-46cf-b324-ca0ffe8e3008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ef8b75-d1d1-455b-94fd-0c27e607f2f5", "tag": "6a5242eb-2e29-4866-a0e3-e2b15cc04ce8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:13.636267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1be428b9-490b-421e-9cbd-b3f801a2d736 req-2c121112-fcdd-46cf-b324-ca0ffe8e3008 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:13.637291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1be428b9-490b-421e-9cbd-b3f801a2d736 req-2c121112-fcdd-46cf-b324-ca0ffe8e3008 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:13.637933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1be428b9-490b-421e-9cbd-b3f801a2d736 req-2c121112-fcdd-46cf-b324-ca0ffe8e3008 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:13.654511 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1be428b9-490b-421e-9cbd-b3f801a2d736 req-2c121112-fcdd-46cf-b324-ca0ffe8e3008 service nova] Creating event network-changed:6a5242eb-2e29-4866-a0e3-e2b15cc04ce8 for instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 on n-h1-846470-15 Aug 24 03:31:13.660606 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1be428b9-490b-421e-9cbd-b3f801a2d736 req-2c121112-fcdd-46cf-b324-ca0ffe8e3008 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044753 Aug 24 03:31:13.662212 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 234/496] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:13.668140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7251c552-dee1-4bd8-ab1e-93e9800ef082 tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] Calling method '.version_select at 0x7f102b610700>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:13.889076 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7251c552-dee1-4bd8-ab1e-93e9800ef082 tempest-SecurityGroupsTestAdminJSON-170448805 tempest-SecurityGroupsTestAdminJSON-170448805-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/c20ccc23-e85c-4385-ad34-6f3cd0c6ad24" status: 202 len: 0 microversion: 2.1 time: 0.224812 Aug 24 03:31:13.890374 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 235/497] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:31:13 2022] DELETE /compute/v2.1/os-security-groups/c20ccc23-e85c-4385-ad34-6f3cd0c6ad24 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:13.896908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a8eb195f-c033-45bd-9ffa-3e882f3a4c59 req-40861fd5-9bed-40d2-a92e-a7cb775290da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c", "tag": "bf3f1eec-aa98-4265-993e-6bc0ec631b29"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:13.926586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a8eb195f-c033-45bd-9ffa-3e882f3a4c59 req-40861fd5-9bed-40d2-a92e-a7cb775290da service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:13.928982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a8eb195f-c033-45bd-9ffa-3e882f3a4c59 req-40861fd5-9bed-40d2-a92e-a7cb775290da service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:13.929765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a8eb195f-c033-45bd-9ffa-3e882f3a4c59 req-40861fd5-9bed-40d2-a92e-a7cb775290da service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:13.946840 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a8eb195f-c033-45bd-9ffa-3e882f3a4c59 req-40861fd5-9bed-40d2-a92e-a7cb775290da service nova] Creating event network-changed:bf3f1eec-aa98-4265-993e-6bc0ec631b29 for instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c on n-h1-846470-15 Aug 24 03:31:13.956410 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a8eb195f-c033-45bd-9ffa-3e882f3a4c59 req-40861fd5-9bed-40d2-a92e-a7cb775290da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063840 Aug 24 03:31:13.957477 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 236/498] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:13.966243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9a407e3-6b45-4626-a31e-d432ab966eab tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] Calling method '.version_select at 0x7f102b4d8e50>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:14.049813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:14.057869 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-874102cf-6fa0-4379-b3b7-daecb76919e6 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1322 microversion: 2.1 time: 0.509032 Aug 24 03:31:14.078703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 263/499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:13 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:14.100971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-099d8cfc-d176-4383-bb40-6aee63f02cb0 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Action: 'update', calling method: .version_select at 0x7f102329cdc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:14.248173 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f9a407e3-6b45-4626-a31e-d432ab966eab tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ff2f6fe5-d6ac-4179-a16e-3b5deee69eab" status: 202 len: 0 microversion: 2.1 time: 0.288914 Aug 24 03:31:14.249857 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 237/500] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:31:13 2022] DELETE /compute/v2.1/os-security-groups/ff2f6fe5-d6ac-4179-a16e-3b5deee69eab => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:14.256404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:14.257896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:14.265986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.267490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.268573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.269496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.270177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.270945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.447914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-099d8cfc-d176-4383-bb40-6aee63f02cb0 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.448791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-099d8cfc-d176-4383-bb40-6aee63f02cb0 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.450275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-099d8cfc-d176-4383-bb40-6aee63f02cb0 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.452321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-099d8cfc-d176-4383-bb40-6aee63f02cb0 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.454372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-099d8cfc-d176-4383-bb40-6aee63f02cb0 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.455069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-099d8cfc-d176-4383-bb40-6aee63f02cb0 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.559979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:14.562119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-099d8cfc-d176-4383-bb40-6aee63f02cb0 tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/69ef5509f4b2437994a55019b4be7239" status: 200 len: 328 microversion: 2.1 time: 0.481930 Aug 24 03:31:14.563779 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 264/501] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:31:14 2022] PUT /compute/v2.1/os-quota-sets/69ef5509f4b2437994a55019b4be7239 => generated 328 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:14.575831 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c21aa5a4-ae07-44bc-bd0f-e75d2edadb27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1318 microversion: 2.1 time: 0.323302 Aug 24 03:31:14.579914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c6e81af-0559-4249-8876-dc6e059b2798 tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] Calling method '.version_select at 0x7f1023313550>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:14.580788 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 238/502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:14 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:14.589073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:14.591210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:14.601712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.602792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.603233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.604056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.604516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.604941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.811160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:14.820594 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f741e65-ca63-4136-928e-b6e4ecb391d0 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1388 microversion: 2.1 time: 0.237945 Aug 24 03:31:14.821822 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 239/503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:14 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1388 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:14.828163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:14.830091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:14.860077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.861149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.863059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.865274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.866017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.866969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.931464 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c6e81af-0559-4249-8876-dc6e059b2798 tempest-SecurityGroupsTestAdminJSON-8572178 tempest-SecurityGroupsTestAdminJSON-8572178-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b3346b5d-e3dd-483e-9391-8f398eeeb25f" status: 202 len: 0 microversion: 2.1 time: 0.366331 Aug 24 03:31:14.932088 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 265/504] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:31:14 2022] DELETE /compute/v2.1/os-security-groups/b3346b5d-e3dd-483e-9391-8f398eeeb25f => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:14.941929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b504e991-5cc7-440a-966d-4bfeeb3b1b0b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Calling method '.version_select at 0x7f10235e6a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.125450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:15.139516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:15.141894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:15.143114 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4c1a551d-b629-4430-af8a-6cf723546ff8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.319945 Aug 24 03:31:15.159115 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 240/505] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:14 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:15.219116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b504e991-5cc7-440a-966d-4bfeeb3b1b0b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.221970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b504e991-5cc7-440a-966d-4bfeeb3b1b0b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.222426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b504e991-5cc7-440a-966d-4bfeeb3b1b0b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.223489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b504e991-5cc7-440a-966d-4bfeeb3b1b0b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.223989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b504e991-5cc7-440a-966d-4bfeeb3b1b0b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.226670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b504e991-5cc7-440a-966d-4bfeeb3b1b0b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.254433 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b504e991-5cc7-440a-966d-4bfeeb3b1b0b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/69ef5509f4b2437994a55019b4be7239/detail" status: 200 len: 916 microversion: 2.1 time: 0.317406 Aug 24 03:31:15.256951 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 266/506] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:31:14 2022] GET /compute/v2.1/os-quota-sets/69ef5509f4b2437994a55019b4be7239/detail => generated 916 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:15.261894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.262615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:15.269977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.270502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.270940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.271646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.272117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.273246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.299951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:15.426292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3fccc1f8-450c-439c-b215-10d468bf2a42 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.429018 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:15.429018 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:31:15.430253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fccc1f8-450c-439c-b215-10d468bf2a42 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.432076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fccc1f8-450c-439c-b215-10d468bf2a42 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.434053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fccc1f8-450c-439c-b215-10d468bf2a42 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.435040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fccc1f8-450c-439c-b215-10d468bf2a42 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.438213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fccc1f8-450c-439c-b215-10d468bf2a42 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.438770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fccc1f8-450c-439c-b215-10d468bf2a42 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.505972 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3fccc1f8-450c-439c-b215-10d468bf2a42 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.335352 Aug 24 03:31:15.505972 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 241/507] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/os-services => generated 949 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:15.507263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:15.521526 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dc383276-875d-466b-96a7-6c1a3bebb8ee tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1472 microversion: 2.1 time: 0.263239 Aug 24 03:31:15.524025 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 267/508] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:15.526954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-379698bf-6183-4b0f-bf3b-cafab2dedf79 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.530403 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:15.530403 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:31:15.531337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-379698bf-6183-4b0f-bf3b-cafab2dedf79 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.531954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-379698bf-6183-4b0f-bf3b-cafab2dedf79 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.532396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-379698bf-6183-4b0f-bf3b-cafab2dedf79 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.533198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-379698bf-6183-4b0f-bf3b-cafab2dedf79 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.533654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-379698bf-6183-4b0f-bf3b-cafab2dedf79 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.534123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-379698bf-6183-4b0f-bf3b-cafab2dedf79 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.546064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.546730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:15.561247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.564291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.566059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.571019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.571819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.572627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.578524 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-379698bf-6183-4b0f-bf3b-cafab2dedf79 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.057234 Aug 24 03:31:15.589826 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 242/509] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:15.595196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dffd2375-65d9-4e85-b254-88276cc654d6 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.598982 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:15.598982 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:31:15.601716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dffd2375-65d9-4e85-b254-88276cc654d6 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.602504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dffd2375-65d9-4e85-b254-88276cc654d6 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.603203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dffd2375-65d9-4e85-b254-88276cc654d6 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.604129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dffd2375-65d9-4e85-b254-88276cc654d6 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.604776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dffd2375-65d9-4e85-b254-88276cc654d6 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.605400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dffd2375-65d9-4e85-b254-88276cc654d6 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.627832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Request method failure captured: Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044/diagnostics HTTP/1.1 Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtu4W_N38Vvi_YBVToQR1FqSuCIQQhHmVY_XumK8qH8w-ncvNWx8iLyPdDmM3k5c_VdD7h-nCehlY5oACv9hoTlyyMyjERQRG50tyLmWhJ0el8vfOwe6IfqI6sAKzJl7OkfGHBOAXxnchz4y4bWkOG34vGlmzDNk5F_Omgt_Dn5ZDs Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ca9864cf1adf435fb032759a1518cb8a Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-156779789 Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:31:15.629871 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca9864cf1adf435fb032759a1518cb8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca9864cf1adf435fb032759a1518cb8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca9864cf1adf435fb032759a1518cb8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca9864cf1adf435fb032759a1518cb8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-156779789 Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ca9864cf1adf435fb032759a1518cb8a Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-156779789 Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerDiagnosticsNegativeTest-156779789-project Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: b6330d9fee114b469aad491bf5af477d Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-156779789-project Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:31:15.631939 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': 'eaf50224-1e50-4491-9e04-c28f568b6044'} Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:31:15.632689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:15.633888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:15.635081 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b1e0727-086b-4285-bbb5-0f4f9afa5272 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.091844 Aug 24 03:31:15.639452 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 268/510] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044/diagnostics => generated 117 bytes in 99 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:31:15.642389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dffd2375-65d9-4e85-b254-88276cc654d6 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.050724 Aug 24 03:31:15.650751 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 243/511] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/os-services => generated 949 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:15.656317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.656875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:15.663254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.663709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.664237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.664878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.665650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.665922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:15.666151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.666579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.679408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.681084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.684905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.685707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.688266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.690614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.696243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:31:15.816060 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c7b6b17a-21e5-4b52-ae2a-4b2f58c18984 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 204 len: 0 microversion: 2.1 time: 0.163744 Aug 24 03:31:15.816719 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 244/512] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:31:15 2022] DELETE /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:15.830899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-177be354-b545-4acf-90c8-78fb0713fc69 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.835727 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:15.835727 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:31:15.842208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177be354-b545-4acf-90c8-78fb0713fc69 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.843858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177be354-b545-4acf-90c8-78fb0713fc69 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.844288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177be354-b545-4acf-90c8-78fb0713fc69 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.847702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177be354-b545-4acf-90c8-78fb0713fc69 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.848488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177be354-b545-4acf-90c8-78fb0713fc69 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.849574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177be354-b545-4acf-90c8-78fb0713fc69 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.881424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:15.898446 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-177be354-b545-4acf-90c8-78fb0713fc69 tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-846470-15&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.079635 Aug 24 03:31:15.905742 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 245/513] 10.222.0.58 () {58 vars in 1196 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/os-services?host=n-d-846470-15&binary=xxx => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:31:15.911104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.912753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:15.920880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.921372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.921799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.922811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.923266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.923708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.958987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:15.968231 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f617ab16-9ed6-4e88-8574-1eb103e9f956 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1318 microversion: 2.1 time: 0.324378 Aug 24 03:31:15.969013 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 269/514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:15.974912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.975874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:15.985180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.985940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.986674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.987800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.988586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.989197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.134800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:16.145802 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b12d16a-20b6-4c4d-aff9-fe247b6332b8 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1478 microversion: 2.1 time: 0.238233 Aug 24 03:31:16.160048 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 246/515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:16.167305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Action: 'update', calling method: .version_select at 0x7f102b4c08b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:16.178318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:16.186995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-22fb714f-a462-41f8-9ac7-552a4851dc7f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1388 microversion: 2.1 time: 0.216724 Aug 24 03:31:16.187871 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 270/516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1388 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:16.192730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bfb07ba-a862-4281-85a0-08dd897d130e tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:16.195449 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:16.195449 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:16.196574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfb07ba-a862-4281-85a0-08dd897d130e tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.197054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfb07ba-a862-4281-85a0-08dd897d130e tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.197480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfb07ba-a862-4281-85a0-08dd897d130e tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.198222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfb07ba-a862-4281-85a0-08dd897d130e tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.198636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfb07ba-a862-4281-85a0-08dd897d130e tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.199051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfb07ba-a862-4281-85a0-08dd897d130e tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.224845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bfb07ba-a862-4281-85a0-08dd897d130e tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.035628 Aug 24 03:31:16.232346 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 271/517] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:31:16 2022] GET /compute/v2.1/os-services => generated 949 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:16.237491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:16.238292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:16.244323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.244799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.245226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.245948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.246394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.246811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.573460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:16.587379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:16.590419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:16.593391 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-afd8414d-a83f-4002-a133-8342e0ebe252 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.358898 Aug 24 03:31:16.595950 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 272/518] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:16 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:16.604254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d74ac233-c9ee-4a7d-b2f1-f318b25f156a tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:16.610734 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:16.610734 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:16.612634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74ac233-c9ee-4a7d-b2f1-f318b25f156a tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.613405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74ac233-c9ee-4a7d-b2f1-f318b25f156a tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.614748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74ac233-c9ee-4a7d-b2f1-f318b25f156a tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.616213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74ac233-c9ee-4a7d-b2f1-f318b25f156a tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.617525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74ac233-c9ee-4a7d-b2f1-f318b25f156a tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.620030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74ac233-c9ee-4a7d-b2f1-f318b25f156a tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.664159 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d74ac233-c9ee-4a7d-b2f1-f318b25f156a tempest-ServicesAdminNegativeTestJSON-814126429 tempest-ServicesAdminNegativeTestJSON-814126429-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.065683 Aug 24 03:31:16.672942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 273/519] 10.222.0.58 () {58 vars in 1198 bytes} [Wed Aug 24 03:31:16 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:31:16.822236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.823499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.824194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.825274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.828735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.830166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.879351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.880216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.880759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.881656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.885698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.886412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.024828 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ffab7a5-2892-409c-bbfa-8545a22ef48a tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/69ef5509f4b2437994a55019b4be7239?user_id=bd6690d57b5046bbaf70271c7e1c7182" status: 200 len: 328 microversion: 2.1 time: 0.862647 Aug 24 03:31:17.025800 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 247/520] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:31:16 2022] PUT /compute/v2.1/os-quota-sets/69ef5509f4b2437994a55019b4be7239?user_id=bd6690d57b5046bbaf70271c7e1c7182 => generated 328 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:17.035737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:17.042886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:17.055093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.055592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.056172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.056874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.057398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.057826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.058560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55342c24-313d-4db1-9c85-842db077dbbd tempest-ServicesAdminNegativeTestJSON-1040283891 tempest-ServicesAdminNegativeTestJSON-1040283891-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:17.062163 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:17.062163 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:17.063551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55342c24-313d-4db1-9c85-842db077dbbd tempest-ServicesAdminNegativeTestJSON-1040283891 tempest-ServicesAdminNegativeTestJSON-1040283891-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'dbf42700038046f2800b33b2eb269f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89175ace64274fde8821af0fb7bbdf12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55342c24-313d-4db1-9c85-842db077dbbd tempest-ServicesAdminNegativeTestJSON-1040283891 tempest-ServicesAdminNegativeTestJSON-1040283891-project] Request method failure captured: Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZuB6v6fUZ7ZzY55PSn60sl1p3dyEWGQ16Onh0FYtuPO13yAFu3Q1HSrbQHUKyKLHF5-TVnK5KfKwE7ZpRUu9ZEPMZMCrfZ8vsBJJosw1bBtEZL1EM8lkhAhQGNZtpSZtjW-TEpciBLA_3dLUTzZEFCJjSfarT-s-QwCNk9kd2ER2pw Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 89175ace64274fde8821af0fb7bbdf12 Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1040283891 Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:31:17.066860 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_89175ace64274fde8821af0fb7bbdf12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/89175ace64274fde8821af0fb7bbdf12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89175ace64274fde8821af0fb7bbdf12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89175ace64274fde8821af0fb7bbdf12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1040283891 Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 89175ace64274fde8821af0fb7bbdf12 Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1040283891 Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServicesAdminNegativeTestJSON-1040283891-project Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: dbf42700038046f2800b33b2eb269f97 Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1040283891-project Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 03:31:17.068552 n-d-846470-15 devstack@n-api.service[122536]: action_args: {} Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:31:17.069290 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 03:31:17.070370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:17.075129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55342c24-313d-4db1-9c85-842db077dbbd tempest-ServicesAdminNegativeTestJSON-1040283891 tempest-ServicesAdminNegativeTestJSON-1040283891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:17.077487 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55342c24-313d-4db1-9c85-842db077dbbd tempest-ServicesAdminNegativeTestJSON-1040283891 tempest-ServicesAdminNegativeTestJSON-1040283891-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.402148 Aug 24 03:31:17.083045 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 274/521] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:31:16 2022] GET /compute/v2.1/os-services => generated 112 bytes in 409 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:31:17.096620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1541729-139c-4f00-9678-891cadd8a7ce tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Calling method '.version_select at 0x7f102329c5e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:17.333344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:17.347438 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd54b64d-a1c5-43c5-8fde-f4fe6638aa9f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1318 microversion: 2.1 time: 0.316894 Aug 24 03:31:17.348132 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 248/522] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:17 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:17.365933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:17.366539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:17.374415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.375048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.375940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.376978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.377977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.378681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.605845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:17.615420 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-43e5c816-69f9-4cf5-97ac-df2afac54d87 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1478 microversion: 2.1 time: 0.253347 Aug 24 03:31:17.616341 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 249/523] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:17 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1478 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:17.632856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:17.633747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:17.657750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.664409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.664963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.665799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.666257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.666675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.689980 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1541729-139c-4f00-9678-891cadd8a7ce tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/69ef5509f4b2437994a55019b4be7239?user_id=bd6690d57b5046bbaf70271c7e1c7182" status: 200 len: 370 microversion: 2.1 time: 0.600882 Aug 24 03:31:17.694547 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 275/524] 10.222.0.58 () {58 vars in 1323 bytes} [Wed Aug 24 03:31:17 2022] GET /compute/v2.1/os-quota-sets/69ef5509f4b2437994a55019b4be7239?user_id=bd6690d57b5046bbaf70271c7e1c7182 => generated 370 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:17.706603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:17.709400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:17.727103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.728028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.731139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.732780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.734838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.735866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.905818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:17.918170 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6da5458-5717-4ff1-ab51-bc32760dc74c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1388 microversion: 2.1 time: 0.300424 Aug 24 03:31:17.919410 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 250/525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:17 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1388 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:17.964671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5af848b1-ba8e-4bc3-a02c-6cb21e6228e4 req-77bcd352-1ee8-4c7c-994a-bedf054bef2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d757e37-d39b-4278-a2c7-21ad1996a360", "name": "network-vif-plugged", "status": "completed", "tag": "6fa961ae-33e4-4648-a84d-8be61eb2e505"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:18.022735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5af848b1-ba8e-4bc3-a02c-6cb21e6228e4 req-77bcd352-1ee8-4c7c-994a-bedf054bef2b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.023191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5af848b1-ba8e-4bc3-a02c-6cb21e6228e4 req-77bcd352-1ee8-4c7c-994a-bedf054bef2b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.023589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5af848b1-ba8e-4bc3-a02c-6cb21e6228e4 req-77bcd352-1ee8-4c7c-994a-bedf054bef2b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.055874 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5af848b1-ba8e-4bc3-a02c-6cb21e6228e4 req-77bcd352-1ee8-4c7c-994a-bedf054bef2b service nova] Creating event network-vif-plugged:6fa961ae-33e4-4648-a84d-8be61eb2e505 for instance 5d757e37-d39b-4278-a2c7-21ad1996a360 on n-h2-846470-15 Aug 24 03:31:18.061872 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5af848b1-ba8e-4bc3-a02c-6cb21e6228e4 req-77bcd352-1ee8-4c7c-994a-bedf054bef2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122177 Aug 24 03:31:18.083591 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 251/526] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:18.117229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:18.141994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:18.145447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:18.149957 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f0a5bc3-9977-4eb0-8866-ad319bfddb45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.454081 Aug 24 03:31:18.152594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 276/527] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:17 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:18.346559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5ab626bb-6a0f-4732-9334-ab0260880a3b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Calling method '.version_select at 0x7f102b5954c0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:18.369209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:18.370004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:18.391129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.392854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.393648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.394700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.395541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.396269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.698485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:18.708185 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-98c654b1-4412-4c05-8c9f-7a19e86360a4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1318 microversion: 2.1 time: 0.343227 Aug 24 03:31:18.709279 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 277/528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:18 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:18.715479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:18.716255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:18.728115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.729294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.730741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.732259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.733381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.734067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.853617 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5ab626bb-6a0f-4732-9334-ab0260880a3b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/73e645f68d084a7e8915cb3637871ba0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.511818 Aug 24 03:31:18.857989 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 252/529] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:31:18 2022] GET /compute/v2.1/os-quota-sets/73e645f68d084a7e8915cb3637871ba0/defaults => generated 371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:18.871093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93079ff7-793f-41b7-86a1-2885edff238b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Action: 'update', calling method: .version_select at 0x7f102b559670>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:18.958089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:18.974044 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f020ebaf-868f-4261-96df-e8b97aec702f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1478 microversion: 2.1 time: 0.261167 Aug 24 03:31:18.976223 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 278/530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:18 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1478 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:18.996314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:18.998937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:19.014637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.016121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.016760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.019635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.020503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.021083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.270708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:19.283014 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d471302-2cc0-4653-81c1-678806b91c8a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1388 microversion: 2.1 time: 0.303129 Aug 24 03:31:19.284662 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 279/531] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:18 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1388 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:19.291398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:19.292446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:19.299882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.300814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.301546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.302597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.303261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.303929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.481683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93079ff7-793f-41b7-86a1-2885edff238b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.482909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93079ff7-793f-41b7-86a1-2885edff238b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.483543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93079ff7-793f-41b7-86a1-2885edff238b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.484830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93079ff7-793f-41b7-86a1-2885edff238b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.485523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93079ff7-793f-41b7-86a1-2885edff238b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.487263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93079ff7-793f-41b7-86a1-2885edff238b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.796547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:19.808985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:19.810483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:19.811605 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-50bebc13-605f-473c-9d50-baed39a114c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.525421 Aug 24 03:31:19.815411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 280/532] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:19 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:19.829790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:19.832095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:19.847861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.848682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.850941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.851956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.853435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.855294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.909462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-93079ff7-793f-41b7-86a1-2885edff238b tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/73e645f68d084a7e8915cb3637871ba0" status: 200 len: 329 microversion: 2.1 time: 1.043507 Aug 24 03:31:19.912595 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 253/533] 10.222.0.58 () {60 vars in 1263 bytes} [Wed Aug 24 03:31:18 2022] PUT /compute/v2.1/os-quota-sets/73e645f68d084a7e8915cb3637871ba0 => generated 329 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:19.924796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5005f64-f3e7-4308-b8f6-61a93d3b681d tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Action: 'update', calling method: .version_select at 0x7f102b4d89d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:20.170261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:20.183292 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f6b2670-89f1-4f18-bd9c-99d99faaf852 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1318 microversion: 2.1 time: 0.361475 Aug 24 03:31:20.186976 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 281/534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:19 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:20.215827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:20.217083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:20.272303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:20.273393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:20.276278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:20.278330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:20.278973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:20.281049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:20.503437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5005f64-f3e7-4308-b8f6-61a93d3b681d tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:20.504587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5005f64-f3e7-4308-b8f6-61a93d3b681d tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:20.505829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5005f64-f3e7-4308-b8f6-61a93d3b681d tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:20.511713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5005f64-f3e7-4308-b8f6-61a93d3b681d tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:20.512921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5005f64-f3e7-4308-b8f6-61a93d3b681d tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:20.513365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5005f64-f3e7-4308-b8f6-61a93d3b681d tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:20.654505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:20.667232 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2453b2bd-80a0-47f7-9759-84e1e1debc83 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1478 microversion: 2.1 time: 0.478639 Aug 24 03:31:20.668159 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 282/535] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:20 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1478 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:20.690319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:20.691729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:20.700375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:20.700910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:20.701553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:20.702467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:20.703348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:20.703961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:20.766685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=19,nova_api:UPDATE=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:20.925746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:20.935974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fb242b09-acd7-46f7-ac6e-8e80dddff028 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1388 microversion: 2.1 time: 0.260151 Aug 24 03:31:20.936571 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 283/536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:20 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1388 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:21.038197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:21.123202 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5005f64-f3e7-4308-b8f6-61a93d3b681d tempest-QuotasAdminTestJSON-1045773372 tempest-QuotasAdminTestJSON-1045773372-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/73e645f68d084a7e8915cb3637871ba0" status: 200 len: 329 microversion: 2.1 time: 1.202265 Aug 24 03:31:21.124000 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 254/537] 10.222.0.58 () {60 vars in 1263 bytes} [Wed Aug 24 03:31:19 2022] PUT /compute/v2.1/os-quota-sets/73e645f68d084a7e8915cb3637871ba0 => generated 329 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:31:21.137860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-25b6576d-b2be-4e90-b596-d74cac1a77a5 req-2e11f21c-9018-4afb-ab78-e0248881e378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19c423f-0e82-4d93-b79d-7fdc5d3cdf42", "name": "network-vif-plugged", "status": "completed", "tag": "8dda5d94-0df8-484c-a955-1bd7d4c92098"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:21.149842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-25b6576d-b2be-4e90-b596-d74cac1a77a5 req-2e11f21c-9018-4afb-ab78-e0248881e378 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.150695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-25b6576d-b2be-4e90-b596-d74cac1a77a5 req-2e11f21c-9018-4afb-ab78-e0248881e378 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.151476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-25b6576d-b2be-4e90-b596-d74cac1a77a5 req-2e11f21c-9018-4afb-ab78-e0248881e378 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.171884 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-25b6576d-b2be-4e90-b596-d74cac1a77a5 req-2e11f21c-9018-4afb-ab78-e0248881e378 service nova] Creating event network-vif-plugged:8dda5d94-0df8-484c-a955-1bd7d4c92098 for instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 on n-h2-846470-15 Aug 24 03:31:21.178212 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-25b6576d-b2be-4e90-b596-d74cac1a77a5 req-2e11f21c-9018-4afb-ab78-e0248881e378 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044289 Aug 24 03:31:21.179544 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 255/538] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:21.186085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:21.187128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:21.196128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.196919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.197535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.199365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.202861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.203838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.302460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1200957758", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:21.426651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:21.453568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:21.465196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:21.466705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:21.467843 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a242c56-0066-4585-8d1c-bb6e0c72fa56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.286922 Aug 24 03:31:21.479699 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 256/539] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:21 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:21.489536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:21.490149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:21.499487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.500061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.500490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.501181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.501623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.502065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.795577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:21.796438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:21.797746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:21.798565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:21.799290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:21.800419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:21.812863 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6017dc37-5f86-4a0d-8236-70c3d1f26d34 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1467 microversion: 2.1 time: 0.340759 Aug 24 03:31:21.827426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.828343 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 257/540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:21 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1467 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:21.829641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.830752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.838107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:21.838732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:21.849129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.854318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.854848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.856337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.859743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.860589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.861490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.862752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.863350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.912328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:21.915480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Getting quotas for project 3323592e260f4331b153e917c9dfc2eb. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:21.922377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Getting quotas for user 651d7bd069d841e38c802573feb9f256 and project 3323592e260f4331b153e917c9dfc2eb. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:21.940988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:21.945837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:22.031467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bf62de9-4a3d-46c3-a8fc-644676b34560 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.080205 Aug 24 03:31:22.033044 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 284/541] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:31:22.038119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:22.039237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:22.045841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:22.049682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:22.050879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:22.052243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:22.052955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:22.053593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:22.396687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:22.408966 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3b4271a8-b415-4660-9900-29ca8d421f6f tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1478 microversion: 2.1 time: 0.579242 Aug 24 03:31:22.409556 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 258/542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:21 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1478 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:22.427068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:22.427714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:22.471201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:22.471913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:22.474578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:22.475562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:22.476231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:22.482698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:22.813848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:22.826111 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f980855-5a61-477d-b75c-80303f4d83ec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1318 microversion: 2.1 time: 0.791775 Aug 24 03:31:22.829599 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 285/543] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:22 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1318 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:22.847576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e97a7f1e-7804-4335-9613-e7aafe7d7ea8 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:22.848685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e97a7f1e-7804-4335-9613-e7aafe7d7ea8 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:23.190497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:23.210856 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-42c97fd4-f1b1-462d-b2c1-6d1e3bc89e2a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1388 microversion: 2.1 time: 0.800222 Aug 24 03:31:23.216103 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 259/544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:22 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1388 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:23.378681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e97a7f1e-7804-4335-9613-e7aafe7d7ea8 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:23.389592 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e97a7f1e-7804-4335-9613-e7aafe7d7ea8 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1222 microversion: 2.1 time: 0.557967 Aug 24 03:31:23.393634 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 286/545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:22 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1222 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:23.411644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:23.412317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:23.451330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:23.451859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:23.452891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:23.458689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:23.459208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:23.462024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:23.675788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24cf679e-1570-4a90-b8b6-aad1b7fdf378 tempest-FlavorsV2NegativeTest-1138387833 tempest-FlavorsV2NegativeTest-1138387833-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:23.688065 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24cf679e-1570-4a90-b8b6-aad1b7fdf378 tempest-FlavorsV2NegativeTest-1138387833 tempest-FlavorsV2NegativeTest-1138387833-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.472833 Aug 24 03:31:23.704822 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 260/546] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:31:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:23.721481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6f799431-8db1-4916-8332-1fe1c2237a9d req-1f87d8c0-e017-4aee-8076-12c093b2f54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ef8b75-d1d1-455b-94fd-0c27e607f2f5", "name": "network-vif-plugged", "status": "completed", "tag": "6a5242eb-2e29-4866-a0e3-e2b15cc04ce8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:23.740243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6f799431-8db1-4916-8332-1fe1c2237a9d req-1f87d8c0-e017-4aee-8076-12c093b2f54b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:23.740820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6f799431-8db1-4916-8332-1fe1c2237a9d req-1f87d8c0-e017-4aee-8076-12c093b2f54b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:23.741312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6f799431-8db1-4916-8332-1fe1c2237a9d req-1f87d8c0-e017-4aee-8076-12c093b2f54b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:23.786771 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6f799431-8db1-4916-8332-1fe1c2237a9d req-1f87d8c0-e017-4aee-8076-12c093b2f54b service nova] Creating event network-vif-plugged:6a5242eb-2e29-4866-a0e3-e2b15cc04ce8 for instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 on n-h1-846470-15 Aug 24 03:31:23.804874 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6f799431-8db1-4916-8332-1fe1c2237a9d req-1f87d8c0-e017-4aee-8076-12c093b2f54b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097703 Aug 24 03:31:23.806579 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 261/547] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:23.817726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:23.821340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:23.843041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:23.849631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:23.852622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:23.853720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:23.854422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:23.856228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:24.416003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:24.432338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:24.436814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:24.454395 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-61084fb7-75b6-48fb-bf24-867289d5df49 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 1.058907 Aug 24 03:31:24.462601 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 287/548] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:23 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:24.479726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:24.481818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:24.506798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:24.507299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:24.512340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:24.515927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:24.519742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:24.522454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:24.645650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:24.663083 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98744f9e-001b-4e7a-8e00-9b9c17ad10f5 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1478 microversion: 2.1 time: 0.854343 Aug 24 03:31:24.665430 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 262/549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:23 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1478 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:24.681423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:24.682478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:24.702264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:24.704509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:24.709840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:24.714096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:24.717040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:24.719886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:25.182851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:25.202006 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1842747e-2832-45a9-824a-d642b32eb07e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1318 microversion: 2.1 time: 0.737313 Aug 24 03:31:25.211704 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 288/550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:24 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:25.222596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:25.223563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:25.249016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:25.251074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:25.251555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:25.252405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:25.253075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:25.253701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:25.264797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:25.408939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:25.425646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44ca52bf-38e4-4287-9c74-1f7d2f049c05 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1280 microversion: 2.1 time: 0.221345 Aug 24 03:31:25.431701 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 289/551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:25 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1280 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:25.440234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61e46077-26cc-4182-8d6f-e58c16d735a7 tempest-FlavorsV2NegativeTest-1138387833 tempest-FlavorsV2NegativeTest-1138387833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-801856052", "imageRef": "6b65070f-d217-4e6c-8568-42cace5bb31d", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:25.465077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:25.548184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-61e46077-26cc-4182-8d6f-e58c16d735a7 tempest-FlavorsV2NegativeTest-1138387833 tempest-FlavorsV2NegativeTest-1138387833-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:25.569130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:25.579006 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d349f57-a795-4e22-baaa-56cccd561ba8 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1587 microversion: 2.1 time: 0.912163 Aug 24 03:31:25.579975 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 263/552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:24 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1587 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:25.585143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-52809fe7-91e9-4cf0-a48d-c7aaf72886e0 req-eaefe1d9-b888-4b11-9137-64099c86bbbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf50224-1e50-4491-9e04-c28f568b6044", "name": "network-vif-deleted", "tag": "89562e24-eacc-4e9e-93fc-a13ac1739f96"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:25.625754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-52809fe7-91e9-4cf0-a48d-c7aaf72886e0 req-eaefe1d9-b888-4b11-9137-64099c86bbbc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:25.628257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-52809fe7-91e9-4cf0-a48d-c7aaf72886e0 req-eaefe1d9-b888-4b11-9137-64099c86bbbc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:25.634018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-52809fe7-91e9-4cf0-a48d-c7aaf72886e0 req-eaefe1d9-b888-4b11-9137-64099c86bbbc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:25.674508 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-52809fe7-91e9-4cf0-a48d-c7aaf72886e0 req-eaefe1d9-b888-4b11-9137-64099c86bbbc service nova] Creating event network-vif-deleted:89562e24-eacc-4e9e-93fc-a13ac1739f96 for instance eaf50224-1e50-4491-9e04-c28f568b6044 on n-h1-846470-15 Aug 24 03:31:25.699439 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-52809fe7-91e9-4cf0-a48d-c7aaf72886e0 req-eaefe1d9-b888-4b11-9137-64099c86bbbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116958 Aug 24 03:31:25.704536 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 264/553] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:25.718916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:25.721999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:25.734601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:25.735292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:25.735772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:25.736638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:25.736990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:25.737466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.069948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:26.080940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:26.083165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:26.084978 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cbdb2290-e3ea-4120-946f-ae746f7ab03c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.378537 Aug 24 03:31:26.085916 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 265/554] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:25 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:26.091028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:26.091971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:26.112146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.112641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.117435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.118210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.118860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.119306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.125486 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-61e46077-26cc-4182-8d6f-e58c16d735a7 tempest-FlavorsV2NegativeTest-1138387833 tempest-FlavorsV2NegativeTest-1138387833-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61e46077-26cc-4182-8d6f-e58c16d735a7 tempest-FlavorsV2NegativeTest-1138387833 tempest-FlavorsV2NegativeTest-1138387833-project] Request method failure captured: Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 142 Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZuK5bDRfVy4qOHLgQRvsFplVaZRvAqRJo6kR8V_UoxHMg2epDB_o2MjOajvESt3hD6CSnHtHuTHJRI8BO-0s8ZbruyYbw-D1o2Wop6aWhYXtm1pIC6NMFMsAKQYz15AIsK3RgXV_JrLN3K_pLAn7Lf2n0od08CalA0qWsQRV7ajaDY Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fe8bd78addf0468fad5c3d891020d17c Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FlavorsV2NegativeTest-1138387833 Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:31:26.128286 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe8bd78addf0468fad5c3d891020d17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe8bd78addf0468fad5c3d891020d17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe8bd78addf0468fad5c3d891020d17c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe8bd78addf0468fad5c3d891020d17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FlavorsV2NegativeTest-1138387833 Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fe8bd78addf0468fad5c3d891020d17c Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1138387833 Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FlavorsV2NegativeTest-1138387833-project Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 40486b729a164715ad9aa03c33a1f3b1 Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FlavorsV2NegativeTest-1138387833-project Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-801856052", "imageRef": "6b65070f-d217-4e6c-8568-42cace5bb31d", "flavorRef": "452"}} Aug 24 03:31:26.129930 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: exception: Flavor's memory is too small for requested image. Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-801856052', 'imageRef': '6b65070f-d217-4e6c-8568-42cace5bb31d', 'flavorRef': '452'}}} Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1006, in _checks_for_create_and_rebuild Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 670, in _validate_flavor_image Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 738, in _validate_flavor_image_nostatus Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:26.130850 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:26.132323 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:26.134551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:26.134551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:26.134551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:26.134551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:26.134551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 24 03:31:26.134551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:26.134551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61e46077-26cc-4182-8d6f-e58c16d735a7 tempest-FlavorsV2NegativeTest-1138387833 tempest-FlavorsV2NegativeTest-1138387833-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:26.134551 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-61e46077-26cc-4182-8d6f-e58c16d735a7 tempest-FlavorsV2NegativeTest-1138387833 tempest-FlavorsV2NegativeTest-1138387833-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.697939 Aug 24 03:31:26.144046 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 290/555] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:25 2022] POST /compute/v2.1/servers => generated 93 bytes in 711 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:31:26.158762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:26.159884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:26.167595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.168385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.169174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.170256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.171031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.171608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.211637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.212619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.213945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.215125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lazy-loading 'fault' on Instance uuid eaf50224-1e50-4491-9e04-c28f568b6044 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:26.296645 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc2b218f-7eb8-4ff0-9671-158d1334d245 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209087 Aug 24 03:31:26.297522 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 266/556] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:31:26 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:26.309903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:26.310330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:26.331204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.331620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6330d9fee114b469aad491bf5af477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9864cf1adf435fb032759a1518cb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:26.332726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.336637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.340293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.340772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.341186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.370348 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef247c5c-667a-4fb5-aafe-8b95f1716081 tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 200 len: 1312 microversion: 2.1 time: 0.224835 Aug 24 03:31:26.373941 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 291/557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:26 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:26.456158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:26.457740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:26.472495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.474988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.476555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.478900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.480961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.482843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.051152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:27.063835 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-77b10b33-dc0a-4434-92d8-1d33c47e6bac tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1280 microversion: 2.1 time: 0.611631 Aug 24 03:31:27.064815 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 292/558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:26 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1280 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:27.112564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:27.113638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:27.129104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.130089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.132650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.134040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.134735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.135377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.266926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:27.282601 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e508c1e3-16b3-40e3-beb3-5129a8f8433c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1468 microversion: 2.1 time: 0.983294 Aug 24 03:31:27.284901 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 267/559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:26 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1468 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:27.313836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:27.322093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:27.325596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Searching by: {'reservation_id': 'r-p9dqz8a4', 'deleted': False, 'project_id': 'd347f85e59734622a091e80dbf0d9521'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:31:27.341035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.341522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.346205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.348624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.351718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.352362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.423101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=30 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:27.531566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:31:27.648747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:27.657913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.658673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.659291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.673775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:27.682975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:27.684742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:27.686019 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6852cb8-1678-432c-beb2-4beb0a769a6b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.580029 Aug 24 03:31:27.687194 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 293/560] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:27 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:31:27.693308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:27.704679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] [instance: eaf50224-1e50-4491-9e04-c28f568b6044] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:27.720102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.720824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.721376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.722239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.722819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.723353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.749608 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] HTTP exception thrown: Instance eaf50224-1e50-4491-9e04-c28f568b6044 could not be found. Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Request method failure captured: Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 HTTP/1.1 Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtu4W_N38Vvi_YBVToQR1FqSuCIQQhHmVY_XumK8qH8w-ncvNWx8iLyPdDmM3k5c_VdD7h-nCehlY5oACv9hoTlyyMyjERQRG50tyLmWhJ0el8vfOwe6IfqI6sAKzJl7OkfGHBOAXxnchz4y4bWkOG34vGlmzDNk5F_Omgt_Dn5ZDs Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ca9864cf1adf435fb032759a1518cb8a Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-156779789 Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:31:27.759570 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca9864cf1adf435fb032759a1518cb8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca9864cf1adf435fb032759a1518cb8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca9864cf1adf435fb032759a1518cb8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca9864cf1adf435fb032759a1518cb8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-156779789 Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ca9864cf1adf435fb032759a1518cb8a Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-156779789 Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerDiagnosticsNegativeTest-156779789-project Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: b6330d9fee114b469aad491bf5af477d Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-156779789-project Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance eaf50224-1e50-4491-9e04-c28f568b6044 could not be found. Aug 24 03:31:27.761245 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'eaf50224-1e50-4491-9e04-c28f568b6044'} Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf50224-1e50-4491-9e04-c28f568b6044 could not be found. Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:27.762095 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf50224-1e50-4491-9e04-c28f568b6044 could not be found. Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf50224-1e50-4491-9e04-c28f568b6044 could not be found. Aug 24 03:31:27.763636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:27.765010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] Returning 404 to user: Instance eaf50224-1e50-4491-9e04-c28f568b6044 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:27.766977 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90806445-c5f2-4a7d-8f2f-c379ee3536dc tempest-ServerDiagnosticsNegativeTest-156779789 tempest-ServerDiagnosticsNegativeTest-156779789-project] 10.222.0.58 "GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044" status: 404 len: 111 microversion: 2.1 time: 0.076922 Aug 24 03:31:27.767733 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 294/561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:27 2022] GET /compute/v2.1/servers/eaf50224-1e50-4491-9e04-c28f568b6044 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:31:27.786891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a7b85ae7-bbf0-43b2-b7fe-0e8647eb0fd3 req-6101ac3c-f653-4357-8034-c7a789d30dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c", "name": "network-vif-plugged", "status": "completed", "tag": "bf3f1eec-aa98-4265-993e-6bc0ec631b29"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:27.798438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a7b85ae7-bbf0-43b2-b7fe-0e8647eb0fd3 req-6101ac3c-f653-4357-8034-c7a789d30dd9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.802309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a7b85ae7-bbf0-43b2-b7fe-0e8647eb0fd3 req-6101ac3c-f653-4357-8034-c7a789d30dd9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.802888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a7b85ae7-bbf0-43b2-b7fe-0e8647eb0fd3 req-6101ac3c-f653-4357-8034-c7a789d30dd9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.831482 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a7b85ae7-bbf0-43b2-b7fe-0e8647eb0fd3 req-6101ac3c-f653-4357-8034-c7a789d30dd9 service nova] Creating event network-vif-plugged:bf3f1eec-aa98-4265-993e-6bc0ec631b29 for instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c on n-h1-846470-15 Aug 24 03:31:27.839985 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a7b85ae7-bbf0-43b2-b7fe-0e8647eb0fd3 req-6101ac3c-f653-4357-8034-c7a789d30dd9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070573 Aug 24 03:31:27.841046 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 295/562] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:28.089174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:28.089870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:28.097087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.097816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.098492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:28.099359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.100084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.100664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:28.445352 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba608c34-3d33-4897-968d-0c2faee8d830 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-p9dqz8a4" status: 200 len: 2928 microversion: 2.1 time: 1.136359 Aug 24 03:31:28.446648 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 268/563] 10.222.0.58 () {58 vars in 1197 bytes} [Wed Aug 24 03:31:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-p9dqz8a4 => generated 2928 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:28.475379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2adad741-ff23-4bb1-8217-718c6de3e15c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:28.535350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.server_groups [None req-2adad741-ff23-4bb1-8217-718c6de3e15c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Querying cell a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) for 2 instances {{(pid=122535) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 03:31:28.536806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2adad741-ff23-4bb1-8217-718c6de3e15c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.537443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2adad741-ff23-4bb1-8217-718c6de3e15c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.538284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2adad741-ff23-4bb1-8217-718c6de3e15c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:28.543086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:28.552823 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9075cd07-5660-48f3-b391-c601e4c93129 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1322 microversion: 2.1 time: 0.468124 Aug 24 03:31:28.569928 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 296/564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:28 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:28.587918 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2adad741-ff23-4bb1-8217-718c6de3e15c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/1ff4f6e9-c8a8-405a-adf4-1623460f9374" status: 200 len: 271 microversion: 2.1 time: 0.118589 Aug 24 03:31:28.589218 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 269/565] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:31:28 2022] GET /compute/v2.1/os-server-groups/1ff4f6e9-c8a8-405a-adf4-1623460f9374 => generated 271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:31:28.601180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:28.601835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:28.618489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.618983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.619415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:28.620246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.620704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.621123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:28.708549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:28.709297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:28.722530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.723230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.723888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:28.724916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.725544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.726135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.208497 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a5d9f4d-3360-47fa-ba72-be285bc58f9c tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 200 len: 1620 microversion: 2.1 time: 0.611792 Aug 24 03:31:29.210103 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 297/566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:28 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 1620 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:29.230011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:29.230738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:29.237584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:29.238077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:29.238513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.239217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:29.239845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:29.240275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.260958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:29.275531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:29.278662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:29.279980 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37ca466a-e4c6-469a-b4e0-4e72d3f3edfd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1362 microversion: 2.25 time: 0.575504 Aug 24 03:31:29.281041 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 270/567] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:28 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1362 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:31:29.585369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:29.591091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:29.615759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:29.616365 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c875491-c842-408e-b5b4-b9c47c7bbfd2 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1621 microversion: 2.1 time: 0.390077 Aug 24 03:31:29.630966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:29.631359 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 298/568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:29 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1621 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:29.652025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.653189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:29.656155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:29.656817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.755073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:29.755694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:29.781502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:29.782002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:29.795436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.801055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:29.801564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:29.802011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:30.063165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:30.074858 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c730b795-8e66-4578-b64a-474d72ee33a6 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1322 microversion: 2.1 time: 0.499540 Aug 24 03:31:30.075445 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 271/569] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:29 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:30.088843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b43532db-71df-497c-a32f-b39c61a7604c req-fc62755b-1fc7-41a8-b9f2-0580bf62be24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19c423f-0e82-4d93-b79d-7fdc5d3cdf42", "tag": "8dda5d94-0df8-484c-a955-1bd7d4c92098"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:30.113280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b43532db-71df-497c-a32f-b39c61a7604c req-fc62755b-1fc7-41a8-b9f2-0580bf62be24 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:30.115146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b43532db-71df-497c-a32f-b39c61a7604c req-fc62755b-1fc7-41a8-b9f2-0580bf62be24 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:30.116416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b43532db-71df-497c-a32f-b39c61a7604c req-fc62755b-1fc7-41a8-b9f2-0580bf62be24 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:30.147874 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b43532db-71df-497c-a32f-b39c61a7604c req-fc62755b-1fc7-41a8-b9f2-0580bf62be24 service nova] Creating event network-changed:8dda5d94-0df8-484c-a955-1bd7d4c92098 for instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 on n-h2-846470-15 Aug 24 03:31:30.164122 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b43532db-71df-497c-a32f-b39c61a7604c req-fc62755b-1fc7-41a8-b9f2-0580bf62be24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083794 Aug 24 03:31:30.167254 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 272/570] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:30.185656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1519589512", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:30.334229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:30.777856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:30.793985 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59416450-5604-4299-8379-d99334c81778 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 200 len: 1587 microversion: 2.1 time: 1.047670 Aug 24 03:31:30.811712 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 299/571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:29 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 1587 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:30.824557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:30.829029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:30.843270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:30.843992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:30.844570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:30.845467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:30.846215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:30.846712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:31.353583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:31.374849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:31.377093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:31.381437 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1b13f38f-6656-4180-854c-dd8fb65b1f6c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1558 microversion: 2.25 time: 0.564538 Aug 24 03:31:31.389655 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 300/572] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:30 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1558 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:31.782108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1186464181", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a8cadaaf-6888-4107-843d-808010e646f6"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:31.787730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:31.789801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:31.790631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:31.791810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:31.793984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:31.824813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:31.825843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:31.826418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:31.828708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:31.834426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:31.835710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:31.851382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] validate_networks() for [('a8cadaaf-6888-4107-843d-808010e646f6', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:31.881317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=39 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:31.896477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:31.916322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:31.954233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:31.959863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:31.984345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=11,nova_api:INSERT=11 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:32.073529 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-64d26dd3-c9a6-4e5a-9b9f-e72bebe0c912 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.892236 Aug 24 03:31:32.080661 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 273/573] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:31:32.087070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:32.087906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:32.095643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:32.096406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:32.097027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:32.097888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:32.098488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:32.099053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:32.358550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:32.370534 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac85f5e2-d0fe-4737-940c-ce814b6b9d78 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1322 microversion: 2.1 time: 0.288467 Aug 24 03:31:32.371245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 274/574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:32 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:32.379348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9a1c68d4-8dd3-471a-a222-729208e09c45 req-015d8a72-4eab-46ef-86c8-32c2c33bf6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4dfd497-923f-42d0-a333-546f43070749", "tag": "18f10c19-0d70-49da-9fe9-b382568d4a09"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:32.411609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9a1c68d4-8dd3-471a-a222-729208e09c45 req-015d8a72-4eab-46ef-86c8-32c2c33bf6e3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:32.412837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9a1c68d4-8dd3-471a-a222-729208e09c45 req-015d8a72-4eab-46ef-86c8-32c2c33bf6e3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:32.414768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9a1c68d4-8dd3-471a-a222-729208e09c45 req-015d8a72-4eab-46ef-86c8-32c2c33bf6e3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:32.440237 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9a1c68d4-8dd3-471a-a222-729208e09c45 req-015d8a72-4eab-46ef-86c8-32c2c33bf6e3 service nova] Creating event network-changed:18f10c19-0d70-49da-9fe9-b382568d4a09 for instance e4dfd497-923f-42d0-a333-546f43070749 on n-h2-846470-15 Aug 24 03:31:32.448615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9a1c68d4-8dd3-471a-a222-729208e09c45 req-015d8a72-4eab-46ef-86c8-32c2c33bf6e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076023 Aug 24 03:31:32.450169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 275/575] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:32.458393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:32.460667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:32.496646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:32.498014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:32.498014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:32.500070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:32.502665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:32.504140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:32.785659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:32.806400 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b2f3a7e9-8511-4a9a-abf2-1a4b01a8072b tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 2053 microversion: 2.25 time: 0.354489 Aug 24 03:31:32.807776 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 276/576] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:32 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 2053 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:33.061060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:33.061698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:33.062345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:33.062766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:33.079959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:33.089924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=95 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:33.092097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.093575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.094213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.095426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.096135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.097124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.135095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43121c6e-ee2b-41bd-a7ef-b3508bc574a7 tempest-ListImageFiltersNegativeTestJSON-1975548088 tempest-ListImageFiltersNegativeTestJSON-1975548088-project] Calling method '.version_select at 0x7f102b39af70>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:33.145415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Getting quotas for project 21381ed0f374420b9d483bb3450cee89. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:33.153439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Getting quotas for user 6ec6f56b6ea1404f9e961409fe530563 and project 21381ed0f374420b9d483bb3450cee89. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:33.164644 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-43121c6e-ee2b-41bd-a7ef-b3508bc574a7 tempest-ListImageFiltersNegativeTestJSON-1975548088 tempest-ListImageFiltersNegativeTestJSON-1975548088-project] HTTP exception thrown: Image not found. Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43121c6e-ee2b-41bd-a7ef-b3508bc574a7 tempest-ListImageFiltersNegativeTestJSON-1975548088 tempest-ListImageFiltersNegativeTestJSON-1975548088-project] Request method failure captured: Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/images/42f6ceab-febc-4257-bc72-714c3136aaf8 HTTP/1.1 Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuTC7AqdDYRKEkqnFNy288pzq_SYg5mx8SqYKIR1CHdOC6jgJcS33nXPcmwZr-Apfyd2JRLiO3IOwrayIg0FdNUUtPndk8x3xUvppB6ltq3FwBbbLNxcJvbEIvrrMKz2M2uXmkTOCWx4vrrXIt7DXnp5-hik605vf1KCjj8cdX3j7M Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: f0305597d97846d1a02dfe731534608c Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1975548088 Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:31:33.177137 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0305597d97846d1a02dfe731534608c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0305597d97846d1a02dfe731534608c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0305597d97846d1a02dfe731534608c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0305597d97846d1a02dfe731534608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1975548088 Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: f0305597d97846d1a02dfe731534608c Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1975548088 Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListImageFiltersNegativeTestJSON-1975548088-project Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 7e07842f0acb43fe97a32605d5d52aff Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1975548088-project Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '42f6ceab-febc-4257-bc72-714c3136aaf8'} Aug 24 03:31:33.178745 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:31:33.179749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 42f6ceab-febc-4257-bc72-714c3136aaf8 Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:31:33.181210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 42f6ceab-febc-4257-bc72-714c3136aaf8 could not be found. Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:33.182684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:31:33.183872 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:33.184777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:33.184777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:33.187934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43121c6e-ee2b-41bd-a7ef-b3508bc574a7 tempest-ListImageFiltersNegativeTestJSON-1975548088 tempest-ListImageFiltersNegativeTestJSON-1975548088-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:33.189468 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-43121c6e-ee2b-41bd-a7ef-b3508bc574a7 tempest-ListImageFiltersNegativeTestJSON-1975548088 tempest-ListImageFiltersNegativeTestJSON-1975548088-project] 10.222.0.58 "GET /compute/v2.1/images/42f6ceab-febc-4257-bc72-714c3136aaf8" status: 404 len: 62 microversion: 2.1 time: 0.379938 Aug 24 03:31:33.197014 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 277/577] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:31:32 2022] GET /compute/v2.1/images/42f6ceab-febc-4257-bc72-714c3136aaf8 => generated 62 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:31:33.204525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:33.205548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:33.226977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.228705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.229988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.234084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.235089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.235761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.289754 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-83760432-32e7-44e2-a343-8aaae10d2f69 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.898137 Aug 24 03:31:33.294958 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 301/578] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:31:33.305069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:33.305675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:33.324788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.325283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.325718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.326423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.326883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.327304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.493452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:33.514419 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bc6a4c0a-eb2e-4a57-8fe3-7f14292128d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1213 microversion: 2.1 time: 0.310949 Aug 24 03:31:33.515481 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 278/579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:33 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1213 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:33.528186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db5ae95c-c4b5-4c62-bbde-e32bc1fce4e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:33.532022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-db5ae95c-c4b5-4c62-bbde-e32bc1fce4e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:33.630430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db5ae95c-c4b5-4c62-bbde-e32bc1fce4e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:33.643538 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db5ae95c-c4b5-4c62-bbde-e32bc1fce4e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1224 microversion: 2.1 time: 0.124367 Aug 24 03:31:33.646535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 279/580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:33 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:33.652427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:33.653369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:33.660734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.661567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.662209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.663644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.664296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.665583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.847645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:33.925328 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a513fcb8-57e9-41a8-b62e-c563dc4dc26d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 2053 microversion: 2.25 time: 0.623380 Aug 24 03:31:33.928115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 302/581] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:33 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 2053 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:33.967027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-28c272d7-2c34-4f6f-94e2-d27c4a237a41 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:33.974745 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:33.974745 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:33.977726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28c272d7-2c34-4f6f-94e2-d27c4a237a41 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.978797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28c272d7-2c34-4f6f-94e2-d27c4a237a41 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.983407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28c272d7-2c34-4f6f-94e2-d27c4a237a41 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.985667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28c272d7-2c34-4f6f-94e2-d27c4a237a41 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.987777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28c272d7-2c34-4f6f-94e2-d27c4a237a41 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.988528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28c272d7-2c34-4f6f-94e2-d27c4a237a41 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.041980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:34.045032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:34.053078 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4eb91ad-eebe-463f-9c9b-fae22fe2a59f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1322 microversion: 2.1 time: 0.405022 Aug 24 03:31:34.056040 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 280/582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:33 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:34.057071 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-28c272d7-2c34-4f6f-94e2-d27c4a237a41 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.102365 Aug 24 03:31:34.058696 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 303/583] 10.222.0.58 () {60 vars in 1217 bytes} [Wed Aug 24 03:31:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:31:34.073602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:34.074476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:34.092849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.095094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.096868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.098491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.099812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.100832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.378544 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a28f40a-1660-4dd4-a7b7-203ddd146a06 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c/action" status: 202 len: 0 microversion: 2.25 time: 0.307960 Aug 24 03:31:34.392552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:34.393455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:34.401796 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 281/584] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:31:34 2022] POST /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:34.411770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.414698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.415169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.415964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.423523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.429175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.538892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:34.540381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:34.571502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.572990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.573699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.575002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.575639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.576327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.756126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:34.774062 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3246c7d2-04fe-4509-97b2-c46820b809e1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1275 microversion: 2.1 time: 0.241929 Aug 24 03:31:34.809803 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 282/585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:34 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1275 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:34.836617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:34.837309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:34.876675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.879507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.881566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.882965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.886171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.886943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.155481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:35.173218 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0206f121-d4fa-488d-bba3-b34d26f8e5ac tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1228 microversion: 2.1 time: 0.357428 Aug 24 03:31:35.174156 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 283/586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:34 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1228 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:35.193612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:35.194691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:35.206543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.208130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.209897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.211055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.212591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.213293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.311462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:35.346730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e27e13f-9966-4a4a-aec1-dc11838a1b6a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 2058 microversion: 2.25 time: 0.959421 Aug 24 03:31:35.348214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 304/587] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:34 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 2058 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:35.598193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:35.613806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7bf73c0-273d-48f3-a35b-8ded98ba3c26 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:35.618131 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:35.618131 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:35.621869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bf73c0-273d-48f3-a35b-8ded98ba3c26 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.622960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bf73c0-273d-48f3-a35b-8ded98ba3c26 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.623122 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dcbb6791-a6e1-4021-927c-da019782e757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1322 microversion: 2.1 time: 0.447610 Aug 24 03:31:35.623843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bf73c0-273d-48f3-a35b-8ded98ba3c26 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.624780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bf73c0-273d-48f3-a35b-8ded98ba3c26 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.624930 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 284/588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:35 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:35.625883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bf73c0-273d-48f3-a35b-8ded98ba3c26 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.626493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bf73c0-273d-48f3-a35b-8ded98ba3c26 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.661068 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7bf73c0-273d-48f3-a35b-8ded98ba3c26 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.310144 Aug 24 03:31:35.662156 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 305/589] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:31:35 2022] GET /compute/v2.1/os-services => generated 949 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:35.675469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4bcc3083-ddcc-4bb4-b255-9e537ff1d3c0 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:35.680217 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:35.680217 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:31:35.682184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcc3083-ddcc-4bb4-b255-9e537ff1d3c0 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.689303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcc3083-ddcc-4bb4-b255-9e537ff1d3c0 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.691055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcc3083-ddcc-4bb4-b255-9e537ff1d3c0 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.692509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcc3083-ddcc-4bb4-b255-9e537ff1d3c0 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.693403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcc3083-ddcc-4bb4-b255-9e537ff1d3c0 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.694321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcc3083-ddcc-4bb4-b255-9e537ff1d3c0 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.733727 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4bcc3083-ddcc-4bb4-b255-9e537ff1d3c0 tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-846470-15" status: 200 len: 581 microversion: 2.1 time: 0.059842 Aug 24 03:31:35.743398 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 285/590] 10.222.0.58 () {58 vars in 1174 bytes} [Wed Aug 24 03:31:35 2022] GET /compute/v2.1/os-services?host=n-d-846470-15 => generated 581 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:35.748130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-06cf5c18-6acd-4b98-bbce-8f6f07ade9cd tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:35.751509 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:35.751509 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:35.757431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06cf5c18-6acd-4b98-bbce-8f6f07ade9cd tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.758482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06cf5c18-6acd-4b98-bbce-8f6f07ade9cd tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.759270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06cf5c18-6acd-4b98-bbce-8f6f07ade9cd tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.760325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06cf5c18-6acd-4b98-bbce-8f6f07ade9cd tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.761025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06cf5c18-6acd-4b98-bbce-8f6f07ade9cd tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.761698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06cf5c18-6acd-4b98-bbce-8f6f07ade9cd tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.806602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:35.807230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:35.821402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.822173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.822951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.823855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.824859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.827073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.837355 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-06cf5c18-6acd-4b98-bbce-8f6f07ade9cd tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.091724 Aug 24 03:31:35.838950 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 306/591] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 03:31:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:35.853684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac1cf673-fba5-4562-b93d-f2c8527c85cf tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:35.856576 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:31:35.856576 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:31:35.862850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac1cf673-fba5-4562-b93d-f2c8527c85cf tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.869823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac1cf673-fba5-4562-b93d-f2c8527c85cf tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.870464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac1cf673-fba5-4562-b93d-f2c8527c85cf tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.873069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac1cf673-fba5-4562-b93d-f2c8527c85cf tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.874308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac1cf673-fba5-4562-b93d-f2c8527c85cf tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.877919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac1cf673-fba5-4562-b93d-f2c8527c85cf tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.961687 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac1cf673-fba5-4562-b93d-f2c8527c85cf tempest-ServicesAdminTestJSON-1929409947 tempest-ServicesAdminTestJSON-1929409947-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.114440 Aug 24 03:31:35.976630 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 307/592] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:31:35 2022] GET /compute/v2.1/os-services => generated 949 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:36.195701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:36.196564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:36.208850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:36.209823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:36.210517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:36.212415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:36.213111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:36.213957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.086509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:37.105898 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c215de76-70f1-45a4-b5ae-fa46fc24d752 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1276 microversion: 2.1 time: 0.915084 Aug 24 03:31:37.106745 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 308/593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:36 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1276 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:37.112366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:37.113242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:37.131912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.132866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.133561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.134522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.135197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.135897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.262587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:37.279911 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d8b0b65a-f5d3-4e8d-8523-fb8a7987ec1e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 1.474801 Aug 24 03:31:37.297944 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 286/594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:35 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:37.308505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:37.319564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:37.332920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.334393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.335161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.339632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.346159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.346770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.827986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:37.848816 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23c3a2cd-92e5-4170-8839-134c0a708081 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 2038 microversion: 2.25 time: 0.740790 Aug 24 03:31:37.849710 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 309/595] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:37 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 2038 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:37.875855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846470-15", "block_migration": "auto"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:37.878630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:37.910172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.910967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.911626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.912787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.913502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.914157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.920195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:37.952654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'flavor' on Instance uuid c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:37.968412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Going to try to live migrate instance to n-h2-846470-15 {{(pid=122536) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:31:38.235269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:38.260944 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-853c4a1c-d0ca-4558-9ed8-33432a54a9b4 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1322 microversion: 2.1 time: 0.960042 Aug 24 03:31:38.261895 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 287/596] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:37 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:38.929051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cee89662-d5e3-4069-9174-29af133bf6d3 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Action: 'create', calling method: .version_select at 0x7f102b559b80>, body: {"keypair": {"name": "tempest-keypair-21964947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4Mj+pGAC+mUujeFocuTK0aYEs709kkA0gxYJwfNjwwjEcmrjJZN9SKQCekSGFlgEMlT6SxdIihNt/LS7fTg2RD5p2uNkoDHW5JLbUITFQZO3cr9xsB9E6O6bME6qy0yg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:38.987449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-cee89662-d5e3-4069-9174-29af133bf6d3 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:39.013304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-cee89662-d5e3-4069-9174-29af133bf6d3 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for user 5bebaa230fb44a60bf0ab55e3627e216 and project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:39.082948 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cee89662-d5e3-4069-9174-29af133bf6d3 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.819339 Aug 24 03:31:39.084261 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 288/597] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:38 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:39.091503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:39.092393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:39.109623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:39.111548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:39.114229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.117449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:39.119815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:39.123836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.836863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:39.849630 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fa38d8c4-1175-4b12-8714-7d19bc614378 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.764071 Aug 24 03:31:39.853111 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 289/598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:39 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:39.878517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:39.880576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:39.899938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:39.903027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:39.907426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.908909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:39.909482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:39.910279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.917460 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f2bfca1-7f58-4db7-8f0e-9bae44318ba0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c/action" status: 202 len: 0 microversion: 2.25 time: 2.044738 Aug 24 03:31:39.924794 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 310/599] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:31:37 2022] POST /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c/action => generated 0 bytes in 2054 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:31:39.936986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-943ba6d7-79a1-46c9-bee1-afe1b4b40b48 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Calling method '.version_select at 0x7f10235e6a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:39.959788 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-943ba6d7-79a1-46c9-bee1-afe1b4b40b48 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-21964947" status: 200 len: 495 microversion: 2.1 time: 0.031769 Aug 24 03:31:39.962128 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 311/600] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 24 03:31:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-21964947 => generated 495 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:39.976487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2e882af3-ff26-4a53-ad09-0dcb2ab76ede req-c542ab54-3af2-4095-a3d5-42a48c23e17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bee13da-b1c6-4a3d-b5e2-dec36fe2031a", "tag": "ad77eb67-70e3-47d6-8e20-34a660d000ee"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:40.000690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2e882af3-ff26-4a53-ad09-0dcb2ab76ede req-c542ab54-3af2-4095-a3d5-42a48c23e17a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.004600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2e882af3-ff26-4a53-ad09-0dcb2ab76ede req-c542ab54-3af2-4095-a3d5-42a48c23e17a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.005435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2e882af3-ff26-4a53-ad09-0dcb2ab76ede req-c542ab54-3af2-4095-a3d5-42a48c23e17a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.279540 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2e882af3-ff26-4a53-ad09-0dcb2ab76ede req-c542ab54-3af2-4095-a3d5-42a48c23e17a service nova] Creating event network-changed:ad77eb67-70e3-47d6-8e20-34a660d000ee for instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a on n-h1-846470-15 Aug 24 03:31:40.296209 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2e882af3-ff26-4a53-ad09-0dcb2ab76ede req-c542ab54-3af2-4095-a3d5-42a48c23e17a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.330869 Aug 24 03:31:40.299523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 312/601] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:40.309913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:40.310663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:40.325256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.327489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.329002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.330171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.332675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.334155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.694338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:40.713621 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fca75478-3b37-4d5b-a82f-119d4c8f1b8a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1322 microversion: 2.1 time: 0.406608 Aug 24 03:31:40.714817 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 313/602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:40 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:40.723844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:40.729046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:40.745367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.747334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.748406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.750812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.753371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.757542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.020784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.036490 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ebe8a36a-2fe3-4c5b-8bd4-fff62f58df65 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 1.182036 Aug 24 03:31:41.037888 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 290/603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:39 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:41.043062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-beef6f40-4bad-4b13-b30b-fa2fa55dfeee tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Calling method '.version_select at 0x7f102b2ed040>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.066919 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-beef6f40-4bad-4b13-b30b-fa2fa55dfeee tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-21964947" status: 202 len: 0 microversion: 2.1 time: 0.027519 Aug 24 03:31:41.067637 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 291/604] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 24 03:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-21964947 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:41.073252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c7f22661-0d4e-4561-a928-f10eefbeaeac req-52bbeb06-4726-4f9b-ac19-3afcebbe2cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dfd497-923f-42d0-a333-546f43070749", "name": "network-vif-plugged", "status": "completed", "tag": "18f10c19-0d70-49da-9fe9-b382568d4a09"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:41.086735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c7f22661-0d4e-4561-a928-f10eefbeaeac req-52bbeb06-4726-4f9b-ac19-3afcebbe2cae service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.087329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c7f22661-0d4e-4561-a928-f10eefbeaeac req-52bbeb06-4726-4f9b-ac19-3afcebbe2cae service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.087887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c7f22661-0d4e-4561-a928-f10eefbeaeac req-52bbeb06-4726-4f9b-ac19-3afcebbe2cae service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.100078 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c7f22661-0d4e-4561-a928-f10eefbeaeac req-52bbeb06-4726-4f9b-ac19-3afcebbe2cae service nova] Creating event network-vif-plugged:18f10c19-0d70-49da-9fe9-b382568d4a09 for instance e4dfd497-923f-42d0-a333-546f43070749 on n-h2-846470-15 Aug 24 03:31:41.108881 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c7f22661-0d4e-4561-a928-f10eefbeaeac req-52bbeb06-4726-4f9b-ac19-3afcebbe2cae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039078 Aug 24 03:31:41.109632 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 292/605] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:41.117572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.119173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:41.128441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.129307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.130398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.131375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.132259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.132915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.197669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.209775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.212440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.214456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6df0d44c-5bf1-4187-9745-4764233397dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 0.496422 Aug 24 03:31:41.215631 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 314/606] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:40 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:41.418331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df72dc8f-80a5-4c44-b457-0f7a9beaf097 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Action: 'create', calling method: .version_select at 0x7f10232df700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRPe0mLk4fEg2pKBcJo75GJX/mxf+Wa4FsGES9hTghPhaJO7mJjPYLxK8pax2KnwR0TduNUZO78Z5k+ompC9E2XHEyeAp+S+pxIcaOvHrifEvzod+LSlz2z/yAudX/Phg=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df72dc8f-80a5-4c44-b457-0f7a9beaf097 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Request method failure captured: Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 257 Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZucC9uCgYNGlK42ItdDd9ZZGRtgp6BhMVFwVI5EEo9E085dVOCKUScqBELVHvIBlgxRJjJ13agr0hO_kX0OaLcSbfziq-dITFllBJbwtrRX8qkDUETsFbHIrlCR5r8Q-l7zmsR1XKuI3IaRS1p9C-3QNmbZmNwRyBuIVR7pAElddtw Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:31:41.428094 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:31:41.429528 n-d-846470-15 devstack@n-api.service[122536]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRPe0mLk4fEg2pKBcJo75GJX/mxf+Wa4FsGES9hTghPhaJO7mJjPYLxK8pax2KnwR0TduNUZO78Z5k+ompC9E2XHEyeAp+S+pxIcaOvHrifEvzod+LSlz2z/yAudX/Phg=="}} Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRPe0mLk4fEg2pKBcJo75GJX/mxf+Wa4FsGES9hTghPhaJO7mJjPYLxK8pax2KnwR0TduNUZO78Z5k+ompC9E2XHEyeAp+S+pxIcaOvHrifEvzod+LSlz2z/yAudX/Phg=='}}} Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.430207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:41.431238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:31:41.432642 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:31:41.433748 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 03:31:41.433748 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.436706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df72dc8f-80a5-4c44-b457-0f7a9beaf097 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:41.438741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df72dc8f-80a5-4c44-b457-0f7a9beaf097 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.220860 Aug 24 03:31:41.439601 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 315/607] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:41 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:31:41.446546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-150f2b81-c4d8-4589-a85f-95969a504f1f tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Action: 'create', calling method: .version_select at 0x7f102327d040>, body: {"keypair": {"name": "tempest-keypair-1327950314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQXtH545OtLpvkDucCsitMEdFvccyDey581aCoImjAvS/If9xMtr0W+poUDSOnIPjupKaOJXAoE+EIbrgD8ZG6WqIkMFTdKC1g5LGNFbEh1oct+/SZdac/e1rRT3J+ybQ=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:41.470612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-150f2b81-c4d8-4589-a85f-95969a504f1f tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:41.476770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-150f2b81-c4d8-4589-a85f-95969a504f1f tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for user 5bebaa230fb44a60bf0ab55e3627e216 and project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:41.532540 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-150f2b81-c4d8-4589-a85f-95969a504f1f tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091492 Aug 24 03:31:41.533158 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 316/608] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:41.541415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97f4302b-af0c-472d-9cf0-5f23b42e3deb tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Action: 'create', calling method: .version_select at 0x7f1023313790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1899415232", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:41.573764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-97f4302b-af0c-472d-9cf0-5f23b42e3deb tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:41.579708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-97f4302b-af0c-472d-9cf0-5f23b42e3deb tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for user 0f1bae60a5e3477987b293d3ed8d58fb and project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:41.600520 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-97f4302b-af0c-472d-9cf0-5f23b42e3deb tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97f4302b-af0c-472d-9cf0-5f23b42e3deb tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Request method failure captured: Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 2167 Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZucC9uCgYNGlK42ItdDd9ZZGRtgp6BhMVFwVI5EEo9E085dVOCKUScqBELVHvIBlgxRJjJ13agr0hO_kX0OaLcSbfziq-dITFllBJbwtrRX8qkDUETsFbHIrlCR5r8Q-l7zmsR1XKuI3IaRS1p9C-3QNmbZmNwRyBuIVR7pAElddtw Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1899415232", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:31:41.609259 n-d-846470-15 devstack@n-api.service[122536]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1899415232', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:41.614906 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97f4302b-af0c-472d-9cf0-5f23b42e3deb tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97f4302b-af0c-472d-9cf0-5f23b42e3deb tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076494 Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 317/609] 10.222.0.58 () {60 vars in 1160 bytes} [Wed Aug 24 03:31:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:31:41.622491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db072b67-77b2-4b1e-a4f5-91c585527ff1 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Calling method '.version_select at 0x7f102343bb80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.634804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:41.643555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.644955 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db072b67-77b2-4b1e-a4f5-91c585527ff1 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327950314" status: 202 len: 0 microversion: 2.1 time: 0.031815 Aug 24 03:31:41.645620 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 318/610] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 03:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327950314 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:41.650976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3d9ca23-0d86-4918-b364-80ba9263b3ef tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Action: 'create', calling method: .version_select at 0x7f1023561790>, body: {"keypair": {"name": "tempest-keypair-944715052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAFQpiD0GDfNJq9VUsBlhFgjh+xR7HYpipIkl4Q/Hji24KKaXK+qtQBRXYzZ6Eh0mZk9N3EPn9d0o1eSZ54I1hzuNES0P7S06nLG8U9yIAWUkTdoLoipPy9oJsl/lpsLw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:41.661721 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02cb1dd9-6e85-4ed0-b63d-fe65eaae91c9 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.550396 Aug 24 03:31:41.663748 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 293/611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:41 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:41.667574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f3d9ca23-0d86-4918-b364-80ba9263b3ef tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:41.673540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f3d9ca23-0d86-4918-b364-80ba9263b3ef tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for user 0f1bae60a5e3477987b293d3ed8d58fb and project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:41.677339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a971847c-6480-40f6-a23a-371bd8fd4ebb tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Action: 'create', calling method: .version_select at 0x7f102b5599d0>, body: {"keypair": {"name": "tempest-keypair-965533837", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:41.713850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a971847c-6480-40f6-a23a-371bd8fd4ebb tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:41.720862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a971847c-6480-40f6-a23a-371bd8fd4ebb tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for user 5bebaa230fb44a60bf0ab55e3627e216 and project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:41.731385 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3d9ca23-0d86-4918-b364-80ba9263b3ef tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078060 Aug 24 03:31:41.733220 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 319/612] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:41.741720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.744350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:41.753408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.754598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.755298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.756365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.757176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.757856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.771434 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a971847c-6480-40f6-a23a-371bd8fd4ebb tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.104010 Aug 24 03:31:41.777396 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 294/613] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:41 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:41.779552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cb21763-9a8b-44f5-b70f-40f8f564299c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Action: 'create', calling method: .version_select at 0x7f102b288550>, body: {"keypair": {"name": "tempest-keypair-944715052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7+b63WNRxdo2WX3KJWelO+O7/j+36L/mpByRvRYDNwCytTsMXgKkqoNJpsnIw6kQHwDwOqkAuAYkjGoZgt+LAb/t84iv4rAN8aIQPjQEB1FLdHU9+BsQYE806L5Qtj1w=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:41.815948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-7cb21763-9a8b-44f5-b70f-40f8f564299c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:41.822927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-7cb21763-9a8b-44f5-b70f-40f8f564299c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for user 0f1bae60a5e3477987b293d3ed8d58fb and project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:41.851598 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7cb21763-9a8b-44f5-b70f-40f8f564299c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] HTTP exception thrown: Key pair 'tempest-keypair-944715052' already exists. Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cb21763-9a8b-44f5-b70f-40f8f564299c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Request method failure captured: Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 272 Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZucC9uCgYNGlK42ItdDd9ZZGRtgp6BhMVFwVI5EEo9E085dVOCKUScqBELVHvIBlgxRJjJ13agr0hO_kX0OaLcSbfziq-dITFllBJbwtrRX8qkDUETsFbHIrlCR5r8Q-l7zmsR1XKuI3IaRS1p9C-3QNmbZmNwRyBuIVR7pAElddtw Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: {"keypair": {"name": "tempest-keypair-944715052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7+b63WNRxdo2WX3KJWelO+O7/j+36L/mpByRvRYDNwCytTsMXgKkqoNJpsnIw6kQHwDwOqkAuAYkjGoZgt+LAb/t84iv4rAN8aIQPjQEB1FLdHU9+BsQYE806L5Qtj1w=="}} Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: exception: Key pair 'tempest-keypair-944715052' already exists. Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-944715052', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7+b63WNRxdo2WX3KJWelO+O7/j+36L/mpByRvRYDNwCytTsMXgKkqoNJpsnIw6kQHwDwOqkAuAYkjGoZgt+LAb/t84iv4rAN8aIQPjQEB1FLdHU9+BsQYE806L5Qtj1w=='}}} Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result.read() Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '0f1bae60a5e3477987b293d3ed8d58fb-tempest-keypair-944715052' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 24 03:31:41.855357 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result.read() Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 03:31:41.860187 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '0f1bae60a5e3477987b293d3ed8d58fb-tempest-keypair-944715052' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 3, 31, 41, 844460), 'updated_at': None, 'name': 'tempest-keypair-944715052', 'user_id': '0f1bae60a5e3477987b293d3ed8d58fb', 'fingerprint': '64:88:e8:14:ed:f9:bc:13:44:eb:79:45:15:7c:f0:05', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7+b63WNRxdo2WX3KJWelO+O7/j+36L/mpByRvRYDNwCytTsMXgKkqoNJpsnIw6kQHwDwOqkAuAYkjGoZgt+LAb/t84iv4rAN8aIQPjQEB1FLdHU9+BsQYE806L5Qtj1w==', 'type': 'ssh'}] Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi keypair.create() Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._create() Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-944715052' already exists. Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 24 03:31:41.868489 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-944715052' already exists. Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-944715052' already exists. Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cb21763-9a8b-44f5-b70f-40f8f564299c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Returning 409 to user: Key pair 'tempest-keypair-944715052' already exists. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:41.874316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7cb21763-9a8b-44f5-b70f-40f8f564299c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.093331 Aug 24 03:31:41.876789 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 295/614] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:41 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:31:41.886315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-171fd2a4-49e4-4a56-996c-a26213b6015f tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Calling method '.version_select at 0x7f102b33af70>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.921297 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-171fd2a4-49e4-4a56-996c-a26213b6015f tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-965533837" status: 202 len: 0 microversion: 2.1 time: 0.043296 Aug 24 03:31:41.922530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 296/615] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-965533837 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:41.929264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0fb4e20-1f93-4bdf-8820-a7c0bb7846bc tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Calling method '.version_select at 0x7f102b2ed940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.958403 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0fb4e20-1f93-4bdf-8820-a7c0bb7846bc tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-944715052" status: 202 len: 0 microversion: 2.1 time: 0.034176 Aug 24 03:31:41.959000 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 297/616] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-944715052 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:41.964635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-996a7c91-87ee-425b-9b30-70bfccbaa94b tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Action: 'create', calling method: .version_select at 0x7f102b33ae50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-875049872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUDx2cwkrO8zi1FkWrp52hFeeDu3rI3rjPwfE9UoY49m2RC8RR6d5zv/nBKhcA0gzRQiy1ujH1Ft0oiEz++b+Cv7gGQScRlmxecH8TfmdRdt7+CeSbmfEt3BIcm/TaQSQ=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:41.986739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-996a7c91-87ee-425b-9b30-70bfccbaa94b tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:41.994224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-996a7c91-87ee-425b-9b30-70bfccbaa94b tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for user 5bebaa230fb44a60bf0ab55e3627e216 and project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:42.021951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:DELETE=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:42.031752 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-996a7c91-87ee-425b-9b30-70bfccbaa94b tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.071474 Aug 24 03:31:42.034382 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 298/617] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:42.040999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4ea6538-a97e-45d7-ba72-3ad625b6dcb2 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Action: 'create', calling method: .version_select at 0x7f102b3b8940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzO7ZiHzV51zLQV8yLbqB4oO4wj4tnqjR5EaSCUDM/5g3RsQ49zf7BM+4wF4ipyELcMQBsTLAgZu/V73MSoDwLb+CIwfZrHU6RuHtbZjuI58gB06QK/xewHnfavP1lOVA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4ea6538-a97e-45d7-ba72-3ad625b6dcb2 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Request method failure captured: Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 247 Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZucC9uCgYNGlK42ItdDd9ZZGRtgp6BhMVFwVI5EEo9E085dVOCKUScqBELVHvIBlgxRJjJ13agr0hO_kX0OaLcSbfziq-dITFllBJbwtrRX8qkDUETsFbHIrlCR5r8Q-l7zmsR1XKuI3IaRS1p9C-3QNmbZmNwRyBuIVR7pAElddtw Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzO7ZiHzV51zLQV8yLbqB4oO4wj4tnqjR5EaSCUDM/5g3RsQ49zf7BM+4wF4ipyELcMQBsTLAgZu/V73MSoDwLb+CIwfZrHU6RuHtbZjuI58gB06QK/xewHnfavP1lOVA=="}} Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzO7ZiHzV51zLQV8yLbqB4oO4wj4tnqjR5EaSCUDM/5g3RsQ49zf7BM+4wF4ipyELcMQBsTLAgZu/V73MSoDwLb+CIwfZrHU6RuHtbZjuI58gB06QK/xewHnfavP1lOVA=='}}} Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi '' Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:31:42.045108 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4ea6538-a97e-45d7-ba72-3ad625b6dcb2 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:42.049095 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4ea6538-a97e-45d7-ba72-3ad625b6dcb2 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010637 Aug 24 03:31:42.054000 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 299/618] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:42 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:31:42.057316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a9f2ffc-0371-4dd3-9b34-fc4070eca439 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Action: 'create', calling method: .version_select at 0x7f102b288a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-441019639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4SiB555z5TA03JZdGDzJ8kVBdndhsxObLOUHFG8NZiTGbEqPRoaIEx5ji3QniMSZ4gRQExySGRIdIbA6V6/Zaso6FKt1nG/ja2nDwdDJBX6sbBcoAgo7CqXm20gcqCZg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:42.079590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-7a9f2ffc-0371-4dd3-9b34-fc4070eca439 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:42.087258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-7a9f2ffc-0371-4dd3-9b34-fc4070eca439 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for user 5bebaa230fb44a60bf0ab55e3627e216 and project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:42.122447 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a9f2ffc-0371-4dd3-9b34-fc4070eca439 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.069185 Aug 24 03:31:42.124599 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 300/619] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:42.129955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-efd6fe46-eea2-4bc1-9847-ea18f0cf9f9c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Action: 'create', calling method: .version_select at 0x7f102b288940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-353237395", "public_key": " "}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:42.149339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-efd6fe46-eea2-4bc1-9847-ea18f0cf9f9c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:42.156301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-efd6fe46-eea2-4bc1-9847-ea18f0cf9f9c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for user 0f1bae60a5e3477987b293d3ed8d58fb and project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:42.193325 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-efd6fe46-eea2-4bc1-9847-ea18f0cf9f9c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-efd6fe46-eea2-4bc1-9847-ea18f0cf9f9c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Request method failure captured: Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 94 Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZucC9uCgYNGlK42ItdDd9ZZGRtgp6BhMVFwVI5EEo9E085dVOCKUScqBELVHvIBlgxRJjJ13agr0hO_kX0OaLcSbfziq-dITFllBJbwtrRX8qkDUETsFbHIrlCR5r8Q-l7zmsR1XKuI3IaRS1p9C-3QNmbZmNwRyBuIVR7pAElddtw Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-353237395", "public_key": " "}} Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-353237395', 'public_key': ' '}}} Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.196101 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.201956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-efd6fe46-eea2-4bc1-9847-ea18f0cf9f9c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:42.205187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-efd6fe46-eea2-4bc1-9847-ea18f0cf9f9c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076368 Aug 24 03:31:42.205187 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 301/620] 10.222.0.58 () {60 vars in 1158 bytes} [Wed Aug 24 03:31:42 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:31:42.215184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.215847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:42.224600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.225459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.226086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.226956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.227595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.228400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.310600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:42.329387 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1635cb84-71da-4765-b013-da355e0d88a2 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1322 microversion: 2.1 time: 0.594574 Aug 24 03:31:42.330013 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 320/621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:41 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1322 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:42.335002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52aff6e2-048c-46f5-bd75-45f2352b3440 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Action: 'create', calling method: .version_select at 0x7f1023305550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-14320758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJLP2y6RUFQZU9A2JfQc87NeznFsyO9g3obFdWchZOAGe/VYre72Ot5PEN2o1NqNPxGU3IAiu/QWIGY27/0n9l60RnetNBD6RQcR5ocPeRudjwodU1+zWDHaCxojBrPLQ=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:42.357932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-52aff6e2-048c-46f5-bd75-45f2352b3440 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:42.364191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-52aff6e2-048c-46f5-bd75-45f2352b3440 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Getting quotas for user 5bebaa230fb44a60bf0ab55e3627e216 and project a6ef96242103480e9e20476de7b749db. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:42.394320 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-52aff6e2-048c-46f5-bd75-45f2352b3440 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062866 Aug 24 03:31:42.395042 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 321/622] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:42.400517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a1a871f-ccfe-48f5-a1a3-a4ee0b52b6d9 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Action: 'create', calling method: .version_select at 0x7f1023561790>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnBmxijHBFoYHwDGcBRihlEyiZYBTyxqy1HISzcaTi3prODGZrAV5ETyFmdgCXO8WVgU7a8Cgnn8t7FUVCToxtzjh6frsQPzIGspuwPDUOaI3Ft+P44n/cK2DZJVlwg2w=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a1a871f-ccfe-48f5-a1a3-a4ee0b52b6d9 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Request method failure captured: Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 507 Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZucC9uCgYNGlK42ItdDd9ZZGRtgp6BhMVFwVI5EEo9E085dVOCKUScqBELVHvIBlgxRJjJ13agr0hO_kX0OaLcSbfziq-dITFllBJbwtrRX8qkDUETsFbHIrlCR5r8Q-l7zmsR1XKuI3IaRS1p9C-3QNmbZmNwRyBuIVR7pAElddtw Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnBmxijHBFoYHwDGcBRihlEyiZYBTyxqy1HISzcaTi3prODGZrAV5ETyFmdgCXO8WVgU7a8Cgnn8t7FUVCToxtzjh6frsQPzIGspuwPDUOaI3Ft+P44n/cK2DZJVlwg2w=="}} Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnBmxijHBFoYHwDGcBRihlEyiZYBTyxqy1HISzcaTi3prODGZrAV5ETyFmdgCXO8WVgU7a8Cgnn8t7FUVCToxtzjh6frsQPzIGspuwPDUOaI3Ft+P44n/cK2DZJVlwg2w=='}}} Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 24 03:31:42.404859 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a1a871f-ccfe-48f5-a1a3-a4ee0b52b6d9 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:42.408743 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a1a871f-ccfe-48f5-a1a3-a4ee0b52b6d9 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010407 Aug 24 03:31:42.412301 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 322/623] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:42 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:31:42.419243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.420177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:42.428580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.429093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.429578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.430742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.431377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.432180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.493820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:42.504060 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d54bacc-e4f0-448d-ae34-e887fe96e751 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 0.297847 Aug 24 03:31:42.505262 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 302/624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:42 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:42.514569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d3d15611-74cc-4fdc-827f-ea7b1c522c2d req-2630e1ca-7d0a-460b-8468-1fce753341d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c", "name": "network-vif-unplugged", "status": "completed", "tag": "bf3f1eec-aa98-4265-993e-6bc0ec631b29"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:42.527188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d3d15611-74cc-4fdc-827f-ea7b1c522c2d req-2630e1ca-7d0a-460b-8468-1fce753341d3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.528107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d3d15611-74cc-4fdc-827f-ea7b1c522c2d req-2630e1ca-7d0a-460b-8468-1fce753341d3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.528828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d3d15611-74cc-4fdc-827f-ea7b1c522c2d req-2630e1ca-7d0a-460b-8468-1fce753341d3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.544603 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d3d15611-74cc-4fdc-827f-ea7b1c522c2d req-2630e1ca-7d0a-460b-8468-1fce753341d3 service nova] Creating event network-vif-unplugged:bf3f1eec-aa98-4265-993e-6bc0ec631b29 for instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c on n-h1-846470-15 Aug 24 03:31:42.552553 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d3d15611-74cc-4fdc-827f-ea7b1c522c2d req-2630e1ca-7d0a-460b-8468-1fce753341d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045941 Aug 24 03:31:42.553906 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 303/625] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:42.566854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5ba603df-dc4d-43f1-9b86-b30ef1d93b45 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Calling method '.version_select at 0x7f102b63adc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.574247 n-d-846470-15 devstack@n-api.service[122535]: WARNING oslo_db.sqlalchemy.utils [None req-5ba603df-dc4d-43f1-9b86-b30ef1d93b45 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 03:31:42.593364 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5ba603df-dc4d-43f1-9b86-b30ef1d93b45 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1090 microversion: 2.1 time: 0.036854 Aug 24 03:31:42.599734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 304/626] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:31:42 2022] GET /compute/v2.1/os-keypairs => generated 1090 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:42.601925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46b436b1-e218-49ba-a2bc-4b23d8c41729 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Action: 'create', calling method: .version_select at 0x7f102b3b88b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1891418159", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:42.638637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-46b436b1-e218-49ba-a2bc-4b23d8c41729 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:42.646083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-46b436b1-e218-49ba-a2bc-4b23d8c41729 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Getting quotas for user 0f1bae60a5e3477987b293d3ed8d58fb and project 9743fbe0b20a499a8f0f87b80e34b13f. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:42.671777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:42.691771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:42.693263 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-46b436b1-e218-49ba-a2bc-4b23d8c41729 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46b436b1-e218-49ba-a2bc-4b23d8c41729 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Request method failure captured: Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 118 Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZucC9uCgYNGlK42ItdDd9ZZGRtgp6BhMVFwVI5EEo9E085dVOCKUScqBELVHvIBlgxRJjJ13agr0hO_kX0OaLcSbfziq-dITFllBJbwtrRX8qkDUETsFbHIrlCR5r8Q-l7zmsR1XKuI3IaRS1p9C-3QNmbZmNwRyBuIVR7pAElddtw Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1891418159", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1891418159', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 03:31:42.699070 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46b436b1-e218-49ba-a2bc-4b23d8c41729 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:42.703086 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-46b436b1-e218-49ba-a2bc-4b23d8c41729 tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.105839 Aug 24 03:31:42.708216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:42.709872 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-84064eb8-e9ae-4b85-905e-424900df9c46 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 0.295973 Aug 24 03:31:42.713815 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 323/628] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:42 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:42.728346 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 305/628] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:31:42 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:31:42.736065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec7459ae-19e9-4b42-b4e3-ad716df30180 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Calling method '.version_select at 0x7f1023561040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.742753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a3de3381-df42-4721-a934-617ba8dac442 req-e48c8184-a0da-4c63-bce7-b2f5c9470c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5", "tag": "182fab05-ee6b-4c54-8428-378902e8857d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:42.784550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3de3381-df42-4721-a934-617ba8dac442 req-e48c8184-a0da-4c63-bce7-b2f5c9470c33 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.785039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3de3381-df42-4721-a934-617ba8dac442 req-e48c8184-a0da-4c63-bce7-b2f5c9470c33 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.785470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3de3381-df42-4721-a934-617ba8dac442 req-e48c8184-a0da-4c63-bce7-b2f5c9470c33 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.785786 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec7459ae-19e9-4b42-b4e3-ad716df30180 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-14320758" status: 202 len: 0 microversion: 2.1 time: 0.052422 Aug 24 03:31:42.791321 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 324/629] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-14320758 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:42.802238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.805595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:42.817584 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a3de3381-df42-4721-a934-617ba8dac442 req-e48c8184-a0da-4c63-bce7-b2f5c9470c33 service nova] Creating event network-changed:182fab05-ee6b-4c54-8428-378902e8857d for instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 on n-h2-846470-15 Aug 24 03:31:42.818200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.818962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.819658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.822556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.828652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.829638 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a3de3381-df42-4721-a934-617ba8dac442 req-e48c8184-a0da-4c63-bce7-b2f5c9470c33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098556 Aug 24 03:31:42.830163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.830610 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 306/630] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:42.840771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12519a97-d9d4-4fe3-b1b3-e7dd16a5568c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Calling method '.version_select at 0x7f102b3b8790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.895931 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-12519a97-d9d4-4fe3-b1b3-e7dd16a5568c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-907905450 not found for user 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12519a97-d9d4-4fe3-b1b3-e7dd16a5568c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Request method failure captured: Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-907905450 HTTP/1.1 Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZucC9uCgYNGlK42ItdDd9ZZGRtgp6BhMVFwVI5EEo9E085dVOCKUScqBELVHvIBlgxRJjJ13agr0hO_kX0OaLcSbfziq-dITFllBJbwtrRX8qkDUETsFbHIrlCR5r8Q-l7zmsR1XKuI3IaRS1p9C-3QNmbZmNwRyBuIVR7pAElddtw Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9743fbe0b20a499a8f0f87b80e34b13f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9743fbe0b20a499a8f0f87b80e34b13f Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-964721608 Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-KeyPairsNegativeTestJSON-964721608-project Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: exception: Keypair tempest-keypair-non-existent-907905450 not found for user 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'tempest-keypair-non-existent-907905450'} Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in delete_key_pair Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6877, in get_key_pair Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-907905450 not found for user 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.904458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-907905450 not found for user 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-907905450 not found for user 0f1bae60a5e3477987b293d3ed8d58fb Aug 24 03:31:42.908513 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:42.912882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12519a97-d9d4-4fe3-b1b3-e7dd16a5568c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] Returning 404 to user: Keypair tempest-keypair-non-existent-907905450 not found for user 0f1bae60a5e3477987b293d3ed8d58fb {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:42.915571 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-12519a97-d9d4-4fe3-b1b3-e7dd16a5568c tempest-KeyPairsNegativeTestJSON-964721608 tempest-KeyPairsNegativeTestJSON-964721608-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-907905450" status: 404 len: 144 microversion: 2.1 time: 0.083430 Aug 24 03:31:42.918277 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 307/631] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 24 03:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-907905450 => generated 144 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:31:42.932574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d692f8ee-8a11-4bea-8eaa-df7051a24bae tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Calling method '.version_select at 0x7f102b39a790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.981038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d692f8ee-8a11-4bea-8eaa-df7051a24bae tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-441019639" status: 202 len: 0 microversion: 2.1 time: 0.060684 Aug 24 03:31:42.982030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 308/632] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-441019639 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:31:42.993969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15721b42-2ddb-41b4-83a2-02de398bdfe9 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] Calling method '.version_select at 0x7f102b2ed550>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:43.042765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15721b42-2ddb-41b4-83a2-02de398bdfe9 tempest-KeyPairsV2TestJSON-754083660 tempest-KeyPairsV2TestJSON-754083660-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-875049872" status: 202 len: 0 microversion: 2.1 time: 0.054747 Aug 24 03:31:43.044214 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 309/633] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-875049872 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:31:43.079321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:43.093509 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9e510832-640b-439b-bae6-3f1b6a83f761 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.302706 Aug 24 03:31:43.102318 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 325/634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:42 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:43.350246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:43.351196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:43.359122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.359616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.360911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.362509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.363292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.363935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.526430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:43.527271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:43.540791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.541433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.541963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.545338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.545939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.546551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.633903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:43.642499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2bd60ca5-8222-49a8-a4c9-0c26b07827ea tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1472 microversion: 2.1 time: 0.296177 Aug 24 03:31:43.646099 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 310/635] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:43 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:43.842088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:43.857040 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-682d1b10-a09b-4f55-9585-76af4336eaea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 0.335583 Aug 24 03:31:43.857715 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 326/636] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:43 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:43.864588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:43.865205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:43.894312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.894806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.895424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.896505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.896971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.897402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.091293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1cc148cb-3c8c-4c9b-ad1a-99cbb84db7f1 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:44.092083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1cc148cb-3c8c-4c9b-ad1a-99cbb84db7f1 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] [instance: 21bcba6f-6542-44d5-8b99-05e9f22c142d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:44.099478 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1cc148cb-3c8c-4c9b-ad1a-99cbb84db7f1 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] HTTP exception thrown: Instance 21bcba6f-6542-44d5-8b99-05e9f22c142d could not be found. Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1cc148cb-3c8c-4c9b-ad1a-99cbb84db7f1 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Request method failure captured: Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/21bcba6f-6542-44d5-8b99-05e9f22c142d/action HTTP/1.1 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 15 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuHDfyksKKrpGkZCwY60T3GGgbIKcTgVAuoqEd8P-jXvC14941MxQOWblTZXPNCCPxX-dETvVDbHNmHKE3iczqg3FyF5a2FAiRRRbO5oaUjeHDvgUSCx8Wi2AJdpwakoqu20OshVluKKawixUna0WnUxsb8hCVNqYOxLtTELXifEk4 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ecc500ef8fbb4adda31961e8d743d4b9 Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: {"migrate": {}} Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 21bcba6f-6542-44d5-8b99-05e9f22c142d could not be found. Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '21bcba6f-6542-44d5-8b99-05e9f22c142d', 'body': {'migrate': {}}} Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bcba6f-6542-44d5-8b99-05e9f22c142d could not be found. Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bcba6f-6542-44d5-8b99-05e9f22c142d could not be found. Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:44.101256 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:44.105499 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:44.105499 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:44.105499 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:44.105499 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:44.105499 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bcba6f-6542-44d5-8b99-05e9f22c142d could not be found. Aug 24 03:31:44.105499 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:31:44.107296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1cc148cb-3c8c-4c9b-ad1a-99cbb84db7f1 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Returning 404 to user: Instance 21bcba6f-6542-44d5-8b99-05e9f22c142d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:44.108414 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1cc148cb-3c8c-4c9b-ad1a-99cbb84db7f1 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/21bcba6f-6542-44d5-8b99-05e9f22c142d/action" status: 404 len: 111 microversion: 2.1 time: 0.444187 Aug 24 03:31:44.109960 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 311/637] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:31:43 2022] POST /compute/v2.1/servers/21bcba6f-6542-44d5-8b99-05e9f22c142d/action => generated 111 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:31:44.127638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:44.128870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:44.142865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.143364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.143847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.146388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.146863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.147295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.397269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:44.406973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:44.408988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:44.410368 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67cb2c77-1807-4508-ab3a-9a40b8013b9a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 0.551721 Aug 24 03:31:44.411439 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 327/638] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:43 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:44.417859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1243083099", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:44.514701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:44.597158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:44.607938 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5bc6b1af-0687-4d8c-9c84-806c09470989 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.492551 Aug 24 03:31:44.622635 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 312/639] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:44 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:44.628485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d2cbdda5-c12a-4409-9aa9-3b68036066f4 req-f348fd7b-0122-4b57-804c-bff11e51dfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c", "tag": "bf3f1eec-aa98-4265-993e-6bc0ec631b29"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:44.640357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d2cbdda5-c12a-4409-9aa9-3b68036066f4 req-f348fd7b-0122-4b57-804c-bff11e51dfee service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.641599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d2cbdda5-c12a-4409-9aa9-3b68036066f4 req-f348fd7b-0122-4b57-804c-bff11e51dfee service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.642629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d2cbdda5-c12a-4409-9aa9-3b68036066f4 req-f348fd7b-0122-4b57-804c-bff11e51dfee service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.671368 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d2cbdda5-c12a-4409-9aa9-3b68036066f4 req-f348fd7b-0122-4b57-804c-bff11e51dfee service nova] Creating event network-changed:bf3f1eec-aa98-4265-993e-6bc0ec631b29 for instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c on n-h1-846470-15 Aug 24 03:31:44.679913 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d2cbdda5-c12a-4409-9aa9-3b68036066f4 req-f348fd7b-0122-4b57-804c-bff11e51dfee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055509 Aug 24 03:31:44.680527 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 313/640] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:44.895956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:44.896721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:44.914138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.918867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.919570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.920785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.927584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.929211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:45.222732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:45.223323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:45.224086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:45.224869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:45.226296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:45.247063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:45.247562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:45.248019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:45.248775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:45.249197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:45.249667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:45.294180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Getting quotas for project 3323592e260f4331b153e917c9dfc2eb. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:45.306301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Getting quotas for user 651d7bd069d841e38c802573feb9f256 and project 3323592e260f4331b153e917c9dfc2eb. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:45.389373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:45.399714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:45.538906 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cfe454cf-0a86-477d-abfc-4f95e03b4d33 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125703 Aug 24 03:31:45.542190 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 328/641] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:31:45.554004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:45.563291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:45.583992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:45.586679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:45.594557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:45.595853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:45.596495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:45.597120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:45.704677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=5 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:46.324893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.339532 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4ae071ef-c215-4114-b264-8b2dd73ad0a6 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 1.456862 Aug 24 03:31:46.341577 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 314/642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:44 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:46.348566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49653879-ec1d-4c86-88f3-df7fead3ccec tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:46.349521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49653879-ec1d-4c86-88f3-df7fead3ccec tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:46.354529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.368419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.370203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.387484 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e8ff2e6-987c-416d-88b1-7fa01241b5e1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 0.828001 Aug 24 03:31:46.391915 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 329/643] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:45 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:46.431567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:46.432402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:46.449816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:46.451210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:46.453184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:46.454239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:46.457890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:46.459912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:46.642434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49653879-ec1d-4c86-88f3-df7fead3ccec tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.653168 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49653879-ec1d-4c86-88f3-df7fead3ccec tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1222 microversion: 2.1 time: 0.309813 Aug 24 03:31:46.660965 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 315/644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:46 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1222 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:47.128374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53f50398-7eb3-4a89-9f1f-34f327229a76 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Action: 'create', calling method: .version_select at 0x7f102b2b5b80>, body: {"keypair": {"name": "tempest-keypair-1666590481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7c8Wo/i5L1BybNMXuHTM81sXXMeh7Nu6JisSm5gSH8MxsAqSk2doEv/gM1Li0yFG7wqNOLWarnKnDayJMhenr33VOFOxQjJ2x+W2+4VyQfYPWs1d4aJ5EFxPiGS6LkhA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:47.205637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-53f50398-7eb3-4a89-9f1f-34f327229a76 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:47.230551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-53f50398-7eb3-4a89-9f1f-34f327229a76 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:47.297270 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53f50398-7eb3-4a89-9f1f-34f327229a76 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.571431 Aug 24 03:31:47.299548 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 316/645] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 24 03:31:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 574 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:31:47.314435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7eee8c59-cedf-4ad5-867e-ace6e90193f5 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b2b3ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:47.329482 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7eee8c59-cedf-4ad5-867e-ace6e90193f5 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1666590481" status: 200 len: 513 microversion: 2.2 time: 0.021485 Aug 24 03:31:47.330230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:47.331028 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 317/646] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Aug 24 03:31:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1666590481 => generated 513 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:47.380845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca0c69bb-6bc3-4d7c-9cac-9ffc25cf8f44 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.950733 Aug 24 03:31:47.381578 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 330/647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:46 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:47.386888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-047b01f6-3537-43c8-bce0-0bb6819a6307 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b2b5280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:47.404922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:47.411797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:47.435882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.437062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.437802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.438751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.439513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.440181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.443776 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-047b01f6-3537-43c8-bce0-0bb6819a6307 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666590481" status: 204 len: 0 microversion: 2.2 time: 0.103300 Aug 24 03:31:47.446323 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 318/648] 10.222.0.58 () {60 vars in 1261 bytes} [Wed Aug 24 03:31:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666590481 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:47.458438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:47.459586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:47.469404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.470709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.471457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.472990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.473728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.474559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.999215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:48.010971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:48.022860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:48.028210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:48.033018 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff1989dc-1824-483b-9e34-bac17becd1d4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 0.584848 Aug 24 03:31:48.034265 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 319/649] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:47 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:48.049092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-612d9139-246a-4580-860e-159f104f8920 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Action: 'create', calling method: .version_select at 0x7f102b33a940>, body: {"keypair": {"name": "tempest-keypair-2047575420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+vDX/eu/WvAFit6R3DAA8hIZkjoqQ7D4qYUsBpTlsZtbuh1nmj18ufXUpa/mw4Kj2UVIOlh44XCTLGwFYEP1kbS4aGg97mcCZ7qeKxZAZbtL1QmxXR33uEwa18t3/yWg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:48.072477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-612d9139-246a-4580-860e-159f104f8920 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:48.085585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-612d9139-246a-4580-860e-159f104f8920 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:48.112849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:48.128403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8e3a7fd0-3332-4e3a-8595-30ece455c7cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 0.739463 Aug 24 03:31:48.130628 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 331/650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:47 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:48.132684 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-612d9139-246a-4580-860e-159f104f8920 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.095485 Aug 24 03:31:48.139289 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 320/651] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 24 03:31:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:31:48.149489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b3ef6f1-a7a9-4582-b8b2-0f161cbca64c tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b2b5940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.167506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.174358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:48.183166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:48.198125 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b3ef6f1-a7a9-4582-b8b2-0f161cbca64c tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047575420" status: 204 len: 0 microversion: 2.2 time: 0.056445 Aug 24 03:31:48.200683 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 321/652] 10.222.0.58 () {60 vars in 1261 bytes} [Wed Aug 24 03:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047575420 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:48.201359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.202818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.205976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.208627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.209307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.210080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.212330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0bcd41e1-3d2b-40ae-a8d5-c8aa6c48df76 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Action: 'create', calling method: .version_select at 0x7f102b2b3e50>, body: {"keypair": {"name": "tempest-keypair-1281746663", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:48.264000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0bcd41e1-3d2b-40ae-a8d5-c8aa6c48df76 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:48.279074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0bcd41e1-3d2b-40ae-a8d5-c8aa6c48df76 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:48.337432 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0bcd41e1-3d2b-40ae-a8d5-c8aa6c48df76 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.130977 Aug 24 03:31:48.343726 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 322/653] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 24 03:31:48 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:31:48.349782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a35671d1-480a-465d-8ffe-254469c2a782 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b288ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.354849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:48.367349 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-434f7105-3bc0-4253-bca4-e214a6966c4d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1274 microversion: 2.1 time: 0.235129 Aug 24 03:31:48.373421 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 332/654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:48 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:48.395055 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a35671d1-480a-465d-8ffe-254469c2a782 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281746663" status: 204 len: 0 microversion: 2.2 time: 0.049431 Aug 24 03:31:48.397341 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 323/655] 10.222.0.58 () {60 vars in 1261 bytes} [Wed Aug 24 03:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281746663 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:48.404367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.406112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:48.420629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.421565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2d6936b6-dc8e-4b29-ac6a-364a5a45c934 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Action: 'create', calling method: .version_select at 0x7f102b2b5940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-154726368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN14wScQ3B4jTeoN3KpaAWhvDu58oSRIgxuXd13IgV5H3+eF4uU4h1c9wxHbTZnWxjR5TKQVMoA7kKuBkSARaN4Rcs9gyoEdJl/xAkQz5TzrqXbno88tLOWh/gr6R8XuEw=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:48.422492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.428683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.431996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.432784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.433974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.456984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2d6936b6-dc8e-4b29-ac6a-364a5a45c934 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:48.465892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2d6936b6-dc8e-4b29-ac6a-364a5a45c934 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:48.512165 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2d6936b6-dc8e-4b29-ac6a-364a5a45c934 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.103148 Aug 24 03:31:48.513287 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 324/656] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 24 03:31:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:31:48.536801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-711e1e6d-23cf-44d3-999c-8745d4c78514 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Action: 'create', calling method: .version_select at 0x7f102b485e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1880712060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELmhU7xWLveAMhDC7OPr/t74XY+KRAUduN7Cppl6/W2hPc/ShYS5PzjXrLWi9IGYqI895czWtWRiQTdFvvaSuqOzyJgnv3t5ipwxjJpsF7u47ZLJXA8CgTINh0uznBkRQ=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:48.581351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-711e1e6d-23cf-44d3-999c-8745d4c78514 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:48.599609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-711e1e6d-23cf-44d3-999c-8745d4c78514 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:48.647888 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-711e1e6d-23cf-44d3-999c-8745d4c78514 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.123014 Aug 24 03:31:48.656570 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 325/657] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 24 03:31:48 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:31:48.662468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffe4e04f-f1b5-4617-9571-28f5db83c9c7 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Action: 'create', calling method: .version_select at 0x7f102b2b3820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-205819720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkEG59LXPa2ULd6T6FYNd1oQJGEwLGE2wSCWVyxzL0bGWUNaQE+j5QiykOQ+M0RyKmnMac4D2g8AFYQlOHsibfgeCq9js2yNiLEn47NL5BxQ81hTL3514fSKHTTvLo+GA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:48.690128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ffe4e04f-f1b5-4617-9571-28f5db83c9c7 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:48.710675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ffe4e04f-f1b5-4617-9571-28f5db83c9c7 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:48.772349 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffe4e04f-f1b5-4617-9571-28f5db83c9c7 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.114322 Aug 24 03:31:48.773022 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 326/658] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 24 03:31:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:31:48.787048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0ccdb81f-ccee-412c-86b5-19811964fc1e tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b288ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.799721 n-d-846470-15 devstack@n-api.service[122535]: WARNING oslo_db.sqlalchemy.utils [None req-0ccdb81f-ccee-412c-86b5-19811964fc1e tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 03:31:48.811163 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0ccdb81f-ccee-412c-86b5-19811964fc1e tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.029390 Aug 24 03:31:48.812283 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 327/659] 10.222.0.58 () {60 vars in 1177 bytes} [Wed Aug 24 03:31:48 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:48.829067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0da4e671-8178-4df2-aec3-a1f5a4a0fdc4 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b2b54c0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.880690 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0da4e671-8178-4df2-aec3-a1f5a4a0fdc4 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-205819720" status: 204 len: 0 microversion: 2.2 time: 0.060204 Aug 24 03:31:48.882115 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 328/660] 10.222.0.58 () {60 vars in 1318 bytes} [Wed Aug 24 03:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-205819720 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:48.892126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3084c659-271b-44e1-a8ce-03e8d5ba290a tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b33a430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.928674 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3084c659-271b-44e1-a8ce-03e8d5ba290a tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1880712060" status: 204 len: 0 microversion: 2.2 time: 0.041477 Aug 24 03:31:48.933311 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 329/661] 10.222.0.58 () {60 vars in 1321 bytes} [Wed Aug 24 03:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1880712060 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:48.938792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e4b21dcf-a454-4241-89a8-44dcc5a8d900 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b2ed790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.972813 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e4b21dcf-a454-4241-89a8-44dcc5a8d900 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-154726368" status: 204 len: 0 microversion: 2.2 time: 0.038148 Aug 24 03:31:48.974037 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 330/662] 10.222.0.58 () {60 vars in 1318 bytes} [Wed Aug 24 03:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-154726368 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:48.999253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5173d43-01c9-4c14-9a33-be17b520d461 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Action: 'create', calling method: .version_select at 0x7f102b485d30>, body: {"keypair": {"name": "tempest-keypair-890011642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2VlazKPU/+OKh4sRpSX21LmDbIkw+ZU8dVw+5qYp7mANYUYQU904PApGtBAtNo+vKt7wEMrVINunsOUNBEci0o3DxkAIBzqt0uJEXRKjlbBfCjbZOg+BSH0w8xbICLBA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:49.036950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-b5173d43-01c9-4c14-9a33-be17b520d461 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:49.044868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-b5173d43-01c9-4c14-9a33-be17b520d461 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:49.104031 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5173d43-01c9-4c14-9a33-be17b520d461 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.116689 Aug 24 03:31:49.112931 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 331/663] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 24 03:31:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 03:31:49.124058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:49.126070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:49.139394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.141931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.143064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.144710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.145647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.146445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.235493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.249709 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2e6a41c1-cb4f-48fd-a992-5122fa09eae8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.850353 Aug 24 03:31:49.253686 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 333/664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:48 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:49.268535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa11efe0-b6ff-48f2-99de-3ae3a7a8a4f4 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f10232dfb80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:49.283052 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa11efe0-b6ff-48f2-99de-3ae3a7a8a4f4 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-890011642" status: 200 len: 512 microversion: 2.2 time: 0.027452 Aug 24 03:31:49.284388 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 334/665] 10.222.0.58 () {60 vars in 1255 bytes} [Wed Aug 24 03:31:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-890011642 => generated 512 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:49.290130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:49.291360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:49.303883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.304783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.305478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.306542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.307864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.308544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.409715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.420613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.423174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.424610 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4f07ffab-598e-434a-905c-c4a257a0a8e9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 0.309152 Aug 24 03:31:49.425197 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 332/666] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:49 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:49.430134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a12d3ae0-8b05-480b-9486-50aed509d6f2 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b2ed1f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:49.434421 n-d-846470-15 devstack@n-api.service[122535]: WARNING oslo_db.sqlalchemy.utils [None req-a12d3ae0-8b05-480b-9486-50aed509d6f2 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 03:31:49.441497 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a12d3ae0-8b05-480b-9486-50aed509d6f2 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.014723 Aug 24 03:31:49.442248 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 333/667] 10.222.0.58 () {60 vars in 1177 bytes} [Wed Aug 24 03:31:49 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:49.453739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:49.454508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:49.461548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.462235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.462774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.463652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.464225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.464906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.590452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.602064 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4412c9a7-144a-4335-a84f-8d72a49789cb tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1280 microversion: 2.1 time: 0.151337 Aug 24 03:31:49.615699 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 334/668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:49 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:49.621095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77eab66e-1970-46b4-9a74-7f2062772b39 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b33a160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:49.644792 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-77eab66e-1970-46b4-9a74-7f2062772b39 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890011642" status: 204 len: 0 microversion: 2.2 time: 0.034559 Aug 24 03:31:49.647810 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 335/669] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Aug 24 03:31:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890011642 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:49.657912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Action: 'create', calling method: .version_select at 0x7f102b2b5b80>, body: {"keypair": {"name": "tempest-keypair-569631920", "type": "x509"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:49.679196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:49.687119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:49.705079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.processutils [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpchac3yfe/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpchac3yfe/temp.key -subj /CN=8e2ce975ed4e43a4880e407cf68280ae -extensions v3_req_client {{(pid=122535) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 24 03:31:49.928427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.processutils [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpchac3yfe/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpchac3yfe/temp.key -subj /CN=8e2ce975ed4e43a4880e407cf68280ae -extensions v3_req_client" returned: 0 in 0.223s {{(pid=122535) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 24 03:31:49.930340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.processutils [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpchac3yfe/temp.key -password pass: {{(pid=122535) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 24 03:31:49.956760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.processutils [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpchac3yfe/temp.key -password pass:" returned: 0 in 0.025s {{(pid=122535) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 24 03:31:49.995374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:50.016253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.044693 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2e219b2d-9e37-45da-9d47-da96438da648 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 0.758506 Aug 24 03:31:50.060815 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 335/670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:49 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:50.077785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:50.085474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Getting quotas for user 8e2ce975ed4e43a4880e407cf68280ae and project fda33a55c7c347238d7a9dc10ab8f89e. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:50.105420 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f14fc88e-18e4-4cae-933e-0f99d5a7ffe8 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.451678 Aug 24 03:31:50.107716 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 336/671] 10.222.0.58 () {62 vars in 1198 bytes} [Wed Aug 24 03:31:49 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 454 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:50.132337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a3f7158-21c0-4634-994a-e774b3763389 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f10232be280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:50.147536 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a3f7158-21c0-4634-994a-e774b3763389 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-569631920" status: 200 len: 1533 microversion: 2.2 time: 0.027776 Aug 24 03:31:50.151120 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 336/672] 10.222.0.58 () {60 vars in 1255 bytes} [Wed Aug 24 03:31:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-569631920 => generated 1533 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:50.162340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72f74a00-abc5-4d2b-84af-128803eab903 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f102b3b83a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:50.172815 n-d-846470-15 devstack@n-api.service[122535]: WARNING oslo_db.sqlalchemy.utils [None req-72f74a00-abc5-4d2b-84af-128803eab903 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 03:31:50.179416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72f74a00-abc5-4d2b-84af-128803eab903 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.022347 Aug 24 03:31:50.180252 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 337/673] 10.222.0.58 () {60 vars in 1177 bytes} [Wed Aug 24 03:31:50 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:50.192481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-460b2c55-9fff-492a-a7fa-e7ef1aad29a6 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] Calling method '.version_select at 0x7f1023438c10>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:50.228919 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-460b2c55-9fff-492a-a7fa-e7ef1aad29a6 tempest-KeyPairsV22TestJSON-994060849 tempest-KeyPairsV22TestJSON-994060849-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569631920" status: 204 len: 0 microversion: 2.2 time: 0.040348 Aug 24 03:31:50.235308 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 337/674] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Aug 24 03:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569631920 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:31:50.289013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:50.289977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:50.297859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.299424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.300110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.301134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.302469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.303152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.448597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:50.449742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:50.461071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.463022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.464116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.465560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.466262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.467247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.500356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:50.510280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.524169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49309cbe-71f1-4f3f-ace8-8aa43fec67df tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.240307 Aug 24 03:31:50.524968 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 338/675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:50 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:50.629847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:50.630482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:50.649268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.656253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.658448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.659631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.661189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.662828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.931022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.941507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.957940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.960630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.962820 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f22c9da-7e84-4665-947a-24f5cafa256d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 0.519681 Aug 24 03:31:50.964064 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 338/676] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:50 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:50.980114 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d047ef8d-3ca8-4de1-8e2e-c9bd70fb0815 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1280 microversion: 2.1 time: 0.357699 Aug 24 03:31:50.981585 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 339/677] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:50 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1280 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:51.068684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:51.069296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:51.083731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.084307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.084927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.085831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.086798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.087374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.336893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:51.348862 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bab311f5-690c-4f14-829a-6bdf885ce171 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 0.284161 Aug 24 03:31:51.350187 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 339/678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:51 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:51.547615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:51.548302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:51.567073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.569073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.569805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.573871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.577015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.579582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.994413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:51.996113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:52.009102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.009800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.010420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.012064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.013490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.014269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.021436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:52.065525 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88103635-5bc7-453a-b4a8-35b5f4977531 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.522690 Aug 24 03:31:52.067576 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 340/679] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:51 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:52.084943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:52.086067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:52.099277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.100563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.101588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.105319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.106555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.108481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.578923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:52.588641 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a7b692d9-fbb0-48a8-9dda-82c5011bd720 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.519509 Aug 24 03:31:52.589247 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 341/680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:52 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:52.604573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1d825ba6-72e7-4439-b4f5-333a0082b381 req-dc1aa062-e85f-46ce-8064-193be6810255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bee13da-b1c6-4a3d-b5e2-dec36fe2031a", "name": "network-vif-plugged", "status": "completed", "tag": "ad77eb67-70e3-47d6-8e20-34a660d000ee"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:52.628504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d825ba6-72e7-4439-b4f5-333a0082b381 req-dc1aa062-e85f-46ce-8064-193be6810255 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.629000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d825ba6-72e7-4439-b4f5-333a0082b381 req-dc1aa062-e85f-46ce-8064-193be6810255 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.632692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d825ba6-72e7-4439-b4f5-333a0082b381 req-dc1aa062-e85f-46ce-8064-193be6810255 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.714401 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1d825ba6-72e7-4439-b4f5-333a0082b381 req-dc1aa062-e85f-46ce-8064-193be6810255 service nova] Creating event network-vif-plugged:ad77eb67-70e3-47d6-8e20-34a660d000ee for instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a on n-h1-846470-15 Aug 24 03:31:52.735473 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1d825ba6-72e7-4439-b4f5-333a0082b381 req-dc1aa062-e85f-46ce-8064-193be6810255 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139945 Aug 24 03:31:52.742065 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 342/681] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:52.756096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:52.756873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:52.775043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.775881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.776708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.777586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.779615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.790254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.670377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:53.701083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:53.711060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:53.713686 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-690ee9cb-eb80-4e38-adbf-4be6622cefc7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 1.724205 Aug 24 03:31:53.736431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 340/682] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:51 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:53.754518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:53.755131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:53.765175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.765671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.766111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.766833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.767289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.767732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.026080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:54.042929 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31af0eb2-17d1-4fc8-893b-6cc6e459ba62 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 1.298333 Aug 24 03:31:54.044547 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 343/683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:52 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:54.053665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:54.055961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:54.073124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.073841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.074892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.076855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.080372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.081086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.409092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:54.427046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a5c66bd-77c3-47c6-822b-40bf434561ad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.689378 Aug 24 03:31:54.430171 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 341/684] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:53 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:54.445120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-59a28d77-ee49-4f2a-88d9-e3a458b22f00 req-6c6d04a7-b327-45d3-a4cf-bcd9cecf9f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f", "tag": "da70c98b-f459-4150-afc9-fb1f7ba911ec"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:54.457938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-59a28d77-ee49-4f2a-88d9-e3a458b22f00 req-6c6d04a7-b327-45d3-a4cf-bcd9cecf9f3f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.458659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-59a28d77-ee49-4f2a-88d9-e3a458b22f00 req-6c6d04a7-b327-45d3-a4cf-bcd9cecf9f3f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.459292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-59a28d77-ee49-4f2a-88d9-e3a458b22f00 req-6c6d04a7-b327-45d3-a4cf-bcd9cecf9f3f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.486464 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-59a28d77-ee49-4f2a-88d9-e3a458b22f00 req-6c6d04a7-b327-45d3-a4cf-bcd9cecf9f3f service nova] Creating event network-changed:da70c98b-f459-4150-afc9-fb1f7ba911ec for instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f on n-h1-846470-15 Aug 24 03:31:54.492536 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-59a28d77-ee49-4f2a-88d9-e3a458b22f00 req-6c6d04a7-b327-45d3-a4cf-bcd9cecf9f3f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060865 Aug 24 03:31:54.493788 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 342/685] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:54.704654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:54.716951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9bb09583-3b07-4af4-bf7c-bd4ac94d5e47 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.671068 Aug 24 03:31:54.717550 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 344/686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:54 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:54.752512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:54.753223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:54.767548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.768076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.768669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.769393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.769859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.770284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.770852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5f3452a8-7e36-46bc-baa5-ee0263afd6f3 req-82d382eb-f303-4f72-94d3-4d7a7e6c505c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5", "name": "network-vif-plugged", "status": "completed", "tag": "182fab05-ee6b-4c54-8428-378902e8857d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:54.793804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5f3452a8-7e36-46bc-baa5-ee0263afd6f3 req-82d382eb-f303-4f72-94d3-4d7a7e6c505c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.794179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5f3452a8-7e36-46bc-baa5-ee0263afd6f3 req-82d382eb-f303-4f72-94d3-4d7a7e6c505c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.794619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5f3452a8-7e36-46bc-baa5-ee0263afd6f3 req-82d382eb-f303-4f72-94d3-4d7a7e6c505c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.819233 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5f3452a8-7e36-46bc-baa5-ee0263afd6f3 req-82d382eb-f303-4f72-94d3-4d7a7e6c505c service nova] Creating event network-vif-plugged:182fab05-ee6b-4c54-8428-378902e8857d for instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 on n-h2-846470-15 Aug 24 03:31:54.832710 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5f3452a8-7e36-46bc-baa5-ee0263afd6f3 req-82d382eb-f303-4f72-94d3-4d7a7e6c505c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065338 Aug 24 03:31:54.834066 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 345/687] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:31:55.067392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:55.068926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:55.084691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.087118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.088404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.090647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.091321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.091832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.275831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:55.352544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=27 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:55.602985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:55.619987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:55.622811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:55.626807 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed73a3f8-036a-4146-881e-8a634f3d3f7c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1568 microversion: 2.25 time: 0.880180 Aug 24 03:31:55.648949 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 343/688] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:54 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1568 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:55.664027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:55.664679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:55.673760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.674671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.675357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.676537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.677241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.677909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.688032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:55.708308 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-634727fe-857d-4431-abd5-1390a6f15b27 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1317 microversion: 2.1 time: 0.645328 Aug 24 03:31:55.720638 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 346/689] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:55 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:55.741189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:55.741952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:55.759769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.760637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.761212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.762315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.762887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.763420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.354359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:56.362587 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55240c0c-e739-4cec-837c-0784cd8a86d6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1324 microversion: 2.1 time: 0.712051 Aug 24 03:31:56.363186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 344/690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:55 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:56.493276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:56.502782 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-406cc041-e8ab-4eaa-b9b1-7a5f4fea3757 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.765692 Aug 24 03:31:56.507028 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 347/691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:55 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:56.657258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:56.657781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:56.665127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.665532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.665971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.666698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.667155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.667577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.733629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:56.734771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:56.742927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.743996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.744668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.745962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.747450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.748778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.008481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:57.017953 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b032ac0-a8c1-404a-9851-69acf386fa17 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1467 microversion: 2.1 time: 0.288560 Aug 24 03:31:57.031100 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 348/692] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:56 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1467 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:57.041003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:57.041879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:57.049529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.050366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.051009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.051933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.052588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.053193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.322998 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1d1d7785-0172-4aef-aefc-031e20439d14 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1620 microversion: 2.1 time: 0.285367 Aug 24 03:31:57.323702 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 349/693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:57 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1620 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:57.376177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:57.401323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:57.405124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:57.408973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:57.410421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:57.413491 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4365be88-1214-4ffa-9dd7-daa86e7cb889 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1543 microversion: 2.25 time: 0.760063 Aug 24 03:31:57.414242 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 345/694] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:56 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1543 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:57.449963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.451339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcb30a3c-168a-40d1-8a90-1376d1498da0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '.version_select at 0x7f10235dd9d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:57.452721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.455437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.458677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.460763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.465847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.475925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb30a3c-168a-40d1-8a90-1376d1498da0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.476855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb30a3c-168a-40d1-8a90-1376d1498da0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.477649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb30a3c-168a-40d1-8a90-1376d1498da0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.512371 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcb30a3c-168a-40d1-8a90-1376d1498da0 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.067243 Aug 24 03:31:57.526229 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 346/695] 10.222.0.58 () {60 vars in 1184 bytes} [Wed Aug 24 03:31:57 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:57.532193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:57.533445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:57.540953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.541449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.541893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.542611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.543072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.543503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.821924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:57.840702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4c65f9e7-4947-49bc-8172-f2a936955742 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1518 microversion: 2.1 time: 0.451051 Aug 24 03:31:57.845249 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 350/696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:57 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1518 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:57.857384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:57.859378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:57.901748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.905636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:57.908701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.908701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.911817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.912784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.913439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.938471 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e2d63d72-021b-4168-b798-c6f6f06eb37a tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 2038 microversion: 2.25 time: 0.409679 Aug 24 03:31:57.939260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 347/697] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:57 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 2038 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:57.952201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-919355289", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4"]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:58.043310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:58.239507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:58.249581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-678e6e60-9ce9-4b04-87fc-ee4ff5121a8e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.402751 Aug 24 03:31:58.253719 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 351/698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:57 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:58.261220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-33b72f79-0307-485b-bac3-776b7da34abe tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'create', calling method: .version_select at 0x7f102b2888b0>, body: {"pool": null} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:58.766097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:58.767244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:58.768588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:58.769269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:58.770496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:58.786828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.787687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.788532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.789576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.790295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.791097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.815765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:58.820732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:58.825995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:58.846199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:58.849391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:58.931830 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23cbb2d6-820d-4128-bfe2-f8f1a8123aad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987530 Aug 24 03:31:58.936019 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 348/699] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:31:58.946931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2c09273-ad66-4bfc-9584-93be040dd8fd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Action: 'create', calling method: .version_select at 0x7f10235619d0>, body: {"keypair": {"name": "tempest-keypair-1244273868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUSK7mWM3exYm2lmofcoIOo75d1tpSlr0y9cme0QRDknNjzzSdGByHiwOlgwPzwyG8of9jFYWtw9GziEGobL0He+DzM0UZWnbSj2w7BdSV9ljK8L7DKmGNAkZfOM3He7w=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:58.970656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a2c09273-ad66-4bfc-9584-93be040dd8fd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:58.980948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a2c09273-ad66-4bfc-9584-93be040dd8fd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for user 6d8976135cf9461e8a0eda1658abeec9 and project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:59.015011 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2c09273-ad66-4bfc-9584-93be040dd8fd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.077420 Aug 24 03:31:59.021798 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 349/700] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 03:31:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:31:59.022588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32a841dd-9db2-42ea-867f-e5b5353b586d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:59.023844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32a841dd-9db2-42ea-867f-e5b5353b586d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:59.427686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32a841dd-9db2-42ea-867f-e5b5353b586d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:59.441546 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32a841dd-9db2-42ea-867f-e5b5353b586d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1216 microversion: 2.1 time: 0.424150 Aug 24 03:31:59.455839 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 350/701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:59 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1216 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:59.463502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:59.471068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:59.482752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.483841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.484725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:59.489141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.490187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.490846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:00.095347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=80 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:00.151073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:00.162743 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5133aa2-c03e-48dd-93bd-1800c6cc58ff tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.705427 Aug 24 03:32:00.165480 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 351/702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:59 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:00.745006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b76efdc-0544-4137-a9cc-7bc2cf27cc36 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Action: 'create', calling method: .version_select at 0x7f10235e6940>, body: {"keypair": {"name": "tempest-keypair-2114960705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdQYeD8vUVH+hLF2q3Fe3TU9e2r0kVI/fjSc0+ApHIRhpaTqUeBAA61XOGs8LAmHqfPcl4DgoMSC4qJ8w936wVPOVVIc+3jb4cpBJSNPMGUHxm7xiBJcdGltyCyKvwlsw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:00.790023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-5b76efdc-0544-4137-a9cc-7bc2cf27cc36 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Getting quotas for project 3835a5249c54414dbc3a19230c247072. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:00.812031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-5b76efdc-0544-4137-a9cc-7bc2cf27cc36 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Getting quotas for user a9a7fe8630514ecba823e9834692cc77 and project 3835a5249c54414dbc3a19230c247072. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:00.855449 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b76efdc-0544-4137-a9cc-7bc2cf27cc36 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.688537 Aug 24 03:32:00.856637 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 352/703] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:32:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:00.862724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:00.863469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:00.871433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:00.872193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:00.872770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:00.873838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:00.875192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:00.875985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:01.154278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:01.178610 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-571204c8-4be6-47ec-9f3d-76d71f78342c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1212 microversion: 2.1 time: 0.313774 Aug 24 03:32:01.179990 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 353/704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:00 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1212 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:01.237898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:01.246822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:01.268745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:01.273418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:01.274138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:01.274992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:01.276616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:01.278401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:01.862580 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-33b72f79-0307-485b-bac3-776b7da34abe tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.607431 Aug 24 03:32:01.863181 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 352/705] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:31:58 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:02.050571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-526063756", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a8cadaaf-6888-4107-843d-808010e646f6"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:02.176501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] validate_networks() for [('a8cadaaf-6888-4107-843d-808010e646f6', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:02.225235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:02.242141 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-43044ebe-45ec-4c65-8ad3-3692e76a9c94 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 1.033479 Aug 24 03:32:02.246046 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 354/706] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:01 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:02.286141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:02.293429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:02.324917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.326170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.331238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.332610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.333326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.334096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.600723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:02.621358 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc0ed9d3-011a-468a-b103-98b79049c34b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1268 microversion: 2.1 time: 0.367980 Aug 24 03:32:02.623583 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 355/707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:02 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1268 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:02.758751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc003d67-ad91-4516-b9b1-e27fb95a42af tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Action: 'create', calling method: .version_select at 0x7f10232df3a0>, body: {"keypair": {"name": "tempest-keypair-280229568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNK2rGCyERz2x/bLv7hmOWDHv7e9KfRL2ipYl1OUp7xlhm3YZU++KxdWMiTyGhz0QQydQMmPnZqYMtCyC1+cvD0Dgg4Wyd2DyvFSOPiqCDuF3UdffbacXLX6D4LfqAD0PA=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:02.791254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cc003d67-ad91-4516-b9b1-e27fb95a42af tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Getting quotas for project b41af6d40f7d47f68cc866be9672d244. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:02.805834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cc003d67-ad91-4516-b9b1-e27fb95a42af tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Getting quotas for user 00f57e4946f04ad8973c2cd6477e7ddb and project b41af6d40f7d47f68cc866be9672d244. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:02.848609 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc003d67-ad91-4516-b9b1-e27fb95a42af tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.219850 Aug 24 03:32:02.849701 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 356/708] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:32:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:03.214469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:32:03.217430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:32:03.223430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:32:03.224332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:32:03.225580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:32:03.260040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.260827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.264029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.270973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.271876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.272167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:03.272794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:03.273245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.290873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.291342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.291805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.294294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.294946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.297700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.340579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Getting quotas for project 21381ed0f374420b9d483bb3450cee89. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:03.359234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Getting quotas for user 6ec6f56b6ea1404f9e961409fe530563 and project 21381ed0f374420b9d483bb3450cee89. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:03.400560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:32:03.406849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:32:03.516626 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e253263e-0a11-4fa3-96c6-44d6416fa764 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470258 Aug 24 03:32:03.518527 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 353/709] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:32:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:32:03.536363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61e38dd4-bf15-43ad-bc60-4dc643559b36 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:03.541188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-61e38dd4-bf15-43ad-bc60-4dc643559b36 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:03.839712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-61e38dd4-bf15-43ad-bc60-4dc643559b36 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:03.854926 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-61e38dd4-bf15-43ad-bc60-4dc643559b36 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1223 microversion: 2.1 time: 0.327930 Aug 24 03:32:03.856632 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 354/710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:03 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1223 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:03.875900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:03.876767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:03.889096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.892369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.895506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.896560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.898600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.899235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.904300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:03.916237 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d43c564-c32a-4870-a027-bcaf68e0bf29 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.647318 Aug 24 03:32:03.933753 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 357/711] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:03 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:04.305762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:04.317624 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b18d30e5-d94a-48c2-afad-3ab49f3b229c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1274 microversion: 2.1 time: 0.458426 Aug 24 03:32:04.320286 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 355/712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:03 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1274 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:04.894607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:04.896024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:04.914577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:04.917068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:04.917772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:04.920893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:04.921932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:04.924141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:04.941543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:04.942747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:04.954780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:04.956457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:04.959175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:04.961741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:04.962863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:04.965574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.031963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:05.122063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:05.145291 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fea41119-0e0e-4444-9e4c-b2732f310185 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1219 microversion: 2.1 time: 0.260887 Aug 24 03:32:05.146034 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 358/713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:04 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1219 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:05.344543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:05.345196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:05.361411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.361919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.362364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.363088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.366849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.367471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.447197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:05.462611 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a99bd07b-2336-4d46-902b-d4908a336045 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.525366 Aug 24 03:32:05.465054 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 356/714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:04 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:05.643892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2143899587", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7cea5f7b-959c-4b39-9ec6-22b9a1e6db87"}], "security_groups": [{"name": "tempest-securitygroup--543752997"}], "key_name": "tempest-keypair-1244273868", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:05.831738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:05.843713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7fd0671-fbe1-418e-bd36-6918fafcf5df tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1274 microversion: 2.1 time: 0.504879 Aug 24 03:32:05.856375 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 359/715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:05 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1274 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:05.988075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] validate_networks() for [('7cea5f7b-959c-4b39-9ec6-22b9a1e6db87', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:06.169184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:06.170445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:06.187889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.188686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.189343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:06.190265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.190888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.191497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:06.228944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:06.388775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:06.404684 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-035b52ca-1e4a-428a-b2e2-1f601c281051 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1293 microversion: 2.1 time: 0.239285 Aug 24 03:32:06.420424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 360/716] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:06 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1293 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:06.494553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:06.495302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:06.510985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.511678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.512358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:06.513224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.513787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.518092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.109443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:07.118602 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8b0d234e-e32a-4c5c-b732-f3c39913566a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.629749 Aug 24 03:32:07.120406 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 361/717] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:06 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:07.136806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:07.138574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:07.146805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:07.147767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:07.148319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.149135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:07.149695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:07.153558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.552257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:07.570620 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e6d4d6b7-d398-4045-af3d-ad412160a6aa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.447554 Aug 24 03:32:07.573606 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 362/718] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:07 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:07.592014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ff8a7376-28fc-4504-a2a3-2e222e4b53a0 req-d4d39e8c-7595-4d94-950f-5d99a8c25063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e539046-aa0d-4d50-9555-8692a4d53f39", "tag": "3eb749a1-080a-45e0-a242-12967cbe89f1"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:07.604426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ff8a7376-28fc-4504-a2a3-2e222e4b53a0 req-d4d39e8c-7595-4d94-950f-5d99a8c25063 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:07.610332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ff8a7376-28fc-4504-a2a3-2e222e4b53a0 req-d4d39e8c-7595-4d94-950f-5d99a8c25063 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:07.611195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ff8a7376-28fc-4504-a2a3-2e222e4b53a0 req-d4d39e8c-7595-4d94-950f-5d99a8c25063 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.632039 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ff8a7376-28fc-4504-a2a3-2e222e4b53a0 req-d4d39e8c-7595-4d94-950f-5d99a8c25063 service nova] Creating event network-changed:3eb749a1-080a-45e0-a242-12967cbe89f1 for instance 4e539046-aa0d-4d50-9555-8692a4d53f39 on n-h1-846470-15 Aug 24 03:32:07.638111 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ff8a7376-28fc-4504-a2a3-2e222e4b53a0 req-d4d39e8c-7595-4d94-950f-5d99a8c25063 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052427 Aug 24 03:32:07.640457 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 363/719] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:07.649030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:07.651167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:07.659550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:07.660405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:07.661029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.662154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:07.662897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:07.663548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.801279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:07.815982 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fbf6139d-7f1c-4fc6-b73c-77867a82b19d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1281 microversion: 2.1 time: 0.172098 Aug 24 03:32:07.817834 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 364/720] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:07 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:07.887809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2d7c84d0-4a8e-4ea9-9764-6f48516e2dc5 req-b77977e9-dd0a-4331-85c4-3be168be43b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f", "name": "network-vif-plugged", "status": "completed", "tag": "da70c98b-f459-4150-afc9-fb1f7ba911ec"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:07.900444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2d7c84d0-4a8e-4ea9-9764-6f48516e2dc5 req-b77977e9-dd0a-4331-85c4-3be168be43b3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:07.901320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2d7c84d0-4a8e-4ea9-9764-6f48516e2dc5 req-b77977e9-dd0a-4331-85c4-3be168be43b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:07.902057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2d7c84d0-4a8e-4ea9-9764-6f48516e2dc5 req-b77977e9-dd0a-4331-85c4-3be168be43b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.918214 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2d7c84d0-4a8e-4ea9-9764-6f48516e2dc5 req-b77977e9-dd0a-4331-85c4-3be168be43b3 service nova] Creating event network-vif-plugged:da70c98b-f459-4150-afc9-fb1f7ba911ec for instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f on n-h1-846470-15 Aug 24 03:32:07.925926 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2d7c84d0-4a8e-4ea9-9764-6f48516e2dc5 req-b77977e9-dd0a-4331-85c4-3be168be43b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041065 Aug 24 03:32:07.927090 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 365/721] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:08.134957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:32:08.136313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:32:08.137090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:32:08.145472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:32:08.146601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:08.147338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:32:08.152864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:08.176372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.178667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.179566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.180629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.182846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.183548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.184026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.184758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.187380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.187721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.191892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.192976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.258894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:08.266362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for user 6d8976135cf9461e8a0eda1658abeec9 and project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:08.332229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:32:08.346108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:32:08.510069 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5d8dbbb-a72f-43ad-a41b-25e2b19cac25 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.871571 Aug 24 03:32:08.514785 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 357/722] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:32:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 03:32:08.536663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f01a803d-4053-41ad-ba79-0711fcc5b8df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:08.540217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f01a803d-4053-41ad-ba79-0711fcc5b8df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:08.687203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:08.699255 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-169b2fbb-6d67-4d59-9fcc-5bd5b32d9c02 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.560419 Aug 24 03:32:08.699892 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 366/723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:08 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:08.733390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:08.738629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:08.754512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.757839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.760346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.761326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.762689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.765135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.783743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f01a803d-4053-41ad-ba79-0711fcc5b8df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:08.797634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f01a803d-4053-41ad-ba79-0711fcc5b8df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:08.799190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f01a803d-4053-41ad-ba79-0711fcc5b8df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:08.803333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:08.804777 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f01a803d-4053-41ad-ba79-0711fcc5b8df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1286 microversion: 2.25 time: 0.282665 Aug 24 03:32:08.805577 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 358/724] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:08 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1286 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:08.839253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:08.839749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:08.855306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.855840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.856679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.857403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.858092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.858775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:09.055335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:09.089499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a451a2b7-0245-4b2c-b0a1-65b5a61f6068 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1281 microversion: 2.1 time: 0.251620 Aug 24 03:32:09.100680 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 359/725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:08 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1281 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:09.337109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:09.346734 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29c2e9ca-85db-4947-8dc4-17518fddc155 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.617197 Aug 24 03:32:09.347340 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 367/726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:08 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:09.398121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-272070327", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "f55312f4-6df6-4f91-b50e-a29e1a825546"}], "security_groups": [{"name": "tempest-securitygroup--1763190542"}], "key_name": "tempest-keypair-2114960705", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:09.638267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] validate_networks() for [('f55312f4-6df6-4f91-b50e-a29e1a825546', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:09.639845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-88562841-fd9d-4be7-83b3-e6e019249f69 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Action: 'create', calling method: .version_select at 0x7f102327d5e0>, body: {"keypair": {"name": "tempest-keypair-1340405640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsGIzBVLVkmhNrzuwL61I6e+LVGpQt67wL15Z+gulsgoqL6MNLBdTSOHWDs+IT1m8Uv0PMRJORzcKycls7dBErgEvY8JQ7/rZMSposOBSPjL3pHkoG1+Mgek+zY3analA=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:09.685945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-88562841-fd9d-4be7-83b3-e6e019249f69 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Getting quotas for project 9ad6dc9d72524a938e879fd2ea583904. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:09.697624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-88562841-fd9d-4be7-83b3-e6e019249f69 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Getting quotas for user 8784affc31e1450da0eef9261f5e280e and project 9ad6dc9d72524a938e879fd2ea583904. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:09.780917 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-88562841-fd9d-4be7-83b3-e6e019249f69 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.344012 Aug 24 03:32:09.781691 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 368/727] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:32:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:09.807720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:09.808609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:09.815171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:09.815721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:09.816149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:09.821264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:09.821815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:09.822260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.215227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:10.226177 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8d7aea1a-8f97-46c4-a40c-b0228d46294c tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.437901 Aug 24 03:32:10.244435 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 369/728] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:09 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:10.251763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:10.252377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:10.290862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.293062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.293780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.296695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.297534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.300826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.433854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:10.439446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:32:10.440789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:32:10.441423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:32:10.442766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:32:10.444129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:32:10.450669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:10.453176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:10.455243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e18669ef-e851-4f6d-9993-f505759af118 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1338 microversion: 2.25 time: 0.207656 Aug 24 03:32:10.455885 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 370/729] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:10 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1338 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:10.463252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.464641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.465152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.467291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.467939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.470502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.471545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:10.472180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:10.481268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.481930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.482553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.483419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.484358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.485254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.551811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Getting quotas for project 3835a5249c54414dbc3a19230c247072. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:10.564946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Getting quotas for user a9a7fe8630514ecba823e9834692cc77 and project 3835a5249c54414dbc3a19230c247072. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:10.571290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:10.594438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:32:10.604632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:32:10.711889 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e1dfd98-ce0d-4fd0-ab05-6c40f9c7efb6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.319465 Aug 24 03:32:10.712760 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 360/730] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:32:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:32:10.730424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:10.731050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:10.786879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.787378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.791218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.792088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.795758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.800642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.848032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:10.863227 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a5bbc16-70d7-4f55-bc76-1c484ed4dfd8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.404125 Aug 24 03:32:10.864338 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 371/731] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:10 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:10.895129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8ffbcb2-61d9-4fc2-bc2c-84680f2db474 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:10.898135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8ffbcb2-61d9-4fc2-bc2c-84680f2db474 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:10.926216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:11.082425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8ffbcb2-61d9-4fc2-bc2c-84680f2db474 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:11.091040 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8ffbcb2-61d9-4fc2-bc2c-84680f2db474 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1241 microversion: 2.1 time: 0.225316 Aug 24 03:32:11.092261 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 372/732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:10 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1241 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:11.248905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:11.249691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:11.271445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.272828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.274437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.275463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.276462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.277158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.280322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:11.292695 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c6459a7c-3574-4826-8d1b-a5015c627db7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.578797 Aug 24 03:32:11.293297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 361/733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:10 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:11.485285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:11.486042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:11.501637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.502269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.502863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.504562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.505248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.507482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.652546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:11.663247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90242683-f8e5-4d9e-b2a3-956475147ae9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.420394 Aug 24 03:32:11.665254 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 373/734] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:11 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:11.681554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:11.695980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:11.698656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:11.701622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-68812c77-0c0d-4914-a8bc-d788bb14d1af tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1344 microversion: 2.25 time: 0.222653 Aug 24 03:32:11.721506 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 362/735] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:11 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:11.886504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:11.887539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:11.902895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.904754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.905663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.910043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.910864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.911880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.114351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:12.114861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:12.122662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.123165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.123604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.124600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.125066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.125491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.258173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:12.269812 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef5be23e-2448-45d5-9cd8-e8f2633d7cde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1245 microversion: 2.1 time: 0.161330 Aug 24 03:32:12.283709 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 363/736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:12 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1245 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:12.321898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:12.322855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:12.331760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.332539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.332979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.333721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.334179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.334638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.468484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:12.482944 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7915dea5-8216-46f7-9990-36f8a2aed151 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.601211 Aug 24 03:32:12.484422 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 374/737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:11 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:12.597431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:12.609840 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-987f1625-6f80-449f-8904-cf26ffa4f8ab tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.293195 Aug 24 03:32:12.610449 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 364/738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:12 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:12.664287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-643163495", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "04335fa5-3428-4061-9ed5-779f624d8c8f"}], "security_groups": [{"name": "tempest-securitygroup--1062554590"}], "key_name": "tempest-keypair-1340405640", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:12.694762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:12.695458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:12.712059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.712941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.713562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.714500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.715141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.716590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.973966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] validate_networks() for [('04335fa5-3428-4061-9ed5-779f624d8c8f', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:13.178912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:13.187717 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b507abc-9632-470c-a589-a58d0f3caeb7 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1322 microversion: 2.1 time: 0.496902 Aug 24 03:32:13.188457 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 365/739] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:12 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:13.193648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:13.194477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:13.200791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.201512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.201979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.202705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.203277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.203733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.380981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:13.391525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:13.393833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:13.395145 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2fbeb855-33c7-40d2-aec3-15706d109fa4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.205559 Aug 24 03:32:13.395909 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 366/740] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:13 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:13.403358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:13.404017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:13.415079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.415552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.416052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.416836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.417297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.417712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.492458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:13.504274 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05c1b241-9fc1-4c99-91f0-6aaaacd77c47 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1245 microversion: 2.1 time: 0.106391 Aug 24 03:32:13.505372 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 367/741] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:13 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:13.511026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:13.511961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:13.520026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.520816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.522021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.522774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.523263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.525245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.783817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:13.799373 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0df39004-1abb-4a61-8dfa-193173a50c8a tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.292579 Aug 24 03:32:13.803580 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 368/742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:13 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:13.818232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:13.819552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:13.834080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.840032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.840752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.842188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.850158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.851101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.878467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Getting quotas for project 9ad6dc9d72524a938e879fd2ea583904. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:13.893251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Getting quotas for user 8784affc31e1450da0eef9261f5e280e and project 9ad6dc9d72524a938e879fd2ea583904. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:13.935971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:32:13.938983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:32:13.939534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:32:13.940208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:32:13.940845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:32:13.954168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.955135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.956079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.958198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.959333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.960497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.985000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Getting quotas for project 9ad6dc9d72524a938e879fd2ea583904. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:13.992334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Getting quotas for user 8784affc31e1450da0eef9261f5e280e and project 9ad6dc9d72524a938e879fd2ea583904. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:14.012267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:32:14.015442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:32:14.094713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-874f411b-7516-44b8-b437-7898351c2c43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.436379 Aug 24 03:32:14.099109 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 375/743] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:32:12 2022] POST /compute/v2.1/servers => generated 407 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:32:14.112350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e0e65241-f2d2-47ea-9c3b-707a346496a0 req-2f1dfecd-0362-412e-8005-3fa8b94487b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf0590f4-ad3d-4016-b019-6e71212ff34e", "tag": "88ddc8b2-32ba-4d59-a1fe-dc8334535167"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:14.151362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e0e65241-f2d2-47ea-9c3b-707a346496a0 req-2f1dfecd-0362-412e-8005-3fa8b94487b5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.152071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e0e65241-f2d2-47ea-9c3b-707a346496a0 req-2f1dfecd-0362-412e-8005-3fa8b94487b5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.153412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e0e65241-f2d2-47ea-9c3b-707a346496a0 req-2f1dfecd-0362-412e-8005-3fa8b94487b5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.209887 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e0e65241-f2d2-47ea-9c3b-707a346496a0 req-2f1dfecd-0362-412e-8005-3fa8b94487b5 service nova] Creating event network-changed:88ddc8b2-32ba-4d59-a1fe-dc8334535167 for instance cf0590f4-ad3d-4016-b019-6e71212ff34e on n-h2-846470-15 Aug 24 03:32:14.220230 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e0e65241-f2d2-47ea-9c3b-707a346496a0 req-2f1dfecd-0362-412e-8005-3fa8b94487b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119144 Aug 24 03:32:14.224044 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 376/744] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:14.235409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a0fa5a36-b05d-4a57-9978-27d8b5bef032 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:14.241322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a0fa5a36-b05d-4a57-9978-27d8b5bef032 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:14.611086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a0fa5a36-b05d-4a57-9978-27d8b5bef032 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:14.643628 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a0fa5a36-b05d-4a57-9978-27d8b5bef032 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1269 microversion: 2.1 time: 0.414928 Aug 24 03:32:14.644773 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 377/745] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:14 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1269 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:14.658066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:14.662634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:14.663247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:14.670501 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-51732ea8-d44c-429b-a848-21d01c6aa3fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.864488 Aug 24 03:32:14.671150 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 369/746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:13 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:14.679806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:14.684464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:14.692016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.697437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.698641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.699286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.699815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.700260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.701018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.701536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.702015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.702563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.702830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.703427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.981129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:14.994791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:14.997687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:14.999219 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f6cca57e-0ff5-428e-b84b-955a2cd6dfe7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.326869 Aug 24 03:32:15.000535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 370/747] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:14 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:15.017390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.018022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.033414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.038577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.052307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.053126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.053618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.054057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.156443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:15.171931 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a87e9999-e553-4155-a866-4d6e83145844 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1472 microversion: 2.1 time: 0.520481 Aug 24 03:32:15.174741 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 378/748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:14 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1472 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:15.194169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.197577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:15.208982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.219036 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0d77cb47-635e-4066-a5c7-334f49d4008d tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1293 microversion: 2.1 time: 0.216069 Aug 24 03:32:15.232112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.234288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.237560 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 371/749] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1293 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:15.240024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.243865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.247104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.248712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ed24567f-4336-47b1-8c2a-92131a4692e4 req-c63d5bcc-42aa-4729-b16a-73fc53c99197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f439e22-224f-40d9-b312-79a59c672563", "tag": "b566b56d-990c-4ceb-9f5f-3c9273bc1e92"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:15.248869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.261429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ed24567f-4336-47b1-8c2a-92131a4692e4 req-c63d5bcc-42aa-4729-b16a-73fc53c99197 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.261912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ed24567f-4336-47b1-8c2a-92131a4692e4 req-c63d5bcc-42aa-4729-b16a-73fc53c99197 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.262332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ed24567f-4336-47b1-8c2a-92131a4692e4 req-c63d5bcc-42aa-4729-b16a-73fc53c99197 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.286790 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ed24567f-4336-47b1-8c2a-92131a4692e4 req-c63d5bcc-42aa-4729-b16a-73fc53c99197 service nova] Creating event network-changed:b566b56d-990c-4ceb-9f5f-3c9273bc1e92 for instance 1f439e22-224f-40d9-b312-79a59c672563 on n-h1-846470-15 Aug 24 03:32:15.299528 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ed24567f-4336-47b1-8c2a-92131a4692e4 req-c63d5bcc-42aa-4729-b16a-73fc53c99197 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060526 Aug 24 03:32:15.301855 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 372/750] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:15.312005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:15.312932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.321773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.323211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.324792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.338609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.341366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.342743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.369493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lazy-loading 'flavor' on Instance uuid 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:32:15.466745 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffa7b8d1-80c3-46c6-8e0c-6263d9373a88 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f/action" status: 202 len: 0 microversion: 2.1 time: 0.161743 Aug 24 03:32:15.472222 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 373/751] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:15 2022] POST /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:32:15.496595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.498537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.507795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.508623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.509853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.513818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.515091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.516612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.547697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:15.746233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:15.755035 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a6cf13a4-7b80-451e-81d4-0593fc8d7d7c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.577249 Aug 24 03:32:15.755631 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 379/752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:15.773307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.774258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.785116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.786393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.787314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.788366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.789088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.789687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.894339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:15.921035 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8961eec1-9321-4397-8279-b3926148b237 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1633 microversion: 2.1 time: 0.443846 Aug 24 03:32:15.921611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 374/753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1633 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:15.929469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.930340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.931247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-11a8ea3d-9092-4238-8460-0c6087aff3bd tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1265 microversion: 2.1 time: 0.174515 Aug 24 03:32:15.932300 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 380/754] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:15.962331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.962839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.963271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.975220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.975793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.976389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.023854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:16.024868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:16.037718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.038656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.039596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.040724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.041753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.042434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.350203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:16.367086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:16.371120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:16.372645 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-deca05f7-d9a4-4774-b077-8628616c3802 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.352929 Aug 24 03:32:16.373223 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 381/755] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:16 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:32:16.390157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:16.390849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:16.421013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.423214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.427516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.428565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.429058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.429493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.534525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:16.537526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:16.556666 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7df38925-857b-481e-99ba-fd364fedd1c1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1299 microversion: 2.1 time: 0.176520 Aug 24 03:32:16.573727 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 382/756] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:16 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:16.667175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:16.683849 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d92abce9-81b2-405e-8d0a-fe3c32642815 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.759850 Aug 24 03:32:16.686455 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 375/757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:16.777537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:16.778464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:16.786072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.786840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.787490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.788286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.788932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.789861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.945428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:16.946451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:16.956790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.957827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.958504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.960962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.963153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.964575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.255082 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf2de221-7ed5-4054-8356-a78dddd7c6b4 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1633 microversion: 2.1 time: 0.314281 Aug 24 03:32:17.256167 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 376/758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:16 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1633 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:17.262944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:17.263565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:17.277543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.285618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.286087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.286849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.287329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.288612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.327827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.340107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-25a55b15-66e7-49f8-8354-d997cac57e31 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.566749 Aug 24 03:32:17.341799 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 383/759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:16 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:17.401036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:17.402613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:17.408249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.412878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.413782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.414431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.415574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.416589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.417214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.418056 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-63a24807-ffef-4655-b9cb-1a979a17d7df tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1321 microversion: 2.1 time: 0.160996 Aug 24 03:32:17.419059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 377/760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:17 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:17.581999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:17.583033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:17.594793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.599888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.600830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.601793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.603140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.605745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.727364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.732404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.738663 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0ff9f777-70d0-4dc1-98e6-55982a026d0c tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1299 microversion: 2.1 time: 0.161361 Aug 24 03:32:17.738663 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 378/761] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:17 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:17.752652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:17.752652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:17.754300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.766325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.766325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8e90421-16ca-4755-9303-b16b02108ff9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.374320 Aug 24 03:32:17.768876 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 384/762] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:17 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:32:17.791562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.792106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.792555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.793290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.793764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.794196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.132303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:18.151024 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94afb7f8-d87b-4161-81d3-0a0a7f0035ae tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.411415 Aug 24 03:32:18.164017 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 379/763] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:17 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:18.278747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:18.279514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:18.299048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.301480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.304695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.306269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.310265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.311747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.365078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:18.365781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:18.379710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.379896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.382145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.384984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.385547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.385989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.621692 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-180e845d-ef58-42d1-9ab1-36e9174f01ac tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1616 microversion: 2.1 time: 0.346914 Aug 24 03:32:18.624179 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 385/764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:18 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1616 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:18.632570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:18.633609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:18.640832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.641737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.642654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.643882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.644576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.645503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.777901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:18.794125 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32b7b427-15a1-40cc-a73a-0098275ad703 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1327 microversion: 2.1 time: 0.167956 Aug 24 03:32:18.812723 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 386/765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:18 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1327 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:18.820487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:18.822665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:18.832931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.833775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.834487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.835878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.838347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.839264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.979453 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] HTTP exception thrown: Cannot 'migrate' instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f while it is in vm_state suspended Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Request method failure captured: Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f/action HTTP/1.1 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 15 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZuHDfyksKKrpGkZCwY60T3GGgbIKcTgVAuoqEd8P-jXvC14941MxQOWblTZXPNCCPxX-dETvVDbHNmHKE3iczqg3FyF5a2FAiRRRbO5oaUjeHDvgUSCx8Wi2AJdpwakoqu20OshVluKKawixUna0WnUxsb8hCVNqYOxLtTELXifEk4 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: ecc500ef8fbb4adda31961e8d743d4b9 Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: {"migrate": {}} Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: exception: Cannot 'migrate' instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f while it is in vm_state suspended Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f', 'body': {'migrate': {}}} Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f in vm_state suspended. Cannot resize while the instance is in this state. Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:32:18.982164 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f while it is in vm_state suspended Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f while it is in vm_state suspended Aug 24 03:32:18.986487 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:18.989811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Returning 409 to user: Cannot 'migrate' instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f while it is in vm_state suspended {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:18.991367 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d76b91e5-2fdf-4682-9665-5a167bae5cdc tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f/action" status: 409 len: 148 microversion: 2.1 time: 0.176668 Aug 24 03:32:18.992220 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 387/766] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:18 2022] POST /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f/action => generated 148 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:32:18.997149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:18.998649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:19.010673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.012438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.013858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.015526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.016717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.017393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.320214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:19.332433 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-71b02c0a-6322-43ee-997a-d2d7f6f24ed4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.971497 Aug 24 03:32:19.335199 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 380/767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:18 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:19.342359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:19.345226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:19.346060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:19.357423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.358229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.359153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.360527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.361242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.361888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.363763 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3b0e3829-8cc0-4b4f-9567-64621cec44bd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.370239 Aug 24 03:32:19.364686 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 388/768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:18 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:19.370968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7c151f18-d5e5-4b22-83c3-c0d683809f3f req-1a488ff8-72cd-4ebf-aa87-09a764ebaefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e539046-aa0d-4d50-9555-8692a4d53f39", "name": "network-vif-plugged", "status": "completed", "tag": "3eb749a1-080a-45e0-a242-12967cbe89f1"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:19.383869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7c151f18-d5e5-4b22-83c3-c0d683809f3f req-1a488ff8-72cd-4ebf-aa87-09a764ebaefd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.385068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7c151f18-d5e5-4b22-83c3-c0d683809f3f req-1a488ff8-72cd-4ebf-aa87-09a764ebaefd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.385729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7c151f18-d5e5-4b22-83c3-c0d683809f3f req-1a488ff8-72cd-4ebf-aa87-09a764ebaefd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.403012 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7c151f18-d5e5-4b22-83c3-c0d683809f3f req-1a488ff8-72cd-4ebf-aa87-09a764ebaefd service nova] Creating event network-vif-plugged:3eb749a1-080a-45e0-a242-12967cbe89f1 for instance 4e539046-aa0d-4d50-9555-8692a4d53f39 on n-h1-846470-15 Aug 24 03:32:19.409450 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7c151f18-d5e5-4b22-83c3-c0d683809f3f req-1a488ff8-72cd-4ebf-aa87-09a764ebaefd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043244 Aug 24 03:32:19.414298 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 389/769] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:19.420374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53c42ce8-a2a9-479c-a96a-c2d866fd4396 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53c42ce8-a2a9-479c-a96a-c2d866fd4396 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Request method failure captured: Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749/action HTTP/1.1 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 39 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZuHDfyksKKrpGkZCwY60T3GGgbIKcTgVAuoqEd8P-jXvC14941MxQOWblTZXPNCCPxX-dETvVDbHNmHKE3iczqg3FyF5a2FAiRRRbO5oaUjeHDvgUSCx8Wi2AJdpwakoqu20OshVluKKawixUna0WnUxsb8hCVNqYOxLtTELXifEk4 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: ecc500ef8fbb4adda31961e8d743d4b9 Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: {"os-resetState": {"state": "invalid"}} Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'e4dfd497-923f-42d0-a333-546f43070749', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:32:19.424366 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53c42ce8-a2a9-479c-a96a-c2d866fd4396 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53c42ce8-a2a9-479c-a96a-c2d866fd4396 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749/action" status: 400 len: 144 microversion: 2.1 time: 0.010235 Aug 24 03:32:19.428870 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 390/770] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:19 2022] POST /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749/action => generated 144 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:32:19.431067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:19.431833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:19.439500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.440041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.440493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.441301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.441768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.442199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.611843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:19.623808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:19.626131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:19.628252 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-726f41e5-92d6-4e65-9551-47f874be24f4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.291480 Aug 24 03:32:19.629076 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 381/771] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:19 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:19.634504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-446dee4a-2dff-436e-9c10-c1ba43b848e7 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-446dee4a-2dff-436e-9c10-c1ba43b848e7 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Request method failure captured: Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749/action HTTP/1.1 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 31 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuHDfyksKKrpGkZCwY60T3GGgbIKcTgVAuoqEd8P-jXvC14941MxQOWblTZXPNCCPxX-dETvVDbHNmHKE3iczqg3FyF5a2FAiRRRbO5oaUjeHDvgUSCx8Wi2AJdpwakoqu20OshVluKKawixUna0WnUxsb8hCVNqYOxLtTELXifEk4 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ecc500ef8fbb4adda31961e8d743d4b9 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: {"os-resetState": {"state": 1}} Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e4dfd497-923f-42d0-a333-546f43070749', 'body': {'os-resetState': {'state': 1}}} Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 1 Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 03:32:19.639260 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-446dee4a-2dff-436e-9c10-c1ba43b848e7 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-446dee4a-2dff-436e-9c10-c1ba43b848e7 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749/action" status: 400 len: 120 microversion: 2.1 time: 0.011595 Aug 24 03:32:19.644253 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 382/772] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:19 2022] POST /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:32:19.654325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-342fc2f6-aaba-41fd-84a2-fc4f6be6a020 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:19.657343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-342fc2f6-aaba-41fd-84a2-fc4f6be6a020 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Failed to fetch instance by id 999 {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 03:32:19.658458 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-342fc2f6-aaba-41fd-84a2-fc4f6be6a020 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-342fc2f6-aaba-41fd-84a2-fc4f6be6a020 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Request method failure captured: Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 37 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuHDfyksKKrpGkZCwY60T3GGgbIKcTgVAuoqEd8P-jXvC14941MxQOWblTZXPNCCPxX-dETvVDbHNmHKE3iczqg3FyF5a2FAiRRRbO5oaUjeHDvgUSCx8Wi2AJdpwakoqu20OshVluKKawixUna0WnUxsb8hCVNqYOxLtTELXifEk4 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0880c767dde044938f5a0b6b9a1da759"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0880c767dde044938f5a0b6b9a1da759 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1388400140 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ecc500ef8fbb4adda31961e8d743d4b9 Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1388400140-project-admin Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: {"os-resetState": {"state": "error"}} Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 999 could not be found. Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:19.660633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:19.665212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:19.665212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 24 03:32:19.665212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:19.667137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-342fc2f6-aaba-41fd-84a2-fc4f6be6a020 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:19.668231 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-342fc2f6-aaba-41fd-84a2-fc4f6be6a020 tempest-ServersAdminNegativeTestJSON-1388400140 tempest-ServersAdminNegativeTestJSON-1388400140-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.017922 Aug 24 03:32:19.669002 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 383/773] 10.222.0.58 () {60 vars in 1179 bytes} [Wed Aug 24 03:32:19 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:32:19.681570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:19.682325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:19.690401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.690979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.691630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.692452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.692986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.693669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.724415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:32:19.750357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:19.760310 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5801999e-3036-4615-bd77-783c7af33773 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.332472 Aug 24 03:32:19.772059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 391/774] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:19 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:19.818404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:19.819118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:19.826673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.828223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.828707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.829713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.830378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.831096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.876940 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-65ea5a46-1f00-4cc7-a78f-9832dc534ee9 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 204 len: 0 microversion: 2.1 time: 0.201082 Aug 24 03:32:19.878059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 384/775] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:32:19 2022] DELETE /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:32:19.887037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:19.887762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:19.894755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.895245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.896033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.896757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.897604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.898195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.004738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.022080 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d79e6e3a-2b8d-42ce-a35b-16368715bf60 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.207607 Aug 24 03:32:20.022957 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 392/776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:19 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:20.090757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.100432 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c259935e-3e96-4b26-be21-3a61d7d5addc tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1469 microversion: 2.1 time: 0.217523 Aug 24 03:32:20.100956 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 385/777] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:19 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:20.356514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:20.357103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:20.364333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.364821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.365256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.365953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.366402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.366817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.392665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:20.393993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:20.402802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.403378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.403931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.404707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.405267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.405837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.501346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:20.527184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.535763 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b416c768-0326-44f9-97ea-93731e0d8c37 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.183250 Aug 24 03:32:20.536607 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 393/778] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:20 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:20.559369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.567929 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad57b9a8-4d0e-41af-87df-5a4a3de2cf64 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.179806 Aug 24 03:32:20.569680 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 386/779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:20 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:20.657937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:20.658466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:20.664885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.665413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.665844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.666537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.666993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.667413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.782686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:20.783307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:20.785580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=22 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:20.792602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.793825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.794487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.795541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.796612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.797330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.824628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.839991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.841822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.843471 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e2c98d3-42b1-44c2-be64-86e79a3ebc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.189961 Aug 24 03:32:20.844253 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 394/780] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:20 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:20.943402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.951974 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0dd27c1-0a23-447f-9537-2113061386ca tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.173466 Aug 24 03:32:20.952920 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 387/781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:20 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:21.042581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.043192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.050871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.051364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.051838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.052576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.053025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.053454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.121000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.123703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.129012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.129588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.130089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.131414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.131414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.131838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.217149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:21.228205 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7495729-b581-40c0-89d1-d0eb8103af5d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.189477 Aug 24 03:32:21.228805 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 395/782] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:21.306999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:21.315355 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cf53a760-d0de-482f-b8bb-3151d6e1028f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1469 microversion: 2.1 time: 0.198189 Aug 24 03:32:21.325779 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 388/783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:21.572813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.573790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.585874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.586859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.587353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.588142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.588674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.589311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.590539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.591174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.600852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.601332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.601778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.602511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.602947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.603383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.752192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:21.752917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:21.761020 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-933578dd-464b-4d02-a58d-a1ab1d5f2751 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.174696 Aug 24 03:32:21.761236 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-49bedfd7-07d9-490b-87b8-9f5fccbf79e8 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.207650 Aug 24 03:32:21.761722 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 396/784] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:21.767992 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 389/785] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:21.866738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.867481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.873878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.874530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.874967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.875703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.876165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.876583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.974995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.975800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.985527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.992449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.992923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.993700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.994220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.994684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.050283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.061028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.062928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.064741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8716b31d-a395-4631-9d88-92254db4e8fe tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.201989 Aug 24 03:32:22.065551 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 397/786] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:22.175132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.188945 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-46331f23-27db-4186-8cd1-2aef23c9a47c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.217349 Aug 24 03:32:22.189445 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 390/787] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:22.250478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:22.251242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:22.258342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.258927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.259430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.260263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.260948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.261445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.341881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:22.342679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:22.353696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.354329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.355704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.360085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.361631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.362200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.402727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:22.506883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.523773 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe199fdc-2a34-4eb4-a121-171c6c357e1d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.278117 Aug 24 03:32:22.524623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 398/788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:22 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:22.784290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:22.785206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:22.803953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.806309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.808836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.813330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.814273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.817234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.959895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.979976 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de2dd604-01b1-4dfe-8db7-56f91aef909d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1469 microversion: 2.1 time: 0.644946 Aug 24 03:32:22.986277 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 391/789] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:22 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1469 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:23.001028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:23.002588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:23.022650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.023493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.024184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.025098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.028739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.029671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.387585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:23.391745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:23.402051 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db0d6362-fa9e-47e1-b948-671d777a5aa7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.411689 Aug 24 03:32:23.407781 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a975075-faff-498e-b720-2eced7c1d3ca tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.629580 Aug 24 03:32:23.412004 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 399/790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:22 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:23.424502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:23.425746 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 392/791] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:22 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:23.434305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:23.435013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:23.440249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:23.459881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.460167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.461159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.461979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.462474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.463236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.465315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.465901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.466365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.468891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.469352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.470350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.796613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:23.799860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:23.806455 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94b736ab-26ed-4185-814d-12f1d7e29b63 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.379050 Aug 24 03:32:23.810077 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 393/792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:23 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:23.815979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5936b99a-5636-4ca7-8246-6361b30daf8c req-74dba8b0-91c0-4317-9e4f-5ec95d0989b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455cb13d-9183-4cac-9f96-22ac9340600d", "tag": "01d404f5-80e4-44d7-800d-aff92275c86a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:23.829456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5936b99a-5636-4ca7-8246-6361b30daf8c req-74dba8b0-91c0-4317-9e4f-5ec95d0989b7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.830405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5936b99a-5636-4ca7-8246-6361b30daf8c req-74dba8b0-91c0-4317-9e4f-5ec95d0989b7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.831012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5936b99a-5636-4ca7-8246-6361b30daf8c req-74dba8b0-91c0-4317-9e4f-5ec95d0989b7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.831379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:23.835562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:23.838892 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48a61452-82cc-45a5-99c4-74fa72a397cd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.425480 Aug 24 03:32:23.843493 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 400/793] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:23 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:23.852090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:23.853066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:23.865298 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5936b99a-5636-4ca7-8246-6361b30daf8c req-74dba8b0-91c0-4317-9e4f-5ec95d0989b7 service nova] Creating event network-changed:01d404f5-80e4-44d7-800d-aff92275c86a for instance 455cb13d-9183-4cac-9f96-22ac9340600d on n-h1-846470-15 Aug 24 03:32:23.871875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.873360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.875035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.876538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.879365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.881061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.892454 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5936b99a-5636-4ca7-8246-6361b30daf8c req-74dba8b0-91c0-4317-9e4f-5ec95d0989b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059444 Aug 24 03:32:23.902069 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 394/794] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:23.914866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3b233e78-63d2-49da-bef9-71c096897592 req-06d1fadf-d164-4230-90f4-a486762f8aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0590f4-ad3d-4016-b019-6e71212ff34e", "name": "network-vif-plugged", "status": "completed", "tag": "88ddc8b2-32ba-4d59-a1fe-dc8334535167"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:23.933781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:23.956888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b233e78-63d2-49da-bef9-71c096897592 req-06d1fadf-d164-4230-90f4-a486762f8aa6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.961933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b233e78-63d2-49da-bef9-71c096897592 req-06d1fadf-d164-4230-90f4-a486762f8aa6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.964601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b233e78-63d2-49da-bef9-71c096897592 req-06d1fadf-d164-4230-90f4-a486762f8aa6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.976034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:23.998129 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3b233e78-63d2-49da-bef9-71c096897592 req-06d1fadf-d164-4230-90f4-a486762f8aa6 service nova] Creating event network-vif-plugged:88ddc8b2-32ba-4d59-a1fe-dc8334535167 for instance cf0590f4-ad3d-4016-b019-6e71212ff34e on n-h2-846470-15 Aug 24 03:32:24.008250 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3b233e78-63d2-49da-bef9-71c096897592 req-06d1fadf-d164-4230-90f4-a486762f8aa6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104289 Aug 24 03:32:24.011345 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 395/795] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:24.031005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4152ab30-093f-47e0-aa77-38536cae2b88 req-2c9a7c53-fa14-4a02-ac15-d271737a9b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a140ff-ed85-412e-9b12-362f2fad9ffa", "tag": "db764fdd-927f-4f53-ab48-48e8691baa73"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:24.082959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4152ab30-093f-47e0-aa77-38536cae2b88 req-2c9a7c53-fa14-4a02-ac15-d271737a9b07 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.083857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4152ab30-093f-47e0-aa77-38536cae2b88 req-2c9a7c53-fa14-4a02-ac15-d271737a9b07 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.084727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4152ab30-093f-47e0-aa77-38536cae2b88 req-2c9a7c53-fa14-4a02-ac15-d271737a9b07 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.118409 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4152ab30-093f-47e0-aa77-38536cae2b88 req-2c9a7c53-fa14-4a02-ac15-d271737a9b07 service nova] Creating event network-changed:db764fdd-927f-4f53-ab48-48e8691baa73 for instance 73a140ff-ed85-412e-9b12-362f2fad9ffa on n-h1-846470-15 Aug 24 03:32:24.125357 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4152ab30-093f-47e0-aa77-38536cae2b88 req-2c9a7c53-fa14-4a02-ac15-d271737a9b07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111931 Aug 24 03:32:24.126545 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 396/796] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:24.133931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:24.135208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:24.147599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.148392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.149656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.150799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.151435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.152374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.385552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:24.416362 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90e06747-78a9-4023-8c3c-6689655eb07b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.565926 Aug 24 03:32:24.436602 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 401/797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:23 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:24.436602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:24.436602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:24.446421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.450833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.450833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.459060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.464339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.464903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.465087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:24.478020 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-51ce2f25-53f1-4599-aeea-e27fc842616a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1469 microversion: 2.1 time: 0.349953 Aug 24 03:32:24.478655 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 397/798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:24 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:24.494282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:24.495044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:24.503887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.504456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.504891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.505607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.506058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.506479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.634577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:24.637234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=38 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:24.645937 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91fad8d3-c12b-4d6d-9af3-40430de4790c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.218601 Aug 24 03:32:24.646535 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 402/799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:24 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:24.685677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:24.694909 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e18849ff-9995-4db6-a419-6bf8fc35b907 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.215153 Aug 24 03:32:24.695500 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 398/800] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:24 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:24.830446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:24.831300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:24.839689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.840199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.840633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.842022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.843634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.844303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.870059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:24.870810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:24.877581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.877965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.878583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.879485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.880139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.881108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.019228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:25.028232 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f5c823da-a7cc-4ccd-b83c-2dfb09202ab8 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.201714 Aug 24 03:32:25.030778 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 403/801] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:24 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:25.170333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:25.183505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:25.186766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:25.187471 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f7d39c70-7b60-4fd0-84ea-8b1bdb38ae0e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1411 microversion: 2.25 time: 0.320996 Aug 24 03:32:25.190544 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 399/802] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:24 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1411 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:25.449956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:25.450760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:25.458384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:25.459015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:25.459588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.460790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:25.461350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:25.462325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.512085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:25.519022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:25.537724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:25.539996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:25.540952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.543463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:25.544481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:25.545332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.652867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:25.664974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ecb1464-f824-4a17-acda-208dba3ad0d0 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.221319 Aug 24 03:32:25.666010 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 404/803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:25 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:25.671523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:25.672301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:25.684911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:25.686280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:25.686280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.687354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:25.688035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:25.688776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.779588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:25.797387 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-454a1741-5c4c-4d7d-a24a-ba9122112f67 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1469 microversion: 2.1 time: 0.299202 Aug 24 03:32:25.800176 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 400/804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:25 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1469 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:25.809678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:25.811291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:25.824268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:25.825403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:25.826591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.828466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:25.829295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:25.830324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.990351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:25.999812 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9e9062f-6355-4ca7-8903-28da79850498 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.332269 Aug 24 03:32:26.007309 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 405/805] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:25 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:26.048365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-fe60d02c-220b-454b-811a-474ad1234d16 req-9b3a134f-df91-490a-a59e-774d41730931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f439e22-224f-40d9-b312-79a59c672563", "name": "network-vif-plugged", "status": "completed", "tag": "b566b56d-990c-4ceb-9f5f-3c9273bc1e92"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:26.070540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fe60d02c-220b-454b-811a-474ad1234d16 req-9b3a134f-df91-490a-a59e-774d41730931 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.071889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fe60d02c-220b-454b-811a-474ad1234d16 req-9b3a134f-df91-490a-a59e-774d41730931 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.073034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fe60d02c-220b-454b-811a-474ad1234d16 req-9b3a134f-df91-490a-a59e-774d41730931 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.112555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fe60d02c-220b-454b-811a-474ad1234d16 req-9b3a134f-df91-490a-a59e-774d41730931 service nova] Creating event network-vif-plugged:b566b56d-990c-4ceb-9f5f-3c9273bc1e92 for instance 1f439e22-224f-40d9-b312-79a59c672563 on n-h1-846470-15 Aug 24 03:32:26.125813 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-fe60d02c-220b-454b-811a-474ad1234d16 req-9b3a134f-df91-490a-a59e-774d41730931 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089061 Aug 24 03:32:26.134756 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 406/806] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:26.148371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:26.149649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:26.192086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.192423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.198902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.200451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.208444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.213406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.367411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:26.389761 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05d6098e-bac3-4462-84e9-38723ce37d46 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.587241 Aug 24 03:32:26.391153 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 401/807] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:25 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:26.403514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:26.404869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:26.424001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.424653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.425414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.426479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.427313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.428363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.883462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:26.929908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:26.932477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:26.934455 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5332028f-a1c8-4992-8821-ace169b4304f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1607 microversion: 2.25 time: 0.542054 Aug 24 03:32:26.949389 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 402/808] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:26 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1607 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:26.974828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:26.976123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:26.977162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:26.986758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.987636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.988397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.989335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.990549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.991215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.001748 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8ef4c0b-aa84-4997-b687-d07b9efb8b4b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1316 microversion: 2.1 time: 0.864142 Aug 24 03:32:27.002809 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 407/809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:26 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1316 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:27.024893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:27.027327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:27.038633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.052917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.054103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.055580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.073830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.074630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.311940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:27.327640 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-143551f3-a0dc-4f6e-9b9b-4c5180fb043b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.376339 Aug 24 03:32:27.339764 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 403/810] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:26 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:27.339764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:27.341858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:27.355808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.356649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.357398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.358082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:27.358606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.359396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.360156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.378671 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a71c5f6a-eda0-4d4a-8bba-9c318d56c39a tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1469 microversion: 2.1 time: 0.364939 Aug 24 03:32:27.387948 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 408/811] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:27 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1469 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:27.422514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:27.423978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:27.441325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.443044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.443581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.444734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.446131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.446605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.579229 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-380c8761-4030-47a5-8839-ee88cb3d6d2a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.247671 Aug 24 03:32:27.580822 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 404/812] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 03:32:27 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:32:27.609485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:27.611908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:27.634420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.634933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.635390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.645868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.646392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.646849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.892027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:27.904456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cac16a69-b262-457a-a077-cb09c73d6e6d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.512328 Aug 24 03:32:27.906334 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 409/813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:27 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:27.912836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d01c8332-f723-4419-a5e8-c6b1a70a6c30 req-f9f53c91-0620-4216-a5b0-1e15f7eda3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f", "name": "network-vif-deleted", "tag": "da70c98b-f459-4150-afc9-fb1f7ba911ec"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:27.921119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:27.927639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d01c8332-f723-4419-a5e8-c6b1a70a6c30 req-f9f53c91-0620-4216-a5b0-1e15f7eda3a0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.928240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d01c8332-f723-4419-a5e8-c6b1a70a6c30 req-f9f53c91-0620-4216-a5b0-1e15f7eda3a0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.928842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d01c8332-f723-4419-a5e8-c6b1a70a6c30 req-f9f53c91-0620-4216-a5b0-1e15f7eda3a0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.944934 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d01c8332-f723-4419-a5e8-c6b1a70a6c30 req-f9f53c91-0620-4216-a5b0-1e15f7eda3a0 service nova] Creating event network-vif-deleted:da70c98b-f459-4150-afc9-fb1f7ba911ec for instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f on n-h1-846470-15 Aug 24 03:32:27.951912 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d01c8332-f723-4419-a5e8-c6b1a70a6c30 req-f9f53c91-0620-4216-a5b0-1e15f7eda3a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043759 Aug 24 03:32:27.957188 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 410/814] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:28.028617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:28.030559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.041341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.042418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.043399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.044697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.045553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.046642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.152903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:28.162043 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58f7fbd9-effc-472b-a167-9c3a6033e2f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.579777 Aug 24 03:32:28.175998 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 405/815] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:27 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:28.266993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:28.276324 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bcf19575-698a-4abb-ab7a-5f800bf592cd tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1465 microversion: 2.1 time: 0.255292 Aug 24 03:32:28.277582 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 411/816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:28 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:28.297003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:28.297632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.301151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:28.305252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.305926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.306559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.307271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.307753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.308173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.374598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:28.375354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.383761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.384260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.384757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.385747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.386280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.386719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.605604 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0dbcaca4-190b-4adb-8fc1-7a5e2bf5c6e0 tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1618 microversion: 2.1 time: 0.312421 Aug 24 03:32:28.608081 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 406/817] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:28 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1618 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:28.621004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:28.621630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.629372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.630241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.630851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.631919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.632565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.633844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.649222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:28.680838 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97df2799-ac00-40dc-babe-a2bddc5e479b tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.312720 Aug 24 03:32:28.682270 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 412/818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:28 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:28.689650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2091070769", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:28.767861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:29.080524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:29.083869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:32:29.086038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:32:29.086038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:32:29.086422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:32:29.087208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:32:29.093581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-39d0bf69-cd7c-4726-a07b-17dacd25e9fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1427 microversion: 2.1 time: 0.483312 Aug 24 03:32:29.094182 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 407/819] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:28 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1427 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:29.099934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:29.100898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:29.101717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.102214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.102649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.103384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.103868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.104293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.110352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.111843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.112694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.113709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.114405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.115857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.145537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:29.152637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Getting quotas for user 906d6efeea2b4af59b76fae3e3531d7b and project d347f85e59734622a091e80dbf0d9521. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:29.168222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:32:29.170575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:32:29.250151 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3c00350e-8d80-4a48-8a04-7e71ddab4161 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566702 Aug 24 03:32:29.250817 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 413/820] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:32:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:32:29.255606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:29.256269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:29.275700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.291400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.291400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.291400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.291400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.291400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.441658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:29.462659 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c045c814-c1f4-4285-a718-7d872faccea4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.366199 Aug 24 03:32:29.465849 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 408/821] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:29 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:29.471122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c0283251-63af-4539-8f18-726ff60e6101 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:29.474622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c0283251-63af-4539-8f18-726ff60e6101 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:29.566846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:29.583261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55f057ad-f85a-4720-a16e-14e220cfb6d1 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.326004 Aug 24 03:32:29.584284 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 414/822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:29 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:29.636379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0283251-63af-4539-8f18-726ff60e6101 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:29.652691 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c0283251-63af-4539-8f18-726ff60e6101 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1217 microversion: 2.1 time: 0.185324 Aug 24 03:32:29.665798 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 409/823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:29 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:29.706080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:29.706809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:29.718991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.721970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.722520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.723798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.726035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.727568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.765289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-399c79a5-c579-4562-8372-33ece79ca422 req-7d9f4965-c780-44ca-9d66-2afce32b9329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf0590f4-ad3d-4016-b019-6e71212ff34e", "tag": "88ddc8b2-32ba-4d59-a1fe-dc8334535167"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:29.788960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-399c79a5-c579-4562-8372-33ece79ca422 req-7d9f4965-c780-44ca-9d66-2afce32b9329 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.789406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-399c79a5-c579-4562-8372-33ece79ca422 req-7d9f4965-c780-44ca-9d66-2afce32b9329 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.789983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-399c79a5-c579-4562-8372-33ece79ca422 req-7d9f4965-c780-44ca-9d66-2afce32b9329 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.812438 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-399c79a5-c579-4562-8372-33ece79ca422 req-7d9f4965-c780-44ca-9d66-2afce32b9329 service nova] Creating event network-changed:88ddc8b2-32ba-4d59-a1fe-dc8334535167 for instance cf0590f4-ad3d-4016-b019-6e71212ff34e on n-h2-846470-15 Aug 24 03:32:29.835861 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-399c79a5-c579-4562-8372-33ece79ca422 req-7d9f4965-c780-44ca-9d66-2afce32b9329 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083534 Aug 24 03:32:29.844163 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 410/824] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:30.042774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:30.057659 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d29389e-8563-4274-898a-42d9690167d7 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.357445 Aug 24 03:32:30.058961 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 415/825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:29 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:30.132428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:30.133615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:30.150106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.151054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.151755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.152726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.153897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.154553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.290784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:30.307108 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea7ae6f8-47d0-480b-9ec4-dfc27f00ad30 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1427 microversion: 2.1 time: 0.179179 Aug 24 03:32:30.307608 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 411/826] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:30 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:30.501525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:30.503912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:30.528399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.529943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.529943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.530498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.531073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.531823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.632819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:30.633464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:30.695723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.696467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.696685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.697886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.698706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.699441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.727580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:31.017328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:31.050705 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d650faaf-2cd0-413a-afb5-789f1070dfce tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.554119 Aug 24 03:32:31.054438 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 416/827] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:30 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:31.081811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:31.092696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:31.111826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.122045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.123059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.125055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.137218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:31.158247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b9a38d50-dcc8-4d92-9631-baa4c3ecbe87 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.537979 Aug 24 03:32:31.163169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 412/828] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:30 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:31.166986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.174221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.193089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:31.194388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:31.204137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.204431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.205214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.206354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.207170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.207612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.486833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:31.496518 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a0dda1e-03e5-4519-a427-cae6adfe0a6b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1269 microversion: 2.1 time: 0.437557 Aug 24 03:32:31.497527 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 417/829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:31 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1269 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:31.525528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:31.526638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:31.579449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.580740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.588224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.590226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.591684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:31.606969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.614887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.622997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09f90793-45ab-42c9-be2a-6bcc5d3ea979 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.452423 Aug 24 03:32:31.628025 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 413/830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:31 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:31.740524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.748168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.750830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.752116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lazy-loading 'fault' on Instance uuid 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:32:31.868894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:31.881686 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ae28831-ec9f-4532-9622-edf17fa4386e tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1312 microversion: 2.1 time: 0.368083 Aug 24 03:32:31.883732 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 418/831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:31 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1312 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:32.082298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:32.083881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:32.099821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.100736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.101766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.103169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.104620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.105735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.194697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:32.195405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:32.207648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.208982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.210243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.213597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.215103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.216236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.483172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:32.488649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:32.524762 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3bb3b532-ef41-45d8-bf8d-813a37d6a5fd tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.337972 Aug 24 03:32:32.535807 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 419/832] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:32 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:32.547753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:32.547753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:32.559685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.559685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.559685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.559685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.560408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.561211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.640130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:32.671213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5414f83e-ffdb-4b01-b038-7c814654b5d7 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.592101 Aug 24 03:32:32.674327 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 414/833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:32 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:32.697661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:32.703349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:32.704051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:32.721903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.722256 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5194c697-8f09-46f8-9cf7-cc4eb365a165 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1275 microversion: 2.1 time: 0.193267 Aug 24 03:32:32.722771 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 420/834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:32 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:32.723606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.725132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.726118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.726741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.727423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.922429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:32.924559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:32.935875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.937061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.938175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.939623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.940580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.941387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.018070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.019098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.019996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.021064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lazy-loading 'fault' on Instance uuid 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:32:33.090749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:33.100660 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a18d23d0-6690-4416-96df-1be095a1df55 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1312 microversion: 2.1 time: 0.184675 Aug 24 03:32:33.101997 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 421/835] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:32 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:33.124253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:33.138974 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b68b94b1-42b0-4920-b77c-1f28cff00065 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.457691 Aug 24 03:32:33.140564 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 415/836] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:32 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:33.577580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:33.597809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:33.649881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.650718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.651580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.659800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.684036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.684982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.705174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:33.706687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:33.741852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.752941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.754129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.757884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.764658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.765329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.025012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:34.053149 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d1843fb-e4cb-480a-b878-7d953d2be287 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.487641 Aug 24 03:32:34.054865 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 422/837] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:33 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:34.087499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:34.088598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:34.100973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.102140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.103126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.104580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.110647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.111951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.449884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:34.486693 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af5689f7-ace5-45d1-8f78-c5379871fadb tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1317 microversion: 2.1 time: 0.429234 Aug 24 03:32:34.502403 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 423/838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:34 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:34.529020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:34.530501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:34.554165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.555490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.555865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.557133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.558001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.569140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.592025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:34.620222 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf63b470-03e7-4488-ad68-7e77ee1c7b45 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1323 microversion: 2.1 time: 0.919042 Aug 24 03:32:34.622647 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 416/839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:33 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1323 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:34.634482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:34.636206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:34.650289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.652171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.661049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.663540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.664799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.665573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.665992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.667142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.668786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.670235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lazy-loading 'fault' on Instance uuid 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:32:34.783394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:34.792101 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74844b19-da0c-4e33-861f-d72efad8f685 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1312 microversion: 2.1 time: 0.289175 Aug 24 03:32:34.805614 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 424/840] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:34 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1312 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:35.050280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-01fb0754-2dce-4f6d-b8bd-92c8928837e4 req-f4e57b8d-e1b4-419d-abb7-df8a021bed60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64e8a33-0915-4e3c-bba8-36eff03e579f", "tag": "115e4cf0-152c-4e1a-b5f1-87899b3f6af1"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:35.073401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-01fb0754-2dce-4f6d-b8bd-92c8928837e4 req-f4e57b8d-e1b4-419d-abb7-df8a021bed60 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.074134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-01fb0754-2dce-4f6d-b8bd-92c8928837e4 req-f4e57b8d-e1b4-419d-abb7-df8a021bed60 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.077111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-01fb0754-2dce-4f6d-b8bd-92c8928837e4 req-f4e57b8d-e1b4-419d-abb7-df8a021bed60 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.109933 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-01fb0754-2dce-4f6d-b8bd-92c8928837e4 req-f4e57b8d-e1b4-419d-abb7-df8a021bed60 service nova] Creating event network-changed:115e4cf0-152c-4e1a-b5f1-87899b3f6af1 for instance f64e8a33-0915-4e3c-bba8-36eff03e579f on n-h2-846470-15 Aug 24 03:32:35.119655 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-01fb0754-2dce-4f6d-b8bd-92c8928837e4 req-f4e57b8d-e1b4-419d-abb7-df8a021bed60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073375 Aug 24 03:32:35.123420 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 425/841] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:35.139151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:35.141599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:35.166146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.169510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.172483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.173556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.179051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.179913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.320486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:35.337897 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b7824da7-fb34-4401-a1e7-cc08cce348bc tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.712163 Aug 24 03:32:35.343086 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 417/842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:34 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:35.531896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:35.533319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:35.551785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.554320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.556144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.561218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.563348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.568329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.772023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:35.802800 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b4988be7-6b39-4073-a8e5-33a754fbb894 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.674662 Aug 24 03:32:35.806326 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 426/843] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:35 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:35.817120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1b81bb4e-a610-43ae-902a-ac42fc477ca3 req-4f823c13-28bc-435c-b9d1-70dedf5b1552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a140ff-ed85-412e-9b12-362f2fad9ffa", "name": "network-vif-plugged", "status": "completed", "tag": "db764fdd-927f-4f53-ab48-48e8691baa73"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:35.841934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1b81bb4e-a610-43ae-902a-ac42fc477ca3 req-4f823c13-28bc-435c-b9d1-70dedf5b1552 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.844059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1b81bb4e-a610-43ae-902a-ac42fc477ca3 req-4f823c13-28bc-435c-b9d1-70dedf5b1552 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.845391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1b81bb4e-a610-43ae-902a-ac42fc477ca3 req-4f823c13-28bc-435c-b9d1-70dedf5b1552 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.884639 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1b81bb4e-a610-43ae-902a-ac42fc477ca3 req-4f823c13-28bc-435c-b9d1-70dedf5b1552 service nova] Creating event network-vif-plugged:db764fdd-927f-4f53-ab48-48e8691baa73 for instance 73a140ff-ed85-412e-9b12-362f2fad9ffa on n-h1-846470-15 Aug 24 03:32:35.914104 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1b81bb4e-a610-43ae-902a-ac42fc477ca3 req-4f823c13-28bc-435c-b9d1-70dedf5b1552 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104152 Aug 24 03:32:35.917583 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 427/844] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:35.940838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:35.941736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:35.973397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.974723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.977367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.982201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.983734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.986522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.238621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:36.250655 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b695c02e-4d60-4cb7-a3a8-2138d1ecfcbe tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1317 microversion: 2.1 time: 0.724920 Aug 24 03:32:36.267729 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 418/845] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:35 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1317 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:36.267729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.268351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:36.284065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.285115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.286842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.289095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.290246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.291077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.518735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:36.546002 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-17c7239f-771d-4b5c-9d48-106606e95692 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 200 len: 1517 microversion: 2.1 time: 0.623761 Aug 24 03:32:36.547639 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 428/846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:35 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 1517 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:36.558649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.560122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:36.575431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.576647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.582179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.585479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.587819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.588764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.717909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.718923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.719540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.720219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lazy-loading 'fault' on Instance uuid 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:32:36.854087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:36.874048 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc940058-b8ee-4d08-b09d-220dc2b6ebc5 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 200 len: 1312 microversion: 2.1 time: 0.617203 Aug 24 03:32:36.875202 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 419/847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:36.885537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'action', calling method: .version_select at 0x7f1031da0550>, body: {"addFloatingIp": {"address": "172.25.4.4"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:36.885537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:36.901065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.902792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.904418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.909070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.910797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.911929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.963781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:36.978149 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5cf0771c-39b6-4f05-8465-7349f53fa82d tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.428638 Aug 24 03:32:36.979742 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 429/848] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:36.989045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.991280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:37.003873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.004543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.005022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.005950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.006419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.006852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.067043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:32:37.067440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquired lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:32:37.248353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:37.264589 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-670f303e-e20c-4fb2-a412-a1eb1e279139 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.282746 Aug 24 03:32:37.279749 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 430/849] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:37.296728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.298060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:37.311406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.312403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.313414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.316856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.317869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.318478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.576676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:37.591747 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a731a43-0a4f-49b3-a732-5b0316a1899a tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1317 microversion: 2.1 time: 0.304734 Aug 24 03:32:37.595743 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 431/850] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:37 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:37.906705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.909598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:37.927566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.929843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.931390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.933839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.936796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.937594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.965175 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] HTTP exception thrown: Instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f could not be found. Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Request method failure captured: Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f HTTP/1.1 Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZuGBVeIoF5aG7RlgQWW0NbV9naRuCuVARMb6hW4L0ljs3upS3YFyPe9xEUv0TcZxd5otOHdFNYflpluvP28H51qx7eSTLz4V1HKKgbNss-ZWk2Zke8Xj2bYyREjyhwCkI2R0EgkZxfGGd2aR70smDd4fi2WURz6of8vme1GZyBjaIE Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 3323592e260f4331b153e917c9dfc2eb Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1541154942 Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3323592e260f4331b153e917c9dfc2eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3323592e260f4331b153e917c9dfc2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3323592e260f4331b153e917c9dfc2eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3323592e260f4331b153e917c9dfc2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1541154942 Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 3323592e260f4331b153e917c9dfc2eb Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1541154942 Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAdminNegativeTestJSON-1541154942-project Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 651d7bd069d841e38c802573feb9f256 Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1541154942-project Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f could not be found. Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f'} Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f could not be found. Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f could not be found. Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:37.967927 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:37.973818 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:37.973818 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:37.973818 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:37.973818 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:37.973818 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:37.973818 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:37.973818 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f could not be found. Aug 24 03:32:37.973818 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:37.975295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Returning 404 to user: Instance 09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:37.976709 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-631cc1dc-0a73-4898-8e1a-8974a8d82934 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f" status: 404 len: 111 microversion: 2.1 time: 0.081318 Aug 24 03:32:37.977483 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 432/851] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:37 2022] GET /compute/v2.1/servers/09c3d35d-20d3-41b6-9fe2-1f3e7f2be34f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:32:37.989631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.990507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:38.001101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.001882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.002555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.003448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.004100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.004710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.043028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:32:38.157967 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7f6d3ac9-e7df-4576-9639-73579122e7fd tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 204 len: 0 microversion: 2.1 time: 0.173048 Aug 24 03:32:38.159272 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 433/852] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:32:37 2022] DELETE /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:32:38.173277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.173277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:38.187046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.187942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.188713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.190895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.191926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.192759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.402455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:38.416985 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a94d157d-48f2-429e-8d26-8847ca34539f tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1395 microversion: 2.1 time: 0.255313 Aug 24 03:32:38.418528 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 434/853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1395 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:38.426788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.427429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:38.444793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.445334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.445774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.446653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.447133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.447563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.648687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:38.666730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-037737f5-d39d-4aae-863a-907be5c6467d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1478 microversion: 2.1 time: 0.246239 Aug 24 03:32:38.667780 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 435/854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1478 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:38.672262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.672881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:38.679713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.680226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.680696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.681408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.681903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.682525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.685877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:38.858976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:38.868490 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e648c388-0728-4ab3-9e1b-514fd709be79 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.199941 Aug 24 03:32:38.869111 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 436/855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:38.890233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.890918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:38.898670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.899179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.900319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.900726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.901246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.901696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.120390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:39.127547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:39.140010 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-346d6dd5-ad15-4c97-9c2d-759007baf39e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1317 microversion: 2.1 time: 0.255064 Aug 24 03:32:39.140709 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 437/856] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:39.452748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:39.453689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:39.455989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:39.464022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:39.464532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:39.464977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.465712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:39.466180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:39.466615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.500706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Building network info cache for instance {{(pid=122535) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:32:39.650548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:39.673053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:39.682361 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a3e26d5-c415-4987-a367-ddc510f69bf4 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1576 microversion: 2.1 time: 0.235606 Aug 24 03:32:39.685870 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 438/857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:39 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:39.692716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-4204f63e-bb39-48a4-86e6-d7480ae312fa req-1e6c6770-2df5-4a78-9e44-3022bd9078d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5", "tag": "182fab05-ee6b-4c54-8428-378902e8857d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:39.705379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4204f63e-bb39-48a4-86e6-d7480ae312fa req-1e6c6770-2df5-4a78-9e44-3022bd9078d7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:39.706026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4204f63e-bb39-48a4-86e6-d7480ae312fa req-1e6c6770-2df5-4a78-9e44-3022bd9078d7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:39.706554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4204f63e-bb39-48a4-86e6-d7480ae312fa req-1e6c6770-2df5-4a78-9e44-3022bd9078d7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.724042 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-4204f63e-bb39-48a4-86e6-d7480ae312fa req-1e6c6770-2df5-4a78-9e44-3022bd9078d7 service nova] Creating event network-changed:182fab05-ee6b-4c54-8428-378902e8857d for instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 on n-h2-846470-15 Aug 24 03:32:39.729879 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-4204f63e-bb39-48a4-86e6-d7480ae312fa req-1e6c6770-2df5-4a78-9e44-3022bd9078d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041436 Aug 24 03:32:39.730945 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 439/858] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:39.737845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-999477283", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "50cf47d0-e40f-45ed-8422-47629120bf74"}], "security_groups": [{"name": "tempest-securitygroup--1391847430"}], "key_name": "tempest-keypair-280229568", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9a731d0b-f214-46e1-ab84-815b3624aca5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:39.913477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] validate_networks() for [('50cf47d0-e40f-45ed-8422-47629120bf74', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:40.577021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Updating instance_info_cache with network_info: [{"id": "182fab05-ee6b-4c54-8428-378902e8857d", "address": "fa:16:3e:93:b9:87", "network": {"id": "a8cadaaf-6888-4107-843d-808010e646f6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-46161511-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "21381ed0f374420b9d483bb3450cee89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap182fab05-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122535) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:32:40.619481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Releasing lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:32:40.621842 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7ce198a4-da40-405c-ac63-bc881d050ce6 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action" status: 202 len: 0 microversion: 2.1 time: 3.745038 Aug 24 03:32:40.631375 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 420/859] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:36 2022] POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action => generated 0 bytes in 3755 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 03:32:40.641848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Getting quotas for project b41af6d40f7d47f68cc866be9672d244. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:40.646412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.648530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:40.653814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Getting quotas for user 00f57e4946f04ad8973c2cd6477e7ddb and project b41af6d40f7d47f68cc866be9672d244. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:40.665282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.666948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:40.668204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:40.669887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.671659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:40.673118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:40.688516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:32:40.689791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:32:40.691209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:32:40.692097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:32:40.693060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:32:40.715422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.719222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:40.720066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:40.721661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.722511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:40.723441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:40.753610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:40.775053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Getting quotas for project b41af6d40f7d47f68cc866be9672d244. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:40.790417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Getting quotas for user 00f57e4946f04ad8973c2cd6477e7ddb and project b41af6d40f7d47f68cc866be9672d244. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:40.917191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:32:40.924860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a731d0b-f214-46e1-ab84-815b3624aca5',volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:32:40.957147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:40.967345 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-35aaa6f0-ccbe-4365-b855-02cc6d630418 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1478 microversion: 2.1 time: 0.333340 Aug 24 03:32:40.968256 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 421/860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1478 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:40.979251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.980623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:40.998929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.999991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.001026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.002233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.003201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.003767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.163290 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2bf33e84-d1ca-4927-9369-7562f77aac43 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192557 Aug 24 03:32:41.175039 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 422/861] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:41.175039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.175039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:41.192339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.192894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.193414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.194215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.194641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.195117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.279197 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0bd134cc-bc0c-4381-ba3c-555907d5bc04 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.544700 Aug 24 03:32:41.284097 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 440/862] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:32:39 2022] POST /compute/v2.1/servers => generated 407 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:32:41.289389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.301540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:41.309399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.309972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.310473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.311353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.311946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.312436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.541039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:41.565062 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44ac749d-fe4e-4fbf-bf26-387547f1e76b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1317 microversion: 2.1 time: 0.279467 Aug 24 03:32:41.579321 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 441/863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:41.579321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'action', calling method: .version_select at 0x7f1031da0550>, body: {"addFloatingIp": {"address": "172.25.4.4"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:41.584081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:41.597543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.598328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.601124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.602218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.603622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.604438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.722449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "refresh_cache-1f439e22-224f-40d9-b312-79a59c672563" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:32:41.723455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquired lock "refresh_cache-1f439e22-224f-40d9-b312-79a59c672563" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:32:41.787620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:41.815559 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-85336c36-7f6f-4420-b850-001492ba72a4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.649795 Aug 24 03:32:41.824886 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 423/864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:41.832015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a9872604-b57b-4ab7-bb89-7fec95e5a525 req-35d3edcd-2bf3-44fb-af52-46ef217d12d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455cb13d-9183-4cac-9f96-22ac9340600d", "name": "network-vif-plugged", "status": "completed", "tag": "01d404f5-80e4-44d7-800d-aff92275c86a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:41.871337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a9872604-b57b-4ab7-bb89-7fec95e5a525 req-35d3edcd-2bf3-44fb-af52-46ef217d12d3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.871958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a9872604-b57b-4ab7-bb89-7fec95e5a525 req-35d3edcd-2bf3-44fb-af52-46ef217d12d3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.872397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a9872604-b57b-4ab7-bb89-7fec95e5a525 req-35d3edcd-2bf3-44fb-af52-46ef217d12d3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.893718 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a9872604-b57b-4ab7-bb89-7fec95e5a525 req-35d3edcd-2bf3-44fb-af52-46ef217d12d3 service nova] Creating event network-vif-plugged:01d404f5-80e4-44d7-800d-aff92275c86a for instance 455cb13d-9183-4cac-9f96-22ac9340600d on n-h1-846470-15 Aug 24 03:32:41.906258 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a9872604-b57b-4ab7-bb89-7fec95e5a525 req-35d3edcd-2bf3-44fb-af52-46ef217d12d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077622 Aug 24 03:32:41.907774 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 424/865] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:41.925135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4fc6acdb-3425-4f77-8f43-53a5a8b8b59a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.927370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4fc6acdb-3425-4f77-8f43-53a5a8b8b59a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:42.158385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4fc6acdb-3425-4f77-8f43-53a5a8b8b59a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:42.182868 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4fc6acdb-3425-4f77-8f43-53a5a8b8b59a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1120 microversion: 2.1 time: 0.271774 Aug 24 03:32:42.183934 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 425/866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1120 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:42.195315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:42.196843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:42.210316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:42.211173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:42.212880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:42.215389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:42.216783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:42.220818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:42.835156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:42.844858 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fb41ca24-0d0e-4eae-875c-27b1389ade3d tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1478 microversion: 2.1 time: 0.659025 Aug 24 03:32:42.856257 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 426/867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:42 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1478 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:42.865524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:42.866676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:42.873944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:42.874889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:42.875521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:42.876687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:42.877392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:42.877998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:43.573537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:43.605662 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0001fa01-53d9-43fe-9eb9-7c0a8299a203 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1317 microversion: 2.1 time: 0.748038 Aug 24 03:32:43.616023 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 427/868] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:42 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:43.626513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:43.634423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:43.650626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:43.653097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:43.654528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:43.656570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:43.657873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:43.659871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.149455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:44.168435 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6cfab132-b528-49ee-b946-a97595ab9adc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1367 microversion: 2.1 time: 0.556716 Aug 24 03:32:44.168435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 428/869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:43 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:44.194987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:44.195619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:44.202291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.202793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.210961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.213296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.214886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.215999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.311791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:44.381242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:44.400822 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-662ecf8e-b51e-4443-8c2c-e692574ba626 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1236 microversion: 2.1 time: 0.232789 Aug 24 03:32:44.401427 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 429/870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:44 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1236 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:44.406637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:44.407268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:44.433196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.433994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.434629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.435559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.436377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.437158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.584529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651d7bd069d841e38c802573feb9f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3323592e260f4331b153e917c9dfc2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:44.597338 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-357d85d7-118d-48b2-9f58-8982c2d57a0f tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 200 len: 1307 microversion: 2.1 time: 0.194771 Aug 24 03:32:44.605823 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 430/871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:44 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:44.605823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9701049f-d271-4918-816f-ec75e77b8d28 req-002ec376-765f-49d4-ba5c-9c73da7e2763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64e8a33-0915-4e3c-bba8-36eff03e579f", "name": "network-vif-plugged", "status": "completed", "tag": "115e4cf0-152c-4e1a-b5f1-87899b3f6af1"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:44.634515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9701049f-d271-4918-816f-ec75e77b8d28 req-002ec376-765f-49d4-ba5c-9c73da7e2763 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.635050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9701049f-d271-4918-816f-ec75e77b8d28 req-002ec376-765f-49d4-ba5c-9c73da7e2763 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.637061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9701049f-d271-4918-816f-ec75e77b8d28 req-002ec376-765f-49d4-ba5c-9c73da7e2763 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.669798 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9701049f-d271-4918-816f-ec75e77b8d28 req-002ec376-765f-49d4-ba5c-9c73da7e2763 service nova] Creating event network-vif-plugged:115e4cf0-152c-4e1a-b5f1-87899b3f6af1 for instance f64e8a33-0915-4e3c-bba8-36eff03e579f on n-h2-846470-15 Aug 24 03:32:44.679362 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9701049f-d271-4918-816f-ec75e77b8d28 req-002ec376-765f-49d4-ba5c-9c73da7e2763 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078654 Aug 24 03:32:44.680490 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 431/872] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:44.689009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-03769d32-09be-4d49-a562-d9d107c89d66 req-93892db5-6492-44ff-a7bb-56ddd273db9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dfd497-923f-42d0-a333-546f43070749", "name": "network-vif-deleted", "tag": "18f10c19-0d70-49da-9fe9-b382568d4a09"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:44.717048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-03769d32-09be-4d49-a562-d9d107c89d66 req-93892db5-6492-44ff-a7bb-56ddd273db9c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.717048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-03769d32-09be-4d49-a562-d9d107c89d66 req-93892db5-6492-44ff-a7bb-56ddd273db9c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.717048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-03769d32-09be-4d49-a562-d9d107c89d66 req-93892db5-6492-44ff-a7bb-56ddd273db9c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.742517 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-03769d32-09be-4d49-a562-d9d107c89d66 req-93892db5-6492-44ff-a7bb-56ddd273db9c service nova] Creating event network-vif-deleted:18f10c19-0d70-49da-9fe9-b382568d4a09 for instance e4dfd497-923f-42d0-a333-546f43070749 on n-h2-846470-15 Aug 24 03:32:44.755735 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-03769d32-09be-4d49-a562-d9d107c89d66 req-93892db5-6492-44ff-a7bb-56ddd273db9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073967 Aug 24 03:32:44.759467 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 432/873] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:44.765671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:44.766401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:44.798500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.799018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.799469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.800249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.800718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.801152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:45.752517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:45.776354 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e73a1bb6-3230-4377-b51b-81f127855544 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1576 microversion: 2.1 time: 1.015005 Aug 24 03:32:45.777428 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 433/874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:44 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1576 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:45.795030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-87dd2c1f-0247-4762-bcfc-f2bd0f42d65a req-defd2d0e-02bd-45b1-b31a-087861216985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a140ff-ed85-412e-9b12-362f2fad9ffa", "tag": "db764fdd-927f-4f53-ab48-48e8691baa73"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:45.833777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-87dd2c1f-0247-4762-bcfc-f2bd0f42d65a req-defd2d0e-02bd-45b1-b31a-087861216985 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:45.834619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-87dd2c1f-0247-4762-bcfc-f2bd0f42d65a req-defd2d0e-02bd-45b1-b31a-087861216985 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:45.843943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-87dd2c1f-0247-4762-bcfc-f2bd0f42d65a req-defd2d0e-02bd-45b1-b31a-087861216985 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:45.893135 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-87dd2c1f-0247-4762-bcfc-f2bd0f42d65a req-defd2d0e-02bd-45b1-b31a-087861216985 service nova] Creating event network-changed:db764fdd-927f-4f53-ab48-48e8691baa73 for instance 73a140ff-ed85-412e-9b12-362f2fad9ffa on n-h1-846470-15 Aug 24 03:32:45.923000 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-87dd2c1f-0247-4762-bcfc-f2bd0f42d65a req-defd2d0e-02bd-45b1-b31a-087861216985 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143313 Aug 24 03:32:45.924851 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 434/875] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:45.934832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:45.938899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:45.955024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:45.956541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:45.957630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:45.959268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:45.960468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:45.961534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:46.968648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:46.992054 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cca84e06-8cfa-450a-92ee-03d752ba7182 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1317 microversion: 2.1 time: 1.064537 Aug 24 03:32:46.999315 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 435/876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:45 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1317 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:47.045281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:47.046674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:47.065211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:47.070982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:47.071925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:47.072971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:47.073743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:47.074425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:48.057636 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.network.neutron [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] re-assign floating IP 172.25.4.4 from instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 Aug 24 03:32:48.106407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:48.132029 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2235517b-251e-452c-9df4-0d73a5129558 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1557 microversion: 2.1 time: 1.098130 Aug 24 03:32:48.152580 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 436/877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:47 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1557 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:48.173762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:48.175437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:48.198786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:48.200342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:48.204653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:48.206554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:48.215465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:48.217415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:48.297701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:32:49.084499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:49.101299 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58b75c22-4c8f-4875-a724-92c414c18a76 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1304 microversion: 2.1 time: 0.946452 Aug 24 03:32:49.102659 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 437/878] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:48 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1304 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:49.111567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:49.113800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] [instance: e4dfd497-923f-42d0-a333-546f43070749] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:49.125921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:49.126773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:49.127518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:49.128766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:49.129845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:49.130583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:49.179086 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] HTTP exception thrown: Instance e4dfd497-923f-42d0-a333-546f43070749 could not be found. Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Request method failure captured: Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 HTTP/1.1 Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuGBVeIoF5aG7RlgQWW0NbV9naRuCuVARMb6hW4L0ljs3upS3YFyPe9xEUv0TcZxd5otOHdFNYflpluvP28H51qx7eSTLz4V1HKKgbNss-ZWk2Zke8Xj2bYyREjyhwCkI2R0EgkZxfGGd2aR70smDd4fi2WURz6of8vme1GZyBjaIE Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 3323592e260f4331b153e917c9dfc2eb Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1541154942 Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3323592e260f4331b153e917c9dfc2eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3323592e260f4331b153e917c9dfc2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3323592e260f4331b153e917c9dfc2eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3323592e260f4331b153e917c9dfc2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1541154942 Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 3323592e260f4331b153e917c9dfc2eb Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1541154942 Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersAdminNegativeTestJSON-1541154942-project Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 651d7bd069d841e38c802573feb9f256 Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1541154942-project Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e4dfd497-923f-42d0-a333-546f43070749 could not be found. Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e4dfd497-923f-42d0-a333-546f43070749'} Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4dfd497-923f-42d0-a333-546f43070749 could not be found. Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4dfd497-923f-42d0-a333-546f43070749 could not be found. Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:49.182608 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:49.191028 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:49.191028 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:49.191028 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:49.191028 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:49.191028 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:49.191028 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:49.191028 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4dfd497-923f-42d0-a333-546f43070749 could not be found. Aug 24 03:32:49.191028 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:49.193803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] Returning 404 to user: Instance e4dfd497-923f-42d0-a333-546f43070749 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:49.195814 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b5a5db6-8da7-4ba4-bb97-596b25e0b080 tempest-ServersAdminNegativeTestJSON-1541154942 tempest-ServersAdminNegativeTestJSON-1541154942-project] 10.222.0.58 "GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749" status: 404 len: 111 microversion: 2.1 time: 0.091087 Aug 24 03:32:49.197534 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 438/879] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:49 2022] GET /compute/v2.1/servers/e4dfd497-923f-42d0-a333-546f43070749 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:32:49.217980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6be5d2f9-22ba-4735-b4f2-fb750810b531 req-adbf7339-5dbd-4e50-a77d-48a48490dce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5", "tag": "182fab05-ee6b-4c54-8428-378902e8857d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:49.254200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6be5d2f9-22ba-4735-b4f2-fb750810b531 req-adbf7339-5dbd-4e50-a77d-48a48490dce2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:49.255443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6be5d2f9-22ba-4735-b4f2-fb750810b531 req-adbf7339-5dbd-4e50-a77d-48a48490dce2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:49.256538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6be5d2f9-22ba-4735-b4f2-fb750810b531 req-adbf7339-5dbd-4e50-a77d-48a48490dce2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:49.298950 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6be5d2f9-22ba-4735-b4f2-fb750810b531 req-adbf7339-5dbd-4e50-a77d-48a48490dce2 service nova] Creating event network-changed:182fab05-ee6b-4c54-8428-378902e8857d for instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 on n-h2-846470-15 Aug 24 03:32:49.311892 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6be5d2f9-22ba-4735-b4f2-fb750810b531 req-adbf7339-5dbd-4e50-a77d-48a48490dce2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111775 Aug 24 03:32:49.319850 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 439/880] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:49.352553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:49.355358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:49.368923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:49.370206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:49.371255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:49.372778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:49.373855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:49.374826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:49.816633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Updating instance_info_cache with network_info: [{"id": "182fab05-ee6b-4c54-8428-378902e8857d", "address": "fa:16:3e:93:b9:87", "network": {"id": "a8cadaaf-6888-4107-843d-808010e646f6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-46161511-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "21381ed0f374420b9d483bb3450cee89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap182fab05-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:32:49.893507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:32:49.920485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:49.965738 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2e86551e-d3df-4fab-93a0-60b0c35454ac tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1466 microversion: 2.1 time: 0.643616 Aug 24 03:32:49.976218 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 440/881] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:49 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1466 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:50.001009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:50.002486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:50.015947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:50.023028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:50.024273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:50.027777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:50.041389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:50.043143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:50.439552 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d32f2cc5-acfe-4ec8-bdf4-248b47214295 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.461096 Aug 24 03:32:50.446600 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 441/882] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:32:49 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-interface => generated 284 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:50.478750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:50.482670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:50.496647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:50.497488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:50.498121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:50.499610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:50.500363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:50.501131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:50.756557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:50.812904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=10 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:51.255829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Updating instance_info_cache with network_info: [{"id": "b566b56d-990c-4ceb-9f5f-3c9273bc1e92", "address": "fa:16:3e:37:c5:41", "network": {"id": "a8cadaaf-6888-4107-843d-808010e646f6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-46161511-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "21381ed0f374420b9d483bb3450cee89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb566b56d-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:32:51.307206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Releasing lock "refresh_cache-1f439e22-224f-40d9-b312-79a59c672563" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:32:51.307811 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cf275029-94ac-474c-bcb1-11c4b617fa11 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563/action" status: 202 len: 0 microversion: 2.1 time: 9.739776 Aug 24 03:32:51.308505 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 442/883] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:41 2022] POST /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563/action => generated 0 bytes in 9742 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 03:32:51.322246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:51.323094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:51.342267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:51.357325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:51.358540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:51.361160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:51.361385 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eaa48fc5-a582-488c-abc5-ca8867fc190a tempest-ServersOnMultiNodesTest-1070971030 tempest-ServersOnMultiNodesTest-1070971030-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1619 microversion: 2.1 time: 0.904300 Aug 24 03:32:51.363109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:51.364152 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 442/884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:50 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1619 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:51.373363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-49544350-a2b5-4c76-9563-f864f4616318 req-fa1fca48-2d2c-4e46-8d63-d0f544c72289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b400f037-8a8c-41a0-9c86-0827aef143cf", "tag": "c4ac14fd-0855-4c88-a576-dc68a2cd8b95"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:51.392272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-49544350-a2b5-4c76-9563-f864f4616318 req-fa1fca48-2d2c-4e46-8d63-d0f544c72289 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:51.393258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:51.403500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-49544350-a2b5-4c76-9563-f864f4616318 req-fa1fca48-2d2c-4e46-8d63-d0f544c72289 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:51.404882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-49544350-a2b5-4c76-9563-f864f4616318 req-fa1fca48-2d2c-4e46-8d63-d0f544c72289 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:51.444089 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-49544350-a2b5-4c76-9563-f864f4616318 req-fa1fca48-2d2c-4e46-8d63-d0f544c72289 service nova] Creating event network-changed:c4ac14fd-0855-4c88-a576-dc68a2cd8b95 for instance b400f037-8a8c-41a0-9c86-0827aef143cf on n-h2-846470-15 Aug 24 03:32:51.449968 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-49544350-a2b5-4c76-9563-f864f4616318 req-fa1fca48-2d2c-4e46-8d63-d0f544c72289 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083616 Aug 24 03:32:51.451397 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 443/885] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:51.458891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'action', calling method: .version_select at 0x7f1031da0af0>, body: {"removeFloatingIp": {"address": "172.25.4.4"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:51.840512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:51.862056 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2bee1b53-3d46-4f32-b5b5-6a446bb0a0f0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1304 microversion: 2.1 time: 0.552048 Aug 24 03:32:51.879255 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 443/886] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:51 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1304 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:51.890512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c3e9a21c-96b6-4f82-92f3-9697bb757d75 req-e5f0ef2b-9344-41df-804b-a4dfe8c2346e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f439e22-224f-40d9-b312-79a59c672563", "tag": "b566b56d-990c-4ceb-9f5f-3c9273bc1e92"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:51.903408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c3e9a21c-96b6-4f82-92f3-9697bb757d75 req-e5f0ef2b-9344-41df-804b-a4dfe8c2346e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:51.903982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c3e9a21c-96b6-4f82-92f3-9697bb757d75 req-e5f0ef2b-9344-41df-804b-a4dfe8c2346e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:51.904620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c3e9a21c-96b6-4f82-92f3-9697bb757d75 req-e5f0ef2b-9344-41df-804b-a4dfe8c2346e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:51.922765 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c3e9a21c-96b6-4f82-92f3-9697bb757d75 req-e5f0ef2b-9344-41df-804b-a4dfe8c2346e service nova] Creating event network-changed:b566b56d-990c-4ceb-9f5f-3c9273bc1e92 for instance 1f439e22-224f-40d9-b312-79a59c672563 on n-h1-846470-15 Aug 24 03:32:51.931773 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c3e9a21c-96b6-4f82-92f3-9697bb757d75 req-e5f0ef2b-9344-41df-804b-a4dfe8c2346e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050711 Aug 24 03:32:51.933833 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 444/887] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:51.941387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:51.942005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:51.954799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:51.956821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:51.958728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:51.960260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:51.961102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:51.962426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:52.022211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:32:52.149169 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-38eda9b9-ec17-4322-8768-cd9cb9fda2e5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 204 len: 0 microversion: 2.1 time: 0.212844 Aug 24 03:32:52.150557 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 445/888] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:32:51 2022] DELETE /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:32:52.165998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:52.167517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:52.171546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:52.182481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:52.183316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:52.184114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:52.186950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:52.188165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:52.188942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:52.383572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:52.410440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:52.412214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:52.417650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:52.421217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:52.422999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:52.424500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:52.543959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:52.590063 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-432d2929-1e6a-4cb1-876f-13d28f4840b1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1472 microversion: 2.1 time: 0.431588 Aug 24 03:32:52.594076 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 446/889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:52 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:52.898281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:52.899888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:52.917102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:52.918287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:52.919816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:52.922003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:52.923330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:52.924312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:53.238318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:53.254456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a1ab0d53-efc5-4009-b331-7ab4dd1a64eb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1304 microversion: 2.1 time: 0.366884 Aug 24 03:32:53.263807 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] HTTP exception thrown: Floating IP 172.25.4.4 is not associated with instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5. Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Request method failure captured: Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action HTTP/1.1 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 47 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuR2Du9xn-hhK9gV6lz3r5eINObg34UjSzqL1FgtihJILx15qE_2QLwRGhYQS5OvyDz75p7kbc7uYiUFSBcybmTgJ_5gOTUgTLgWGMgN6mJT7btzub0GLADoyMZ_zAzTAjF9ZiVsGFYOqvdaM0bwzlWKbMOmBAJmDWk9I5uWSABMHk Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 21381ed0f374420b9d483bb3450cee89 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_21381ed0f374420b9d483bb3450cee89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 21381ed0f374420b9d483bb3450cee89 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPsAssociationTestJSON-13639284-project Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6ec6f56b6ea1404f9e961409fe530563 Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-13639284-project Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: {"removeFloatingIp": {"address": "172.25.4.4"}} Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: exception: Floating IP 172.25.4.4 is not associated with instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5. Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5', 'body': {'removeFloatingIp': {'address': '172.25.4.4'}}} Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.4 is not associated with instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5. Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.4 is not associated with instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5. Aug 24 03:32:53.266329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:53.276758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Returning 409 to user: Floating IP 172.25.4.4 is not associated with instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:53.279484 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 447/890] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:52 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1304 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:53.281311 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a7cfb6c-9020-45a1-8c6a-5be1847b4cad tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action" status: 409 len: 144 microversion: 2.1 time: 1.826181 Aug 24 03:32:53.283551 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 444/891] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:51 2022] POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action => generated 144 bytes in 1831 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:32:53.301055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'action', calling method: .version_select at 0x7f1031da0af0>, body: {"removeFloatingIp": {"address": "172.25.4.4"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:53.624929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:53.629750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:53.633280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:53.644907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:53.646282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:53.647043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:53.648519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:53.649483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:53.650136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:53.662503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:53.663540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:53.664416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:53.667981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:53.668889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:53.672665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:54.063427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "refresh_cache-1f439e22-224f-40d9-b312-79a59c672563" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:32:54.064215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquired lock "refresh_cache-1f439e22-224f-40d9-b312-79a59c672563" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:32:54.462292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:54.471140 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-abac7f01-61b6-46b7-8e9f-b83a34efdfc4 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1472 microversion: 2.1 time: 0.849619 Aug 24 03:32:54.480511 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 445/892] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:53 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1472 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:54.491168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:54.491168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:54.511878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:54.512630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:54.513114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:54.513894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:54.514384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:54.515635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:55.226282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:55.236796 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8273109d-dbfe-4c51-a32d-19706a6afb0a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1304 microversion: 2.1 time: 0.754948 Aug 24 03:32:55.238169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 446/893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:54 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1304 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:55.299144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:32:55.309075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0144598f-162a-4719-af82-f2e1ed84b8fa req-4f9059cb-9e07-42e7-84de-b94eadf4c043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f439e22-224f-40d9-b312-79a59c672563", "tag": "b566b56d-990c-4ceb-9f5f-3c9273bc1e92"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:55.327931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0144598f-162a-4719-af82-f2e1ed84b8fa req-4f9059cb-9e07-42e7-84de-b94eadf4c043 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:55.328865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0144598f-162a-4719-af82-f2e1ed84b8fa req-4f9059cb-9e07-42e7-84de-b94eadf4c043 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:55.331289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0144598f-162a-4719-af82-f2e1ed84b8fa req-4f9059cb-9e07-42e7-84de-b94eadf4c043 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:55.355878 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0144598f-162a-4719-af82-f2e1ed84b8fa req-4f9059cb-9e07-42e7-84de-b94eadf4c043 service nova] Creating event network-changed:b566b56d-990c-4ceb-9f5f-3c9273bc1e92 for instance 1f439e22-224f-40d9-b312-79a59c672563 on n-h1-846470-15 Aug 24 03:32:55.362803 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0144598f-162a-4719-af82-f2e1ed84b8fa req-4f9059cb-9e07-42e7-84de-b94eadf4c043 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058461 Aug 24 03:32:55.365029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 447/894] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:55.560357 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6082ab25-6429-49d5-bf7e-abf5e5081a56 tempest-TenantUsagesNegativeTestJSON-238895692 tempest-TenantUsagesNegativeTestJSON-238895692-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-23T03%3A32%3A55.347605&end=2022-08-25T03%3A32%3A55.347605" status: 404 len: 112 microversion: - time: 0.193370 Aug 24 03:32:55.566589 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 448/895] 10.222.0.58 () {58 vars in 1316 bytes} [Wed Aug 24 03:32:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-23T03%3A32%3A55.347605&end=2022-08-25T03%3A32%3A55.347605 => generated 112 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:32:55.577993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:55.579457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:55.591963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:55.592554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:55.593006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:55.593759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:55.598246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:55.598739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.285336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Updating instance_info_cache with network_info: [{"id": "b566b56d-990c-4ceb-9f5f-3c9273bc1e92", "address": "fa:16:3e:37:c5:41", "network": {"id": "a8cadaaf-6888-4107-843d-808010e646f6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-46161511-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "21381ed0f374420b9d483bb3450cee89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb566b56d-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:32:56.321091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Releasing lock "refresh_cache-1f439e22-224f-40d9-b312-79a59c672563" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:32:56.325549 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dabe4019-f713-4be4-8591-7eb8c3453736 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563/action" status: 202 len: 0 microversion: 2.1 time: 3.033933 Aug 24 03:32:56.327728 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 448/896] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:53 2022] POST /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563/action => generated 0 bytes in 3038 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 03:32:56.345473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae408418-5ee9-48db-9b7f-5959e785f21a tempest-TenantUsagesNegativeTestJSON-238895692 tempest-TenantUsagesNegativeTestJSON-238895692-project-admin] Calling method '.version_select at 0x7f1023233ca0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:56.359002 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ae408418-5ee9-48db-9b7f-5959e785f21a tempest-TenantUsagesNegativeTestJSON-238895692 tempest-TenantUsagesNegativeTestJSON-238895692-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae408418-5ee9-48db-9b7f-5959e785f21a tempest-TenantUsagesNegativeTestJSON-238895692 tempest-TenantUsagesNegativeTestJSON-238895692-project-admin] Request method failure captured: Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-simple-tenant-usage/5045bcbd68984ebba0a4d007704db73a?start=2022-08-25T03%3A32%3A55.347605&end=2022-08-23T03%3A32%3A55.347605 HTTP/1.1 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZvnB0EYzOAeVPu-8tjoLxMtq3vr9U5lfGECuW1ku3KaH1E8vYbQlINBUWzGBM6SdV7fpp46ti8OKIAXegovAhwPjinz4ayL80MqqXAnre2GuKdZdft0ZaDun1_xQgSqyQaPUkPo6lpQJ9uKJGeTE9wnfKU6rfwbFOWP3uZcKqMD4-8 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ad035bb8b9144c058f7c156cb975d86e Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-238895692 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ad035bb8b9144c058f7c156cb975d86e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ad035bb8b9144c058f7c156cb975d86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad035bb8b9144c058f7c156cb975d86e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ad035bb8b9144c058f7c156cb975d86e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-238895692 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ad035bb8b9144c058f7c156cb975d86e Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-238895692 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TenantUsagesNegativeTestJSON-238895692-project-admin Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6f6fb5574874416886e66073971b7788 Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-238895692-project-admin Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid start time. The start time cannot occur after the end time. Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5045bcbd68984ebba0a4d007704db73a'} Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 24 03:32:56.364288 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:32:56.376034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae408418-5ee9-48db-9b7f-5959e785f21a tempest-TenantUsagesNegativeTestJSON-238895692 tempest-TenantUsagesNegativeTestJSON-238895692-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:56.378055 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae408418-5ee9-48db-9b7f-5959e785f21a tempest-TenantUsagesNegativeTestJSON-238895692 tempest-TenantUsagesNegativeTestJSON-238895692-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/5045bcbd68984ebba0a4d007704db73a?start=2022-08-25T03%3A32%3A55.347605&end=2022-08-23T03%3A32%3A55.347605" status: 400 len: 111 microversion: 2.1 time: 0.044459 Aug 24 03:32:56.379911 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 449/897] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Aug 24 03:32:56 2022] GET /compute/v2.1/os-simple-tenant-usage/5045bcbd68984ebba0a4d007704db73a?start=2022-08-25T03%3A32%3A55.347605&end=2022-08-23T03%3A32%3A55.347605 => generated 111 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:32:56.396118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7d304dc5-2bbb-48c6-a3f8-cb6372794b55 req-da5910e8-8102-40ce-becb-81ecbcb8e9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455cb13d-9183-4cac-9f96-22ac9340600d", "tag": "01d404f5-80e4-44d7-800d-aff92275c86a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:56.420090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d304dc5-2bbb-48c6-a3f8-cb6372794b55 req-da5910e8-8102-40ce-becb-81ecbcb8e9c0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.422651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d304dc5-2bbb-48c6-a3f8-cb6372794b55 req-da5910e8-8102-40ce-becb-81ecbcb8e9c0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.423924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d304dc5-2bbb-48c6-a3f8-cb6372794b55 req-da5910e8-8102-40ce-becb-81ecbcb8e9c0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.452155 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7d304dc5-2bbb-48c6-a3f8-cb6372794b55 req-da5910e8-8102-40ce-becb-81ecbcb8e9c0 service nova] Creating event network-changed:01d404f5-80e4-44d7-800d-aff92275c86a for instance 455cb13d-9183-4cac-9f96-22ac9340600d on n-h1-846470-15 Aug 24 03:32:56.460210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:56.465047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7d304dc5-2bbb-48c6-a3f8-cb6372794b55 req-da5910e8-8102-40ce-becb-81ecbcb8e9c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082676 Aug 24 03:32:56.470157 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 450/898] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:56.474064 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3422e8e8-aa46-4a99-85b9-03c1b87c7a3d tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1472 microversion: 2.1 time: 0.905747 Aug 24 03:32:56.481469 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 449/899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:55 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1472 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:56.484740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:56.487607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:56.492674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:56.493264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:56.505355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.506902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.508324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.510550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.511845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.512868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.516008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.516964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.517615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.518557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.519231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.519873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.594317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:56.598817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:32:56.732374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:56.801148 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e7179026-9af1-480c-80d1-0390e65a3893 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 204 len: 0 microversion: 2.1 time: 0.317362 Aug 24 03:32:56.806150 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 450/900] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:32:56 2022] DELETE /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:32:57.002764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:57.019930 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d74836fe-00c1-4230-8f66-8b8b83b947e6 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.546691 Aug 24 03:32:57.023466 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 451/901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:56 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:57.035316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.4"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:57.039815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:57.052213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:57.053715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:57.054745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:57.056581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:57.057763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:57.058839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:57.070455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6b739f3-b230-433a-8cc8-d71d52244290 tempest-TenantUsagesNegativeTestJSON-750883728 tempest-TenantUsagesNegativeTestJSON-750883728-project] Calling method '.version_select at 0x7f102b3b8160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:57.074805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6b739f3-b230-433a-8cc8-d71d52244290 tempest-TenantUsagesNegativeTestJSON-750883728 tempest-TenantUsagesNegativeTestJSON-750883728-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'a018f66a100a40329e4e843ed8e9d31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5045bcbd68984ebba0a4d007704db73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6b739f3-b230-433a-8cc8-d71d52244290 tempest-TenantUsagesNegativeTestJSON-750883728 tempest-TenantUsagesNegativeTestJSON-750883728-project] Request method failure captured: Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T03%3A32%3A55.347605&end=2022-08-25T03%3A32%3A55.347605&detailed=1 HTTP/1.1 Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZvl82Ta8yGFPA2tmYRQI83sMnqfaWb6KcB0YjUGL26bxwbqgoBLXVpKRmF5REU3xqwVi9Evg7W2-ELSkJ31A-m5D3WaTiiCHJLNxRRZxXqxsTTeZVFmVJ2FnsTzbzSWVg4mviFEZq7bo_8kfQwFaNiV0EvxHFkNzgDSoylN3TZ2rJk Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 5045bcbd68984ebba0a4d007704db73a Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-750883728 Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5045bcbd68984ebba0a4d007704db73a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5045bcbd68984ebba0a4d007704db73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5045bcbd68984ebba0a4d007704db73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5045bcbd68984ebba0a4d007704db73a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-750883728 Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 5045bcbd68984ebba0a4d007704db73a Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-750883728 Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TenantUsagesNegativeTestJSON-750883728-project Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: a018f66a100a40329e4e843ed8e9d31e Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-750883728-project Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: action_args: {} Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:32:57.080641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 03:32:57.084910 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:57.094474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6b739f3-b230-433a-8cc8-d71d52244290 tempest-TenantUsagesNegativeTestJSON-750883728 tempest-TenantUsagesNegativeTestJSON-750883728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:57.096478 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6b739f3-b230-433a-8cc8-d71d52244290 tempest-TenantUsagesNegativeTestJSON-750883728 tempest-TenantUsagesNegativeTestJSON-750883728-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T03%3A32%3A55.347605&end=2022-08-25T03%3A32%3A55.347605&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.288810 Aug 24 03:32:57.099529 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 451/902] 10.222.0.58 () {58 vars in 1335 bytes} [Wed Aug 24 03:32:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T03%3A32%3A55.347605&end=2022-08-25T03%3A32%3A55.347605&detailed=1 => generated 123 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:32:57.192187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:32:57.195617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquired lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:32:57.503503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:57.510179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:57.536282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:57.544673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:57.548956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:57.549859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:57.556693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:57.560110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:57.562463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:57.689526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:57.690360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:57.691450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:57.693127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid f64e8a33-0915-4e3c-bba8-36eff03e579f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:32:57.790731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:57.806379 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-483185e7-c173-442a-8ad8-e98ea2fba100 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 200 len: 1307 microversion: 2.1 time: 0.312986 Aug 24 03:32:57.807613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 452/903] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:57 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:58.049835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:58.054302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:58.077022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.082835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.083624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.084981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.085790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.086539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.661383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:58.676026 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e1ed6489-d3a4-4f06-bbf4-4a6c27dd19da tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.634253 Aug 24 03:32:58.677499 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 453/904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:58 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:58.686660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:58.687491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:58.697595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.700757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.702021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.703341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.704062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.704801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.735387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:32:58.854630 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-983a9d7a-c139-4ff4-bd85-9684b1a95304 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 204 len: 0 microversion: 2.1 time: 0.173762 Aug 24 03:32:58.857512 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 454/905] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:32:58 2022] DELETE /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:32:58.879285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-051e91af-76b2-4471-8438-2d64e123fe71 req-9a3e58af-9c50-476a-bb2b-37501b4d6368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64e8a33-0915-4e3c-bba8-36eff03e579f", "name": "network-vif-deleted", "tag": "115e4cf0-152c-4e1a-b5f1-87899b3f6af1"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:58.899136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-051e91af-76b2-4471-8438-2d64e123fe71 req-9a3e58af-9c50-476a-bb2b-37501b4d6368 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.899136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-051e91af-76b2-4471-8438-2d64e123fe71 req-9a3e58af-9c50-476a-bb2b-37501b4d6368 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.899136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-051e91af-76b2-4471-8438-2d64e123fe71 req-9a3e58af-9c50-476a-bb2b-37501b4d6368 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.912713 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-051e91af-76b2-4471-8438-2d64e123fe71 req-9a3e58af-9c50-476a-bb2b-37501b4d6368 service nova] Creating event network-vif-deleted:115e4cf0-152c-4e1a-b5f1-87899b3f6af1 for instance f64e8a33-0915-4e3c-bba8-36eff03e579f on n-h2-846470-15 Aug 24 03:32:58.918135 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-051e91af-76b2-4471-8438-2d64e123fe71 req-9a3e58af-9c50-476a-bb2b-37501b4d6368 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057815 Aug 24 03:32:58.919056 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 455/906] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:58.925055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:58.925762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f64e8a33-0915-4e3c-bba8-36eff03e579f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:58.934589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.934589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.934981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.935604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.936320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.936933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.956558 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] HTTP exception thrown: Instance f64e8a33-0915-4e3c-bba8-36eff03e579f could not be found. Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Request method failure captured: Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f HTTP/1.1 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs9a3PSnWyPM4oxrtpOmhych2UNWusgJa-lwsewb0ma_NpTMELj20KNj5HVpRSejYJ11CDsiWDzARm7j_w9WmCaSk_xKrJeWjGSrra45x2OmDkhWDZoiNgbPGlgAVyB6FoU5vlzXl1ibHQi3SLCOMdp4YcaLkCFcOhA8hHy77yiz2s Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d347f85e59734622a091e80dbf0d9521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 906d6efeea2b4af59b76fae3e3531d7b Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance f64e8a33-0915-4e3c-bba8-36eff03e579f could not be found. Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'f64e8a33-0915-4e3c-bba8-36eff03e579f'} Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64e8a33-0915-4e3c-bba8-36eff03e579f could not be found. Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64e8a33-0915-4e3c-bba8-36eff03e579f could not be found. Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:58.958875 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64e8a33-0915-4e3c-bba8-36eff03e579f could not be found. Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Returning 404 to user: Instance f64e8a33-0915-4e3c-bba8-36eff03e579f could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d5b40fd4-3a00-4e95-9eb6-f1bb7571e1f5 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f" status: 404 len: 111 microversion: 2.1 time: 0.041200 Aug 24 03:32:58.969524 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 456/907] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:58 2022] GET /compute/v2.1/servers/f64e8a33-0915-4e3c-bba8-36eff03e579f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:32:58.975458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:58.976889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:58.984910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.985569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.986122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.987019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:58.987656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:58.989715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:59.087230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:32:59.245426 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8bf5096-38ce-4dbf-878e-53234877f268 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 204 len: 0 microversion: 2.1 time: 0.275658 Aug 24 03:32:59.248302 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 457/908] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:32:58 2022] DELETE /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:32:59.260260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1276634990", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "400945594", "adminPass": "***", "networks": [{"uuid": "b4290256-1ad8-4c5b-b78c-eaa28264c1e8"}], "security_groups": [{"name": "tempest-securitygroup--1654990478"}], "key_name": "tempest-keypair-1091403419", "user_data": "}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:59.421893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] validate_networks() for [('b4290256-1ad8-4c5b-b78c-eaa28264c1e8', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:59.896556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:33:00.085907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:33:00.087113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:33:00.087628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:33:00.088192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:33:00.089710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:33:00.111511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:00.114697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:00.115233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:00.116321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:00.117383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:00.118172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:00.141880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Getting quotas for project 808a68a19ba646a29463d4cba0379351. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:00.153370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Getting quotas for user 842bb125a58946649e7a150e35eca5bb and project 808a68a19ba646a29463d4cba0379351. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:00.190605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:33:00.196184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:33:00.313167 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0e416e3a-5fab-4546-9c31-31454271ce4e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.060096 Aug 24 03:33:00.315597 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 458/909] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:32:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:33:00.334107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:00.335978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:00.351607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:00.352177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:00.352627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:00.353377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:00.354589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:00.354589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:00.630491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:00.646316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2eb5e122-a72d-412c-b1e0-3459ed098d30 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1471 microversion: 2.1 time: 0.328323 Aug 24 03:33:00.647926 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 459/910] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:00 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:00.653571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:00.654263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:00.663697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:00.664340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:00.664866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:00.665682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:00.666246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:00.666752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:01.039625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:01.054381 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-531bbb29-655d-4a97-877b-a1dbfeea48b9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.404959 Aug 24 03:33:01.069035 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 460/911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:00 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:01.077044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ab893a4a-a8d1-472c-8120-4e5b13c55482 req-66d4725e-b893-4681-988e-adebdc7e42d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5", "tag": "182fab05-ee6b-4c54-8428-378902e8857d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:01.099345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab893a4a-a8d1-472c-8120-4e5b13c55482 req-66d4725e-b893-4681-988e-adebdc7e42d3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:01.106455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab893a4a-a8d1-472c-8120-4e5b13c55482 req-66d4725e-b893-4681-988e-adebdc7e42d3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:01.107220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab893a4a-a8d1-472c-8120-4e5b13c55482 req-66d4725e-b893-4681-988e-adebdc7e42d3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:01.129371 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ab893a4a-a8d1-472c-8120-4e5b13c55482 req-66d4725e-b893-4681-988e-adebdc7e42d3 service nova] Creating event network-changed:182fab05-ee6b-4c54-8428-378902e8857d for instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 on n-h2-846470-15 Aug 24 03:33:01.148267 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ab893a4a-a8d1-472c-8120-4e5b13c55482 req-66d4725e-b893-4681-988e-adebdc7e42d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073314 Aug 24 03:33:01.152684 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 461/912] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:01.169038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de407e0f-2814-48ff-8bec-472182a1041d tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:01.173048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de407e0f-2814-48ff-8bec-472182a1041d tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:01.174133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Updating instance_info_cache with network_info: [{"id": "182fab05-ee6b-4c54-8428-378902e8857d", "address": "fa:16:3e:93:b9:87", "network": {"id": "a8cadaaf-6888-4107-843d-808010e646f6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-46161511-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "21381ed0f374420b9d483bb3450cee89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap182fab05-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:33:01.217911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Releasing lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:33:01.220949 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f5dec558-7160-4f13-bf1f-36fbb34cff3c tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action" status: 202 len: 0 microversion: 2.1 time: 4.194277 Aug 24 03:33:01.232098 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 452/913] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:57 2022] POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action => generated 0 bytes in 4207 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 03:33:01.248951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c564d962-713a-4a71-9692-b2fcac1ef21d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '.version_select at 0x7f102323baf0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:01.421092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de407e0f-2814-48ff-8bec-472182a1041d tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:01.428301 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de407e0f-2814-48ff-8bec-472182a1041d tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1263 microversion: 2.1 time: 0.274179 Aug 24 03:33:01.432609 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 462/914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:01 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1263 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:01.679602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:01.680662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:01.700642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:01.701882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:01.704796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:01.706583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:01.707702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:01.708686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:02.041748 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c564d962-713a-4a71-9692-b2fcac1ef21d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/b94c4f0a-0e3c-4019-abb5-5e10a7b50b64" status: 200 len: 182 microversion: 2.1 time: 0.806505 Aug 24 03:33:02.042356 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 453/915] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:33:01 2022] GET /compute/v2.1/os-floating-ips/b94c4f0a-0e3c-4019-abb5-5e10a7b50b64 => generated 182 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:02.063972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.4"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:02.428703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:02.447104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:02.447434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:02.448150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:02.449403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:02.449587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:02.450058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:02.705430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:02.768217 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4262137-4f2e-442f-891c-b103e9cb85d9 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1471 microversion: 2.1 time: 1.099322 Aug 24 03:33:02.797612 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 463/916] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:01 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1471 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:02.832139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:02.833794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:02.849008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:02.850199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:02.852136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:02.853759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:02.854942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:02.855964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:03.265596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:33:03.266828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquired lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:33:03.513248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:03.529875 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac65ef33-3fa6-4941-85ef-641e556de66c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.716873 Aug 24 03:33:03.532420 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 464/917] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:02 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:03.543511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:03.545898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:03.558818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.560614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.562346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:03.564480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.567173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.567173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:03.750572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:03.775077 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f1ca2a21-9f6b-4a94-a883-316a9204bbdb tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1323 microversion: 2.1 time: 0.239619 Aug 24 03:33:03.776562 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 465/918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:03 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1323 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:03.815885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-aa37c7a9-3528-40c5-bb9c-dd396fbd863e req-30c7bc63-02ae-41e0-b9ff-421db873b053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f439e22-224f-40d9-b312-79a59c672563", "name": "network-vif-deleted", "tag": "b566b56d-990c-4ceb-9f5f-3c9273bc1e92"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:03.848778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-aa37c7a9-3528-40c5-bb9c-dd396fbd863e req-30c7bc63-02ae-41e0-b9ff-421db873b053 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.859874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-aa37c7a9-3528-40c5-bb9c-dd396fbd863e req-30c7bc63-02ae-41e0-b9ff-421db873b053 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.860568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-aa37c7a9-3528-40c5-bb9c-dd396fbd863e req-30c7bc63-02ae-41e0-b9ff-421db873b053 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:03.891031 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-aa37c7a9-3528-40c5-bb9c-dd396fbd863e req-30c7bc63-02ae-41e0-b9ff-421db873b053 service nova] Creating event network-vif-deleted:b566b56d-990c-4ceb-9f5f-3c9273bc1e92 for instance 1f439e22-224f-40d9-b312-79a59c672563 on n-h1-846470-15 Aug 24 03:33:03.898202 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-aa37c7a9-3528-40c5-bb9c-dd396fbd863e req-30c7bc63-02ae-41e0-b9ff-421db873b053 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102364 Aug 24 03:33:03.899474 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 466/919] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:03.909855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:03.910592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:03.918267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.918796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.919158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:03.919932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.920474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.921410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:04.860067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:04.874342 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e601e4d-76cc-4271-b7e1-5a3a4b684711 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1471 microversion: 2.1 time: 0.971430 Aug 24 03:33:04.875632 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 467/920] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:03 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1471 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:04.888429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:04.894293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:04.927401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:04.929749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:04.930484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:04.931617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:04.932292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:04.932902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.508711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:05.531658 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8557729-a89a-4fe7-956a-4e2c0d4c97cb tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.648759 Aug 24 03:33:05.533477 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 468/921] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:04 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:05.543944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c096734b-f3ec-4027-939c-f4c0a882e770 req-2b75b225-5e18-4844-bd66-bef8131a8960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19c423f-0e82-4d93-b79d-7fdc5d3cdf42", "name": "network-vif-deleted", "tag": "8dda5d94-0df8-484c-a955-1bd7d4c92098"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:05.571254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c096734b-f3ec-4027-939c-f4c0a882e770 req-2b75b225-5e18-4844-bd66-bef8131a8960 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.584182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c096734b-f3ec-4027-939c-f4c0a882e770 req-2b75b225-5e18-4844-bd66-bef8131a8960 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.586236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c096734b-f3ec-4027-939c-f4c0a882e770 req-2b75b225-5e18-4844-bd66-bef8131a8960 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.595577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:05.626467 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c096734b-f3ec-4027-939c-f4c0a882e770 req-2b75b225-5e18-4844-bd66-bef8131a8960 service nova] Creating event network-vif-deleted:8dda5d94-0df8-484c-a955-1bd7d4c92098 for instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 on n-h2-846470-15 Aug 24 03:33:05.650732 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c096734b-f3ec-4027-939c-f4c0a882e770 req-2b75b225-5e18-4844-bd66-bef8131a8960 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113328 Aug 24 03:33:05.651997 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 469/922] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:05.671381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:33:05.681679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:05.686498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:05.713129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.714164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.715102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.716610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.717779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.735050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.873825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:05.895201 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-63e57c9b-beaa-481c-b064-e85280758652 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1321 microversion: 2.1 time: 0.240693 Aug 24 03:33:05.897320 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 470/923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:05 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:05.917138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:05.918312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:05.937528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.938940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.940076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.941847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.942649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.943552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:06.025593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:06.027183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:06.027533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:06.028594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid 4e539046-aa0d-4d50-9555-8692a4d53f39 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:06.163472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:06.187493 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89c2b8bd-d9bc-4f77-b24b-a8aebf190d8b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 200 len: 1306 microversion: 2.1 time: 0.286924 Aug 24 03:33:06.190669 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 471/924] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:05 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 1306 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:06.227229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-30daea69-756d-4668-94e6-10a52edd5c89 req-128ea31d-a038-4a27-aaef-f3945f921d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5", "tag": "182fab05-ee6b-4c54-8428-378902e8857d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:06.249999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30daea69-756d-4668-94e6-10a52edd5c89 req-128ea31d-a038-4a27-aaef-f3945f921d4a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:06.250491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30daea69-756d-4668-94e6-10a52edd5c89 req-128ea31d-a038-4a27-aaef-f3945f921d4a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:06.250937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30daea69-756d-4668-94e6-10a52edd5c89 req-128ea31d-a038-4a27-aaef-f3945f921d4a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:06.267312 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-30daea69-756d-4668-94e6-10a52edd5c89 req-128ea31d-a038-4a27-aaef-f3945f921d4a service nova] Creating event network-changed:182fab05-ee6b-4c54-8428-378902e8857d for instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 on n-h2-846470-15 Aug 24 03:33:06.274345 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-30daea69-756d-4668-94e6-10a52edd5c89 req-128ea31d-a038-4a27-aaef-f3945f921d4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054358 Aug 24 03:33:06.275902 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 472/925] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:06.559001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:06.560366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:06.579154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:06.581227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:06.586420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:06.589869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:06.590690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:06.600688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.170740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:07.184202 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8a00c8d-2711-49cc-87de-495b29dc52a9 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.632280 Aug 24 03:33:07.185028 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 473/926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:06 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:07.198379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:07.199179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:07.219089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.219998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.220749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.225130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.226051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.226763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.496195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:07.516073 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2d1dab24-1178-4d38-ac11-5ee81400d277 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.330008 Aug 24 03:33:07.516741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 474/927] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:07 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:07.528924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:07.529472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4e539046-aa0d-4d50-9555-8692a4d53f39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:07.539749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.540261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.540858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.542355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.542935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.543384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.567216 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] HTTP exception thrown: Instance 4e539046-aa0d-4d50-9555-8692a4d53f39 could not be found. Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Request method failure captured: Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 HTTP/1.1 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs9a3PSnWyPM4oxrtpOmhych2UNWusgJa-lwsewb0ma_NpTMELj20KNj5HVpRSejYJ11CDsiWDzARm7j_w9WmCaSk_xKrJeWjGSrra45x2OmDkhWDZoiNgbPGlgAVyB6FoU5vlzXl1ibHQi3SLCOMdp4YcaLkCFcOhA8hHy77yiz2s Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d347f85e59734622a091e80dbf0d9521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 906d6efeea2b4af59b76fae3e3531d7b Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 4e539046-aa0d-4d50-9555-8692a4d53f39 could not be found. Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '4e539046-aa0d-4d50-9555-8692a4d53f39'} Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e539046-aa0d-4d50-9555-8692a4d53f39 could not be found. Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e539046-aa0d-4d50-9555-8692a4d53f39 could not be found. Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:07.569363 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:07.574109 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:07.574109 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:07.574109 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:07.574109 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:07.574109 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:07.574109 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e539046-aa0d-4d50-9555-8692a4d53f39 could not be found. Aug 24 03:33:07.574109 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:07.576178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Returning 404 to user: Instance 4e539046-aa0d-4d50-9555-8692a4d53f39 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:07.578357 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45666e53-a621-4842-b6cc-05a10d9939ea tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39" status: 404 len: 111 microversion: 2.1 time: 0.060021 Aug 24 03:33:07.580148 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 475/928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:07 2022] GET /compute/v2.1/servers/4e539046-aa0d-4d50-9555-8692a4d53f39 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:07.597244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:07.599311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:07.611519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.612835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.613850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.615565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.616890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.617966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.694953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:33:07.965531 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5863cd55-dece-4271-b5e2-dd887113ebe0 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 204 len: 0 microversion: 2.1 time: 0.378135 Aug 24 03:33:07.973616 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 476/929] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:07 2022] DELETE /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:33:07.988396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3829ce44-be2e-473b-837a-97e10735043a req-85ce3033-a655-4d85-9909-779aae7691e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e539046-aa0d-4d50-9555-8692a4d53f39", "name": "network-vif-deleted", "tag": "3eb749a1-080a-45e0-a242-12967cbe89f1"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:08.023129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3829ce44-be2e-473b-837a-97e10735043a req-85ce3033-a655-4d85-9909-779aae7691e7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.024140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3829ce44-be2e-473b-837a-97e10735043a req-85ce3033-a655-4d85-9909-779aae7691e7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.025176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3829ce44-be2e-473b-837a-97e10735043a req-85ce3033-a655-4d85-9909-779aae7691e7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.054219 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3829ce44-be2e-473b-837a-97e10735043a req-85ce3033-a655-4d85-9909-779aae7691e7 service nova] Creating event network-vif-deleted:3eb749a1-080a-45e0-a242-12967cbe89f1 for instance 4e539046-aa0d-4d50-9555-8692a4d53f39 on n-h1-846470-15 Aug 24 03:33:08.070628 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3829ce44-be2e-473b-837a-97e10735043a req-85ce3033-a655-4d85-9909-779aae7691e7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093959 Aug 24 03:33:08.072297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 477/930] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:08.099070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:08.100998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:08.117273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.118154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.120580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.122520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.123190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.124978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.488500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Updating instance_info_cache with network_info: [{"id": "182fab05-ee6b-4c54-8428-378902e8857d", "address": "fa:16:3e:93:b9:87", "network": {"id": "a8cadaaf-6888-4107-843d-808010e646f6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-46161511-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "21381ed0f374420b9d483bb3450cee89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap182fab05-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:33:08.510441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Releasing lock "refresh_cache-22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:33:08.514916 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c61e681b-3960-4a73-b11b-1ea4c4921adc tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action" status: 202 len: 0 microversion: 2.1 time: 6.454111 Aug 24 03:33:08.517648 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 454/931] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:33:02 2022] POST /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5/action => generated 0 bytes in 6458 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 24 03:33:08.528399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:08.531195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:08.549053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.550813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.552084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.554129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.555291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.556433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.585208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:08.616638 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7b2d53eb-0daa-4a34-8507-2026c289d0d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1473 microversion: 2.1 time: 0.539591 Aug 24 03:33:08.617837 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 478/932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:08 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1473 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:08.634904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:08.642186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:08.673462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.683633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.685575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.696750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.699168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.705288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.759633 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] HTTP exception thrown: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Request method failure captured: Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 HTTP/1.1 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuR2Du9xn-hhK9gV6lz3r5eINObg34UjSzqL1FgtihJILx15qE_2QLwRGhYQS5OvyDz75p7kbc7uYiUFSBcybmTgJ_5gOTUgTLgWGMgN6mJT7btzub0GLADoyMZ_zAzTAjF9ZiVsGFYOqvdaM0bwzlWKbMOmBAJmDWk9I5uWSABMHk Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 21381ed0f374420b9d483bb3450cee89 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_21381ed0f374420b9d483bb3450cee89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 21381ed0f374420b9d483bb3450cee89 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPsAssociationTestJSON-13639284-project Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6ec6f56b6ea1404f9e961409fe530563 Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-13639284-project Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '1f439e22-224f-40d9-b312-79a59c672563'} Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:08.764023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:08.773636 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:08.785911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Returning 404 to user: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:08.788452 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-83119007-f437-4bc5-8b89-6b3e955ec47d tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 404 len: 111 microversion: 2.1 time: 0.166542 Aug 24 03:33:08.790372 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 479/933] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:08 2022] DELETE /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:08.818923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:08.823198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:08.844067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.847484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.848895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.850606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.851938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.853386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:09.153016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:09.182623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc041c57-8f74-45a3-9f0e-6d07b95b431a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.662614 Aug 24 03:33:09.196092 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 455/934] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:08 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:09.205647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:09.206896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 1f439e22-224f-40d9-b312-79a59c672563] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:09.230396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:09.231304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:09.232187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:09.233653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:09.242659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:09.243760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:09.303939 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] HTTP exception thrown: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Request method failure captured: Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 HTTP/1.1 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZuR2Du9xn-hhK9gV6lz3r5eINObg34UjSzqL1FgtihJILx15qE_2QLwRGhYQS5OvyDz75p7kbc7uYiUFSBcybmTgJ_5gOTUgTLgWGMgN6mJT7btzub0GLADoyMZ_zAzTAjF9ZiVsGFYOqvdaM0bwzlWKbMOmBAJmDWk9I5uWSABMHk Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 21381ed0f374420b9d483bb3450cee89 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_21381ed0f374420b9d483bb3450cee89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 21381ed0f374420b9d483bb3450cee89 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FloatingIPsAssociationTestJSON-13639284-project Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6ec6f56b6ea1404f9e961409fe530563 Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-13639284-project Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1f439e22-224f-40d9-b312-79a59c672563'} Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:09.322918 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Returning 404 to user: Instance 1f439e22-224f-40d9-b312-79a59c672563 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b1b40a2-5968-4393-98b7-9bdbf7645f86 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563" status: 404 len: 111 microversion: 2.1 time: 0.131197 Aug 24 03:33:09.339986 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 456/935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:09 2022] GET /compute/v2.1/servers/1f439e22-224f-40d9-b312-79a59c672563 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:09.355840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b3b1a341-09d8-4849-8d26-1a1e4f0c9a6b req-bff27a00-a761-4e4e-b78a-b14ac125b89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08e8a55-bcba-46e8-8d19-592b1a193bc7", "tag": "bb35f0ad-0556-43ca-8cfd-9cc8114faf00"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:09.390194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b3b1a341-09d8-4849-8d26-1a1e4f0c9a6b req-bff27a00-a761-4e4e-b78a-b14ac125b89a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:09.390991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b3b1a341-09d8-4849-8d26-1a1e4f0c9a6b req-bff27a00-a761-4e4e-b78a-b14ac125b89a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:09.392037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b3b1a341-09d8-4849-8d26-1a1e4f0c9a6b req-bff27a00-a761-4e4e-b78a-b14ac125b89a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:09.442462 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b3b1a341-09d8-4849-8d26-1a1e4f0c9a6b req-bff27a00-a761-4e4e-b78a-b14ac125b89a service nova] Creating event network-changed:bb35f0ad-0556-43ca-8cfd-9cc8114faf00 for instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 on n-h1-846470-15 Aug 24 03:33:09.454542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b3b1a341-09d8-4849-8d26-1a1e4f0c9a6b req-bff27a00-a761-4e4e-b78a-b14ac125b89a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116628 Aug 24 03:33:09.464176 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 457/936] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:09.482408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8709af46-883c-4a89-8986-328db62b2e7f tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '.version_select at 0x7f10231f7280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:09.657117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:09.690764 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e18c2704-7556-40b5-9bd4-7efd0a58ca38 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.896455 Aug 24 03:33:09.691819 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 480/937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:08 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:09.749611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:09.754109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:09.778747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:09.783437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:09.784668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:09.788752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:09.792447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:09.794039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:10.132440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:10.489150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:10.518031 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3161d134-9ff4-424c-b4be-7340ac9150fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1473 microversion: 2.1 time: 0.799882 Aug 24 03:33:10.519101 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 481/938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:09 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1473 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:10.575012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:10.575813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:10.584091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:10.589094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:10.589942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:10.590625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:10.591175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:10.595729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:10.595729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.088878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:11.104552 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bd2b955c-ee57-45d3-a21d-9e7e849579ae tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.555935 Aug 24 03:33:11.104867 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 482/939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:10 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:11.125541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:11.127064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:11.134873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.135381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.135884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.136639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.137109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.137543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.428406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:11.661514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:11.709470 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c56d6c4b-5a23-40dd-87a9-84de9428eb6a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.603233 Aug 24 03:33:11.710065 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 483/940] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:11 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:11.721180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:11.722185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:11.742457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.743314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.744010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.745928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.746934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.747789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.983858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.015697 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eb57532a-acf1-4c60-a309-9e0548a924b2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1431 microversion: 2.1 time: 0.301749 Aug 24 03:33:12.018227 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 484/941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:11 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1431 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:12.070831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-55dd66f5-0e87-4eab-b135-769a78734d0b req-bc38d357-840f-4d86-8336-581822a6e51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bee13da-b1c6-4a3d-b5e2-dec36fe2031a", "name": "network-vif-deleted", "tag": "ad77eb67-70e3-47d6-8e20-34a660d000ee"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:12.108172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-55dd66f5-0e87-4eab-b135-769a78734d0b req-bc38d357-840f-4d86-8336-581822a6e51d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.111264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-55dd66f5-0e87-4eab-b135-769a78734d0b req-bc38d357-840f-4d86-8336-581822a6e51d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.112589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-55dd66f5-0e87-4eab-b135-769a78734d0b req-bc38d357-840f-4d86-8336-581822a6e51d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.149793 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-55dd66f5-0e87-4eab-b135-769a78734d0b req-bc38d357-840f-4d86-8336-581822a6e51d service nova] Creating event network-vif-deleted:ad77eb67-70e3-47d6-8e20-34a660d000ee for instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a on n-h1-846470-15 Aug 24 03:33:12.168883 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-55dd66f5-0e87-4eab-b135-769a78734d0b req-bc38d357-840f-4d86-8336-581822a6e51d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109474 Aug 24 03:33:12.172432 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 485/942] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:12.191069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:12.192399 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8709af46-883c-4a89-8986-328db62b2e7f tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/b94c4f0a-0e3c-4019-abb5-5e10a7b50b64" status: 202 len: 0 microversion: 2.1 time: 2.725893 Aug 24 03:33:12.193279 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 458/943] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:33:09 2022] DELETE /compute/v2.1/os-floating-ips/b94c4f0a-0e3c-4019-abb5-5e10a7b50b64 => generated 0 bytes in 2728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:33:12.201632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:12.204744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:12.205418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:12.217762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:12.220436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.221860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.223379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.225679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.227018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.228159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.252284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.252806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.253262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.254064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.254547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.254991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.369055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:33:12.521774 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc300165-5164-4e18-bc15-c27f3703b738 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 204 len: 0 microversion: 2.1 time: 0.322328 Aug 24 03:33:12.523829 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 459/944] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:12 2022] DELETE /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:33:12.541327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:12.543358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:12.558075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.560098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.561559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.564464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.567233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.570098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.834695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.852899 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b331949f-9c06-4f61-886f-37e21c9ba392 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1524 microversion: 2.1 time: 0.320786 Aug 24 03:33:12.853250 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 460/945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:12 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1524 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:12.859520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:12.860621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:12.869560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.870585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.871836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.875068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.876120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.876818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.099742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:13.123460 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-49df3e07-75dc-44ef-9eaa-4443ab40ede5 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.267833 Aug 24 03:33:13.135715 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 461/946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:12 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:13.135971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:13.139271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:13.152302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.153231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.154036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.156119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.157358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.158147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.166044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:13.185270 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d8826a9f-5dc5-4916-abe2-cdfb112d43c2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 1.009964 Aug 24 03:33:13.189200 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 486/947] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:12 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:13.236263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.237648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.238418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.239196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:13.313197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:13.337869 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0d99c322-2c93-4374-802a-e482b6252daf tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1307 microversion: 2.1 time: 0.209943 Aug 24 03:33:13.344034 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 462/948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:13 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:13.890537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:13.891534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:13.907313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.908533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.912190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.913619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.914219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.914712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.030158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-afd03f61-d0db-43a2-a15f-2a3345ec8164 req-a95f1877-87c1-4af0-948f-3ae484022fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b400f037-8a8c-41a0-9c86-0827aef143cf", "name": "network-vif-plugged", "status": "completed", "tag": "c4ac14fd-0855-4c88-a576-dc68a2cd8b95"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:14.052442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-afd03f61-d0db-43a2-a15f-2a3345ec8164 req-a95f1877-87c1-4af0-948f-3ae484022fba service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.053825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-afd03f61-d0db-43a2-a15f-2a3345ec8164 req-a95f1877-87c1-4af0-948f-3ae484022fba service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.055089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-afd03f61-d0db-43a2-a15f-2a3345ec8164 req-a95f1877-87c1-4af0-948f-3ae484022fba service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.088295 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-afd03f61-d0db-43a2-a15f-2a3345ec8164 req-a95f1877-87c1-4af0-948f-3ae484022fba service nova] Creating event network-vif-plugged:c4ac14fd-0855-4c88-a576-dc68a2cd8b95 for instance b400f037-8a8c-41a0-9c86-0827aef143cf on n-h2-846470-15 Aug 24 03:33:14.109931 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-afd03f61-d0db-43a2-a15f-2a3345ec8164 req-a95f1877-87c1-4af0-948f-3ae484022fba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085441 Aug 24 03:33:14.112161 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 463/949] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:14.168750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:14.174713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:14.206363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.210979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.213048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.215457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.223176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.224512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.260366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:14.285456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:14.297282 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1dd97a11-3164-44c5-87a8-aae78c9c6f2e tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1524 microversion: 2.1 time: 0.411273 Aug 24 03:33:14.301463 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 487/950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:13 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1524 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:14.329321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:14.330888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:14.367407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.376187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.378628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.383142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.385430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.386607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.653238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:14.671224 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9937a1ba-6627-419f-9edc-8b72c7616a9b tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.526266 Aug 24 03:33:14.688317 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 464/951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:14 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:14.710767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:14.712212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:14.725429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.726635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.727735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.729330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.730453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.731458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.784267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:14.806713 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b9ee438f-24b5-49d5-be09-18ccec3e3164 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.503325 Aug 24 03:33:14.824147 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 488/952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:14 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:14.827760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.828645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.830058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.830789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:14.944731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:14.968575 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ff7ca5ed-f270-4ee8-a406-50535bcabaf1 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1307 microversion: 2.1 time: 0.277568 Aug 24 03:33:14.984729 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 465/953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:14 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:15.309484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-feadfd45-64e3-4b7a-a3e1-d931b891e3c9 req-64ab14ac-91fc-4f7d-a5eb-127d5676cf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5", "name": "network-vif-deleted", "tag": "182fab05-ee6b-4c54-8428-378902e8857d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:15.321904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:15.324503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:15.324720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-feadfd45-64e3-4b7a-a3e1-d931b891e3c9 req-64ab14ac-91fc-4f7d-a5eb-127d5676cf82 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.325102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-feadfd45-64e3-4b7a-a3e1-d931b891e3c9 req-64ab14ac-91fc-4f7d-a5eb-127d5676cf82 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.325739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-feadfd45-64e3-4b7a-a3e1-d931b891e3c9 req-64ab14ac-91fc-4f7d-a5eb-127d5676cf82 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.338759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.339283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.339839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.341129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.341839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.342600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.344806 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-feadfd45-64e3-4b7a-a3e1-d931b891e3c9 req-64ab14ac-91fc-4f7d-a5eb-127d5676cf82 service nova] Creating event network-vif-deleted:182fab05-ee6b-4c54-8428-378902e8857d for instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 on n-h2-846470-15 Aug 24 03:33:15.351348 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-feadfd45-64e3-4b7a-a3e1-d931b891e3c9 req-64ab14ac-91fc-4f7d-a5eb-127d5676cf82 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045562 Aug 24 03:33:15.355127 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 489/954] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:15.721469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:15.724909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:15.740159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.741177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.742052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.744531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.747955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.749588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.806269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:15.818970 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2fce055-7392-4356-8675-66abce84d9c5 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1482 microversion: 2.1 time: 0.501795 Aug 24 03:33:15.832918 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 466/955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:15 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1482 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:15.844694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:15.845903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:15.855832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.856975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.858634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.862582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.865333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.866189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.190534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.212496 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fc0eacfd-aa85-4696-a41c-fe81e9d9eb6c tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.503380 Aug 24 03:33:16.222690 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 490/956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:15 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:16.231858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:16.233862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:16.254039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.255417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.256547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.258029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.259114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.260267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.318519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.319373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.319915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.320057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:16.391918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.404201 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bcbefd6f-3a02-45c2-98f9-9b185a5c92ad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1307 microversion: 2.1 time: 0.182184 Aug 24 03:33:16.405855 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 491/957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:16 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:16.424243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.445203 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e0e9649-3788-4afa-b0c0-9a65d87428e5 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1292 microversion: 2.1 time: 0.610880 Aug 24 03:33:16.463156 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 467/958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:15 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1292 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:16.853862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:16.855116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:16.866541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.867796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.868885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.870174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.871280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.872304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.957198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.958173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.959023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.960195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lazy-loading 'fault' on Instance uuid 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:17.057455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec6f56b6ea1404f9e961409fe530563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21381ed0f374420b9d483bb3450cee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:17.086516 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-749dd724-58f5-47a7-a7da-7b8c1c1622c4 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 200 len: 1314 microversion: 2.1 time: 0.240582 Aug 24 03:33:17.087931 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 492/959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:16 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:17.249271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:17.250400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:17.262100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.262895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.263921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.265707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.266007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.266726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.298656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:17.452603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:17.457424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:17.469374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.470150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.470841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.472244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.473037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.474274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.527569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.528281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.528847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.529418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:17.628174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:17.640490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:17.650313 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d2d3ff8-44db-47c2-b945-5a5eb383ebad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 200 len: 1307 microversion: 2.1 time: 0.218323 Aug 24 03:33:17.651789 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 493/960] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:17 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:17.666770 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e078e633-e1c8-4180-b9ef-d484ee0b8e87 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.428204 Aug 24 03:33:17.668767 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 468/961] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:17 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:17.672617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:17.673547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:17.686426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.687535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.688371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.689170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.689847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.690332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.906187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:17.917254 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-30749105-4084-4a81-99c9-9f637c2294fc tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1484 microversion: 2.1 time: 0.263397 Aug 24 03:33:17.918739 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 494/962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:17 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1484 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:17.957300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:17.962229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:17.976782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.977729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.978528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.979941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.981569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.982974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.126283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:18.128890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] [instance: 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:18.144881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.146323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.147955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.150194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.151856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.153009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.179220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d4595d46-b57f-40e1-a4ad-3873d37c134f tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.228642 Aug 24 03:33:18.180227 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 469/963] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:33:17 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] HTTP exception thrown: Instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 could not be found. Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Request method failure captured: Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 HTTP/1.1 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuR2Du9xn-hhK9gV6lz3r5eINObg34UjSzqL1FgtihJILx15qE_2QLwRGhYQS5OvyDz75p7kbc7uYiUFSBcybmTgJ_5gOTUgTLgWGMgN6mJT7btzub0GLADoyMZ_zAzTAjF9ZiVsGFYOqvdaM0bwzlWKbMOmBAJmDWk9I5uWSABMHk Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 21381ed0f374420b9d483bb3450cee89 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_21381ed0f374420b9d483bb3450cee89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/21381ed0f374420b9d483bb3450cee89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 21381ed0f374420b9d483bb3450cee89 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-13639284 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPsAssociationTestJSON-13639284-project Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6ec6f56b6ea1404f9e961409fe530563 Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-13639284-project Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 could not be found. Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5'} Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 could not be found. Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:18.194574 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 could not be found. Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 could not be found. Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] Returning 404 to user: Instance 22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31e443c2-92f2-4f17-a35d-2dcdba2b2863 tempest-FloatingIPsAssociationTestJSON-13639284 tempest-FloatingIPsAssociationTestJSON-13639284-project] 10.222.0.58 "GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5" status: 404 len: 111 microversion: 2.1 time: 0.078578 Aug 24 03:33:18.207217 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 495/964] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:18 2022] GET /compute/v2.1/servers/22fd0e2d-7b26-4e79-9efb-a8e5f1fa26e5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:18.676404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:18.677247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:18.695606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:18.696704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:18.710647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.714185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.720238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.721611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.730149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.731510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.732821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.733573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.736289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.738108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.739991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.741185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.771385 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] HTTP exception thrown: Instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a could not be found. Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Request method failure captured: Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a HTTP/1.1 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs9a3PSnWyPM4oxrtpOmhych2UNWusgJa-lwsewb0ma_NpTMELj20KNj5HVpRSejYJ11CDsiWDzARm7j_w9WmCaSk_xKrJeWjGSrra45x2OmDkhWDZoiNgbPGlgAVyB6FoU5vlzXl1ibHQi3SLCOMdp4YcaLkCFcOhA8hHy77yiz2s Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d347f85e59734622a091e80dbf0d9521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 906d6efeea2b4af59b76fae3e3531d7b Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a could not be found. Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '6bee13da-b1c6-4a3d-b5e2-dec36fe2031a'} Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a could not be found. Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a could not be found. Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:18.774958 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.783832 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:18.783832 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:18.783832 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:18.783832 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:18.783832 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:18.783832 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a could not be found. Aug 24 03:33:18.783832 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:18.783832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Returning 404 to user: Instance 6bee13da-b1c6-4a3d-b5e2-dec36fe2031a could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:18.785257 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65a2233c-3462-4a1a-9807-94676e9c1851 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a" status: 404 len: 111 microversion: 2.1 time: 0.107855 Aug 24 03:33:18.786967 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 470/965] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:18 2022] GET /compute/v2.1/servers/6bee13da-b1c6-4a3d-b5e2-dec36fe2031a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:33:18.800376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:18.805146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:18.830879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.831933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.832911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.834364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.835468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.836334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.891471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:33:19.074067 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-73406301-29a0-4e44-8cb8-3e14a37ba2cc tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 204 len: 0 microversion: 2.1 time: 0.280750 Aug 24 03:33:19.082116 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 471/966] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:18 2022] DELETE /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:33:19.094650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:19.096098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:19.108054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.108843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.109846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.111353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.112261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.113208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.175266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:33:19.349474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0ca6b5e5-4c12-4c9c-a70a-29e1bb56b1d7 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 204 len: 0 microversion: 2.1 time: 0.263427 Aug 24 03:33:19.350556 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 472/967] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:19 2022] DELETE /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:33:19.366993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:19.368693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:19.381362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.383912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.383912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.383912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.383912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.383912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.431447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.445738 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6e47a96-8227-489e-8273-a1ec46311833 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.757652 Aug 24 03:33:19.466422 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 496/968] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:18 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:19.966442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.994622 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eca1d063-5559-44ce-b576-36b5a5b3cea3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1474 microversion: 2.1 time: 0.634964 Aug 24 03:33:20.005181 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 473/969] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:19 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1474 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:20.482168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:20.487105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:20.512848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.517417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.518276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.519168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.520282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.521899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.045851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:21.046615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:21.063327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.064249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.064916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.065947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.066670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.067348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.526112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:21.545923 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf5b0481-bf99-48b5-9437-0a0c9b87a8ee tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1474 microversion: 2.1 time: 0.504413 Aug 24 03:33:21.546926 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 474/970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:21 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1474 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:21.667215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:21.673731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:21.719191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.721098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.727790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.728510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.729002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.729442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.166461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.185246 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bccf4081-f32b-420d-8bf3-ca565a45643e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 1.713509 Aug 24 03:33:22.196745 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 497/971] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:20 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:22.215020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d7df4e60-0461-488d-9cc7-239bade7625b req-36371033-e90a-4429-9787-9e6332e06171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b400f037-8a8c-41a0-9c86-0827aef143cf", "tag": "c4ac14fd-0855-4c88-a576-dc68a2cd8b95"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:22.258832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d7df4e60-0461-488d-9cc7-239bade7625b req-36371033-e90a-4429-9787-9e6332e06171 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.269673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d7df4e60-0461-488d-9cc7-239bade7625b req-36371033-e90a-4429-9787-9e6332e06171 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.271614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d7df4e60-0461-488d-9cc7-239bade7625b req-36371033-e90a-4429-9787-9e6332e06171 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.332098 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d7df4e60-0461-488d-9cc7-239bade7625b req-36371033-e90a-4429-9787-9e6332e06171 service nova] Creating event network-changed:c4ac14fd-0855-4c88-a576-dc68a2cd8b95 for instance b400f037-8a8c-41a0-9c86-0827aef143cf on n-h2-846470-15 Aug 24 03:33:22.359227 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d7df4e60-0461-488d-9cc7-239bade7625b req-36371033-e90a-4429-9787-9e6332e06171 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161505 Aug 24 03:33:22.360909 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 498/972] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:22.586437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:22.591102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:22.630091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.634102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.638580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.645707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.646963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.652763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.306595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.326076 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09e62d8a-e7bd-4d07-bad2-19b96a986e8f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1432 microversion: 2.1 time: 0.757580 Aug 24 03:33:23.357925 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 499/973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:22 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1432 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:23.399329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:23.406942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:23.445059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.446483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.447641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.449217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.450432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.453978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.990857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.054435 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a22be91-8cb5-4d78-a95a-5412cb7d09b0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1484 microversion: 2.1 time: 2.397438 Aug 24 03:33:24.068349 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 475/974] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:21 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1484 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:24.401643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:24.402975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:24.423805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.427383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.427870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.432256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.432913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.433375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.612983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.626350 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8773b10b-7e07-43ef-9165-c11dedcee8e2 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1432 microversion: 2.1 time: 0.231559 Aug 24 03:33:24.627188 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 476/975] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:24 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1432 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:24.653432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-adf257ac-a276-4645-a91c-0e901fb5c422 req-c3362f4e-f60e-48e5-abec-7daf817ba3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ef8b75-d1d1-455b-94fd-0c27e607f2f5", "name": "network-vif-deleted", "tag": "6a5242eb-2e29-4866-a0e3-e2b15cc04ce8"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:24.695548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-adf257ac-a276-4645-a91c-0e901fb5c422 req-c3362f4e-f60e-48e5-abec-7daf817ba3ec service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.698475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-adf257ac-a276-4645-a91c-0e901fb5c422 req-c3362f4e-f60e-48e5-abec-7daf817ba3ec service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.700274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-adf257ac-a276-4645-a91c-0e901fb5c422 req-c3362f4e-f60e-48e5-abec-7daf817ba3ec service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.742680 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-adf257ac-a276-4645-a91c-0e901fb5c422 req-c3362f4e-f60e-48e5-abec-7daf817ba3ec service nova] Creating event network-vif-deleted:6a5242eb-2e29-4866-a0e3-e2b15cc04ce8 for instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 on n-h1-846470-15 Aug 24 03:33:24.749773 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-adf257ac-a276-4645-a91c-0e901fb5c422 req-c3362f4e-f60e-48e5-abec-7daf817ba3ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120027 Aug 24 03:33:24.751085 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 477/976] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:24.944077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-68255341-3bc1-4943-8b90-6c1cd30bd2c2 req-c7278b51-db54-41c5-9695-bede6c2e39e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08e8a55-bcba-46e8-8d19-592b1a193bc7", "name": "network-vif-plugged", "status": "completed", "tag": "bb35f0ad-0556-43ca-8cfd-9cc8114faf00"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:24.964997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-68255341-3bc1-4943-8b90-6c1cd30bd2c2 req-c7278b51-db54-41c5-9695-bede6c2e39e1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.965488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-68255341-3bc1-4943-8b90-6c1cd30bd2c2 req-c7278b51-db54-41c5-9695-bede6c2e39e1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.965932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-68255341-3bc1-4943-8b90-6c1cd30bd2c2 req-c7278b51-db54-41c5-9695-bede6c2e39e1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.002568 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-68255341-3bc1-4943-8b90-6c1cd30bd2c2 req-c7278b51-db54-41c5-9695-bede6c2e39e1 service nova] Creating event network-vif-plugged:bb35f0ad-0556-43ca-8cfd-9cc8114faf00 for instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 on n-h1-846470-15 Aug 24 03:33:25.011804 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-68255341-3bc1-4943-8b90-6c1cd30bd2c2 req-c7278b51-db54-41c5-9695-bede6c2e39e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072259 Aug 24 03:33:25.012935 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 478/977] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:25.033390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.057547 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79477326-41aa-4f6c-b99e-4184015cace1 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 1.694106 Aug 24 03:33:25.059348 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 500/978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:23 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:25.450949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9be33e15-370f-4e0d-8fdf-e742dfd195cf req-5a97ac8e-08fe-40eb-a988-a846d9e36fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d757e37-d39b-4278-a2c7-21ad1996a360", "name": "network-vif-deleted", "tag": "6fa961ae-33e4-4648-a84d-8be61eb2e505"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:25.510639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9be33e15-370f-4e0d-8fdf-e742dfd195cf req-5a97ac8e-08fe-40eb-a988-a846d9e36fc8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.513105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9be33e15-370f-4e0d-8fdf-e742dfd195cf req-5a97ac8e-08fe-40eb-a988-a846d9e36fc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.518550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9be33e15-370f-4e0d-8fdf-e742dfd195cf req-5a97ac8e-08fe-40eb-a988-a846d9e36fc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.623760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9be33e15-370f-4e0d-8fdf-e742dfd195cf req-5a97ac8e-08fe-40eb-a988-a846d9e36fc8 service nova] Creating event network-vif-deleted:6fa961ae-33e4-4648-a84d-8be61eb2e505 for instance 5d757e37-d39b-4278-a2c7-21ad1996a360 on n-h2-846470-15 Aug 24 03:33:25.653286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:25.656512 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9be33e15-370f-4e0d-8fdf-e742dfd195cf req-5a97ac8e-08fe-40eb-a988-a846d9e36fc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209586 Aug 24 03:33:25.659212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:25.662937 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 479/979] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:25.722331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.731864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.733964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.742705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.744837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.751731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.938348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.939830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.940912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.942063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:26.104884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.107103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.118880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.119850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.120627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.122777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.123773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.124498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.245218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.277616 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89c69dde-f410-4da2-b976-9692bf97766e tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.624875 Aug 24 03:33:26.279774 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 501/980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:25 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 1308 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:26.804830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.817840 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-68e6eda0-2bb8-469c-a6fd-2677e016942f tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1389 microversion: 2.1 time: 0.724855 Aug 24 03:33:26.837866 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 480/981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1389 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:27.314996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.315877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: f0ef8b75-d1d1-455b-94fd-0c27e607f2f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:27.330738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.334221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.334870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.337586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.340381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.340993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.397920 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] HTTP exception thrown: Instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 could not be found. Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Request method failure captured: Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 HTTP/1.1 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs9a3PSnWyPM4oxrtpOmhych2UNWusgJa-lwsewb0ma_NpTMELj20KNj5HVpRSejYJ11CDsiWDzARm7j_w9WmCaSk_xKrJeWjGSrra45x2OmDkhWDZoiNgbPGlgAVyB6FoU5vlzXl1ibHQi3SLCOMdp4YcaLkCFcOhA8hHy77yiz2s Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d347f85e59734622a091e80dbf0d9521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 906d6efeea2b4af59b76fae3e3531d7b Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 could not be found. Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'f0ef8b75-d1d1-455b-94fd-0c27e607f2f5'} Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 could not be found. Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 could not be found. Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:27.405212 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.415602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:27.415602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:27.415602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:27.415602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:27.415602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:27.415602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 could not be found. Aug 24 03:33:27.415602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.415602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Returning 404 to user: Instance f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:27.426565 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8252f093-e849-4a1a-8e50-6baf9d46b281 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5" status: 404 len: 111 microversion: 2.1 time: 0.106467 Aug 24 03:33:27.426565 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 502/982] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:27 2022] GET /compute/v2.1/servers/f0ef8b75-d1d1-455b-94fd-0c27e607f2f5 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:27.432238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.433087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 5d757e37-d39b-4278-a2c7-21ad1996a360] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:27.454888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.454888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.455299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.455748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.456212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.456641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.492170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] HTTP exception thrown: Instance 5d757e37-d39b-4278-a2c7-21ad1996a360 could not be found. Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Request method failure captured: Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 HTTP/1.1 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs9a3PSnWyPM4oxrtpOmhych2UNWusgJa-lwsewb0ma_NpTMELj20KNj5HVpRSejYJ11CDsiWDzARm7j_w9WmCaSk_xKrJeWjGSrra45x2OmDkhWDZoiNgbPGlgAVyB6FoU5vlzXl1ibHQi3SLCOMdp4YcaLkCFcOhA8hHy77yiz2s Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d347f85e59734622a091e80dbf0d9521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 906d6efeea2b4af59b76fae3e3531d7b Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 5d757e37-d39b-4278-a2c7-21ad1996a360 could not be found. Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5d757e37-d39b-4278-a2c7-21ad1996a360'} Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d757e37-d39b-4278-a2c7-21ad1996a360 could not be found. Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d757e37-d39b-4278-a2c7-21ad1996a360 could not be found. Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:27.494062 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d757e37-d39b-4278-a2c7-21ad1996a360 could not be found. Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Returning 404 to user: Instance 5d757e37-d39b-4278-a2c7-21ad1996a360 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4afeeee2-7ed0-4dd2-8d16-1595d26df5d3 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360" status: 404 len: 111 microversion: 2.1 time: 0.069251 Aug 24 03:33:27.509879 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 481/983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:27 2022] GET /compute/v2.1/servers/5d757e37-d39b-4278-a2c7-21ad1996a360 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:27.517506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cd4182f6-5480-4168-af9f-cedebdb6dc6f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.595842 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cd4182f6-5480-4168-af9f-cedebdb6dc6f tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/1ff4f6e9-c8a8-405a-adf4-1623460f9374" status: 204 len: 0 microversion: 2.1 time: 0.092676 Aug 24 03:33:27.596484 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 503/984] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:33:27 2022] DELETE /compute/v2.1/os-server-groups/1ff4f6e9-c8a8-405a-adf4-1623460f9374 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:33:27.606736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.607279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:27.624324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.625181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.627427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.629661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.635071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.636155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.726956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:33:27.857908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.863432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:27.909581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.916503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.917790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.926364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.929800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.934742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.047811 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0d450d60-c088-49d6-ae19-ba903f228a82 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d" status: 204 len: 0 microversion: 2.1 time: 0.444227 Aug 24 03:33:28.065714 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 482/985] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:27 2022] DELETE /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:33:28.080551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:28.090629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:28.101664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.103090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.103618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.104948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.105671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.106669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.152465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:33:28.162037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:28.313658 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e6c7f83-031f-4348-81c9-e9b372d42dad tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 204 len: 0 microversion: 2.1 time: 0.244816 Aug 24 03:33:28.315984 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 483/986] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:28 2022] DELETE /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:33:28.332091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:28.333353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:28.344064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.344755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.345690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.347624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.349545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.351900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.627007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.641908 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a552236d-3601-4929-a1f8-e06a632b5023 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1589 microversion: 2.1 time: 0.792251 Aug 24 03:33:28.655802 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 504/987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:27 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1589 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:28.678053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:28.679473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:28.690855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.692362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.693573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.695555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.696903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.698037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.873528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.920183 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a7c7ba8-93f8-4adc-8c5b-2e7b2ee09cda tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d" status: 200 len: 1473 microversion: 2.1 time: 0.596444 Aug 24 03:33:28.923886 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 484/988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:28 2022] GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d => generated 1473 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:29.065468 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0d9f78f5-3f07-450f-85d4-c8a8588515ef tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.395367 Aug 24 03:33:29.081095 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 505/989] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:33:28 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7/os-interface => generated 285 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:29.975783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:29.976933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:29.998167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.999328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:30.000300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.001980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:30.004384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:30.016136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.725160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:30.762929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-33d37aad-45b5-45c8-a246-b5f919b9a072 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d" status: 200 len: 1473 microversion: 2.1 time: 0.794298 Aug 24 03:33:30.773502 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 485/990] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:29 2022] GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d => generated 1473 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:31.817257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:31.822394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:31.852611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.858255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.859356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:31.860795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.868458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.874038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.936619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.004079 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01a713a2-45de-460d-9887-4cef8989e423 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d" status: 200 len: 1473 microversion: 2.1 time: 2.188990 Aug 24 03:33:34.005357 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 506/991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:31 2022] GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d => generated 1473 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:34.583558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6140a5d5-7eb4-4b7d-b77c-6110d89ae9e9 req-957ad5d7-38d9-4e30-9c8e-e7b69c6ca783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7aa936-21eb-4c3a-8829-a29d00b4814d", "name": "network-vif-deleted", "tag": "6a883dd7-0669-479f-8f71-6ce06bf55747"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:34.614911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:34.615348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:34.620616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6140a5d5-7eb4-4b7d-b77c-6110d89ae9e9 req-957ad5d7-38d9-4e30-9c8e-e7b69c6ca783 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.623862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6140a5d5-7eb4-4b7d-b77c-6110d89ae9e9 req-957ad5d7-38d9-4e30-9c8e-e7b69c6ca783 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.625742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6140a5d5-7eb4-4b7d-b77c-6110d89ae9e9 req-957ad5d7-38d9-4e30-9c8e-e7b69c6ca783 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.635948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.636485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.636935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.637682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.638147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.642940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.657740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6140a5d5-7eb4-4b7d-b77c-6110d89ae9e9 req-957ad5d7-38d9-4e30-9c8e-e7b69c6ca783 service nova] Creating event network-vif-deleted:6a883dd7-0669-479f-8f71-6ce06bf55747 for instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d on n-h2-846470-15 Aug 24 03:33:34.658085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:34.677390 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6140a5d5-7eb4-4b7d-b77c-6110d89ae9e9 req-957ad5d7-38d9-4e30-9c8e-e7b69c6ca783 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097562 Aug 24 03:33:34.680305 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 486/992] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:35.035919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:35.039546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:35.060062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.061565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.063565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.066969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.070414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.072443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.158442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.159386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.160679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.161681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid 4d7aa936-21eb-4c3a-8829-a29d00b4814d {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:35.359823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:35.386423 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8ddfd3f-910e-4712-936a-501da21ca219 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1589 microversion: 2.1 time: 0.773413 Aug 24 03:33:35.399813 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 507/993] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:34 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1589 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:35.483565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:35.512361 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8fda9002-4c6f-422f-a2a6-5c9b909b3aec tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d" status: 200 len: 1307 microversion: 2.1 time: 0.485442 Aug 24 03:33:35.546789 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 487/994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:35 2022] GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d => generated 1307 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:36.554129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:36.554944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 4d7aa936-21eb-4c3a-8829-a29d00b4814d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:36.571091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.573359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.579856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.581587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.582278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.583548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.655708 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] HTTP exception thrown: Instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d could not be found. Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Request method failure captured: Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d HTTP/1.1 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs9a3PSnWyPM4oxrtpOmhych2UNWusgJa-lwsewb0ma_NpTMELj20KNj5HVpRSejYJ11CDsiWDzARm7j_w9WmCaSk_xKrJeWjGSrra45x2OmDkhWDZoiNgbPGlgAVyB6FoU5vlzXl1ibHQi3SLCOMdp4YcaLkCFcOhA8hHy77yiz2s Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d347f85e59734622a091e80dbf0d9521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 906d6efeea2b4af59b76fae3e3531d7b Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d could not be found. Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '4d7aa936-21eb-4c3a-8829-a29d00b4814d'} Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d could not be found. Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d could not be found. Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:36.660572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:36.667213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:36.667213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:36.667213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:36.667213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:36.667213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:36.667213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d could not be found. Aug 24 03:33:36.667213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:36.669142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Returning 404 to user: Instance 4d7aa936-21eb-4c3a-8829-a29d00b4814d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:36.672883 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-334afe89-8579-464e-b121-66fcea766e40 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d" status: 404 len: 111 microversion: 2.1 time: 0.125411 Aug 24 03:33:36.674124 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 508/995] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:36 2022] GET /compute/v2.1/servers/4d7aa936-21eb-4c3a-8829-a29d00b4814d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:36.708721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-deb5a024-5dbc-4a80-9df0-1519745553d0 req-94793e73-b1de-41e4-a9ff-a4bad983f114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08e8a55-bcba-46e8-8d19-592b1a193bc7", "tag": "bb35f0ad-0556-43ca-8cfd-9cc8114faf00"}, {"server_uuid": "adea76d3-8c1f-4645-a7ba-5ede9ac10799", "name": "network-vif-deleted", "tag": "cb73f79b-76ad-496f-888b-ae6a7e36c8af"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:36.714236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:36.716051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:36.791695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.794969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.802286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.810881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.813227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-deb5a024-5dbc-4a80-9df0-1519745553d0 req-94793e73-b1de-41e4-a9ff-a4bad983f114 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.819948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.822167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.827291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-deb5a024-5dbc-4a80-9df0-1519745553d0 req-94793e73-b1de-41e4-a9ff-a4bad983f114 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.833305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-deb5a024-5dbc-4a80-9df0-1519745553d0 req-94793e73-b1de-41e4-a9ff-a4bad983f114 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.900637 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-deb5a024-5dbc-4a80-9df0-1519745553d0 req-94793e73-b1de-41e4-a9ff-a4bad983f114 service nova] Creating event network-changed:bb35f0ad-0556-43ca-8cfd-9cc8114faf00 for instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 on n-h1-846470-15 Aug 24 03:33:36.901448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-deb5a024-5dbc-4a80-9df0-1519745553d0 req-94793e73-b1de-41e4-a9ff-a4bad983f114 service nova] Creating event network-vif-deleted:cb73f79b-76ad-496f-888b-ae6a7e36c8af for instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 on n-h2-846470-15 Aug 24 03:33:36.927245 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-deb5a024-5dbc-4a80-9df0-1519745553d0 req-94793e73-b1de-41e4-a9ff-a4bad983f114 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.222706 Aug 24 03:33:36.928952 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 509/996] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:37.019044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.019825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.023604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.025517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid adea76d3-8c1f-4645-a7ba-5ede9ac10799 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:37.378147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:37.415201 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74b5abc8-f792-47dc-a571-501432dbe982 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 200 len: 1307 microversion: 2.1 time: 0.725482 Aug 24 03:33:37.419443 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 488/997] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:36 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 1307 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:38.478381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:38.479795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: adea76d3-8c1f-4645-a7ba-5ede9ac10799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:38.506091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.511908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.520235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.521593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.522520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.523395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.557353 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] HTTP exception thrown: Instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 could not be found. Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Request method failure captured: Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 HTTP/1.1 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs9a3PSnWyPM4oxrtpOmhych2UNWusgJa-lwsewb0ma_NpTMELj20KNj5HVpRSejYJ11CDsiWDzARm7j_w9WmCaSk_xKrJeWjGSrra45x2OmDkhWDZoiNgbPGlgAVyB6FoU5vlzXl1ibHQi3SLCOMdp4YcaLkCFcOhA8hHy77yiz2s Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d347f85e59734622a091e80dbf0d9521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 906d6efeea2b4af59b76fae3e3531d7b Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 could not be found. Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'adea76d3-8c1f-4645-a7ba-5ede9ac10799'} Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 could not be found. Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 could not be found. Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:38.569602 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:38.576331 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:38.576331 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:38.576331 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:38.576331 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:38.576331 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:38.576331 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 could not be found. Aug 24 03:33:38.576331 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:38.578329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Returning 404 to user: Instance adea76d3-8c1f-4645-a7ba-5ede9ac10799 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:38.589185 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2d934dd-66c8-40f1-a520-906a4301824b tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799" status: 404 len: 111 microversion: 2.1 time: 0.131166 Aug 24 03:33:38.590399 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 510/998] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:38 2022] GET /compute/v2.1/servers/adea76d3-8c1f-4645-a7ba-5ede9ac10799 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:33:38.603318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29037481-fdc3-4494-bad7-338bee556181 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:38.690366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:38.701279 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29037481-fdc3-4494-bad7-338bee556181 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/6786a6c6-ae09-42a1-a032-6f0f14215e75" status: 204 len: 0 microversion: 2.1 time: 0.104050 Aug 24 03:33:38.708803 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 489/999] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:33:38 2022] DELETE /compute/v2.1/os-server-groups/6786a6c6-ae09-42a1-a032-6f0f14215e75 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:33:38.716445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:38.718541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:38.744744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.746876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.749046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.750279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.754279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.756084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.840082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:33:39.010169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c93e5f48-73d6-4f45-9519-f3c28b3a52fa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "DELETE /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 204 len: 0 microversion: 2.1 time: 0.300267 Aug 24 03:33:39.010769 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 511/1000] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:33:38 2022] DELETE /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:33:39.027952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:39.029471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:39.040610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:39.041878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:39.042869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:39.044444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:39.045630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:39.046637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:39.394135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:39.406392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-974e1a3d-f730-42fa-b08e-aabaf0c42311 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1471 microversion: 2.1 time: 0.388463 Aug 24 03:33:39.407353 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 490/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:39 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1471 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:40.439759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:40.442936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:40.481197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.485965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.486883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.491125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.492037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.497466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.826746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:40.838718 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b7c7b7b9-fb7e-4c01-879b-1c375313681c tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1471 microversion: 2.1 time: 0.406221 Aug 24 03:33:40.839764 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 512/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:40 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1471 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:41.884904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:41.887031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:41.900163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.902608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.906072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:41.907546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.908935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.909903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.447851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.465595 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5333e3f9-8fb0-4050-97bc-a7c36870dc29 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1429 microversion: 2.1 time: 0.589135 Aug 24 03:33:42.473501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 491/1003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:41 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1429 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:42.527497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c1e3a50c-c1be-4bbb-90cb-8e43acd13cb9 req-f74005e4-1740-4c30-8c68-5bcaaedd1c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4", "name": "network-vif-deleted", "tag": "58bc2fa4-f5ed-4c39-b48d-4711daf944d9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:42.540886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:42.558271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c1e3a50c-c1be-4bbb-90cb-8e43acd13cb9 req-f74005e4-1740-4c30-8c68-5bcaaedd1c87 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.559919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c1e3a50c-c1be-4bbb-90cb-8e43acd13cb9 req-f74005e4-1740-4c30-8c68-5bcaaedd1c87 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.562766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c1e3a50c-c1be-4bbb-90cb-8e43acd13cb9 req-f74005e4-1740-4c30-8c68-5bcaaedd1c87 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.600887 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c1e3a50c-c1be-4bbb-90cb-8e43acd13cb9 req-f74005e4-1740-4c30-8c68-5bcaaedd1c87 service nova] Creating event network-vif-deleted:58bc2fa4-f5ed-4c39-b48d-4711daf944d9 for instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 on n-h2-846470-15 Aug 24 03:33:42.621908 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c1e3a50c-c1be-4bbb-90cb-8e43acd13cb9 req-f74005e4-1740-4c30-8c68-5bcaaedd1c87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100358 Aug 24 03:33:42.625797 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 513/1004] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:43.503905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:43.506091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:43.518630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:43.520169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:43.521157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:43.522598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:43.523649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:43.524911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:43.650583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:43.652641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:43.653801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:43.654793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lazy-loading 'fault' on Instance uuid 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:43.820317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906d6efeea2b4af59b76fae3e3531d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd347f85e59734622a091e80dbf0d9521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:43.854923 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8faca3ef-8de5-41d5-a8f0-ddd119c44daa tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 200 len: 1305 microversion: 2.1 time: 0.359319 Aug 24 03:33:43.863095 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 492/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:43 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 1305 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:44.884343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:44.885079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] [instance: 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:44.900451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.901928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.902840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:44.905482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.906268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.906928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:44.951142 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] HTTP exception thrown: Instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 could not be found. Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Request method failure captured: Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 HTTP/1.1 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs9a3PSnWyPM4oxrtpOmhych2UNWusgJa-lwsewb0ma_NpTMELj20KNj5HVpRSejYJ11CDsiWDzARm7j_w9WmCaSk_xKrJeWjGSrra45x2OmDkhWDZoiNgbPGlgAVyB6FoU5vlzXl1ibHQi3SLCOMdp4YcaLkCFcOhA8hHy77yiz2s Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d347f85e59734622a091e80dbf0d9521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d347f85e59734622a091e80dbf0d9521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d347f85e59734622a091e80dbf0d9521 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-245732413 Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 906d6efeea2b4af59b76fae3e3531d7b Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersOnMultiNodesTest-245732413-project Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 could not be found. Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4'} Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 could not be found. Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 could not be found. Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:33:44.954188 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:44.959453 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:33:44.959453 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:33:44.959453 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:33:44.959453 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:33:44.959453 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:33:44.959453 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 could not be found. Aug 24 03:33:44.959453 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:33:44.961449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] Returning 404 to user: Instance 370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:33:44.962852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d07960f7-acf7-4a0f-82ff-d79c069ab093 tempest-ServersOnMultiNodesTest-245732413 tempest-ServersOnMultiNodesTest-245732413-project] 10.222.0.58 "GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4" status: 404 len: 111 microversion: 2.1 time: 0.082844 Aug 24 03:33:44.964055 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 514/1006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:44 2022] GET /compute/v2.1/servers/370f0d95-dc1f-4860-a6be-1eb2b3cf6fd4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:33:50.805852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9152defa-3fdd-46cd-9717-7c9db078869a tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Action: 'create', calling method: .version_select at 0x7f10230d94c0>, body: {"pool": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:52.996598 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9152defa-3fdd-46cd-9717-7c9db078869a tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.139635 Aug 24 03:33:52.997588 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 493/1007] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:33:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:53.020167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5c339240-36cd-45a6-bee8-cf2871be62af tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Calling method '.version_select at 0x7f102b559c10>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:53.450058 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5c339240-36cd-45a6-bee8-cf2871be62af tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/a48eb5d1-99d9-4d73-8ccd-cac78ba76d9f" status: 200 len: 141 microversion: 2.1 time: 0.439263 Aug 24 03:33:53.455468 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 515/1008] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:33:53 2022] GET /compute/v2.1/os-floating-ips/a48eb5d1-99d9-4d73-8ccd-cac78ba76d9f => generated 141 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:53.470057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce0b9a1d-c608-44af-b2c2-10149ede6f28 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Calling method '.version_select at 0x7f10230a1940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:53.696102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:53.848789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:54.077785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce0b9a1d-c608-44af-b2c2-10149ede6f28 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.611529 Aug 24 03:33:54.078820 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 494/1009] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:33:53 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:54.099393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7145e2c8-0e11-4191-b612-8b73697843bd tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Calling method '.version_select at 0x7f10231ce820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:54.268260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-702146263", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:54.373271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:33:54.767264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:33:54.767950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:33:54.768538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:33:54.769492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:33:54.770331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:33:54.785326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:54.786349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:54.787633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:54.789833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:54.790966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:54.791858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:54.839140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Getting quotas for project 178acce277d94baf90bcf4b822c1fdc7. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:54.854307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Getting quotas for user 30fa234c08344cd0bae820dc6be36d38 and project 178acce277d94baf90bcf4b822c1fdc7. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:54.881663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:33:54.886267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:33:55.022977 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a597e3bf-cce3-41f9-8717-5280d566cb21 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154806 Aug 24 03:33:55.023816 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 516/1010] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:33:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:33:55.046733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cd4a9e97-1562-46e6-a509-1c22b7ece470 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:55.048194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cd4a9e97-1562-46e6-a509-1c22b7ece470 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:55.166181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cd4a9e97-1562-46e6-a509-1c22b7ece470 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:55.186121 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cd4a9e97-1562-46e6-a509-1c22b7ece470 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1213 microversion: 2.1 time: 0.143991 Aug 24 03:33:55.187151 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 517/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:55 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:56.120733 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7145e2c8-0e11-4191-b612-8b73697843bd tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/a48eb5d1-99d9-4d73-8ccd-cac78ba76d9f" status: 202 len: 0 microversion: 2.1 time: 2.031005 Aug 24 03:33:56.122649 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 495/1012] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:33:54 2022] DELETE /compute/v2.1/os-floating-ips/a48eb5d1-99d9-4d73-8ccd-cac78ba76d9f => generated 0 bytes in 2034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:33:56.160593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bbb57cdb-925a-416a-bacb-cec8349500cd tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Action: 'create', calling method: .version_select at 0x7f102b610310>, body: {"pool": null} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:56.225486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:56.230158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:56.261612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:56.262868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:56.264758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:56.266552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:56.267792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:56.269076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:56.397729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:56.425918 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-719b3bb7-2ce3-4e2e-be62-d8c41759cf60 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1265 microversion: 2.1 time: 0.208613 Aug 24 03:33:56.428026 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 496/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:56 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:57.478136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:57.480419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:57.497128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.500925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.503249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.509262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.510107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.510852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.676286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:57.688654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67eebf26-b2c4-4cca-aa7c-8561301709d1 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1271 microversion: 2.1 time: 0.218288 Aug 24 03:33:57.689531 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 497/1014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:57 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:58.182863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:58.190169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:58.226749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.227114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.227706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.228240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.232608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.238472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.308906 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bbb57cdb-925a-416a-bacb-cec8349500cd tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.176372 Aug 24 03:33:58.312935 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 518/1015] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:33:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:58.336124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ea48136-ecb1-422e-9b30-38411f564395 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Calling method '.version_select at 0x7f102b2b5e50>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:58.845270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid cf0590f4-ad3d-4016-b019-6e71212ff34e {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:58.870194 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0230d25c-ca74-44a8-9f73-a18d1a2ed762 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 2346 microversion: 2.25 time: 0.710762 Aug 24 03:33:58.871259 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 498/1016] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:58 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 2346 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:58.898182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:58.899381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:58.908509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.909790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.910835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.912978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.913848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.914650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:59.260181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:59.301194 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8013d015-7be8-474f-933f-0dd2389fce61 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.422699 Aug 24 03:33:59.302285 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 499/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:58 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:59.316141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-510a0b6f-0b2e-49ee-bca9-262eaadaf28d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:59.322086 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:33:59.322086 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:33:59.325126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-510a0b6f-0b2e-49ee-bca9-262eaadaf28d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:59.327850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-510a0b6f-0b2e-49ee-bca9-262eaadaf28d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:59.329124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-510a0b6f-0b2e-49ee-bca9-262eaadaf28d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:59.330874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-510a0b6f-0b2e-49ee-bca9-262eaadaf28d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:59.332155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-510a0b6f-0b2e-49ee-bca9-262eaadaf28d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:59.333217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-510a0b6f-0b2e-49ee-bca9-262eaadaf28d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:59.453045 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-510a0b6f-0b2e-49ee-bca9-262eaadaf28d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.143926 Aug 24 03:33:59.455304 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 500/1018] 10.222.0.58 () {60 vars in 1217 bytes} [Wed Aug 24 03:33:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:33:59.832557 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ea48136-ecb1-422e-9b30-38411f564395 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/2b5945bd-246d-4b29-9e07-5fa776d45f0d" status: 202 len: 0 microversion: 2.1 time: 1.506782 Aug 24 03:33:59.834291 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 519/1019] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:33:58 2022] DELETE /compute/v2.1/os-floating-ips/2b5945bd-246d-4b29-9e07-5fa776d45f0d => generated 0 bytes in 1511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:33:59.866800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8095975-f9ff-4eba-9e60-a72162f3ce77 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Calling method '.version_select at 0x7f10230d9820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.001984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-f8095975-f9ff-4eba-9e60-a72162f3ce77 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2b5945bd-246d-4b29-9e07-5fa776d45f0d could not be found", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:34:00.004290 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f8095975-f9ff-4eba-9e60-a72162f3ce77 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] HTTP exception thrown: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8095975-f9ff-4eba-9e60-a72162f3ce77 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Request method failure captured: Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-floating-ips/2b5945bd-246d-4b29-9e07-5fa776d45f0d HTTP/1.1 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZwdAu-Kakf9rOxKb1KnxogYZb7m5bfQzhzdtvbzU36suli_jv_sZzqD-mKs_VP-3Rnkva54IrLou-sfBUyLNnY9WSZ60bf5pIkRWivPklQ8McbvyPAV1iQ18AB65sIudCqoiM67bnAij0t7t9UsTOWcpSljWF95fFETWlwbVkQ-IQ0 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f61f4eeecd7e46dba3bde72854e0ed05 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FloatingIPsTestJSON-693341502 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f61f4eeecd7e46dba3bde72854e0ed05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f61f4eeecd7e46dba3bde72854e0ed05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f61f4eeecd7e46dba3bde72854e0ed05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f61f4eeecd7e46dba3bde72854e0ed05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FloatingIPsTestJSON-693341502 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f61f4eeecd7e46dba3bde72854e0ed05 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FloatingIPsTestJSON-693341502 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FloatingIPsTestJSON-693341502-project Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 3350ebfe7de74e8c99c7cc4af7f4c1a6 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FloatingIPsTestJSON-693341502-project Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: exception: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '2b5945bd-246d-4b29-9e07-5fa776d45f0d'} Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2b5945bd-246d-4b29-9e07-5fa776d45f0d could not be found Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45b0da60-b176-4c3e-9698-0e08dcfa407b'] Aug 24 03:34:00.113710 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d. Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8095975-f9ff-4eba-9e60-a72162f3ce77 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Returning 404 to user: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:00.118065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8095975-f9ff-4eba-9e60-a72162f3ce77 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/2b5945bd-246d-4b29-9e07-5fa776d45f0d" status: 404 len: 111 microversion: 2.1 time: 0.266055 Aug 24 03:34:00.120743 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 501/1020] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:33:59 2022] GET /compute/v2.1/os-floating-ips/2b5945bd-246d-4b29-9e07-5fa776d45f0d => generated 111 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:00.145636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b3ddaa66-43b3-4943-b530-b8f17521e1c5 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Calling method '.version_select at 0x7f102b500550>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.249082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-b3ddaa66-43b3-4943-b530-b8f17521e1c5 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2b5945bd-246d-4b29-9e07-5fa776d45f0d could not be found", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:34:00.250110 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b3ddaa66-43b3-4943-b530-b8f17521e1c5 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] HTTP exception thrown: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b3ddaa66-43b3-4943-b530-b8f17521e1c5 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Request method failure captured: Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-floating-ips/2b5945bd-246d-4b29-9e07-5fa776d45f0d HTTP/1.1 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZwdAu-Kakf9rOxKb1KnxogYZb7m5bfQzhzdtvbzU36suli_jv_sZzqD-mKs_VP-3Rnkva54IrLou-sfBUyLNnY9WSZ60bf5pIkRWivPklQ8McbvyPAV1iQ18AB65sIudCqoiM67bnAij0t7t9UsTOWcpSljWF95fFETWlwbVkQ-IQ0 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: f61f4eeecd7e46dba3bde72854e0ed05 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPsTestJSON-693341502 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f61f4eeecd7e46dba3bde72854e0ed05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f61f4eeecd7e46dba3bde72854e0ed05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f61f4eeecd7e46dba3bde72854e0ed05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f61f4eeecd7e46dba3bde72854e0ed05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPsTestJSON-693341502 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: f61f4eeecd7e46dba3bde72854e0ed05 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPsTestJSON-693341502 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPsTestJSON-693341502-project Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 3350ebfe7de74e8c99c7cc4af7f4c1a6 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPsTestJSON-693341502-project Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: exception: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '2b5945bd-246d-4b29-9e07-5fa776d45f0d'} Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2b5945bd-246d-4b29-9e07-5fa776d45f0d could not be found Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48573333-7d63-4a1c-993b-997e1df2aaae'] Aug 24 03:34:00.255925 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d. Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b3ddaa66-43b3-4943-b530-b8f17521e1c5 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] Returning 404 to user: Floating IP not found for ID 2b5945bd-246d-4b29-9e07-5fa776d45f0d {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b3ddaa66-43b3-4943-b530-b8f17521e1c5 tempest-FloatingIPsTestJSON-693341502 tempest-FloatingIPsTestJSON-693341502-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/2b5945bd-246d-4b29-9e07-5fa776d45f0d" status: 404 len: 111 microversion: 2.1 time: 0.120610 Aug 24 03:34:00.281797 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 520/1021] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:34:00 2022] DELETE /compute/v2.1/os-floating-ips/2b5945bd-246d-4b29-9e07-5fa776d45f0d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:00.317288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.332386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.335208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:00.359073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:00.363460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Searching by: {'deleted': False, 'project_id': 'b41af6d40f7d47f68cc866be9672d244'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:34:00.365174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.365816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.366445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.368835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.369344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.369811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.397063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.400246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.407484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.410709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.412345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.414048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.523505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:34:00.658171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-77635e5e-5888-4d34-9517-2ac862b7883b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.363765 Aug 24 03:34:00.661031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 502/1022] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 03:34:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:00.682884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.699445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:00.702760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Searching by: {'deleted': False, 'project_id': 'b41af6d40f7d47f68cc866be9672d244'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:34:00.721481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.723447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.725854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.729125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.733186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.735166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:01.008596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:01.011736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:34:01.017705 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-269eeb67-2fec-4515-8407-4b06c417a5be tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.696543 Aug 24 03:34:01.032577 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 521/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:00 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:01.037938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-de90558e-e600-4ccc-94f9-248c3acdea49 req-01acf731-0ca2-4e02-b896-4503a68a049d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32a278f-0c38-4fd5-81f5-eeca4416d759", "tag": "10972caa-6fbf-4bac-ad39-59df6c606d03"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:01.052556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-de90558e-e600-4ccc-94f9-248c3acdea49 req-01acf731-0ca2-4e02-b896-4503a68a049d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:01.059720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-de90558e-e600-4ccc-94f9-248c3acdea49 req-01acf731-0ca2-4e02-b896-4503a68a049d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:01.063171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-de90558e-e600-4ccc-94f9-248c3acdea49 req-01acf731-0ca2-4e02-b896-4503a68a049d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:01.101849 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-de90558e-e600-4ccc-94f9-248c3acdea49 req-01acf731-0ca2-4e02-b896-4503a68a049d service nova] Creating event network-changed:10972caa-6fbf-4bac-ad39-59df6c606d03 for instance d32a278f-0c38-4fd5-81f5-eeca4416d759 on n-h2-846470-15 Aug 24 03:34:01.124212 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-de90558e-e600-4ccc-94f9-248c3acdea49 req-01acf731-0ca2-4e02-b896-4503a68a049d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089922 Aug 24 03:34:01.131340 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 522/1024] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:01.273941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:01.303889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:01.307469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:01.308603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:01.950801 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-819f3b48-8a5c-4914-973f-8337ac79899c tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.280146 Aug 24 03:34:01.952288 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 503/1025] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:34:00 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:01.985043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebc7dd46-9bf4-46b5-a9ae-284f9fadc288 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:02.001112 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ebc7dd46-9bf4-46b5-a9ae-284f9fadc288 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020473 Aug 24 03:34:02.004004 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 523/1026] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:02.039791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:02.041166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:02.052503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.056496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.057226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.058169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.058925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.059515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.408294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:02.409339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:02.413375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:02.440362 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-35d8890a-d23f-47d1-bcfb-ee09dcafe0e3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.404819 Aug 24 03:34:02.448545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.456642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 504/1027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:02 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:02.460577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.463386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.469340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.478289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.481723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.645139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:02.924149 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de9bf210-0fdf-483e-bb32-f27bdf6f1c78 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 204 len: 0 microversion: 2.1 time: 0.522738 Aug 24 03:34:02.936538 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 524/1028] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:02 2022] DELETE /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:02.953213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:02.955918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:02.982057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.983150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.991096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.992571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.993643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.994634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.211971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:03.228606 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1860ed13-2a58-431c-9b7a-69d0ceae7c3e tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1608 microversion: 2.1 time: 0.284951 Aug 24 03:34:03.229837 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 505/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:02 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1608 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:03.488541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:03.490910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:03.504164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.507238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.508428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.510089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.511901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.512941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.864438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93393a76-274a-4e7b-a9ad-c8092fe9cbdf", "device": "/dev/xvdb"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:03.871722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:03.883999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.885380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.886425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.888986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.891943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.893353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.925617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:03.970354 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e65ee6dc-428f-440b-81e0-b517d84bd261 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.493050 Aug 24 03:34:03.973063 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 525/1030] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:03 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:04.274805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:04.276543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:04.304371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:04.309124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:04.309404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:04.312224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:04.313060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:04.313842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:04.812868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:05.124264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:05.131936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:05.140104 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e195bfcd-8262-4de8-8e09-1937d0253889 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1608 microversion: 2.1 time: 0.878433 Aug 24 03:34:05.141340 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 526/1031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:04 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1608 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:05.161160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:05.162061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:05.175104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:05.181817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:05.183375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:05.184038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:05.187158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:05.188151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:05.189293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:05.520408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:05.536407 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c7057b7d-5c8d-4aba-bc93-a40e8e116ba3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.393744 Aug 24 03:34:05.537020 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 527/1032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:05 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:06.170747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:06.172401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:06.183909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.184820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.185624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.186861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.187637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.188327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.521859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:06.549058 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e19d1ff7-9df9-4fba-97d0-ba09098abe29 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1608 microversion: 2.1 time: 0.386784 Aug 24 03:34:06.550404 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 528/1033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:06 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1608 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:06.609383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:06.614513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:06.643791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.653906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.655506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.657515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.658608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.659929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.104783 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a85c37bc-1bce-4259-b58a-0c430f5538c7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "POST /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 3.248069 Aug 24 03:34:07.106205 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 506/1034] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 24 03:34:03 2022] POST /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments => generated 194 bytes in 3251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:07.439854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-765c42d2-c2ef-47e4-934b-b6bebd2e92ce tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Action: 'create', calling method: .version_select at 0x7f1022f003a0>, body: {"keypair": {"name": "tempest-keypair-157812234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwQ/bWw9jwSnHNJ2xnlPXXmtE/Xk8ZDpewcSER+93lwo5fElimBJzL7BWMcgRPyKLqzjAK3GyeJEOLOwmLJ7sQhFUGIHJlXSFEM0Yd+RnNxFaPci2sk+MMfKzAEKh2Pfw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:07.476615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-765c42d2-c2ef-47e4-934b-b6bebd2e92ce tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Getting quotas for project 2b4ede14edb348d2a7285cad101c81bf. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:07.488918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:07.489968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-765c42d2-c2ef-47e4-934b-b6bebd2e92ce tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Getting quotas for user d0391b542eb6463ca68946e4d76cb551 and project 2b4ede14edb348d2a7285cad101c81bf. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:07.514242 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2dc055a-4055-4edd-8342-f8987d18b9cb tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.939680 Aug 24 03:34:07.518861 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 529/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:06 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:07.556125 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-765c42d2-c2ef-47e4-934b-b6bebd2e92ce tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.442722 Aug 24 03:34:07.558159 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 507/1036] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:34:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:07.600717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:07.602143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:07.621110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.628184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.629753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.631223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.632235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.636980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:08.568661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:08.577737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:08.602822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:08.609814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:08.610691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:08.616220 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5dcb9639-3b7a-4843-8952-c9a8b9bed55d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1608 microversion: 2.1 time: 1.029183 Aug 24 03:34:08.616505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:08.616830 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 530/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:07 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1608 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:08.633502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:08.634413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:08.635239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.033231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:09.048886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-698a0ada-36e9-4dd6-b30d-b549781fcffe tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.499260 Aug 24 03:34:09.050972 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 508/1038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:08 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:09.592654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-501eaa76-1fb3-4996-a964-939baba23388 req-cf29ecf4-8fe6-4120-9b7e-26ae6ee8e809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b400f037-8a8c-41a0-9c86-0827aef143cf", "name": "network-vif-deleted", "tag": "c4ac14fd-0855-4c88-a576-dc68a2cd8b95"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:09.655689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:09.656675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:09.662987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-501eaa76-1fb3-4996-a964-939baba23388 req-cf29ecf4-8fe6-4120-9b7e-26ae6ee8e809 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.665615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-501eaa76-1fb3-4996-a964-939baba23388 req-cf29ecf4-8fe6-4120-9b7e-26ae6ee8e809 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.666471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-501eaa76-1fb3-4996-a964-939baba23388 req-cf29ecf4-8fe6-4120-9b7e-26ae6ee8e809 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.672009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.674255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.675932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.676766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.677259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.679447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.718767 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-501eaa76-1fb3-4996-a964-939baba23388 req-cf29ecf4-8fe6-4120-9b7e-26ae6ee8e809 service nova] Creating event network-vif-deleted:c4ac14fd-0855-4c88-a576-dc68a2cd8b95 for instance b400f037-8a8c-41a0-9c86-0827aef143cf on n-h2-846470-15 Aug 24 03:34:09.730185 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-501eaa76-1fb3-4996-a964-939baba23388 req-cf29ecf4-8fe6-4120-9b7e-26ae6ee8e809 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147448 Aug 24 03:34:09.736618 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 531/1039] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:09.862605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:09.886376 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b805914-b0f0-4f7e-8b88-bc0b27fdc40d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.235925 Aug 24 03:34:09.893620 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 509/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:09 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:10.090794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:10.094410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:10.118163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.119476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.120560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.143835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.145298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.146435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.514979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:10.543960 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d5caadf4-885a-45dc-8ba9-ee4d26f488dc tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.460213 Aug 24 03:34:10.548029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 532/1041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:10 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:10.921655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:10.925879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:10.937380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:10.958195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.959088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.959954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.961279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.962361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.963885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.112561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:11.128144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-603629473", "imageRef": "1c1b216e-60f2-4a83-9f1e-df92f548e270", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e15c254a-26a3-4b66-a11e-e49471991f03"}], "security_groups": [{"name": "tempest-securitygroup--1540626157"}], "key_name": "tempest-keypair-157812234", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:11.139793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0187953c-301c-4c4e-ad8e-40ce64241b9b tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.227983 Aug 24 03:34:11.145314 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 510/1042] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:10 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:11.271904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] validate_networks() for [('e15c254a-26a3-4b66-a11e-e49471991f03', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:34:11.570711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:11.572095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:11.593970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.596063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.597966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.601123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.603153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.605097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.891375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:11.908412 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74eb2271-9ec2-4379-8763-f475cfba0a0c tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.345688 Aug 24 03:34:11.909304 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 511/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:11 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:12.092963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:34:12.093893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:34:12.094871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:34:12.096576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:34:12.097374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:34:12.118771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.119747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.120358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.122073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.123688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.124521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.160772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Getting quotas for project 2b4ede14edb348d2a7285cad101c81bf. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:12.170640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:12.171428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:12.178235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.178741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.179183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.179655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Getting quotas for user d0391b542eb6463ca68946e4d76cb551 and project 2b4ede14edb348d2a7285cad101c81bf. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:12.179915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.180425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.180801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.206054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:12.222179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:34:12.227921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c1b216e-60f2-4a83-9f1e-df92f548e270',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:34:12.264297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:12.292507 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b75bc8c-901e-449d-9c5e-e0fb39df2c31 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.126719 Aug 24 03:34:12.294035 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 512/1044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:12 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:12.361893 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-55a229a0-6bd0-4a4c-9fab-f78c51c156e8 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.239603 Aug 24 03:34:12.371002 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 533/1045] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:34:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:34:12.378702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f855aeb-cfba-4f84-a05c-6c4fc8c974d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:12.379381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f855aeb-cfba-4f84-a05c-6c4fc8c974d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:12.477764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f855aeb-cfba-4f84-a05c-6c4fc8c974d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:12.487860 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f855aeb-cfba-4f84-a05c-6c4fc8c974d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1244 microversion: 2.1 time: 0.113589 Aug 24 03:34:12.489042 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 513/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:12 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:12.688623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cae05011-2a7b-49bd-b7e9-f44d964dcc07 req-49bcdccc-7e01-4d2d-8366-d51bfbebb1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32a278f-0c38-4fd5-81f5-eeca4416d759", "name": "network-vif-plugged", "status": "completed", "tag": "10972caa-6fbf-4bac-ad39-59df6c606d03"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:12.713512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cae05011-2a7b-49bd-b7e9-f44d964dcc07 req-49bcdccc-7e01-4d2d-8366-d51bfbebb1f7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.713895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cae05011-2a7b-49bd-b7e9-f44d964dcc07 req-49bcdccc-7e01-4d2d-8366-d51bfbebb1f7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.714378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cae05011-2a7b-49bd-b7e9-f44d964dcc07 req-49bcdccc-7e01-4d2d-8366-d51bfbebb1f7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.748828 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cae05011-2a7b-49bd-b7e9-f44d964dcc07 req-49bcdccc-7e01-4d2d-8366-d51bfbebb1f7 service nova] Creating event network-vif-plugged:10972caa-6fbf-4bac-ad39-59df6c606d03 for instance d32a278f-0c38-4fd5-81f5-eeca4416d759 on n-h2-846470-15 Aug 24 03:34:12.762919 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cae05011-2a7b-49bd-b7e9-f44d964dcc07 req-49bcdccc-7e01-4d2d-8366-d51bfbebb1f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079932 Aug 24 03:34:12.765213 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 534/1047] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:12.952514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:12.953479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:12.963427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.964772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.965512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.967235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.968035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.968912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.312519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:13.324844 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab390cb1-10f9-49a1-bb7a-d75f7612a2ff tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.378335 Aug 24 03:34:13.326400 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 514/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:12 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:13.373706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:13.377063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:13.404012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.406072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.408254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.415897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.416908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.420616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.509621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:13.510375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:13.522324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.523206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.524233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.526152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.527011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.527880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.571151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:13.585000 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a03b26e8-1d58-4bc4-9b6b-f8168d6d6ca2 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.229891 Aug 24 03:34:13.588136 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 535/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:13 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:13.653032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:13.676702 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae2cee62-8095-427f-8f4a-cc08cbea93f2 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1240 microversion: 2.1 time: 0.170887 Aug 24 03:34:13.680719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 515/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:13 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1240 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:14.379497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:14.380513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:14.407773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.410535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.411403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.414620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.416292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.416918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.616385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:14.625201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:14.648823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.649737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.660126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.661693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.662562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.663372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.827283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:14.844037 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a66b47e8-717c-4d09-980d-b5aea4ea1386 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1313 microversion: 2.1 time: 0.478606 Aug 24 03:34:14.862941 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 536/1051] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:14 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:14.885507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:14.887591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:14.898859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.900248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.901325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.903018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.904428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.905618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.946825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:14.964182 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f606a84-590a-4c3f-b98c-32d82a52d19d tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.355562 Aug 24 03:34:14.967225 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 516/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:14 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:15.080857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:15.098492 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09be34a9-a9b5-4f7d-aaa9-87152af57aec tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1314 microversion: 2.1 time: 0.232606 Aug 24 03:34:15.107491 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 537/1053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:14 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:15.890957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:15.892135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:15.924270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:15.925621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:15.927314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:15.928985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:15.938969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:15.939869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:15.993215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:15.995774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:15.999244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:16.020123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.020658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.021172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.028945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.035638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.038349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.243589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:16.258106 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5069154-156b-497f-9df6-f1e179d6fb19 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.268875 Aug 24 03:34:16.265302 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 538/1054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:15 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:16.276885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:16.278259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:16.289023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.299125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.299973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.300935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.301573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.302179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.448291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:16.467811 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02726703-4cb8-4aff-b8bc-0a52d666ea03 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1302 microversion: 2.1 time: 0.196281 Aug 24 03:34:16.491139 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 539/1055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:16 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1302 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:17.030452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:17.085300 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-062b5896-e841-4321-b79e-d773f05885d3 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1463 microversion: 2.1 time: 1.179446 Aug 24 03:34:17.095031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 517/1056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:15 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1463 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:17.313186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:17.314237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:17.354873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:17.355761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:17.356558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:17.357981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:17.358768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:17.359507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:17.886633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b3862e2-bc87-496c-ac74-36e63dda840e tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Calling method '.version_select at 0x7f102b685d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:17.939147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b3862e2-bc87-496c-ac74-36e63dda840e tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:17.940030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b3862e2-bc87-496c-ac74-36e63dda840e tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:17.940475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b3862e2-bc87-496c-ac74-36e63dda840e tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:17.961879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b3862e2-bc87-496c-ac74-36e63dda840e tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:17.963014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b3862e2-bc87-496c-ac74-36e63dda840e tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:17.963792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b3862e2-bc87-496c-ac74-36e63dda840e tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.011180 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b3862e2-bc87-496c-ac74-36e63dda840e tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/178acce277d94baf90bcf4b822c1fdc7?start=2022-08-23T03%3A34%3A17.132340&end=2022-08-25T03%3A34%3A17.132340" status: 200 len: 694 microversion: 2.1 time: 0.870496 Aug 24 03:34:18.016524 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 540/1057] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Aug 24 03:34:17 2022] GET /compute/v2.1/os-simple-tenant-usage/178acce277d94baf90bcf4b822c1fdc7?start=2022-08-23T03%3A34%3A17.132340&end=2022-08-25T03%3A34%3A17.132340 => generated 694 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:18.032146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:18.037550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:18.059447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.063046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.064695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.071487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.073254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.084496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.222603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:18.234238 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7601c26b-2e72-44ef-bb5d-b8af3c3e5021 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1302 microversion: 2.1 time: 0.216134 Aug 24 03:34:18.235710 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 541/1058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:18 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1302 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:18.243833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f53045d8-c656-4a11-9af5-a980d9b8d9ee tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '.version_select at 0x7f102b500ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:18.256053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f53045d8-c656-4a11-9af5-a980d9b8d9ee tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.257102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f53045d8-c656-4a11-9af5-a980d9b8d9ee tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.257739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f53045d8-c656-4a11-9af5-a980d9b8d9ee tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.275034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f53045d8-c656-4a11-9af5-a980d9b8d9ee tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.276402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f53045d8-c656-4a11-9af5-a980d9b8d9ee tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.276856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f53045d8-c656-4a11-9af5-a980d9b8d9ee tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.297536 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f53045d8-c656-4a11-9af5-a980d9b8d9ee tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/178acce277d94baf90bcf4b822c1fdc7?start=2022-08-23T03%3A34%3A17.132340&end=2022-08-25T03%3A34%3A17.132340" status: 200 len: 694 microversion: 2.1 time: 0.060425 Aug 24 03:34:18.309777 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 542/1059] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Aug 24 03:34:18 2022] GET /compute/v2.1/os-simple-tenant-usage/178acce277d94baf90bcf4b822c1fdc7?start=2022-08-23T03%3A34%3A17.132340&end=2022-08-25T03%3A34%3A17.132340 => generated 694 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:18.319512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c0e23138-dccb-4d00-8043-ca5212b00004 tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Calling method '.version_select at 0x7f102b3b8dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:18.336164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0e23138-dccb-4d00-8043-ca5212b00004 tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.337335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0e23138-dccb-4d00-8043-ca5212b00004 tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.338954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0e23138-dccb-4d00-8043-ca5212b00004 tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.377972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0e23138-dccb-4d00-8043-ca5212b00004 tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.382290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0e23138-dccb-4d00-8043-ca5212b00004 tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.388249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0e23138-dccb-4d00-8043-ca5212b00004 tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.544733 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c0e23138-dccb-4d00-8043-ca5212b00004 tempest-TenantUsagesTestJSON-716887578 tempest-TenantUsagesTestJSON-716887578-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T03%3A34%3A17.132340&end=2022-08-25T03%3A34%3A17.132340&detailed=1" status: 200 len: 13368 microversion: 2.1 time: 0.232610 Aug 24 03:34:18.564110 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 543/1060] 10.222.0.58 () {58 vars in 1335 bytes} [Wed Aug 24 03:34:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T03%3A34%3A17.132340&end=2022-08-25T03%3A34%3A17.132340&detailed=1 => generated 13368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:18.587264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:18.589010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:18.600793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.602259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.603423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.605169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.606320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.607486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.664778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:18.692203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:18.703104 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d59c383d-3a2f-4231-98c6-896b956fbb98 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 1.397907 Aug 24 03:34:18.730187 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 518/1061] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:17 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:19.028063 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8825391c-3d26-42ba-bc04-befb1cebbac6 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 204 len: 0 microversion: 2.1 time: 0.444168 Aug 24 03:34:19.033560 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 544/1062] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:18 2022] DELETE /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:19.050653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:19.055423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:19.074662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:19.076896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:19.078009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:19.079530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:19.080979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:19.083466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:19.301764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:19.324779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:19.345425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:19.346068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:19.346774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:19.347587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:19.348128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:19.348563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:19.728682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:19.731457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:19.749729 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11133838-1f7d-4765-aea0-e3e4bc2072ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.493613 Aug 24 03:34:19.765169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 545/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:19 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:19.788518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:19.800652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:19.827501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:19.829824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:19.831490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:19.836034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:19.840233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:19.843784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:19.900860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:19.947601 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4867722e-af09-4a92-85db-2fd09e651751 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1469 microversion: 2.1 time: 0.906447 Aug 24 03:34:19.953356 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 519/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:19 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1469 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:20.247227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:20.279123 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6ac508a-5ab0-41c1-a114-48569b442a74 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.511912 Aug 24 03:34:20.290519 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 546/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:19 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:20.794033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:20.797678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:20.833967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.840629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.843213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.845272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.854743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.858438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.988507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:20.989127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:20.999346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.999986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.000430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.001166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.011528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.012496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.674414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:21.698096 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2ade3c3-68c8-4911-a64a-06a9ead9da5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.913454 Aug 24 03:34:21.700310 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 520/1066] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:20 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:21.710218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:21.712209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:21.727171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.729503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.732236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.734388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.735638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.736794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.949170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:21.988355 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-abe3dd3d-7fe5-4f3b-ac8b-f550b0f2363a tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.284381 Aug 24 03:34:21.995404 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 521/1067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:21 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:22.125485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:22.150420 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5bab19d2-19cb-47d8-bea2-142b8e4ce049 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1469 microversion: 2.1 time: 1.166092 Aug 24 03:34:22.155441 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 547/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:20 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1469 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:22.240330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5adf8531-3c3a-4910-a86e-092f0284e8f4 req-ff057373-a500-42a2-83be-2c98281114b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6", "tag": "38c92963-f8fb-45f3-a11d-91993bd60399"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:22.277606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5adf8531-3c3a-4910-a86e-092f0284e8f4 req-ff057373-a500-42a2-83be-2c98281114b5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:22.285822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5adf8531-3c3a-4910-a86e-092f0284e8f4 req-ff057373-a500-42a2-83be-2c98281114b5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:22.287426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5adf8531-3c3a-4910-a86e-092f0284e8f4 req-ff057373-a500-42a2-83be-2c98281114b5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:22.341450 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5adf8531-3c3a-4910-a86e-092f0284e8f4 req-ff057373-a500-42a2-83be-2c98281114b5 service nova] Creating event network-changed:38c92963-f8fb-45f3-a11d-91993bd60399 for instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 on n-h1-846470-15 Aug 24 03:34:22.358938 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5adf8531-3c3a-4910-a86e-092f0284e8f4 req-ff057373-a500-42a2-83be-2c98281114b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120425 Aug 24 03:34:22.360436 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 522/1069] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:22.764589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:22.768468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:22.826404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:22.845878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:22.851181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:22.858116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:22.863440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:22.869168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:22.871488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.019362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:23.033357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:23.049997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:23.079524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.085954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.087061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.088932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.096573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.104336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.344257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f57e4946f04ad8973c2cd6477e7ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41af6d40f7d47f68cc866be9672d244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:23.406696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8e53a6e-1f60-4189-9830-54e872bbe6f1 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 200 len: 1251 microversion: 2.1 time: 0.389388 Aug 24 03:34:23.426898 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 523/1070] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:23 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 1251 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:23.467362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:23.471214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:23.515158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.516597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.517614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.519201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.520369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.526238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.688709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:24.721087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:24.726268 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a131f770-c1a2-4ca2-9383-0703f0c3a677 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 1.983416 Aug 24 03:34:24.728132 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 548/1071] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:22 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:24.737507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:24.748990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] [instance: b400f037-8a8c-41a0-9c86-0827aef143cf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:24.760616 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bfd36f3d-b24c-4d35-8d2e-ab67722c1fd9 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1469 microversion: 2.1 time: 1.302412 Aug 24 03:34:24.765086 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 524/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:23 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1469 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:24.780779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.782223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.782978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.785448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.788076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.792429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.850178 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] HTTP exception thrown: Instance b400f037-8a8c-41a0-9c86-0827aef143cf could not be found. Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Request method failure captured: Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf HTTP/1.1 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuy7tHfWk2NRiNSilbPwxJLV0Ha1yz-EBz5PU2IG-IdNH0nKFE-yV4g60AX0CIVQQe7M5d-P2GzrUJUhNG6hL0_Xarzp7Kuz6DE83K76_8VFoHXYN8zrGeUTLpOyWmsY7rhWzQ6ZLvypanNm_IieZF7GU5k6txMgaTKNQHvJN0CpzU Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b41af6d40f7d47f68cc866be9672d244 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestBootFromVolume-1853455176 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b41af6d40f7d47f68cc866be9672d244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b41af6d40f7d47f68cc866be9672d244"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b41af6d40f7d47f68cc866be9672d244"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b41af6d40f7d47f68cc866be9672d244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestBootFromVolume-1853455176 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b41af6d40f7d47f68cc866be9672d244 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1853455176 Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestBootFromVolume-1853455176-project Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 00f57e4946f04ad8973c2cd6477e7ddb Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestBootFromVolume-1853455176-project Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance b400f037-8a8c-41a0-9c86-0827aef143cf could not be found. Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'b400f037-8a8c-41a0-9c86-0827aef143cf'} Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b400f037-8a8c-41a0-9c86-0827aef143cf could not be found. Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b400f037-8a8c-41a0-9c86-0827aef143cf could not be found. Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:24.852213 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:24.857981 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:24.857981 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:24.857981 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:24.857981 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:24.857981 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:24.857981 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b400f037-8a8c-41a0-9c86-0827aef143cf could not be found. Aug 24 03:34:24.857981 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:24.861825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Returning 404 to user: Instance b400f037-8a8c-41a0-9c86-0827aef143cf could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:24.868400 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee068fe7-5edc-4982-8548-79b794dda961 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf" status: 404 len: 111 microversion: 2.1 time: 0.139008 Aug 24 03:34:24.871051 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 549/1073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:24 2022] GET /compute/v2.1/servers/b400f037-8a8c-41a0-9c86-0827aef143cf => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:24.882654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2447e3f9-c28e-4195-b17f-12e5e6faf6a0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] Calling method '.version_select at 0x7f1022f388b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:24.918532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:24.983319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a3bcba4a-71a5-4374-a488-c87cbb3f7462 req-118e158b-6c14-4a13-882d-79034a2cdd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32a278f-0c38-4fd5-81f5-eeca4416d759", "name": "network-vif-unplugged", "status": "completed", "tag": "10972caa-6fbf-4bac-ad39-59df6c606d03"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:25.034149 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2447e3f9-c28e-4195-b17f-12e5e6faf6a0 tempest-ServersTestBootFromVolume-1853455176 tempest-ServersTestBootFromVolume-1853455176-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280229568" status: 202 len: 0 microversion: 2.1 time: 0.155135 Aug 24 03:34:25.042121 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 525/1074] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280229568 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:34:25.049947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3bcba4a-71a5-4374-a488-c87cbb3f7462 req-118e158b-6c14-4a13-882d-79034a2cdd18 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.057194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3bcba4a-71a5-4374-a488-c87cbb3f7462 req-118e158b-6c14-4a13-882d-79034a2cdd18 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.062615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3bcba4a-71a5-4374-a488-c87cbb3f7462 req-118e158b-6c14-4a13-882d-79034a2cdd18 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:25.115421 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a3bcba4a-71a5-4374-a488-c87cbb3f7462 req-118e158b-6c14-4a13-882d-79034a2cdd18 service nova] Creating event network-vif-unplugged:10972caa-6fbf-4bac-ad39-59df6c606d03 for instance d32a278f-0c38-4fd5-81f5-eeca4416d759 on n-h2-846470-15 Aug 24 03:34:25.156118 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a3bcba4a-71a5-4374-a488-c87cbb3f7462 req-118e158b-6c14-4a13-882d-79034a2cdd18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.183798 Aug 24 03:34:25.178065 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 550/1075] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:25.755607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:25.757458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:25.803755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:25.804628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:25.822223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.829436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.829727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.830712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:25.832466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.833269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:25.833627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.834406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.835514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.848938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:25.850118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.852753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.193655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:27.212113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:27.227302 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-27388ea6-56c0-4753-b04b-486c3b2c64a9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 1.476876 Aug 24 03:34:27.232347 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a768ce31-4a33-4edd-a042-0d1cd6e7393e tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1469 microversion: 2.1 time: 1.429582 Aug 24 03:34:27.249947 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 526/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:25 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:27.269561 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 551/1077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:25 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1469 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:27.700264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-bbef0f5d-4c5a-465c-b9cb-7f807b959901 req-a110e57e-ebc7-4a18-b7c4-0954f7d197fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32a278f-0c38-4fd5-81f5-eeca4416d759", "name": "network-vif-deleted", "tag": "10972caa-6fbf-4bac-ad39-59df6c606d03"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:27.730231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bbef0f5d-4c5a-465c-b9cb-7f807b959901 req-a110e57e-ebc7-4a18-b7c4-0954f7d197fd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.734303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bbef0f5d-4c5a-465c-b9cb-7f807b959901 req-a110e57e-ebc7-4a18-b7c4-0954f7d197fd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.737824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bbef0f5d-4c5a-465c-b9cb-7f807b959901 req-a110e57e-ebc7-4a18-b7c4-0954f7d197fd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.812623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bbef0f5d-4c5a-465c-b9cb-7f807b959901 req-a110e57e-ebc7-4a18-b7c4-0954f7d197fd service nova] Creating event network-vif-deleted:10972caa-6fbf-4bac-ad39-59df6c606d03 for instance d32a278f-0c38-4fd5-81f5-eeca4416d759 on n-h2-846470-15 Aug 24 03:34:27.846843 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-bbef0f5d-4c5a-465c-b9cb-7f807b959901 req-a110e57e-ebc7-4a18-b7c4-0954f7d197fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150241 Aug 24 03:34:27.870638 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 527/1078] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:28.262768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:28.271013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:28.286510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:28.287822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:28.307993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:28.309268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:28.311300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:28.315353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:28.316001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:28.317050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:28.317556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:28.319210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:28.322021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:28.323263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:28.323384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:28.324266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:28.425085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:28.443637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:28.445099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:28.446751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:28.447354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lazy-loading 'fault' on Instance uuid d32a278f-0c38-4fd5-81f5-eeca4416d759 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:28.669732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fa234c08344cd0bae820dc6be36d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178acce277d94baf90bcf4b822c1fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:28.692119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9e50006a-32f0-40c1-bccc-47f267da1060 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 200 len: 1303 microversion: 2.1 time: 0.411336 Aug 24 03:34:28.709098 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 528/1079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:28 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 1303 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:29.034338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:29.056023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:29.061279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Searching by: {'deleted': False, 'project_id': '9ad6dc9d72524a938e879fd2ea583904'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:34:29.077449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.079599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.081399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.085395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.086593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:29.092651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.095378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.104282 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47010e6f-a9ad-4103-ac4e-26fab40cdb76 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.851684 Aug 24 03:34:29.122160 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 552/1080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:28 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:29.193279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:34:29.352268 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5efe21fd-c449-4e9d-bc78-c62bbd373829 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.320003 Aug 24 03:34:29.360703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 529/1081] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 03:34:29 2022] GET /compute/v2.1/servers => generated 333 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:29.378958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:29.384193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:29.385157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Searching by: {'deleted': False, 'project_id': '9ad6dc9d72524a938e879fd2ea583904'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:34:29.401761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.402277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.402859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.403877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.404954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.405237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.754720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:29.757846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] [instance: d32a278f-0c38-4fd5-81f5-eeca4416d759] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:29.771127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:34:29.773344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.774179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.787511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.788952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.791754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.792958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.917568 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] HTTP exception thrown: Instance d32a278f-0c38-4fd5-81f5-eeca4416d759 could not be found. Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Request method failure captured: Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 HTTP/1.1 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZwfG5TSSy-0QQwT9pOgqks79GsItt-CdHDb_2MlHi-b_7X6kSSWhk43YLOJu5tlut5XDBfjtTS2mH5-G2EXKTsMum-YnZ0z6Q8vGLe9wsz4ulEQuRVXnmAcnfElobN3F4cniJBaBJtE_u8iDOQVXeAfgoKTFTfW_HM-XsNLfMj4G9g Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 178acce277d94baf90bcf4b822c1fdc7 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TenantUsagesTestJSON-1912863530 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_178acce277d94baf90bcf4b822c1fdc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/178acce277d94baf90bcf4b822c1fdc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/178acce277d94baf90bcf4b822c1fdc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/178acce277d94baf90bcf4b822c1fdc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TenantUsagesTestJSON-1912863530 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 178acce277d94baf90bcf4b822c1fdc7 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1912863530 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TenantUsagesTestJSON-1912863530-project Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 30fa234c08344cd0bae820dc6be36d38 Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TenantUsagesTestJSON-1912863530-project Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d32a278f-0c38-4fd5-81f5-eeca4416d759 could not be found. Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd32a278f-0c38-4fd5-81f5-eeca4416d759'} Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32a278f-0c38-4fd5-81f5-eeca4416d759 could not be found. Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32a278f-0c38-4fd5-81f5-eeca4416d759 could not be found. Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:29.929647 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:29.943987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:29.943987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:29.943987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:29.943987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:29.943987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:29.943987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32a278f-0c38-4fd5-81f5-eeca4416d759 could not be found. Aug 24 03:34:29.943987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:29.943987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] Returning 404 to user: Instance d32a278f-0c38-4fd5-81f5-eeca4416d759 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:29.952836 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ffbaf010-8ad8-47e8-98c6-9dbb0237a094 tempest-TenantUsagesTestJSON-1912863530 tempest-TenantUsagesTestJSON-1912863530-project] 10.222.0.58 "GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759" status: 404 len: 111 microversion: 2.1 time: 0.206361 Aug 24 03:34:29.977651 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 530/1082] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:29 2022] GET /compute/v2.1/servers/d32a278f-0c38-4fd5-81f5-eeca4416d759 => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:30.079883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:30.111484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:30.115764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:30.116936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:30.151551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:30.155760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:30.191682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:30.196034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:30.201069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:30.212262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:30.214087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:30.215171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:30.768082 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-544d41c9-2794-42d2-ace9-379f8bcbc0ef tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.392601 Aug 24 03:34:30.770947 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 553/1083] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:34:29 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:30.795441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-260bad89-e987-464b-a586-77787512bb8c tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:30.820648 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-260bad89-e987-464b-a586-77787512bb8c tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029627 Aug 24 03:34:30.826174 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 554/1084] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:31.524552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3826826-e3a4-42d0-b793-a79030d8d2e7 tempest-FloatingIPDetailsNegativeTestJSON-1237188872 tempest-FloatingIPDetailsNegativeTestJSON-1237188872-project] Calling method '.version_select at 0x7f102b10db80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:31.868179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-c3826826-e3a4-42d0-b793-a79030d8d2e7 tempest-FloatingIPDetailsNegativeTestJSON-1237188872 tempest-FloatingIPDetailsNegativeTestJSON-1237188872-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a784a295-012a-4fb1-9936-8124bc7ba1be could not be found", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:34:31.882523 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-c3826826-e3a4-42d0-b793-a79030d8d2e7 tempest-FloatingIPDetailsNegativeTestJSON-1237188872 tempest-FloatingIPDetailsNegativeTestJSON-1237188872-project] HTTP exception thrown: Floating IP not found for ID a784a295-012a-4fb1-9936-8124bc7ba1be Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3826826-e3a4-42d0-b793-a79030d8d2e7 tempest-FloatingIPDetailsNegativeTestJSON-1237188872 tempest-FloatingIPDetailsNegativeTestJSON-1237188872-project] Request method failure captured: Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-floating-ips/a784a295-012a-4fb1-9936-8124bc7ba1be HTTP/1.1 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxGgDYz4zQVQC_n2e_IKbL4Qpfjd0MZ_0_qBfW54KaUUafBjxtAt2ESN6d0xctZZm8wVT8MGjiUhYcFJZ7GkVpuL7FfZ_YAwTTM8BHMIwDoUd-zTiX8qcuV5Ye_FPOP28XXZvStm3jTq85MDCMkCfFee1EvX7aHqGHKflkn7nZA7XQ Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9fa8340d7fe94c56807a725d03cf84bf Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1237188872 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9fa8340d7fe94c56807a725d03cf84bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9fa8340d7fe94c56807a725d03cf84bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9fa8340d7fe94c56807a725d03cf84bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9fa8340d7fe94c56807a725d03cf84bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1237188872 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9fa8340d7fe94c56807a725d03cf84bf Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1237188872 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1237188872-project Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 18e58ea99d984ccbba0a1ec8c5479e88 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1237188872-project Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: exception: Floating IP not found for ID a784a295-012a-4fb1-9936-8124bc7ba1be Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a784a295-012a-4fb1-9936-8124bc7ba1be'} Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:34:31.908860 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a784a295-012a-4fb1-9936-8124bc7ba1be could not be found Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d86e7758-9794-4408-98a9-c9bf216f7105'] Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a784a295-012a-4fb1-9936-8124bc7ba1be. Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a784a295-012a-4fb1-9936-8124bc7ba1be Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a784a295-012a-4fb1-9936-8124bc7ba1be Aug 24 03:34:31.917478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:34:31.928431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3826826-e3a4-42d0-b793-a79030d8d2e7 tempest-FloatingIPDetailsNegativeTestJSON-1237188872 tempest-FloatingIPDetailsNegativeTestJSON-1237188872-project] Returning 404 to user: Floating IP not found for ID a784a295-012a-4fb1-9936-8124bc7ba1be {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:31.929986 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c3826826-e3a4-42d0-b793-a79030d8d2e7 tempest-FloatingIPDetailsNegativeTestJSON-1237188872 tempest-FloatingIPDetailsNegativeTestJSON-1237188872-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/a784a295-012a-4fb1-9936-8124bc7ba1be" status: 404 len: 111 microversion: 2.1 time: 1.093557 Aug 24 03:34:31.935266 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 555/1085] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:34:30 2022] GET /compute/v2.1/os-floating-ips/a784a295-012a-4fb1-9936-8124bc7ba1be => generated 111 bytes in 1100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:31.954738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:31.958364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:31.982237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:31.985514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:31.988505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:31.990981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:31.992449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:31.993513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:32.060422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:32.343602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d410d09-cf66-4b1a-9a87-96336adf7784 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "DELETE /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 204 len: 0 microversion: 2.1 time: 0.405537 Aug 24 03:34:32.350763 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 556/1086] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:31 2022] DELETE /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:32.380210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:32.384956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:32.430661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:32.434058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:32.434919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:32.436422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:32.441227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:32.442143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:32.746862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:32.768474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3b1ea572-4972-4cc2-a196-79285e1057b9 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 2.628733 Aug 24 03:34:32.774665 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 531/1087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:30 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 2636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:33.249196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:33.280659 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-51abe4c0-6f87-4def-95f3-4ac7e925b6ff tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1701 microversion: 2.1 time: 0.920520 Aug 24 03:34:33.283338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 557/1088] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:32 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1701 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:33.812112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:33.815315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:33.843547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.850297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.853566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.856829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.866967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.868431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.941730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:34.317132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:34.319864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:34.334263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.335802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.336836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.338714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.339940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.341491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.347724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:34.365851 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-19a0284c-71ee-4ec9-a17b-34aaa1161f5e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.561281 Aug 24 03:34:34.366986 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 532/1089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:33 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:35.091028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:35.122069 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49e5efa1-d6a7-473b-b802-cead1e82989a tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1701 microversion: 2.1 time: 0.812207 Aug 24 03:34:35.126932 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 558/1090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:34 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1701 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:35.409756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:35.411120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:35.430650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:35.435482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:35.437198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:35.438246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:35.438958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:35.442466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.162134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:36.164126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:36.202813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.203755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.204453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.205614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.206350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.207032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.222283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:36.230822 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a36d42e5-1eed-4c0a-9b9c-275074cd6acd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.826995 Aug 24 03:34:36.231424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 533/1091] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:35 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:36.296474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:36.297654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:36.327972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.328524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.328978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.329816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.336572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.339103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.579655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:37.597440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid cf0590f4-ad3d-4016-b019-6e71212ff34e {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:37.608915 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-63b0c80d-20e5-4083-9565-e5b12e52a7f2 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1701 microversion: 2.1 time: 1.453304 Aug 24 03:34:37.624114 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 559/1092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:36 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1701 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:37.689527 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8d5241a-337f-40ec-a96d-12cde9328718 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 2424 microversion: 2.25 time: 1.399411 Aug 24 03:34:37.690906 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 534/1093] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:36 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 2424 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:37.706320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:37.711745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:37.722193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.722979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.723650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.724779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.725759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.726462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.808703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cbc2a324-861d-4d04-a255-e94a2ed782f8 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:37.842377 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cbc2a324-861d-4d04-a255-e94a2ed782f8 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.216400 Aug 24 03:34:37.861498 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 560/1094] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:37.870406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846470-15", "block_migration": "auto"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:37.891388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:37.906880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.907518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.908137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.921122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.921888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.922425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.006343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'flavor' on Instance uuid cf0590f4-ad3d-4016-b019-6e71212ff34e {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:38.068182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Going to try to live migrate instance to n-h1-846470-15 {{(pid=122535) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:34:38.592514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:38.605974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-45cb46a5-65bf-4ad9-8fba-7ef86d560f6a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.913016 Aug 24 03:34:38.619055 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 535/1095] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:37 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:38.641582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f93e9b52-0034-467d-b5b4-82d1c0a2b012 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:38.724726 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f93e9b52-0034-467d-b5b4-82d1c0a2b012 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3075 microversion: 2.1 time: 0.103421 Aug 24 03:34:38.734057 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 536/1096] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 03:34:38 2022] GET /compute/v2.1/flavors => generated 3075 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:38.762415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:38.763693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:38.790293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.791074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.791803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.793163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.804720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.805546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:39.129995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:39.415484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:39.444296 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec5ca4f3-08c1-45e2-b024-0dc76dd12d31 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1701 microversion: 2.1 time: 0.705903 Aug 24 03:34:39.449198 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 537/1097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:38 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1701 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:39.470085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3f79175e-58ba-42dc-8a15-b68b0f338d4d tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:39.509665 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3f79175e-58ba-42dc-8a15-b68b0f338d4d tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.057260 Aug 24 03:34:39.516573 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 538/1098] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:39.537202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:39.546350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-71895ae4-f6a1-4248-90a3-ee638c7df0a2 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:39.606037 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-71895ae4-f6a1-4248-90a3-ee638c7df0a2 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.074381 Aug 24 03:34:39.610602 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 539/1099] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:39.631112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3a7172a9-7953-4284-ab6c-dbab7f66fd76 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:39.770297 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3a7172a9-7953-4284-ab6c-dbab7f66fd76 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.147734 Aug 24 03:34:39.779572 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 540/1100] 10.222.0.58 () {58 vars in 1165 bytes} [Wed Aug 24 03:34:39 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:39.792685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:39.796396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:39.805469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:39.806185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:39.807455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:39.808456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:39.809523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:39.810534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:40.048952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:40.232463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:40.265544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2dd42ece-8a61-4f9f-9d17-647357289455 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.483914 Aug 24 03:34:40.267005 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 541/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:39 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:40.300251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fad6958-8dff-45d9-80a2-ff20f2056c34 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:40.322688 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fad6958-8dff-45d9-80a2-ff20f2056c34 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.053398 Aug 24 03:34:40.324435 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 542/1102] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:40.344867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2bafafa-4b0a-4a7a-9c79-61f4964e91ed tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:40.381886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d2bafafa-4b0a-4a7a-9c79-61f4964e91ed tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.042865 Aug 24 03:34:40.383095 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 543/1103] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 24 03:34:40 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:40.425305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c012f367-296e-4307-8125-9a4b8a33a18b tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:40.454586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c012f367-296e-4307-8125-9a4b8a33a18b tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.050542 Aug 24 03:34:40.468373 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 544/1104] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:34:40 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:40.480831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99b287e4-b26c-4296-8c0a-afc78c609259 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:40.502253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99b287e4-b26c-4296-8c0a-afc78c609259 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028709 Aug 24 03:34:40.515396 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 545/1105] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:40.524529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:40.526039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:40.539067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:40.540067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:40.541018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:40.542476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:40.543492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:40.545184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:41.035396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:41.046112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-588cc615-ddee-4439-bb8b-ec5659cc11c5 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1701 microversion: 2.1 time: 0.528805 Aug 24 03:34:41.048496 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 546/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:40 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1701 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:41.057560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6713ddab-145c-43eb-8f58-17821f6d93fb tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:41.188229 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6713ddab-145c-43eb-8f58-17821f6d93fb tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.137695 Aug 24 03:34:41.192828 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 547/1107] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 24 03:34:41 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:41.199998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "856924ed-9643-485a-a497-1a59e3eaa10d"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:41.204315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:41.213992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:41.215465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:41.216617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:41.217688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:41.218711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:41.220107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:41.767535 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-338e3e1f-55b9-4863-aa7d-58d98a0ec993 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "POST /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572148 Aug 24 03:34:41.768693 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 548/1108] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:34:41 2022] POST /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:41.789263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-08ea2896-3bfd-47fe-a61a-13315f348d9b tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:41.833167 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-08ea2896-3bfd-47fe-a61a-13315f348d9b tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.061893 Aug 24 03:34:41.834734 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 549/1109] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:41.848618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:41.850601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:41.862285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:41.863478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:41.868624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:41.869799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:41.870291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:41.870936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.287560 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b99b9247-5521-4dd3-aedb-263b47a16064 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/action" status: 202 len: 0 microversion: 2.25 time: 4.422959 Aug 24 03:34:42.289769 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 561/1110] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:34:37 2022] POST /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/action => generated 0 bytes in 4428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:42.307156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-895115f5-5eb7-44ed-afab-ef0cba216b7f tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:42.390330 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-895115f5-5eb7-44ed-afab-ef0cba216b7f tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.098236 Aug 24 03:34:42.391793 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 562/1111] 10.222.0.58 () {58 vars in 1144 bytes} [Wed Aug 24 03:34:42 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:42.421592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:42.425544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:42.452848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.455375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.456084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.456864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.459021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.461443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.505951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:42.519126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:42.528896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a1f2d768-08b0-44de-ac0c-284b30b8ff94 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.692240 Aug 24 03:34:42.540925 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 550/1112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:41 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:42.559479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:42.563188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:42.573633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.574488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.575142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:42.576258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:42.577613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:42.578627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:43.367800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:43.421890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:43.431371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:43.452258 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-57f663fb-72e9-4c96-aa43-ece42c1bd7d2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.904979 Aug 24 03:34:43.455529 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 551/1113] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:42 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:43.482405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3f93aa0-5ace-4deb-b5c8-0acea12efe70 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.525540 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3f93aa0-5ace-4deb-b5c8-0acea12efe70 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.060506 Aug 24 03:34:43.539763 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 552/1114] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:43.551716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66b70aee-c60d-41f0-9a15-08573920b034 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.586923 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66b70aee-c60d-41f0-9a15-08573920b034 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.044119 Aug 24 03:34:43.604238 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 553/1115] 10.222.0.58 () {58 vars in 1148 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:43.618147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.620813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:43.628497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:43.635711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:43.637220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:43.639162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:43.647603 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53250abf-6c28-4588-bec8-e5869d1911bb tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1701 microversion: 2.1 time: 1.252000 Aug 24 03:34:43.647603 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 563/1116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:42 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1701 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:43.649490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:43.650198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:43.650917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:43.665804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-513d7765-9e11-4891-a3b7-b149f12cba0a tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.694315 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-513d7765-9e11-4891-a3b7-b149f12cba0a tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.046090 Aug 24 03:34:43.701993 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 564/1117] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:43.711576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-690cd7ce-5b7c-49e0-87b2-21f7556fdfff tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.739178 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-690cd7ce-5b7c-49e0-87b2-21f7556fdfff tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025382 Aug 24 03:34:43.753348 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 565/1118] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:43.773728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6292112-49c1-4af5-992e-e098249890c4 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.893655 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6292112-49c1-4af5-992e-e098249890c4 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.126586 Aug 24 03:34:43.895125 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 566/1119] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:43.926658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a1141d5-842c-48b6-a21a-3c80a6061159 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:43.972008 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a1141d5-842c-48b6-a21a-3c80a6061159 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.056287 Aug 24 03:34:43.972641 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 567/1120] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:44.002418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9fd859b0-2d04-474b-abd7-89b0ffcfd407 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:44.012220 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9fd859b0-2d04-474b-abd7-89b0ffcfd407 tempest-FlavorsV2TestJSON-624886765 tempest-FlavorsV2TestJSON-624886765-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013901 Aug 24 03:34:44.012781 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 568/1121] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:44.079731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c5ea4495-45b8-44df-92c7-7f9befcad183 req-04f83d89-d654-46d1-a032-b6cd29b5c7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6", "name": "network-vif-plugged", "status": "completed", "tag": "38c92963-f8fb-45f3-a11d-91993bd60399"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:44.119399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5ea4495-45b8-44df-92c7-7f9befcad183 req-04f83d89-d654-46d1-a032-b6cd29b5c7a4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:44.119868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5ea4495-45b8-44df-92c7-7f9befcad183 req-04f83d89-d654-46d1-a032-b6cd29b5c7a4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:44.120453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5ea4495-45b8-44df-92c7-7f9befcad183 req-04f83d89-d654-46d1-a032-b6cd29b5c7a4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:44.171194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c5ea4495-45b8-44df-92c7-7f9befcad183 req-04f83d89-d654-46d1-a032-b6cd29b5c7a4 service nova] Creating event network-vif-plugged:38c92963-f8fb-45f3-a11d-91993bd60399 for instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 on n-h1-846470-15 Aug 24 03:34:44.196449 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c5ea4495-45b8-44df-92c7-7f9befcad183 req-04f83d89-d654-46d1-a032-b6cd29b5c7a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124044 Aug 24 03:34:44.197581 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 569/1122] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:44.263324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:44.276350 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed568e9f-0713-4de7-bf1c-561a0a87ba7e tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.670188 Aug 24 03:34:44.279763 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 554/1123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:43 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:44.474811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b93df107-9d92-45f3-8309-19ea87f613e6 req-b2e53d36-2c44-4210-9426-3b37a86c691e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a140ff-ed85-412e-9b12-362f2fad9ffa", "name": "network-vif-deleted", "tag": "db764fdd-927f-4f53-ab48-48e8691baa73"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:44.480703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:44.481666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:44.506178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:44.506909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:44.507586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:44.508904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:44.509734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:44.510489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:44.513182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b93df107-9d92-45f3-8309-19ea87f613e6 req-b2e53d36-2c44-4210-9426-3b37a86c691e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:44.517849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b93df107-9d92-45f3-8309-19ea87f613e6 req-b2e53d36-2c44-4210-9426-3b37a86c691e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:44.521824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b93df107-9d92-45f3-8309-19ea87f613e6 req-b2e53d36-2c44-4210-9426-3b37a86c691e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:44.566662 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b93df107-9d92-45f3-8309-19ea87f613e6 req-b2e53d36-2c44-4210-9426-3b37a86c691e service nova] Creating event network-vif-deleted:db764fdd-927f-4f53-ab48-48e8691baa73 for instance 73a140ff-ed85-412e-9b12-362f2fad9ffa on n-h1-846470-15 Aug 24 03:34:44.598878 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b93df107-9d92-45f3-8309-19ea87f613e6 req-b2e53d36-2c44-4210-9426-3b37a86c691e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128447 Aug 24 03:34:44.601833 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 570/1124] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:44.680039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:44.686359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:44.708707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:44.710927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:44.714477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:44.717569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:44.720971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:44.722089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:44.837697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:44.839097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:44.839910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:44.840419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lazy-loading 'fault' on Instance uuid 73a140ff-ed85-412e-9b12-362f2fad9ffa {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:44.853540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:44.876626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:44.880911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:44.882651 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-abc85c0d-c332-4bc9-b846-8a4d774621a9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.407469 Aug 24 03:34:44.888184 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 555/1125] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:44 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:45.304294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:45.305224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:45.312887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:45.313386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:45.313830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:45.314549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:45.315010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:45.315442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:45.641003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:45.658958 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b7c7953-4cb5-49e5-ad6d-2134e3f8ae16 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.357306 Aug 24 03:34:45.660479 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 556/1126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:45 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:45.826514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8784affc31e1450da0eef9261f5e280e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad6dc9d72524a938e879fd2ea583904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:45.841795 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-051ae7a1-3e05-44e9-a992-8a8898d55bd3 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 200 len: 1359 microversion: 2.1 time: 1.175034 Aug 24 03:34:45.842797 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 571/1127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:44 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 1359 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:45.954857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:45.961792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:45.989522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:45.995739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.000422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.004162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.006266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.007555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.606030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:46.689065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:46.697799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:46.702137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:46.703152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:46.705520 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-952af697-02b1-4374-a53a-e4098dbeb0ad tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.774781 Aug 24 03:34:46.723576 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 557/1128] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:45 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:46.732758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:46.752342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.754237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.754747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.755506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.765669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.768403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.872647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:46.873603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] [instance: 73a140ff-ed85-412e-9b12-362f2fad9ffa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:46.890225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.892904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.894796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.908519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:46.909613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:46.913008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:46.966975 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] HTTP exception thrown: Instance 73a140ff-ed85-412e-9b12-362f2fad9ffa could not be found. Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Request method failure captured: Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa HTTP/1.1 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZu5VBmzioDezJcyAf2qm4EOwl_y-lZMsanPlsC-jPxhpog_EkTQKaEvO4PVxmtJq_u1qmf8JDQWtJJ78nEur2PAQOd2Wgk7wyz2dhUJ_JwKODwjNx7b4kKhNLbNIFKlzELLWv9OxpE3WsNvHI8FxwoTXm-CD0SoBWN-RUyj8UlkLjw Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9ad6dc9d72524a938e879fd2ea583904 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-869607277 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ad6dc9d72524a938e879fd2ea583904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ad6dc9d72524a938e879fd2ea583904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ad6dc9d72524a938e879fd2ea583904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ad6dc9d72524a938e879fd2ea583904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-869607277 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9ad6dc9d72524a938e879fd2ea583904 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-869607277 Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-869607277-project Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 8784affc31e1450da0eef9261f5e280e Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-869607277-project Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 73a140ff-ed85-412e-9b12-362f2fad9ffa could not be found. Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '73a140ff-ed85-412e-9b12-362f2fad9ffa'} Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a140ff-ed85-412e-9b12-362f2fad9ffa could not be found. Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a140ff-ed85-412e-9b12-362f2fad9ffa could not be found. Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:46.969749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:46.974231 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:46.974231 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:46.974231 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:46.974231 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:46.974231 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a140ff-ed85-412e-9b12-362f2fad9ffa could not be found. Aug 24 03:34:46.974231 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:34:46.980141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Returning 404 to user: Instance 73a140ff-ed85-412e-9b12-362f2fad9ffa could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:46.982406 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d3e6888-820a-49c2-bd79-ae210fec01e9 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa" status: 404 len: 111 microversion: 2.1 time: 0.115087 Aug 24 03:34:46.986581 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 558/1129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:46 2022] GET /compute/v2.1/servers/73a140ff-ed85-412e-9b12-362f2fad9ffa => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:47.005008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a81ee177-a9c3-46c3-a231-a94d2c0a9949 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] Calling method '.version_select at 0x7f1022e70a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:47.054233 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a81ee177-a9c3-46c3-a231-a94d2c0a9949 tempest-ServersTestJSON-869607277 tempest-ServersTestJSON-869607277-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340405640" status: 202 len: 0 microversion: 2.1 time: 0.058076 Aug 24 03:34:47.057403 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 559/1130] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 03:34:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340405640 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:34:47.416799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:47.442296 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52d9ba3a-02b4-4dcb-b1bf-c58a93749dbd tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1370 microversion: 2.1 time: 0.746669 Aug 24 03:34:47.455380 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 572/1131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:46 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1370 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:47.742698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:47.746879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:47.773885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:47.774536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:47.781694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:47.782975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:47.785271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:47.790658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.226859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:48.281129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:48.284845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:48.287489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-82a9deaa-4f03-4445-ac26-4cf8583a6d99 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.549604 Aug 24 03:34:48.296878 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 560/1132] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:47 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:48.477429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:48.478031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:48.494110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.494946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.496181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:48.500445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:48.501297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:48.502434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.319298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:49.319945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:49.333827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:49.336118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:49.339835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.341112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:49.343220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:49.346290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.353515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:49.367657 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea5c8bbd-fd72-411b-a308-6d772d7318d3 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1556 microversion: 2.1 time: 0.895226 Aug 24 03:34:49.376440 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 573/1133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:48 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1556 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:49.406103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:49.406614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:49.433069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:49.433740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:49.434193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.435109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:49.435590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:49.436074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:49.449113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:49.637113 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58037b0b-36fb-4aad-b524-a957186e5b92 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235998 Aug 24 03:34:49.638089 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 574/1134] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:34:49 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:49.788796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:49.801910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:49.803516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:49.804776 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b98ade21-349c-4e50-8c53-7fc1dc927395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.490268 Aug 24 03:34:49.805352 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 561/1135] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:49 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:50.842136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:50.844389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:50.856916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.858309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.859384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:50.861045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.862183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.863188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.130397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-06c0b396-1aa0-4939-a78c-64d1fa7ef7f9 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Calling method '.version_select at 0x7f1022e7b700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:51.219530 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-06c0b396-1aa0-4939-a78c-64d1fa7ef7f9 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e" status: 200 len: 635 microversion: 2.1 time: 0.102753 Aug 24 03:34:51.231272 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 562/1136] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:51 2022] GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e => generated 635 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:51.236774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8022ec01-48af-4216-80d1-381c1f9838c1 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'update_all', calling method: .version_select at 0x7f1022f00940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:51.328527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-8022ec01-48af-4216-80d1-381c1f9838c1 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:51.342971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-8022ec01-48af-4216-80d1-381c1f9838c1 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:52.110147 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8022ec01-48af-4216-80d1-381c1f9838c1 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.877216 Aug 24 03:34:52.111798 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 563/1137] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:34:51 2022] PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 61 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:52.125458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d95cf6eb-059b-4889-b211-4b9e22a6e995 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Calling method '.version_select at 0x7f1022fd71f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:52.644732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:52.687739 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d95cf6eb-059b-4889-b211-4b9e22a6e995 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "DELETE /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.568238 Aug 24 03:34:52.688370 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 564/1138] 10.222.0.58 () {58 vars in 1296 bytes} [Wed Aug 24 03:34:52 2022] DELETE /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata/os_version => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:34:52.690816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:52.694925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:52.696609 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e93de1c9-59af-4cd7-9714-fd22a02d5b2d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 1.864619 Aug 24 03:34:52.697852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3a580966-ce66-42e1-9eb5-2b3ae0fc7179 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Calling method '.version_select at 0x7f1023021ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:52.698386 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 575/1139] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:50 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:52.783289 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3a580966-ce66-42e1-9eb5-2b3ae0fc7179 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.089250 Aug 24 03:34:52.785836 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 565/1140] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:34:52 2022] GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 37 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:52.796102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c1d57fd6-ec9f-4966-8b73-da4e965e8a07 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'update_all', calling method: .version_select at 0x7f102b1758b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:52.881267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c1d57fd6-ec9f-4966-8b73-da4e965e8a07 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:52.897305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c1d57fd6-ec9f-4966-8b73-da4e965e8a07 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:53.307801 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c1d57fd6-ec9f-4966-8b73-da4e965e8a07 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.516181 Aug 24 03:34:53.308794 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 576/1141] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:34:52 2022] PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 61 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:53.321798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb310d80-e88a-4e9d-8785-a83a2fb36fe8 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Calling method '.version_select at 0x7f1022f779d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.395619 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bb310d80-e88a-4e9d-8785-a83a2fb36fe8 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.079226 Aug 24 03:34:53.396315 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 566/1142] 10.222.0.58 () {58 vars in 1290 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata/os_distro => generated 33 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:53.422437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-353c6e5b-2ff2-4a97-8700-6d87082dd7d3 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'update_all', calling method: .version_select at 0x7f102afc24c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:53.610692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-353c6e5b-2ff2-4a97-8700-6d87082dd7d3 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:53.621445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-353c6e5b-2ff2-4a97-8700-6d87082dd7d3 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:53.750836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.756785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.789680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.790622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.795399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.797188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.799574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.800558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.045714 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-353c6e5b-2ff2-4a97-8700-6d87082dd7d3 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.630841 Aug 24 03:34:54.046681 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 577/1143] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:34:53 2022] PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 61 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:54.057216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8724b80c-1a3b-4e4e-8b7e-f4ea6a1d252c tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Calling method '.version_select at 0x7f102b1759d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:54.149193 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8724b80c-1a3b-4e4e-8b7e-f4ea6a1d252c tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.096886 Aug 24 03:34:54.149789 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 578/1144] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:34:54 2022] GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 61 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:34:54.162047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e931cf30-b7dd-4bd7-bd3f-493758ac3823 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'update_all', calling method: .version_select at 0x7f102afe5dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:54.241739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e931cf30-b7dd-4bd7-bd3f-493758ac3823 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:54.249331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e931cf30-b7dd-4bd7-bd3f-493758ac3823 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:54.475509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:54.507960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:54.514059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:54.514942 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31851dea-581d-4251-81ac-a057f4a72ad8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.791000 Aug 24 03:34:54.515608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 567/1145] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:54.564956 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e931cf30-b7dd-4bd7-bd3f-493758ac3823 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.407382 Aug 24 03:34:54.565447 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 579/1146] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:34:54 2022] PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 61 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:34:54.579030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15087475-98c4-4b13-94ae-52efeea8ac7a tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'update_all', calling method: .version_select at 0x7f1022e7b5e0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:54.679439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-15087475-98c4-4b13-94ae-52efeea8ac7a tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:54.696601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-15087475-98c4-4b13-94ae-52efeea8ac7a tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:55.351155 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15087475-98c4-4b13-94ae-52efeea8ac7a tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.776459 Aug 24 03:34:55.353265 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 568/1147] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:34:54 2022] PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 64 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:55.366061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72db2d2e-ab37-4e4e-b98f-039bd6f08142 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Calling method '.version_select at 0x7f102afc2790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:55.465812 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72db2d2e-ab37-4e4e-b98f-039bd6f08142 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.104706 Aug 24 03:34:55.468373 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 580/1148] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:34:55 2022] GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 64 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:55.481800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-323ff47d-2237-448d-add0-e6b7889c82bc tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'update_all', calling method: .version_select at 0x7f1022efd550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:55.545404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:55.546404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:55.560416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:55.573896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.574476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-323ff47d-2237-448d-add0-e6b7889c82bc tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:55.574858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.581261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.585830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-323ff47d-2237-448d-add0-e6b7889c82bc tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:55.589666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.599700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.600485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.294143 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-323ff47d-2237-448d-add0-e6b7889c82bc tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.816325 Aug 24 03:34:56.295082 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 569/1149] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:34:55 2022] PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 61 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:56.325190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff3d7bb5-40d6-4e8d-aa08-82e11b29b4a8 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'update', calling method: .version_select at 0x7f1022e7b790>, body: {"meta": {"os_version": "alt"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:56.462426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ff3d7bb5-40d6-4e8d-aa08-82e11b29b4a8 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:56.488089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ff3d7bb5-40d6-4e8d-aa08-82e11b29b4a8 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:57.053057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:57.095007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:57.101667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:57.106903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98d4e4c7-f7cf-4c4c-9619-f13a6d983f35 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 1.566277 Aug 24 03:34:57.107913 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 581/1150] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:55 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:57.328455 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ff3d7bb5-40d6-4e8d-aa08-82e11b29b4a8 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.024408 Aug 24 03:34:57.339302 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 570/1151] 10.222.0.58 () {60 vars in 1313 bytes} [Wed Aug 24 03:34:56 2022] PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata/os_version => generated 31 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:57.354840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-54f8fa2e-8a0c-4e1c-bd9b-4ab7b14544dd tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Calling method '.version_select at 0x7f1022efd3a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:57.465974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-54f8fa2e-8a0c-4e1c-bd9b-4ab7b14544dd tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.123567 Aug 24 03:34:57.481307 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 571/1152] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:34:57 2022] GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 58 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:57.502967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07f11bbb-76cc-4d06-b6ec-f412dc5d6a2a tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'update_all', calling method: .version_select at 0x7f1022e7bee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:57.704215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-07f11bbb-76cc-4d06-b6ec-f412dc5d6a2a tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:57.730804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-07f11bbb-76cc-4d06-b6ec-f412dc5d6a2a tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:57.791659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-89aeb8c1-9bc2-4114-a4ba-3970a25fd7ba req-f4ddab6a-6da0-4b43-b71b-c5741562edf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6", "tag": "38c92963-f8fb-45f3-a11d-91993bd60399"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:57.850845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-89aeb8c1-9bc2-4114-a4ba-3970a25fd7ba req-f4ddab6a-6da0-4b43-b71b-c5741562edf0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.854051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-89aeb8c1-9bc2-4114-a4ba-3970a25fd7ba req-f4ddab6a-6da0-4b43-b71b-c5741562edf0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.854992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-89aeb8c1-9bc2-4114-a4ba-3970a25fd7ba req-f4ddab6a-6da0-4b43-b71b-c5741562edf0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.921761 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-89aeb8c1-9bc2-4114-a4ba-3970a25fd7ba req-f4ddab6a-6da0-4b43-b71b-c5741562edf0 service nova] Creating event network-changed:38c92963-f8fb-45f3-a11d-91993bd60399 for instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 on n-h1-846470-15 Aug 24 03:34:57.940127 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-89aeb8c1-9bc2-4114-a4ba-3970a25fd7ba req-f4ddab6a-6da0-4b43-b71b-c5741562edf0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.823102 Aug 24 03:34:57.941650 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 582/1153] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:58.159571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:58.160691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.179173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.179881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.180449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.181352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.184560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.185432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.693081 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07f11bbb-76cc-4d06-b6ec-f412dc5d6a2a tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 61 microversion: 2.1 time: 1.209086 Aug 24 03:34:58.694411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 572/1154] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:34:57 2022] PUT /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 61 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:58.763781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84c76d58-4d1e-487b-8ca9-8ef75d128752 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Action: 'create', calling method: .version_select at 0x7f1022efd9d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:59.016732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-84c76d58-4d1e-487b-8ca9-8ef75d128752 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:59.036059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-84c76d58-4d1e-487b-8ca9-8ef75d128752 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Getting quotas for user 37b009596b17432f8f4d076020d85e4b and project 083cbe7b5aa1401a8b054744457f91b5. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:59.591196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.622073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.629256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.632574 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dace7943-79fb-49f2-a86c-ad8d76b04dbf tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 1.477607 Aug 24 03:34:59.635618 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 583/1155] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:58 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:59.709384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-84c76d58-4d1e-487b-8ca9-8ef75d128752 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "POST /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.997857 Aug 24 03:34:59.710282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 573/1156] 10.222.0.58 () {60 vars in 1281 bytes} [Wed Aug 24 03:34:58 2022] POST /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 85 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:59.729799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef7f2e44-41df-467c-89a4-6af0d8e97769 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] Calling method '.version_select at 0x7f1022e221f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:59.766694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-219894509", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:59.829069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef7f2e44-41df-467c-89a4-6af0d8e97769 tempest-ImagesMetadataTestJSON-2017595576 tempest-ImagesMetadataTestJSON-2017595576-project] 10.222.0.58 "GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.109572 Aug 24 03:34:59.847393 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 574/1157] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:34:59 2022] GET /compute/v2.1/images/a4622e86-6fe3-4f7c-a7f7-818f97ab979e/metadata => generated 85 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:35:00.071031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] validate_networks() for [('689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:35:00.672989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:00.673976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:00.685497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.686459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.687079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.688081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.688710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.690496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.059925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.099481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.108500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.112690 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd5703d2-17f1-4b8a-88de-187d3bd68042 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.448600 Aug 24 03:35:01.115608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 575/1158] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:00 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:02.148726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:02.149385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:02.174931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.177475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.178638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.181077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.187990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.188946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.227204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:35:02.228013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:35:02.229015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:35:02.229823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:35:02.230926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:35:02.303030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.306098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.307983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.310979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.313554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.316181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.368290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Getting quotas for project be5362b5593d49a7a695870b28211472. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:02.387359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Getting quotas for user 8589c37ef3c74c86924bd4f521f11add and project be5362b5593d49a7a695870b28211472. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:02.437719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:35:02.448723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:35:02.576588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e421ec62-60e5-409c-aeb5-06309be03cba tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.939286 Aug 24 03:35:02.587074 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 584/1159] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:35:02.597314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cdc3574f-fa01-4a36-80cb-81857f20d015 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:02.598956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cdc3574f-fa01-4a36-80cb-81857f20d015 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:02.812401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:02.831381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cdc3574f-fa01-4a36-80cb-81857f20d015 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:02.840242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:02.846496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:02.847166 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cdc3574f-fa01-4a36-80cb-81857f20d015 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1223 microversion: 2.1 time: 0.252827 Aug 24 03:35:02.848499 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 585/1160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:02 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1223 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:02.851578 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47f03088-e9f2-467b-8c8b-d6483d0f9d10 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.710659 Aug 24 03:35:02.858738 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 576/1161] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:02 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:03.887759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:03.889930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1955a58e-da6d-4d93-9172-1ce4e2c2b956 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:03.891252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:03.895765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1955a58e-da6d-4d93-9172-1ce4e2c2b956 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:03.918227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:03.921382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:03.923022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:03.925546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:03.927743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:03.929237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.130908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1955a58e-da6d-4d93-9172-1ce4e2c2b956 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:04.154932 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1955a58e-da6d-4d93-9172-1ce4e2c2b956 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1223 microversion: 2.1 time: 0.278717 Aug 24 03:35:04.156014 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 586/1162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:03 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1223 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:04.889229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:04.912948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:04.925217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:04.929660 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df013aab-d451-44c2-83aa-d94e182267a2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 1.048490 Aug 24 03:35:04.932282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 577/1163] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:03 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:05.202050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:05.204009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:05.239499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:05.240850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:05.243036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:05.247825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:05.255614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:05.258002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:05.773877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:05.817499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-add83ab6-d779-4666-b734-2b4956bef5bb tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1275 microversion: 2.1 time: 0.620722 Aug 24 03:35:05.821040 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 587/1164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:05 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1275 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:05.990755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:05.991564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:06.014556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.021595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.022339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.023641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.027922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.029295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.650457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.677894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.695349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.707916 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8f3d6d7d-cafc-4831-ac1e-5e6388a45951 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.733082 Aug 24 03:35:06.722109 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 578/1165] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:05 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:06.856362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:06.861159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:06.894574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.895396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.897154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.898715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.899349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.900179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.302002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d59a6174-b8e8-4021-b870-b55cb712ce88 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Action: 'create', calling method: .version_select at 0x7f102afaae50>, body: {"keypair": {"name": "tempest-keypair-544542039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP40hM4s9F25mx01rDwVG1q/zn0feSPBwy9ViQMn18xF2t8/kF7lyd2g+DVdnGUPo+VAPil/KIlwfFUS9wpH8DgvL6PVo+yHsEvGc156dsrzLLNcoWr1DPhTvTBAu2XGIw=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:07.340402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d59a6174-b8e8-4021-b870-b55cb712ce88 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Getting quotas for project 3539cede59d0402f982520a408682e75. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:07.348770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d59a6174-b8e8-4021-b870-b55cb712ce88 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Getting quotas for user 46f8941377734c788dd8411f46ee0b65 and project 3539cede59d0402f982520a408682e75. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:07.363561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:07.402957 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-95f6c2e0-f2a1-4f9b-b71d-69c881d8f442 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1281 microversion: 2.1 time: 0.554541 Aug 24 03:35:07.403937 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 579/1166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:06 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1281 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:07.423446 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d59a6174-b8e8-4021-b870-b55cb712ce88 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.903500 Aug 24 03:35:07.425460 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 588/1167] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:35:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:07.636703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-50bb291a-7ece-422e-8537-332ea86d0677 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Calling method '.version_select at 0x7f1022f380d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.697204 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-50bb291a-7ece-422e-8537-332ea86d0677 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] HTTP exception thrown: Image not found. Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-50bb291a-7ece-422e-8537-332ea86d0677 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Request method failure captured: Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/images/f26b2639-fb5f-4899-8957-4a5279525aa8/metadata/os_distro HTTP/1.1 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZxrCozkTzydkp0E2zSyk61HSJC6O4yJ4L0OZZmNS6L_WqxxZ4DYAoaihmO1M58QuiVjCBjjlsBihECkTftxCe1jMe3bHzpJBo8pdFvTPap03RgQ4cloDNDtW_yzG5lGNdGY7yZoATfDeb1GKV0sCS86FirIZ6SoEUxyBbtMgIwx0RA Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_654668b2568d4edbaed48661b42ad584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/654668b2568d4edbaed48661b42ad584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: ad664786b93a4bbeb26075ea43a2aee5 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: exception: Image not found. Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'image_id': 'f26b2639-fb5f-4899-8957-4a5279525aa8', 'id': 'os_distro'} Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f26b2639-fb5f-4899-8957-4a5279525aa8 Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:35:07.735863 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f26b2639-fb5f-4899-8957-4a5279525aa8 could not be found. Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-50bb291a-7ece-422e-8537-332ea86d0677 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Returning 404 to user: Image not found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-50bb291a-7ece-422e-8537-332ea86d0677 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] 10.222.0.58 "DELETE /compute/v2.1/images/f26b2639-fb5f-4899-8957-4a5279525aa8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.296211 Aug 24 03:35:07.757554 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 580/1168] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 24 03:35:07 2022] DELETE /compute/v2.1/images/f26b2639-fb5f-4899-8957-4a5279525aa8/metadata/os_distro => generated 62 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:35:07.773017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6abb02fa-b836-48f0-a659-b7dae6fe03b0 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Calling method '.version_select at 0x7f102b0da0d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.773478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.773478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:07.785389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.790572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.790934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.792101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.792894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.800482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.844249 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6abb02fa-b836-48f0-a659-b7dae6fe03b0 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] HTTP exception thrown: Image not found. Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6abb02fa-b836-48f0-a659-b7dae6fe03b0 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Request method failure captured: Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/images/0c2f83cf-55c1-4c09-a656-d3934c0fbd87/metadata/os_version HTTP/1.1 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxrCozkTzydkp0E2zSyk61HSJC6O4yJ4L0OZZmNS6L_WqxxZ4DYAoaihmO1M58QuiVjCBjjlsBihECkTftxCe1jMe3bHzpJBo8pdFvTPap03RgQ4cloDNDtW_yzG5lGNdGY7yZoATfDeb1GKV0sCS86FirIZ6SoEUxyBbtMgIwx0RA Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_654668b2568d4edbaed48661b42ad584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/654668b2568d4edbaed48661b42ad584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ad664786b93a4bbeb26075ea43a2aee5 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'image_id': '0c2f83cf-55c1-4c09-a656-d3934c0fbd87', 'id': 'os_version'} Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c2f83cf-55c1-4c09-a656-d3934c0fbd87 Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:35:07.851871 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c2f83cf-55c1-4c09-a656-d3934c0fbd87 could not be found. Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6abb02fa-b836-48f0-a659-b7dae6fe03b0 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:07.870498 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6abb02fa-b836-48f0-a659-b7dae6fe03b0 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] 10.222.0.58 "GET /compute/v2.1/images/0c2f83cf-55c1-4c09-a656-d3934c0fbd87/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.121005 Aug 24 03:35:07.889080 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 589/1169] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 24 03:35:07 2022] GET /compute/v2.1/images/0c2f83cf-55c1-4c09-a656-d3934c0fbd87/metadata/os_version => generated 62 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:35:07.907357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4712ee7e-c9ec-4ada-9737-002dc88494b9 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Calling method '.version_select at 0x7f102afb4280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.990947 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-4712ee7e-c9ec-4ada-9737-002dc88494b9 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] HTTP exception thrown: Image not found. Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4712ee7e-c9ec-4ada-9737-002dc88494b9 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Request method failure captured: Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/images/419a3390-1da8-4c88-9829-a98733a0502c/metadata HTTP/1.1 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxrCozkTzydkp0E2zSyk61HSJC6O4yJ4L0OZZmNS6L_WqxxZ4DYAoaihmO1M58QuiVjCBjjlsBihECkTftxCe1jMe3bHzpJBo8pdFvTPap03RgQ4cloDNDtW_yzG5lGNdGY7yZoATfDeb1GKV0sCS86FirIZ6SoEUxyBbtMgIwx0RA Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_654668b2568d4edbaed48661b42ad584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/654668b2568d4edbaed48661b42ad584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ad664786b93a4bbeb26075ea43a2aee5 Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'image_id': '419a3390-1da8-4c88-9829-a98733a0502c'} Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 419a3390-1da8-4c88-9829-a98733a0502c Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:35:07.997433 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 419a3390-1da8-4c88-9829-a98733a0502c could not be found. Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:35:08.010506 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.024091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4712ee7e-c9ec-4ada-9737-002dc88494b9 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:08.030599 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4712ee7e-c9ec-4ada-9737-002dc88494b9 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] 10.222.0.58 "GET /compute/v2.1/images/419a3390-1da8-4c88-9829-a98733a0502c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.131312 Aug 24 03:35:08.033886 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 590/1170] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:35:07 2022] GET /compute/v2.1/images/419a3390-1da8-4c88-9829-a98733a0502c/metadata => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:35:08.064808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7248944e-ab6e-4328-bfe3-a6d1400d694e tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Action: 'update_all', calling method: .version_select at 0x7f102afb4b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:08.120796 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7248944e-ab6e-4328-bfe3-a6d1400d694e tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] HTTP exception thrown: Image not found. Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7248944e-ab6e-4328-bfe3-a6d1400d694e tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Request method failure captured: Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/images/248f08fe-ebc4-4759-9750-a29a1b9736fd/metadata HTTP/1.1 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 57 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxrCozkTzydkp0E2zSyk61HSJC6O4yJ4L0OZZmNS6L_WqxxZ4DYAoaihmO1M58QuiVjCBjjlsBihECkTftxCe1jMe3bHzpJBo8pdFvTPap03RgQ4cloDNDtW_yzG5lGNdGY7yZoATfDeb1GKV0sCS86FirIZ6SoEUxyBbtMgIwx0RA Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_654668b2568d4edbaed48661b42ad584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/654668b2568d4edbaed48661b42ad584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ad664786b93a4bbeb26075ea43a2aee5 Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'image_id': '248f08fe-ebc4-4759-9750-a29a1b9736fd', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 248f08fe-ebc4-4759-9750-a29a1b9736fd Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:35:08.125784 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 248f08fe-ebc4-4759-9750-a29a1b9736fd could not be found. Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7248944e-ab6e-4328-bfe3-a6d1400d694e tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7248944e-ab6e-4328-bfe3-a6d1400d694e tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] 10.222.0.58 "PUT /compute/v2.1/images/248f08fe-ebc4-4759-9750-a29a1b9736fd/metadata" status: 404 len: 62 microversion: 2.1 time: 0.088298 Aug 24 03:35:08.133733 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 591/1171] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:35:08 2022] PUT /compute/v2.1/images/248f08fe-ebc4-4759-9750-a29a1b9736fd/metadata => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:35:08.166161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b96036fd-507f-468e-8aa2-caede8c4aeba tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Action: 'update', calling method: .version_select at 0x7f102afb4820>, body: {"meta": {"os_distro": "alt"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:08.248088 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b96036fd-507f-468e-8aa2-caede8c4aeba tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] HTTP exception thrown: Image not found. Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b96036fd-507f-468e-8aa2-caede8c4aeba tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Request method failure captured: Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/images/008ac00a-a20c-4bd6-b241-5ebacd6ce505/metadata/os_distro HTTP/1.1 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 30 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxrCozkTzydkp0E2zSyk61HSJC6O4yJ4L0OZZmNS6L_WqxxZ4DYAoaihmO1M58QuiVjCBjjlsBihECkTftxCe1jMe3bHzpJBo8pdFvTPap03RgQ4cloDNDtW_yzG5lGNdGY7yZoATfDeb1GKV0sCS86FirIZ6SoEUxyBbtMgIwx0RA Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_654668b2568d4edbaed48661b42ad584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/654668b2568d4edbaed48661b42ad584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ad664786b93a4bbeb26075ea43a2aee5 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: {"meta": {"os_distro": "alt"}} Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'image_id': '008ac00a-a20c-4bd6-b241-5ebacd6ce505', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 008ac00a-a20c-4bd6-b241-5ebacd6ce505 Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:35:08.257038 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 008ac00a-a20c-4bd6-b241-5ebacd6ce505 could not be found. Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b96036fd-507f-468e-8aa2-caede8c4aeba tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b96036fd-507f-468e-8aa2-caede8c4aeba tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] 10.222.0.58 "PUT /compute/v2.1/images/008ac00a-a20c-4bd6-b241-5ebacd6ce505/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.110562 Aug 24 03:35:08.263738 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 592/1172] 10.222.0.58 () {60 vars in 1310 bytes} [Wed Aug 24 03:35:08 2022] PUT /compute/v2.1/images/008ac00a-a20c-4bd6-b241-5ebacd6ce505/metadata/os_distro => generated 62 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:35:08.272972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37406eed-db9a-4b01-9b20-f6f5d70a85f6 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Action: 'create', calling method: .version_select at 0x7f102afaaee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:08.315002 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-37406eed-db9a-4b01-9b20-f6f5d70a85f6 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] HTTP exception thrown: Image not found. Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37406eed-db9a-4b01-9b20-f6f5d70a85f6 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Request method failure captured: Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/images/7cac83b4-68d6-4790-b95f-f7e697533911/metadata HTTP/1.1 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 57 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxrCozkTzydkp0E2zSyk61HSJC6O4yJ4L0OZZmNS6L_WqxxZ4DYAoaihmO1M58QuiVjCBjjlsBihECkTftxCe1jMe3bHzpJBo8pdFvTPap03RgQ4cloDNDtW_yzG5lGNdGY7yZoATfDeb1GKV0sCS86FirIZ6SoEUxyBbtMgIwx0RA Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_654668b2568d4edbaed48661b42ad584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/654668b2568d4edbaed48661b42ad584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/654668b2568d4edbaed48661b42ad584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 654668b2568d4edbaed48661b42ad584 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-882105362 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ad664786b93a4bbeb26075ea43a2aee5 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-882105362-project Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'image_id': '7cac83b4-68d6-4790-b95f-f7e697533911', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7cac83b4-68d6-4790-b95f-f7e697533911 Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:35:08.318454 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7cac83b4-68d6-4790-b95f-f7e697533911 could not be found. Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37406eed-db9a-4b01-9b20-f6f5d70a85f6 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37406eed-db9a-4b01-9b20-f6f5d70a85f6 tempest-ImagesMetadataNegativeTestJSON-882105362 tempest-ImagesMetadataNegativeTestJSON-882105362-project] 10.222.0.58 "POST /compute/v2.1/images/7cac83b4-68d6-4790-b95f-f7e697533911/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057255 Aug 24 03:35:08.324977 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 593/1173] 10.222.0.58 () {60 vars in 1281 bytes} [Wed Aug 24 03:35:08 2022] POST /compute/v2.1/images/7cac83b4-68d6-4790-b95f-f7e697533911/metadata => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:35:08.910654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "191fab0d-421e-499b-9d00-45fa0abd8416"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:08.924784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:08.952988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.954702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.959385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.960508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.962841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:08.964156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.969380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.992337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:08.998599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:09.001153 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7dcb42e-dc15-476e-add0-5aee7601906a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 1.253472 Aug 24 03:35:09.005395 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 581/1174] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:07 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:09.017970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.022705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:09.040166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.042048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.044234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.047635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.048647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.050745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.153095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=24 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:09.359356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] HTTP exception thrown: Volume 191fab0d-421e-499b-9d00-45fa0abd8416 could not be found. Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Request method failure captured: Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments/856924ed-9643-485a-a497-1a59e3eaa10d HTTP/1.1 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 74 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZuvHK67WFrUwj0gbHlEujLXmI7VpjGOxhye-yJgNKYE6-DVISmaYyhTDA3FCK9xxYPrCv0Kwcok3-zqdJFRl0DcR384UVMNMcUXewvzrR-q4510jbw2tR0hWI7xgboqvkbfSx7vuVkeH_ZYcL2uu0maqLHYk9bAD_xtI5y0ffmvPmI Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 4b7b32f8849944eda8f3587e18eb23a4 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesAdminNegativeTest-422920215 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4b7b32f8849944eda8f3587e18eb23a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4b7b32f8849944eda8f3587e18eb23a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b7b32f8849944eda8f3587e18eb23a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b7b32f8849944eda8f3587e18eb23a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesAdminNegativeTest-422920215 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 4b7b32f8849944eda8f3587e18eb23a4 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-422920215 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesAdminNegativeTest-422920215-project-admin Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 8539fbb1695548e8970a36388ad3a2e1 Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesAdminNegativeTest-422920215-project-admin Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: {"volumeAttachment": {"volumeId": "191fab0d-421e-499b-9d00-45fa0abd8416"}} Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: exception: Volume 191fab0d-421e-499b-9d00-45fa0abd8416 could not be found. Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': '455cb13d-9183-4cac-9f96-22ac9340600d', 'id': '856924ed-9643-485a-a497-1a59e3eaa10d', 'body': {'volumeAttachment': {'volumeId': '191fab0d-421e-499b-9d00-45fa0abd8416'}}} Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 191fab0d-421e-499b-9d00-45fa0abd8416 could not be found. (HTTP 404) (Request-ID: req-856333fc-a133-475a-b85a-0d10f3015f1a) Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:35:09.392736 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 191fab0d-421e-499b-9d00-45fa0abd8416 could not be found. Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 191fab0d-421e-499b-9d00-45fa0abd8416 could not be found. Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 191fab0d-421e-499b-9d00-45fa0abd8416 could not be found. Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Returning 400 to user: Volume 191fab0d-421e-499b-9d00-45fa0abd8416 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:09.398699 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-38da6a06-67c0-4506-b623-a1ae9b4d080c tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments/856924ed-9643-485a-a497-1a59e3eaa10d" status: 400 len: 107 microversion: 2.1 time: 1.012845 Aug 24 03:35:09.412675 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 594/1175] 10.222.0.58 () {60 vars in 1433 bytes} [Wed Aug 24 03:35:08 2022] PUT /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments/856924ed-9643-485a-a497-1a59e3eaa10d => generated 107 bytes in 1020 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:35:09.538064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.538899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:09.550253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.551563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.552756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.554538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.555726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.557513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.631201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:09.646117 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7d1fdf34-7fd9-4891-b955-b3bf5442cdc4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.638807 Aug 24 03:35:09.648764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 582/1176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:09 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:09.940947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lazy-loading 'services' on Instance uuid 455cb13d-9183-4cac-9f96-22ac9340600d {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:10.034326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:10.036394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.078707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.079211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.079695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.086931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.090318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.091172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.352449 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-696378f2-38b8-44d1-a477-17c9f21f4edc tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "DELETE /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments/856924ed-9643-485a-a497-1a59e3eaa10d" status: 202 len: 0 microversion: 2.1 time: 0.823789 Aug 24 03:35:10.353074 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 595/1177] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 03:35:09 2022] DELETE /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments/856924ed-9643-485a-a497-1a59e3eaa10d => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:35:10.370162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:10.387174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.415407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.417368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.419621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.421692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.422315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.422898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.517424 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-18521305-4e27-4189-a699-7bc019c84470 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157567 Aug 24 03:35:10.519723 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 596/1178] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:10 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:10.553024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.586704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.603227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.608420 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f857cd64-fc58-4ba5-a5b3-98030054673f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.583911 Aug 24 03:35:10.627727 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 583/1179] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:10 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:10.674424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:10.676059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.692344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.694294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.694294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.694294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.694644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.695077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.340732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:11.364258 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e56c2beb-43ca-4f6b-b28f-b6eb4c826df1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.698158 Aug 24 03:35:11.366982 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 597/1180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:10 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:11.540620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:11.564363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:11.610696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.614740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.621716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.625616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.631193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.632639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.762993 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-79eaf21d-1c6f-4320-8c37-6bf91dad126a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.234357 Aug 24 03:35:11.771293 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 584/1181] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:11 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:12.345776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:12.404984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:12.406266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:12.429947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.430646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.431332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.456604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.457266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.457983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.683025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:12.683650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:12.716826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.733017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.733803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.740928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.741837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.742637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.765794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:13.085233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:13.099305 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5de3d58e-42d3-4ddd-81c6-3120349d39ee tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.701411 Aug 24 03:35:13.102321 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 585/1182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:12 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:13.116101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:13.121052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:13.146996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.150239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.151432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.152423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.153175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.162136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.284427 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75fc5f94-167f-4480-9e07-bd36655c3cef tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177530 Aug 24 03:35:13.285979 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 586/1183] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:13 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:13.360158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-3f49e53e-729f-4f21-ad4e-5bab97d20d83 req-be67b035-f986-42e5-bbdd-90b6b446fa21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffeeab50-8a2b-4979-8731-ab6d1356ead0", "tag": "75424023-d96a-4a2c-a8ff-58b3bc6c4319"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:13.421788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3f49e53e-729f-4f21-ad4e-5bab97d20d83 req-be67b035-f986-42e5-bbdd-90b6b446fa21 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.430055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3f49e53e-729f-4f21-ad4e-5bab97d20d83 req-be67b035-f986-42e5-bbdd-90b6b446fa21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.432805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3f49e53e-729f-4f21-ad4e-5bab97d20d83 req-be67b035-f986-42e5-bbdd-90b6b446fa21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.491180 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-3f49e53e-729f-4f21-ad4e-5bab97d20d83 req-be67b035-f986-42e5-bbdd-90b6b446fa21 service nova] Creating event network-changed:75424023-d96a-4a2c-a8ff-58b3bc6c4319 for instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 on n-h2-846470-15 Aug 24 03:35:13.528661 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-3f49e53e-729f-4f21-ad4e-5bab97d20d83 req-be67b035-f986-42e5-bbdd-90b6b446fa21 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203233 Aug 24 03:35:13.535378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 587/1184] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:14.136977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:14.138199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:14.165097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:14.165671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:14.166128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.166947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:14.167434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:14.167944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.830600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.873322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.880430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.890804 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6662d4b-6b3e-400c-aac1-50e58fbe0249 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 3.253622 Aug 24 03:35:14.894010 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 598/1185] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:11 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 3259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:14.913876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.916043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:14.925297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:14.943256 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1f37b43-24bf-4362-ac6f-562478eadd7f tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.806417 Aug 24 03:35:14.948275 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 588/1186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:14 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:14.970944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:14.971691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:14.984116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.985401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:14.986767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:14.987225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.069038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dddea98f-0d8d-45e2-bd30-a9e8017b5da2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172037 Aug 24 03:35:15.072352 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 599/1187] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:14 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:15.739215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-4ae40910-387f-4bbc-bc09-86dc8ad1181e req-11aa1a06-47a4-4542-a793-e7cbb7f0d3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0590f4-ad3d-4016-b019-6e71212ff34e", "name": "network-vif-unplugged", "status": "completed", "tag": "88ddc8b2-32ba-4d59-a1fe-dc8334535167"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:15.763832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4ae40910-387f-4bbc-bc09-86dc8ad1181e req-11aa1a06-47a4-4542-a793-e7cbb7f0d3d3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.764788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4ae40910-387f-4bbc-bc09-86dc8ad1181e req-11aa1a06-47a4-4542-a793-e7cbb7f0d3d3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.765468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4ae40910-387f-4bbc-bc09-86dc8ad1181e req-11aa1a06-47a4-4542-a793-e7cbb7f0d3d3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.796842 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-4ae40910-387f-4bbc-bc09-86dc8ad1181e req-11aa1a06-47a4-4542-a793-e7cbb7f0d3d3 service nova] Creating event network-vif-unplugged:88ddc8b2-32ba-4d59-a1fe-dc8334535167 for instance cf0590f4-ad3d-4016-b019-6e71212ff34e on n-h2-846470-15 Aug 24 03:35:15.807558 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-4ae40910-387f-4bbc-bc09-86dc8ad1181e req-11aa1a06-47a4-4542-a793-e7cbb7f0d3d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072323 Aug 24 03:35:15.810074 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 589/1188] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:15.935467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:15.936291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:15.956055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.956861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.957348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.964992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.967310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.969568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.981386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:15.982763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:16.000702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.002740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.004067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.005344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.007189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.008714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.472446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.496835 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-735eb626-1267-4136-8fdb-e88ecc883501 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.520581 Aug 24 03:35:16.498705 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 590/1189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:15 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:16.535211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:16.539941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:16.561226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.562033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.565198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.574090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.575227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.576217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.606420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.653921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.656323 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-284a1fa3-2792-46ce-8a7b-cf6b4e574932 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136274 Aug 24 03:35:16.658679 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 591/1190] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:16 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:16.659562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.661928 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26ef5728-9990-46c2-88af-00c35179d927 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.732936 Aug 24 03:35:16.664137 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 600/1191] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:15 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:16.670404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "d9a17fbc-5d08-4ebf-bbc4-aff2a5fa5d8e"}], "security_groups": [{"name": "tempest-securitygroup--735710926"}], "key_name": "tempest-keypair-544542039", "user_data": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:17.118307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] validate_networks() for [('d9a17fbc-5d08-4ebf-bbc4-aff2a5fa5d8e', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:35:17.469161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:17.470189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:17.476523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=26 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:17.478221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:17.521175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.523687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.528806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.530877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.547975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.554605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.657519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:35:17.977215 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b745c242-4306-4688-a38e-f7d170968f62 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 204 len: 0 microversion: 2.1 time: 0.515778 Aug 24 03:35:17.983075 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 601/1192] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:17 2022] DELETE /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:35:17.987094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:17.988464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:18.002352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.002882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.003493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.007645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.009794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.010881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.345013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:18.357891 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-595c6870-0651-4ad5-bc61-261ce9ff8c4a tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.376291 Aug 24 03:35:18.359778 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 602/1193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:17 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:18.371234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:18.380262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:18.393809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.394461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.394991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.395829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.396384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.396908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.495120 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89c3ee3f-c158-4209-8493-98b8240d1d2e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133563 Aug 24 03:35:18.501508 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 603/1194] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:18 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:18.514123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:18.522690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:18.570812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.576910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.578088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.579513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.583893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.585372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.590021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:35:18.595142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:35:18.596725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:35:18.597960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:35:18.598869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:35:18.612985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.614033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.614921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.616038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.617133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.618255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.658971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:18.703214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Getting quotas for project 3539cede59d0402f982520a408682e75. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:18.718655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Getting quotas for user 46f8941377734c788dd8411f46ee0b65 and project 3539cede59d0402f982520a408682e75. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:18.768159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:35:18.770672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:35:18.900532 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb831dbd-033e-4a4e-91cf-543f9e5f612e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.238420 Aug 24 03:35:18.901867 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 592/1195] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:35:18.912531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-34f1b22a-8659-4bba-b625-02c618da266a req-55b61e1b-cb59-45bf-b472-aa5d6c79324e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf0590f4-ad3d-4016-b019-6e71212ff34e", "tag": "88ddc8b2-32ba-4d59-a1fe-dc8334535167"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:18.943283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-34f1b22a-8659-4bba-b625-02c618da266a req-55b61e1b-cb59-45bf-b472-aa5d6c79324e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.943871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-34f1b22a-8659-4bba-b625-02c618da266a req-55b61e1b-cb59-45bf-b472-aa5d6c79324e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.946867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-34f1b22a-8659-4bba-b625-02c618da266a req-55b61e1b-cb59-45bf-b472-aa5d6c79324e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.989408 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-34f1b22a-8659-4bba-b625-02c618da266a req-55b61e1b-cb59-45bf-b472-aa5d6c79324e service nova] Creating event network-changed:88ddc8b2-32ba-4d59-a1fe-dc8334535167 for instance cf0590f4-ad3d-4016-b019-6e71212ff34e on n-h2-846470-15 Aug 24 03:35:18.999915 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-34f1b22a-8659-4bba-b625-02c618da266a req-55b61e1b-cb59-45bf-b472-aa5d6c79324e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096505 Aug 24 03:35:19.003145 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 593/1196] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:19.010376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:19.011512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:19.022993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:19.023996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:19.024669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:19.026748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:19.027591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:19.028609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:19.565853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.599743 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-270c5d4d-3b73-4560-8d8a-42fa43e88069 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1712 microversion: 2.1 time: 0.593293 Aug 24 03:35:19.615694 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 594/1197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:19 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1712 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:19.624873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-50d56973-528e-404f-a595-15b6fcce9363 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:19.625990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-50d56973-528e-404f-a595-15b6fcce9363 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:19.659729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.699119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.710176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.726917 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3600239a-b048-45f8-b3db-e74431741ec0 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 1.223815 Aug 24 03:35:19.732825 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 604/1198] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:18 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:19.744469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:19.746031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:19.761194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:19.763149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:19.764332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:19.769215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:19.770553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:19.772818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:19.966128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-50d56973-528e-404f-a595-15b6fcce9363 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.997877 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-50d56973-528e-404f-a595-15b6fcce9363 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1225 microversion: 2.1 time: 0.391684 Aug 24 03:35:20.004650 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 595/1199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:19 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1225 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:20.025200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:20.029588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:20.062776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.066098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.067285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.072733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.073855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.074930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.182848 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd99e858-540b-428e-ab7a-d90cc9c50250 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175728 Aug 24 03:35:20.188642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 596/1200] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:20 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:20.621104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:20.636266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:20.638312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:20.677849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.680467 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2df8b6d4-51fc-49f2-b45f-be74f53c229e tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.945336 Aug 24 03:35:20.683560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.688297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.689009 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 605/1201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:19 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:20.690017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.692766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.693544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.768260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:20.769201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:20.789510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.791001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.792681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.796426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.799579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.804950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:21.829481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:21.850525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:21.853717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:21.857848 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ce5c214-19b2-409c-b9b8-56a1f0e07cc9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 1.094071 Aug 24 03:35:21.858450 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 606/1202] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:20 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:21.869104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:21.874176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:21.894803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:21.900227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:21.901342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:21.902536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:21.903397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:21.904180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:22.581318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:22.615342 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-552edf47-9e64-46b1-9a40-4824e8b98215 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1277 microversion: 2.1 time: 0.738671 Aug 24 03:35:22.617206 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 607/1203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:21 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1277 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:22.631604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:22.653020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:22.675162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:22.678100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:22.679851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:22.690890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:22.693519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:22.694828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:22.813310 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f3147e84-b3d6-4db1-b3bf-b237b8cef0e4 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.186122 Aug 24 03:35:22.814027 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 608/1204] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:22 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d/os-volume_attachments => generated 25 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:35:22.819470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:22.823223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:22.844872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:22.846071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:22.848240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:22.849449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:22.853885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:22.854708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:23.237653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:23.281834 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99fb4510-b4dd-4b24-a33e-d95ab81c9f84 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1712 microversion: 2.1 time: 2.651329 Aug 24 03:35:23.282873 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 597/1205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:20 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1712 bytes in 2654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:23.310284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:23.311088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:23.366336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:23.373297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:23.374110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:23.375460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:23.376382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:23.382789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.014745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:24.045268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:24.057839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:24.070346 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d9c2a677-f04f-424f-b750-57603dd5dfe4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.772592 Aug 24 03:35:24.071918 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 598/1206] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:23 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:24.112262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-965744630", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "f55312f4-6df6-4f91-b50e-a29e1a825546"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:24.258926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] validate_networks() for [('f55312f4-6df6-4f91-b50e-a29e1a825546', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:35:25.025414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:25.035323 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-973078d2-e1bd-4351-910d-7c72a76a5cd8 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 2.219771 Aug 24 03:35:25.035988 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 609/1207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:22 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:25.063887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:25.065034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:25.089440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.090578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.091244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.093747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.094430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.095119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.245397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:35:25.245832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:35:25.246355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:35:25.246898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:35:25.247811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:35:25.269391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.275424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.276033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.276857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.277331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.277787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.283400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:25.296371 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-30df973f-72d4-4587-8395-3ab43b168190 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1283 microversion: 2.1 time: 0.242394 Aug 24 03:35:25.297836 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 610/1208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:25 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:25.307876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:25.330923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Getting quotas for project 3835a5249c54414dbc3a19230c247072. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:25.349920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Getting quotas for user a9a7fe8630514ecba823e9834692cc77 and project 3835a5249c54414dbc3a19230c247072. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:25.411309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:35:25.414392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:35:25.564089 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a287ae3-08b0-4c35-ab85-e3f9be3f07a2 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.488492 Aug 24 03:35:25.571408 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 599/1209] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:35:25.575020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:25.583986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:25.596495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.601908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.603382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.604571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.606170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.606883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.662040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-662569a1-dead-4013-91b9-50fc614f3561 req-078dd5e9-edbf-4d12-9536-787d945682e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeeab50-8a2b-4979-8731-ab6d1356ead0", "name": "network-vif-plugged", "status": "completed", "tag": "75424023-d96a-4a2c-a8ff-58b3bc6c4319"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:25.690548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-662569a1-dead-4013-91b9-50fc614f3561 req-078dd5e9-edbf-4d12-9536-787d945682e7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.691436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-662569a1-dead-4013-91b9-50fc614f3561 req-078dd5e9-edbf-4d12-9536-787d945682e7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.692139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-662569a1-dead-4013-91b9-50fc614f3561 req-078dd5e9-edbf-4d12-9536-787d945682e7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.709765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-662569a1-dead-4013-91b9-50fc614f3561 req-078dd5e9-edbf-4d12-9536-787d945682e7 service nova] Creating event network-vif-plugged:75424023-d96a-4a2c-a8ff-58b3bc6c4319 for instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 on n-h2-846470-15 Aug 24 03:35:25.720932 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-662569a1-dead-4013-91b9-50fc614f3561 req-078dd5e9-edbf-4d12-9536-787d945682e7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.416648 Aug 24 03:35:25.722304 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 611/1210] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:25.729312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:25.730333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:25.753150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.756452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.757126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.759571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.760921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.764783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.989379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:26.001883 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9bfaead-f322-49d1-9e81-f3ce61a33bd3 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1712 microversion: 2.1 time: 0.433864 Aug 24 03:35:26.018610 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 600/1211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:25 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1712 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:26.035194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cea348f1-61e6-4218-88eb-4831c417853a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:26.036173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cea348f1-61e6-4218-88eb-4831c417853a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:26.144584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cea348f1-61e6-4218-88eb-4831c417853a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:26.165542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cea348f1-61e6-4218-88eb-4831c417853a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1217 microversion: 2.1 time: 0.144804 Aug 24 03:35:26.178475 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 601/1212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:26 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:26.190950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:26.193228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:26.219477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:26.220475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:26.221114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:26.222572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:26.224241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:26.224868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:26.445888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:26.446408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:26.457927 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7cfd7d6-d05d-44a6-b850-cc10d9f7b2db tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.273353 Aug 24 03:35:26.458830 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 602/1213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:26 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:26.463676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:26.465198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:26.467289 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41c3546e-a20d-440a-937d-12499a8fcaee tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.743652 Aug 24 03:35:26.470505 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 612/1214] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:25 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:26.496902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:26.504594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:26.519040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:26.520050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:26.520746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:26.521719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:26.522511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:26.524029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:26.646763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:26.669039 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b3c74a4b-f5b6-4c48-96a8-1d75d837c86a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1283 microversion: 2.1 time: 0.182788 Aug 24 03:35:26.676702 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 603/1215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:26 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:27.035174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:27.035980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:27.045872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.046683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.047306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.057030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.058829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.061271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.191843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:27.192477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:27.206410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.211931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.214055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.215593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.218027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.219484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.350924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842bb125a58946649e7a150e35eca5bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a68a19ba646a29463d4cba0379351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:27.374419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:27.393441 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-14ba0705-ea3e-43f5-add5-8943f138cd67 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 200 len: 1644 microversion: 2.1 time: 0.364792 Aug 24 03:35:27.413600 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 613/1216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:27 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 1644 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:27.452634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6e455739-15fd-4f64-a378-e0186b088ec5 req-7430b437-7221-4387-9e74-6c333b41fe17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08e8a55-bcba-46e8-8d19-592b1a193bc7", "name": "network-vif-deleted", "tag": "bb35f0ad-0556-43ca-8cfd-9cc8114faf00"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:27.583277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:27.613868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6e455739-15fd-4f64-a378-e0186b088ec5 req-7430b437-7221-4387-9e74-6c333b41fe17 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.620151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6e455739-15fd-4f64-a378-e0186b088ec5 req-7430b437-7221-4387-9e74-6c333b41fe17 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.625695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6e455739-15fd-4f64-a378-e0186b088ec5 req-7430b437-7221-4387-9e74-6c333b41fe17 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.642135 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c6c31ef-48d6-443f-b910-01017eb0db13 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1213 microversion: 2.1 time: 0.455821 Aug 24 03:35:27.663888 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 604/1217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:27 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1213 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:27.693615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:27.694556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:27.713741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.714341 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6e455739-15fd-4f64-a378-e0186b088ec5 req-7430b437-7221-4387-9e74-6c333b41fe17 service nova] Creating event network-vif-deleted:bb35f0ad-0556-43ca-8cfd-9cc8114faf00 for instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 on n-h1-846470-15 Aug 24 03:35:27.715535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.716758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.718907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.720381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.722324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.739885 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6e455739-15fd-4f64-a378-e0186b088ec5 req-7430b437-7221-4387-9e74-6c333b41fe17 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.322768 Aug 24 03:35:27.743200 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 614/1218] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:27.760677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:27.766765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:27.789479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.790104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.790704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.791494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:27.792087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:27.792896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:27.990193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:28.001733 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b81b7dff-ef0e-442a-96aa-18617b1c4c86 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1323 microversion: 2.1 time: 0.335624 Aug 24 03:35:28.018151 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 605/1219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:27 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1323 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:28.128941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eeb7cfad-a669-4db1-a8c9-4302037cd0d1 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Action: 'create', calling method: .version_select at 0x7f1022e225e0>, body: {"keypair": {"name": "tempest-keypair-237924055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3XIJFfGYioBc4ON44Ot/03xLhhuAs45ZoIBwMoQcazHrodVEnmeHrrdVjVU25o9Kj189ygo8ngkc749vd6CFyb3Jj/KyA10YC1gEQygzk1HJ20cprG2qPufd4gHOhJA=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:28.155514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-eeb7cfad-a669-4db1-a8c9-4302037cd0d1 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Getting quotas for project 4106f94adf184471b76f1f81694ff161. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:28.163983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-eeb7cfad-a669-4db1-a8c9-4302037cd0d1 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Getting quotas for user 41f453b3b603436795dc0b2507c18079 and project 4106f94adf184471b76f1f81694ff161. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:28.228644 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eeb7cfad-a669-4db1-a8c9-4302037cd0d1 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.208791 Aug 24 03:35:28.230439 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 606/1220] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:35:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:28.238049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:28.238711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:28.254949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:28.255468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:28.255942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:28.263135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:28.263623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:28.264100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:28.915296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:28.945967 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-113e4971-d977-46dc-b6ce-4cfd9738c491 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.710532 Aug 24 03:35:28.947461 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 607/1221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:28 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:28.958893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:28.961321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:28.975620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:28.976681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:28.977954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:28.979624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:28.980386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:28.981299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.006072 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] HTTP exception thrown: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Request method failure captured: Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 HTTP/1.1 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtjba5McIVCU5ezFbquDWANKt6sgz-BUKmBdr86oTxr7ilB4IS1vUmpnV8ztsiOOSn3C8BapdJyK2DlCL533nczMLobe7IxHzK0slg0xTg_4qbuDEDMq1mFRmwDR5OUvqhRBOoIb7wctgHbT8tVT5cC30vI6IjIA9u8XeirnsV0MgM Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_808a68a19ba646a29463d4cba0379351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/808a68a19ba646a29463d4cba0379351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 842bb125a58946649e7a150e35eca5bb Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'f08e8a55-bcba-46e8-8d19-592b1a193bc7'} Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.007582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Returning 404 to user: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:29.015256 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3338ced-563b-4cf7-af37-b5c6c15d9ad7 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 404 len: 111 microversion: 2.1 time: 0.060101 Aug 24 03:35:29.027524 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 608/1222] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:28 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:29.032836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:29.033454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:29.056452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.057296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.058066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.060257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.065093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.066128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.251385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:29.261107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7d94ff7-fbad-4513-8147-84fef0e433a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1287 microversion: 2.1 time: 0.232106 Aug 24 03:35:29.264541 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 609/1223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:29 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1287 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:29.279191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:29.280058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:29.293575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.297677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.298336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.299301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.300881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.302016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.349647 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] HTTP exception thrown: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Request method failure captured: Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 HTTP/1.1 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtjba5McIVCU5ezFbquDWANKt6sgz-BUKmBdr86oTxr7ilB4IS1vUmpnV8ztsiOOSn3C8BapdJyK2DlCL533nczMLobe7IxHzK0slg0xTg_4qbuDEDMq1mFRmwDR5OUvqhRBOoIb7wctgHbT8tVT5cC30vI6IjIA9u8XeirnsV0MgM Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_808a68a19ba646a29463d4cba0379351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/808a68a19ba646a29463d4cba0379351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 842bb125a58946649e7a150e35eca5bb Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a19c423f-0e82-4d93-b79d-7fdc5d3cdf42'} Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:29.351802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.359813 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.363112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Returning 404 to user: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:29.364442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-52aa9259-342e-4c2e-90d8-c6a1a36a8126 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 404 len: 111 microversion: 2.1 time: 0.097508 Aug 24 03:35:29.365284 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 610/1224] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:29 2022] DELETE /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:29.372637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:29.374346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:29.403435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.403435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.403435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.403435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.403435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.403435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.752946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:29.792231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:29.794280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:29.795705 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a733f17-7b4f-42e8-b04d-d35e772df932 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 2.050849 Aug 24 03:35:29.796427 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 615/1225] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:27 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:29.812247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:29.813041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:29.825745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.826700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.827497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.828962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:29.829776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:29.831963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:29.867321 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] HTTP exception thrown: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Request method failure captured: Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 HTTP/1.1 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtjba5McIVCU5ezFbquDWANKt6sgz-BUKmBdr86oTxr7ilB4IS1vUmpnV8ztsiOOSn3C8BapdJyK2DlCL533nczMLobe7IxHzK0slg0xTg_4qbuDEDMq1mFRmwDR5OUvqhRBOoIb7wctgHbT8tVT5cC30vI6IjIA9u8XeirnsV0MgM Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_808a68a19ba646a29463d4cba0379351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/808a68a19ba646a29463d4cba0379351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 842bb125a58946649e7a150e35eca5bb Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a19c423f-0e82-4d93-b79d-7fdc5d3cdf42'} Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.877906 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:29.882295 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.882295 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:29.882295 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:29.882295 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:29.882295 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:29.882295 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:29.882295 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:29.882295 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:29.884522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Returning 404 to user: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:29.885701 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-021556ab-1deb-4890-b4f8-99634fe53fc6 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 404 len: 111 microversion: 2.1 time: 0.088112 Aug 24 03:35:29.886869 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 616/1226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:29 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:29.898878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c438573d-8d78-449d-9d84-e8509ae63f5a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '.version_select at 0x7f102ae93700>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:29.912425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:29.924541 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-94c70fa3-5858-45e2-956b-dde692078827 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1518 microversion: 2.1 time: 0.557859 Aug 24 03:35:29.943807 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 611/1227] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:29 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1518 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:29.975511 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c438573d-8d78-449d-9d84-e8509ae63f5a tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091403419" status: 202 len: 0 microversion: 2.1 time: 0.081503 Aug 24 03:35:29.976737 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 617/1228] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 03:35:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091403419 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:35:29.995297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:30.002946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:30.026803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:30.027302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:30.027834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:30.036221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:30.036818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:30.037265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:30.222474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b49a410f-2904-40a6-9be7-f26c3114a3e1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-891273458", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b49a410f-2904-40a6-9be7-f26c3114a3e1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Request method failure captured: Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 242 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxjXIzyJqJO_te1Ovi28rcGEqMkEhdIh4avVZuHs3BgBreMPSX6ASXMNCbLdHLcC6fysRD7UWneVIWS06tDqiliEnw9X7ZiDUYC-EjJ939FG-hL_wqHbwkN_j_E_cZOparFdqGk7z5BnBjjvHdqxCtK1j4K3WRTwE2wjTmovaa7z9w Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5362b5593d49a7a695870b28211472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5362b5593d49a7a695870b28211472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 8589c37ef3c74c86924bd4f521f11add Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-891273458", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-891273458', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144'}]}}} Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:30.232716 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.239633 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.242885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b49a410f-2904-40a6-9be7-f26c3114a3e1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:30.244213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b49a410f-2904-40a6-9be7-f26c3114a3e1 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.033054 Aug 24 03:35:30.245384 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 618/1229] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:30 2022] POST /compute/v2.1/servers => generated 175 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:35:30.261919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e415c5d3-a61f-4fdc-b911-ce06dca924e3 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:30.264267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e415c5d3-a61f-4fdc-b911-ce06dca924e3 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: 5dbcf158-25e6-478c-bbac-4f9b3faed5a4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:30.274810 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e415c5d3-a61f-4fdc-b911-ce06dca924e3 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] HTTP exception thrown: Instance 5dbcf158-25e6-478c-bbac-4f9b3faed5a4 could not be found. Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e415c5d3-a61f-4fdc-b911-ce06dca924e3 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Request method failure captured: Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/5dbcf158-25e6-478c-bbac-4f9b3faed5a4/metadata HTTP/1.1 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxjXIzyJqJO_te1Ovi28rcGEqMkEhdIh4avVZuHs3BgBreMPSX6ASXMNCbLdHLcC6fysRD7UWneVIWS06tDqiliEnw9X7ZiDUYC-EjJ939FG-hL_wqHbwkN_j_E_cZOparFdqGk7z5BnBjjvHdqxCtK1j4K3WRTwE2wjTmovaa7z9w Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5362b5593d49a7a695870b28211472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5362b5593d49a7a695870b28211472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 8589c37ef3c74c86924bd4f521f11add Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 5dbcf158-25e6-478c-bbac-4f9b3faed5a4 could not be found. Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': '5dbcf158-25e6-478c-bbac-4f9b3faed5a4'} Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dbcf158-25e6-478c-bbac-4f9b3faed5a4 could not be found. Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dbcf158-25e6-478c-bbac-4f9b3faed5a4 could not be found. Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:30.291045 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:30.296276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:30.296276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:30.296276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dbcf158-25e6-478c-bbac-4f9b3faed5a4 could not be found. Aug 24 03:35:30.296276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.303627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e415c5d3-a61f-4fdc-b911-ce06dca924e3 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Returning 404 to user: Instance 5dbcf158-25e6-478c-bbac-4f9b3faed5a4 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:30.303627 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e415c5d3-a61f-4fdc-b911-ce06dca924e3 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/5dbcf158-25e6-478c-bbac-4f9b3faed5a4/metadata" status: 404 len: 111 microversion: 2.1 time: 0.047212 Aug 24 03:35:30.311776 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 619/1230] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:35:30 2022] GET /compute/v2.1/servers/5dbcf158-25e6-478c-bbac-4f9b3faed5a4/metadata => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:30.343477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:30.346742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:30.374249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:30.374780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:30.375232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:30.376016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:30.376673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:30.377111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:30.705075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:30.725570 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a64b8e3e-7eb1-49de-a503-5cd0920d5e5e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.745754 Aug 24 03:35:30.727597 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 612/1231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:29 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:30.735095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c62a26ca-7a65-4308-85fc-b1eb2c79ce98 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1619526520", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c62a26ca-7a65-4308-85fc-b1eb2c79ce98 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Request method failure captured: Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 499 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZxjXIzyJqJO_te1Ovi28rcGEqMkEhdIh4avVZuHs3BgBreMPSX6ASXMNCbLdHLcC6fysRD7UWneVIWS06tDqiliEnw9X7ZiDUYC-EjJ939FG-hL_wqHbwkN_j_E_cZOparFdqGk7z5BnBjjvHdqxCtK1j4K3WRTwE2wjTmovaa7z9w Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5362b5593d49a7a695870b28211472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5362b5593d49a7a695870b28211472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 8589c37ef3c74c86924bd4f521f11add Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1619526520", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1619526520', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144'}]}}} Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 03:35:30.741087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.751268 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.756801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c62a26ca-7a65-4308-85fc-b1eb2c79ce98 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:30.757846 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c62a26ca-7a65-4308-85fc-b1eb2c79ce98 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.028904 Aug 24 03:35:30.758933 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 613/1232] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:30 2022] POST /compute/v2.1/servers => generated 687 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:35:30.814024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:30.822970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:30.823801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:30.834187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52533a61-4f40-4bf5-987d-01986a6a47f0 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1275 microversion: 2.1 time: 0.520360 Aug 24 03:35:30.845018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:30.846218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:30.847159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:30.848244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:30.851309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:30.852221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:30.864832 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 620/1233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:30 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1275 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:30.871155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dafff35f-ed59-4b7f-822f-62782844613d tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-377950580", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dafff35f-ed59-4b7f-822f-62782844613d tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Request method failure captured: Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 499 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxjXIzyJqJO_te1Ovi28rcGEqMkEhdIh4avVZuHs3BgBreMPSX6ASXMNCbLdHLcC6fysRD7UWneVIWS06tDqiliEnw9X7ZiDUYC-EjJ939FG-hL_wqHbwkN_j_E_cZOparFdqGk7z5BnBjjvHdqxCtK1j4K3WRTwE2wjTmovaa7z9w Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5362b5593d49a7a695870b28211472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5362b5593d49a7a695870b28211472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 8589c37ef3c74c86924bd4f521f11add Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-377950580", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-377950580', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144'}]}}} Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 03:35:30.877071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dafff35f-ed59-4b7f-822f-62782844613d tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:30.880488 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dafff35f-ed59-4b7f-822f-62782844613d tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012999 Aug 24 03:35:30.887450 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 621/1234] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:30 2022] POST /compute/v2.1/servers => generated 689 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:35:31.020453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b8362e2-1d2a-4b8e-ae0a-31785f6f2177 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-95947954", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b8362e2-1d2a-4b8e-ae0a-31785f6f2177 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Request method failure captured: Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 752 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxjXIzyJqJO_te1Ovi28rcGEqMkEhdIh4avVZuHs3BgBreMPSX6ASXMNCbLdHLcC6fysRD7UWneVIWS06tDqiliEnw9X7ZiDUYC-EjJ939FG-hL_wqHbwkN_j_E_cZOparFdqGk7z5BnBjjvHdqxCtK1j4K3WRTwE2wjTmovaa7z9w Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5362b5593d49a7a695870b28211472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5362b5593d49a7a695870b28211472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 8589c37ef3c74c86924bd4f521f11add Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-95947954", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-95947954', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144'}]}}} Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:35:31.039731 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:35:31.048128 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:35:31.060044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:31.060044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.065143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b8362e2-1d2a-4b8e-ae0a-31785f6f2177 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:31.070499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b8362e2-1d2a-4b8e-ae0a-31785f6f2177 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.054491 Aug 24 03:35:31.076412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 622/1235] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:31 2022] POST /compute/v2.1/servers => generated 1197 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 24 03:35:31.181888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9bc3423b-8fe0-4b10-bba8-9499317a3328 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1731661806", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9bc3423b-8fe0-4b10-bba8-9499317a3328 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Request method failure captured: Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 1266 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxjXIzyJqJO_te1Ovi28rcGEqMkEhdIh4avVZuHs3BgBreMPSX6ASXMNCbLdHLcC6fysRD7UWneVIWS06tDqiliEnw9X7ZiDUYC-EjJ939FG-hL_wqHbwkN_j_E_cZOparFdqGk7z5BnBjjvHdqxCtK1j4K3WRTwE2wjTmovaa7z9w Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5362b5593d49a7a695870b28211472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5362b5593d49a7a695870b28211472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 8589c37ef3c74c86924bd4f521f11add Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1731661806", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144"}]}} Aug 24 03:35:31.196991 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1731661806', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '689cc8ad-e2b9-44bb-b5a5-6cc0f03b1144'}]}}} Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.199611 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:35:31.201681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:35:31.205327 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:35:31.205327 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.205327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9bc3423b-8fe0-4b10-bba8-9499317a3328 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:31.207703 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9bc3423b-8fe0-4b10-bba8-9499317a3328 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.032015 Aug 24 03:35:31.210622 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 623/1236] 10.222.0.58 () {60 vars in 1148 bytes} [Wed Aug 24 03:35:31 2022] POST /compute/v2.1/servers => generated 2221 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 24 03:35:31.227514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50b1643a-cee0-4fd7-9cbb-12856b62dab9 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:31.228452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-50b1643a-cee0-4fd7-9cbb-12856b62dab9 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: 0736f1f8-7503-466d-a419-029f34bb2675] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:31.253087 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-50b1643a-cee0-4fd7-9cbb-12856b62dab9 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] HTTP exception thrown: Instance 0736f1f8-7503-466d-a419-029f34bb2675 could not be found. Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50b1643a-cee0-4fd7-9cbb-12856b62dab9 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Request method failure captured: Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/0736f1f8-7503-466d-a419-029f34bb2675/metadata/test2 HTTP/1.1 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxjXIzyJqJO_te1Ovi28rcGEqMkEhdIh4avVZuHs3BgBreMPSX6ASXMNCbLdHLcC6fysRD7UWneVIWS06tDqiliEnw9X7ZiDUYC-EjJ939FG-hL_wqHbwkN_j_E_cZOparFdqGk7z5BnBjjvHdqxCtK1j4K3WRTwE2wjTmovaa7z9w Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5362b5593d49a7a695870b28211472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5362b5593d49a7a695870b28211472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 8589c37ef3c74c86924bd4f521f11add Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 0736f1f8-7503-466d-a419-029f34bb2675 could not be found. Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': '0736f1f8-7503-466d-a419-029f34bb2675', 'id': 'test2'} Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0736f1f8-7503-466d-a419-029f34bb2675 could not be found. Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0736f1f8-7503-466d-a419-029f34bb2675 could not be found. Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:31.263503 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:31.279000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:31.279000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:31.279000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0736f1f8-7503-466d-a419-029f34bb2675 could not be found. Aug 24 03:35:31.279000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:31.279000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50b1643a-cee0-4fd7-9cbb-12856b62dab9 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Returning 404 to user: Instance 0736f1f8-7503-466d-a419-029f34bb2675 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:31.279000 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50b1643a-cee0-4fd7-9cbb-12856b62dab9 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/0736f1f8-7503-466d-a419-029f34bb2675/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.045497 Aug 24 03:35:31.279000 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 624/1237] 10.222.0.58 () {58 vars in 1281 bytes} [Wed Aug 24 03:35:31 2022] GET /compute/v2.1/servers/0736f1f8-7503-466d-a419-029f34bb2675/metadata/test2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:31.326817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:31.327718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:31.350576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:31.351565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:31.352378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:31.353392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:31.354200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:31.354939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:31.422014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:35:31.502091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:31.516669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:31.528599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:31.533502 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d4302bd4-8002-4f9f-942e-35e68fbb60c9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.714514 Aug 24 03:35:31.556242 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 614/1238] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:30 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:31.639027 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a0d9002-67d7-41ce-8a89-82c196f7b1b7 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 204 len: 0 microversion: 2.1 time: 0.335177 Aug 24 03:35:31.649215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:31.649833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:31.653537 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 625/1239] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:31 2022] DELETE /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:35:31.669469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:31.670089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:31.670525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:31.671245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:31.671722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:31.672146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:31.763589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:31.776375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:31.797182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:31.797683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:31.798123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:31.798853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:31.799308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:31.799760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:32.862232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:32.884275 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bc0771cc-e6fa-44d2-8efb-d312af0d0525 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 1.127918 Aug 24 03:35:32.884904 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 626/1240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:31 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:32.898486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:32.899143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:32.915378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:32.915914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:32.919123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:32.923152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:32.923851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:32.924692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.249590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:33.281359 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88f1757b-fc17-46fa-8a1f-b362aa471a66 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1275 microversion: 2.1 time: 0.395270 Aug 24 03:35:33.281974 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 627/1241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:32 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1275 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:33.293038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-03d20f15-a3de-4e9c-b26f-8fbf8b28e6b3 req-f0e6720c-c3ac-48b9-a94a-055645654867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60becdd0-8d76-430b-89c5-78ea632f808b", "tag": "5e05419e-f6a4-4d09-a5f5-5f31009c3f1e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:33.322924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-03d20f15-a3de-4e9c-b26f-8fbf8b28e6b3 req-f0e6720c-c3ac-48b9-a94a-055645654867 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.323472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-03d20f15-a3de-4e9c-b26f-8fbf8b28e6b3 req-f0e6720c-c3ac-48b9-a94a-055645654867 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.325255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-03d20f15-a3de-4e9c-b26f-8fbf8b28e6b3 req-f0e6720c-c3ac-48b9-a94a-055645654867 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.352743 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-03d20f15-a3de-4e9c-b26f-8fbf8b28e6b3 req-f0e6720c-c3ac-48b9-a94a-055645654867 service nova] Creating event network-changed:5e05419e-f6a4-4d09-a5f5-5f31009c3f1e for instance 60becdd0-8d76-430b-89c5-78ea632f808b on n-h1-846470-15 Aug 24 03:35:33.367934 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-03d20f15-a3de-4e9c-b26f-8fbf8b28e6b3 req-f0e6720c-c3ac-48b9-a94a-055645654867 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083862 Aug 24 03:35:33.369138 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 628/1242] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:33.397073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:33.401980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:33.402880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:33.412204 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fbea2c9-3f29-498c-ac5a-3d7273c411d4 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1524 microversion: 2.1 time: 1.764952 Aug 24 03:35:33.428954 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 615/1243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:31 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1524 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:33.435392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.436379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.437766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.438753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.439419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.440672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.906124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:33.906755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:33.921599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.922105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.922656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.923409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.923988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.924632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.938473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:34.376880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:34.402175 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf506c78-4947-4502-a620-cbef456a0c9b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.500214 Aug 24 03:35:34.416210 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 616/1244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:33 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:34.422576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9aa2c4df-fda7-4a02-8b8a-25ab054d0e68 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:34.426961 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:35:34.426961 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:35:34.475794 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9aa2c4df-fda7-4a02-8b8a-25ab054d0e68 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/197574864" status: 202 len: 0 microversion: 2.1 time: 0.070251 Aug 24 03:35:34.481219 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 617/1245] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:35:34 2022] DELETE /compute/v2.1/flavors/197574864 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:34.492714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:34.493777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:34.502825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:34.503334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:34.503808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:34.504548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:34.505013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:34.505451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:34.589562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:34.600914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:34.602529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:34.604084 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac9d7f22-2f70-4cf3-839f-0b577a0085e2 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 1.233469 Aug 24 03:35:34.605455 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 629/1246] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:33 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:34.611340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:34.612287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:34.619318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:34.620341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:34.621126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:34.622452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:34.623152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:34.623881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:34.889028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:34.898227 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce22d565-914f-4219-bd2f-3771f8744354 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.415790 Aug 24 03:35:34.899062 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 618/1247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:34 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:34.938637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1505372949", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8ecdf8db-7eee-4511-a71f-8d4dab2c0c67"}], "security_groups": [{"name": "tempest-securitygroup--1043528571"}], "key_name": "tempest-keypair-237924055", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:35.204479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] validate_networks() for [('8ecdf8db-7eee-4511-a71f-8d4dab2c0c67', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:35:35.304935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:35.458244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:35.488535 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-711b5048-e348-4edc-b11a-15f1f1455e91 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1524 microversion: 2.1 time: 0.879044 Aug 24 03:35:35.503701 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 630/1248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:34 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1524 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:35.512586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-66bd26a2-e514-4813-a55b-45992259cf0d tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:35.542897 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-66bd26a2-e514-4813-a55b-45992259cf0d tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.048992 Aug 24 03:35:35.545109 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 631/1249] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:35:35 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:35.553111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:35.554382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:35.567197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:35.568183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:35.568861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:35.569885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:35.571042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:35.571792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.030531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Getting quotas for project 4106f94adf184471b76f1f81694ff161. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:36.040042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Getting quotas for user 41f453b3b603436795dc0b2507c18079 and project 4106f94adf184471b76f1f81694ff161. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:36.117705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:35:36.118558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:35:36.119262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:35:36.120184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:35:36.120870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:35:36.126997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.139429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.140511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.141196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.142649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.144035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.144822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.161053 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0e645272-e2cb-4032-8e68-139e1180eb6b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.613861 Aug 24 03:35:36.162579 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 632/1250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:35 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:36.181212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2e2a9dce-86e3-43a1-985e-2f39252078a6 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.183233 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:35:36.183233 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:35:36.196077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Getting quotas for project 4106f94adf184471b76f1f81694ff161. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:36.216383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Getting quotas for user 41f453b3b603436795dc0b2507c18079 and project 4106f94adf184471b76f1f81694ff161. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:36.242655 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2e2a9dce-86e3-43a1-985e-2f39252078a6 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/400945594" status: 202 len: 0 microversion: 2.1 time: 0.064703 Aug 24 03:35:36.242912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:35:36.243858 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 633/1251] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:35:36 2022] DELETE /compute/v2.1/flavors/400945594 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:36.247351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:35:36.252229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.253310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:36.262650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.269807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.270777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.272157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.275515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.280828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.354945 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-12ddef27-5617-4de6-9be8-38ec318ac99d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.436714 Aug 24 03:35:36.355758 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 619/1252] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:35:36.365396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.367419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:36.385860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.386780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.387627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.388694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.391141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.391944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.663314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.674525 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8402609e-f963-4764-b5d5-f795ec770e9f tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.317133 Aug 24 03:35:36.690276 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 620/1253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:36 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:36.695751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-271f7eae-dab0-4c18-b773-a45902676b20 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.727696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-271f7eae-dab0-4c18-b773-a45902676b20 tempest-ServersWithSpecificFlavorTestJSON-686918441 tempest-ServersWithSpecificFlavorTestJSON-686918441-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036224 Aug 24 03:35:36.728595 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 621/1254] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:35:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:36.733964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-49976e52-f2ef-4bca-867b-2708e0298f44 req-0a509006-47b9-4efa-b9ab-8fbd7e7b47ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeeab50-8a2b-4979-8731-ab6d1356ead0", "name": "network-vif-deleted", "tag": "75424023-d96a-4a2c-a8ff-58b3bc6c4319"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:36.756220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49976e52-f2ef-4bca-867b-2708e0298f44 req-0a509006-47b9-4efa-b9ab-8fbd7e7b47ee service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.756728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49976e52-f2ef-4bca-867b-2708e0298f44 req-0a509006-47b9-4efa-b9ab-8fbd7e7b47ee service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.757159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49976e52-f2ef-4bca-867b-2708e0298f44 req-0a509006-47b9-4efa-b9ab-8fbd7e7b47ee service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.775780 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-49976e52-f2ef-4bca-867b-2708e0298f44 req-0a509006-47b9-4efa-b9ab-8fbd7e7b47ee service nova] Creating event network-vif-deleted:75424023-d96a-4a2c-a8ff-58b3bc6c4319 for instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 on n-h2-846470-15 Aug 24 03:35:36.783039 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-49976e52-f2ef-4bca-867b-2708e0298f44 req-0a509006-47b9-4efa-b9ab-8fbd7e7b47ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053205 Aug 24 03:35:36.784664 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 622/1255] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:36.791924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-87aeb164-9b97-46a6-a1b2-25e7c26f7a70 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.792883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-87aeb164-9b97-46a6-a1b2-25e7c26f7a70 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:36.803589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:36.828291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.857061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.876372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.882814 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a6807437-fa1f-4bc7-8bd1-791d4bfbab56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.635355 Aug 24 03:35:36.883833 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 634/1256] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:36 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:36.904435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87aeb164-9b97-46a6-a1b2-25e7c26f7a70 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:36.905137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.905942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:36.915197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.915984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.916613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.917500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.918121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.918869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.939393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-87aeb164-9b97-46a6-a1b2-25e7c26f7a70 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1277 microversion: 2.1 time: 0.151055 Aug 24 03:35:36.950448 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 623/1257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:36 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:36.950448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:36.950448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:36.955771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.956517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.958348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.959274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.959920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.960520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.983027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:36.984022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:36.985463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:36.986151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lazy-loading 'fault' on Instance uuid ffeeab50-8a2b-4979-8731-ab6d1356ead0 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:36.989686 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] HTTP exception thrown: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Request method failure captured: Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 HTTP/1.1 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtjba5McIVCU5ezFbquDWANKt6sgz-BUKmBdr86oTxr7ilB4IS1vUmpnV8ztsiOOSn3C8BapdJyK2DlCL533nczMLobe7IxHzK0slg0xTg_4qbuDEDMq1mFRmwDR5OUvqhRBOoIb7wctgHbT8tVT5cC30vI6IjIA9u8XeirnsV0MgM Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_808a68a19ba646a29463d4cba0379351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/808a68a19ba646a29463d4cba0379351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 842bb125a58946649e7a150e35eca5bb Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'f08e8a55-bcba-46e8-8d19-592b1a193bc7'} Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:36.993083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:36.998049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:36.999108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Returning 404 to user: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:37.000390 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2468d201-3c4e-444c-99d0-4a5e2316d23e tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 404 len: 111 microversion: 2.1 time: 0.058697 Aug 24 03:35:37.001603 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 624/1258] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:36 2022] DELETE /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:37.015620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:37.016460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: f08e8a55-bcba-46e8-8d19-592b1a193bc7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:37.025011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.025959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.026486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.027440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.028026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.029203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.069801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589c37ef3c74c86924bd4f521f11add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5362b5593d49a7a695870b28211472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:37.078394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] HTTP exception thrown: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:37.083213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eb393418-d7f8-4ba7-8896-fa60939f6ce6 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 200 len: 1313 microversion: 2.1 time: 0.180129 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Request method failure captured: Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 HTTP/1.1 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtjba5McIVCU5ezFbquDWANKt6sgz-BUKmBdr86oTxr7ilB4IS1vUmpnV8ztsiOOSn3C8BapdJyK2DlCL533nczMLobe7IxHzK0slg0xTg_4qbuDEDMq1mFRmwDR5OUvqhRBOoIb7wctgHbT8tVT5cC30vI6IjIA9u8XeirnsV0MgM Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_808a68a19ba646a29463d4cba0379351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/808a68a19ba646a29463d4cba0379351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 842bb125a58946649e7a150e35eca5bb Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'f08e8a55-bcba-46e8-8d19-592b1a193bc7'} Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.083396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:37.088065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.088065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.088065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:37.088065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:37.088065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:37.088065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:37.088065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. Aug 24 03:35:37.088065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.089245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 635/1259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:36 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:37.090133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Returning 404 to user: Instance f08e8a55-bcba-46e8-8d19-592b1a193bc7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:37.091464 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dbdff392-1499-4492-9950-db14c035a034 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7" status: 404 len: 111 microversion: 2.1 time: 0.084373 Aug 24 03:35:37.095798 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 625/1260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:37 2022] GET /compute/v2.1/servers/f08e8a55-bcba-46e8-8d19-592b1a193bc7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:35:37.101654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:37.102185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:37.109546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.110530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.111387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.114914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.115584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.117245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.141245 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] HTTP exception thrown: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Request method failure captured: Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 HTTP/1.1 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZtjba5McIVCU5ezFbquDWANKt6sgz-BUKmBdr86oTxr7ilB4IS1vUmpnV8ztsiOOSn3C8BapdJyK2DlCL533nczMLobe7IxHzK0slg0xTg_4qbuDEDMq1mFRmwDR5OUvqhRBOoIb7wctgHbT8tVT5cC30vI6IjIA9u8XeirnsV0MgM Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_808a68a19ba646a29463d4cba0379351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/808a68a19ba646a29463d4cba0379351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 842bb125a58946649e7a150e35eca5bb Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a19c423f-0e82-4d93-b79d-7fdc5d3cdf42'} Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:37.142989 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Returning 404 to user: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-909b24ad-6c7b-4745-96f6-725ac261a482 tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 404 len: 111 microversion: 2.1 time: 0.047481 Aug 24 03:35:37.147422 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 636/1261] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:37 2022] DELETE /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:35:37.156397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:37.157343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] [instance: a19c423f-0e82-4d93-b79d-7fdc5d3cdf42] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:37.173755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.174296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.174770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.176754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.181482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.182460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.183776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:37.185950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:37.195497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.195997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.196442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.200571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.201018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.201534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.220541 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] HTTP exception thrown: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Request method failure captured: Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 HTTP/1.1 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZtjba5McIVCU5ezFbquDWANKt6sgz-BUKmBdr86oTxr7ilB4IS1vUmpnV8ztsiOOSn3C8BapdJyK2DlCL533nczMLobe7IxHzK0slg0xTg_4qbuDEDMq1mFRmwDR5OUvqhRBOoIb7wctgHbT8tVT5cC30vI6IjIA9u8XeirnsV0MgM Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_808a68a19ba646a29463d4cba0379351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/808a68a19ba646a29463d4cba0379351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/808a68a19ba646a29463d4cba0379351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 808a68a19ba646a29463d4cba0379351 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478 Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 842bb125a58946649e7a150e35eca5bb Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-139579478-project Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a19c423f-0e82-4d93-b79d-7fdc5d3cdf42'} Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.226019 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:37.230993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.230993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:37.230993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:37.230993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:37.230993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:37.230993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:37.230993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. Aug 24 03:35:37.230993 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:37.234813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] Returning 404 to user: Instance a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:37.237223 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67e61532-7b96-4dae-a836-c304442d09ec tempest-ServersWithSpecificFlavorTestJSON-139579478 tempest-ServersWithSpecificFlavorTestJSON-139579478-project] 10.222.0.58 "GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42" status: 404 len: 111 microversion: 2.1 time: 0.085181 Aug 24 03:35:37.241152 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 626/1262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:37 2022] GET /compute/v2.1/servers/a19c423f-0e82-4d93-b79d-7fdc5d3cdf42 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:35:37.602819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:37.619893 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02f7e8ba-0edb-47cd-b98a-5f173d628a66 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.440027 Aug 24 03:35:37.621079 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 637/1263] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:37 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:37.698948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:37.700229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:37.722808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.728091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.728787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.731908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.732692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.733523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.916121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:37.916740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:37.924882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.925811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.926544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:37.927407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:37.928220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:37.928917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:38.099186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:38.116442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0f28331-1b09-4e53-b1fd-952cd0c3654a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.423476 Aug 24 03:35:38.119237 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 627/1264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:37 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:38.127627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:38.128744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:38.136440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:38.137322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:38.138039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:38.139152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:38.140233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:38.141016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:38.476621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:38.487612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:38.497577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:38.500093 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee1e2ea1-8c40-4bf0-8e95-78b50fbb6823 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.587791 Aug 24 03:35:38.504305 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 638/1265] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:37 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:38.629209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:38.648678 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10c8fa52-663b-4a95-b94b-76802fafe5fc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1329 microversion: 2.1 time: 0.528051 Aug 24 03:35:38.662400 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 628/1266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:38 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1329 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:38.671935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:38.672937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-387238636", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "e07f3288-7434-41be-a4ae-1a790904361f"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:38.677472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] [instance: ffeeab50-8a2b-4979-8731-ab6d1356ead0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:38.699285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:38.708804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:38.710453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:38.714821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:38.718579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:38.721685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:38.779458 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] HTTP exception thrown: Instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 could not be found. Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Request method failure captured: Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 HTTP/1.1 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZxjXIzyJqJO_te1Ovi28rcGEqMkEhdIh4avVZuHs3BgBreMPSX6ASXMNCbLdHLcC6fysRD7UWneVIWS06tDqiliEnw9X7ZiDUYC-EjJ939FG-hL_wqHbwkN_j_E_cZOparFdqGk7z5BnBjjvHdqxCtK1j4K3WRTwE2wjTmovaa7z9w Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be5362b5593d49a7a695870b28211472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be5362b5593d49a7a695870b28211472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be5362b5593d49a7a695870b28211472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: be5362b5593d49a7a695870b28211472 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1287394699 Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 8589c37ef3c74c86924bd4f521f11add Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1287394699-project Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 could not be found. Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'ffeeab50-8a2b-4979-8731-ab6d1356ead0'} Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 could not be found. Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 could not be found. Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:38.785395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 could not be found. Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] Returning 404 to user: Instance ffeeab50-8a2b-4979-8731-ab6d1356ead0 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:38.790560 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df87b619-dd2e-43d8-8d32-f6bac70894f5 tempest-ServerMetadataNegativeTestJSON-1287394699 tempest-ServerMetadataNegativeTestJSON-1287394699-project] 10.222.0.58 "GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0" status: 404 len: 111 microversion: 2.1 time: 0.124852 Aug 24 03:35:38.797550 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 629/1267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:38 2022] GET /compute/v2.1/servers/ffeeab50-8a2b-4979-8731-ab6d1356ead0 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:38.808348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:38.813936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:38.824622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] validate_networks() for [('e07f3288-7434-41be-a4ae-1a790904361f', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:35:38.827995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:38.830258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:38.830806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:38.832547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:38.834420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:38.834964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.376061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:39.391799 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-87a6e857-4586-44be-8128-e09501d140ad tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.590443 Aug 24 03:35:39.399514 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 630/1268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:38 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:39.413940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ec973c50-0dd6-402b-9588-068254046dad req-4c662835-0ed8-458b-abe8-ed15a5d36cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c36470a-8993-4954-8e70-f90a446a2240", "tag": "e79d43a2-9e92-4735-9ad0-3a655e27ce35"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:39.431550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ec973c50-0dd6-402b-9588-068254046dad req-4c662835-0ed8-458b-abe8-ed15a5d36cbb service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.432500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ec973c50-0dd6-402b-9588-068254046dad req-4c662835-0ed8-458b-abe8-ed15a5d36cbb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.433789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ec973c50-0dd6-402b-9588-068254046dad req-4c662835-0ed8-458b-abe8-ed15a5d36cbb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.452654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ec973c50-0dd6-402b-9588-068254046dad req-4c662835-0ed8-458b-abe8-ed15a5d36cbb service nova] Creating event network-changed:e79d43a2-9e92-4735-9ad0-3a655e27ce35 for instance 8c36470a-8993-4954-8e70-f90a446a2240 on n-h2-846470-15 Aug 24 03:35:39.459783 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ec973c50-0dd6-402b-9588-068254046dad req-4c662835-0ed8-458b-abe8-ed15a5d36cbb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058382 Aug 24 03:35:39.461017 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 631/1269] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:39.471044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:39.472118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:39.480640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.482297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.482983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.484063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.485039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.485643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.738945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:39.752092 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63a94da5-d20a-4373-a62e-6afacc12e408 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.288974 Aug 24 03:35:39.763460 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 632/1270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:39 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:39.785668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:39.786648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:39.799054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.800050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.800706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:39.801725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:39.802361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:39.803005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.445407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:40.462676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:40.464606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:35:40.466418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:35:40.467103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:35:40.468226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:35:40.468895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:35:40.482597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:40.485654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5dff3d4b-0365-4e55-b5ac-ed709c66ec2b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1813 microversion: 2.25 time: 0.717276 Aug 24 03:35:40.490268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.491333 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 633/1271] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:39 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1813 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:40.501222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:40.502176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:40.511962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.513669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.514174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.514313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.514613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.516649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.519039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.519757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.522230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.524429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.529928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.573959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Getting quotas for project 6251e0afcbcd4be99a11a20e42e5eea5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:40.593827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Getting quotas for user c3a7defb9bc748f684309d7a7674154b and project 6251e0afcbcd4be99a11a20e42e5eea5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:40.633239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:40.639767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:35:40.650370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:35:40.736701 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6cb8e85e-db6d-4d4f-9596-cd5212b4df85 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.230548 Aug 24 03:35:40.755737 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 639/1272] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:35:40.766298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:40.767210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:40.786518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.787422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.791809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.794745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:40.800363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:40.810906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:40.921750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:40.931276 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1443020c-e86d-4173-b40d-f10a5611bf09 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1335 microversion: 2.1 time: 0.438655 Aug 24 03:35:40.932772 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 634/1273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:40 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1335 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:40.947898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2700e1f2-d815-4079-81b9-7af863228c14 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:40.950078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2700e1f2-d815-4079-81b9-7af863228c14 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:41.108712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2700e1f2-d815-4079-81b9-7af863228c14 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:41.117425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=33 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:41.138609 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2700e1f2-d815-4079-81b9-7af863228c14 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1224 microversion: 2.1 time: 0.204370 Aug 24 03:35:41.163433 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 635/1274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:40 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1224 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:41.176880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:41.178954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:41.189217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.190104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.190740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:41.191629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.192424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.193617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:41.300704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:41.317498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:41.330881 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-554182f4-f24c-4faf-9870-dbacc2bb51a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.570665 Aug 24 03:35:41.331988 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 640/1275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:40 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:41.517814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:41.519397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:41.528743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.529098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.529855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:41.535189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.536198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.536874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:41.658294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:41.670811 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9de0cd79-f481-4c23-b447-ab09c6f696a9 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.505502 Aug 24 03:35:41.671427 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 636/1276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:41 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:41.958076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:41.958603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:41.974397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.976443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.977625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:41.995167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:41.996701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:41.998401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:42.795950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:42.816172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:42.817763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:42.819057 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a54d68dc-e114-4204-b161-20bed4c78057 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1803 microversion: 2.25 time: 1.305815 Aug 24 03:35:42.836211 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 641/1277] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:41 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1803 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:42.854458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:42.855512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:42.864812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:42.868514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:42.869306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:42.871311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:42.872079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:42.877994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.211367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.227512 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c0c24f6f-dc8d-4c2d-972f-c9ae0e6f1af9 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1403 microversion: 2.1 time: 1.273637 Aug 24 03:35:43.228894 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 637/1278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:41 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1403 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:43.239096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.240005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.252578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.255491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.257752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.259042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.260913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.261665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.277019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.338202 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b1915343-b05b-420e-b45a-2f5a87e2fedc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1276 microversion: 2.1 time: 0.500375 Aug 24 03:35:43.339438 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 642/1279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:42 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1276 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:43.357268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.358337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.366407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.374573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.375163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.376173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.376648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.377249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.733377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.753382 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23cf49c5-067e-45b6-9dba-35a9f8a969a3 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.522719 Aug 24 03:35:43.754261 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 638/1280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:43 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:43.770482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3a21ec2-cf5b-4f00-b80e-fe96e0fb3738 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '.version_select at 0x7f1022e2d700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.779227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3a21ec2-cf5b-4f00-b80e-fe96e0fb3738 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.781130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3a21ec2-cf5b-4f00-b80e-fe96e0fb3738 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.782876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3a21ec2-cf5b-4f00-b80e-fe96e0fb3738 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.805009 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3a21ec2-cf5b-4f00-b80e-fe96e0fb3738 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1532 microversion: 2.25 time: 0.048455 Aug 24 03:35:43.806721 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 639/1281] 10.222.0.58 () {60 vars in 1184 bytes} [Wed Aug 24 03:35:43 2022] GET /compute/v2.1/os-migrations => generated 1532 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:43.813887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-66c7b351-291a-496e-8344-dbea8b0b3598 req-edf15e49-a768-4ef9-ba0b-223e5336f989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60becdd0-8d76-430b-89c5-78ea632f808b", "name": "network-vif-plugged", "status": "completed", "tag": "5e05419e-f6a4-4d09-a5f5-5f31009c3f1e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:43.840383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:43.862870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-66c7b351-291a-496e-8344-dbea8b0b3598 req-edf15e49-a768-4ef9-ba0b-223e5336f989 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.864878 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a72e0fe-de82-462a-b5e0-cdf4cf1e9d76 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.523915 Aug 24 03:35:43.865724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-66c7b351-291a-496e-8344-dbea8b0b3598 req-edf15e49-a768-4ef9-ba0b-223e5336f989 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.866414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-66c7b351-291a-496e-8344-dbea8b0b3598 req-edf15e49-a768-4ef9-ba0b-223e5336f989 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.868633 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 643/1282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:43 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:43.887196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.887971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.895129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.895910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.896535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.897438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.898072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.898297 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-66c7b351-291a-496e-8344-dbea8b0b3598 req-edf15e49-a768-4ef9-ba0b-223e5336f989 service nova] Creating event network-vif-plugged:5e05419e-f6a4-4d09-a5f5-5f31009c3f1e for instance 60becdd0-8d76-430b-89c5-78ea632f808b on n-h1-846470-15 Aug 24 03:35:43.898921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.915282 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-66c7b351-291a-496e-8344-dbea8b0b3598 req-edf15e49-a768-4ef9-ba0b-223e5336f989 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103188 Aug 24 03:35:43.916346 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 640/1283] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:44.252408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:44.254642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:44.264366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.265031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.265545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.267443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.268923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.269933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.469407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid cf0590f4-ad3d-4016-b019-6e71212ff34e {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:44.506020 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e68e02a2-e34c-425f-8ad5-b4a58ed34077 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 2424 microversion: 2.25 time: 0.631088 Aug 24 03:35:44.511186 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 644/1284] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:43 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 2424 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:44.535336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:44.537437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:44.567441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.569012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.574072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.576145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.577286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.578456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.748380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:44.765942 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-12ead055-5a4c-46d4-8ab7-e5c3278d1be5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1282 microversion: 2.1 time: 0.251283 Aug 24 03:35:44.768335 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 645/1285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:44 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:44.798443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:44.799488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:44.807788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.808704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.809751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.811473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.812203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.813245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.829764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:44.843074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cf06cbe4-d50e-4880-bf94-cc0858d2ec77 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1403 microversion: 2.1 time: 0.596423 Aug 24 03:35:44.843992 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 641/1286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:44 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1403 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:44.863216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:44.864568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:44.882325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.883249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.884404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:44.885742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:44.887306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:44.888587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.197546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid cf0590f4-ad3d-4016-b019-6e71212ff34e {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:45.224198 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bdbdb2e6-53f8-423b-8bfc-01c1b23ae9ee tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 2424 microversion: 2.25 time: 0.453263 Aug 24 03:35:45.225534 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 646/1287] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:44 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 2424 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:45.233318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:45.234497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:45.255262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.255981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.256752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.257654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.258574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.259334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.432689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:45.436767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:45.446695 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a8970e3-36d0-4543-a1e1-c80e365818da tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1350 microversion: 2.1 time: 0.601435 Aug 24 03:35:45.447284 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 642/1288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:44 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1350 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:45.467747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:45.468503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:45.478229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.479034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.479779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.480937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.482463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.483135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.539919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:45.552613 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f1de53b4-606b-4739-b1df-8075d315cbde tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.325489 Aug 24 03:35:45.559613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 647/1289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:45 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:45.630454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8bcab0c8-430d-4268-98c8-90b9095a62c8 req-3f90f9c6-9186-48e6-a662-64e951667bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b32a2f37-3a7c-442f-8148-40aa5541cae8", "tag": "d018d629-f0a8-454b-9e96-e8d6d2dda40b"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:45.663392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8bcab0c8-430d-4268-98c8-90b9095a62c8 req-3f90f9c6-9186-48e6-a662-64e951667bfa service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.666106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8bcab0c8-430d-4268-98c8-90b9095a62c8 req-3f90f9c6-9186-48e6-a662-64e951667bfa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.666607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8bcab0c8-430d-4268-98c8-90b9095a62c8 req-3f90f9c6-9186-48e6-a662-64e951667bfa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.697492 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8bcab0c8-430d-4268-98c8-90b9095a62c8 req-3f90f9c6-9186-48e6-a662-64e951667bfa service nova] Creating event network-changed:d018d629-f0a8-454b-9e96-e8d6d2dda40b for instance b32a2f37-3a7c-442f-8148-40aa5541cae8 on n-h2-846470-15 Aug 24 03:35:45.704105 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8bcab0c8-430d-4268-98c8-90b9095a62c8 req-3f90f9c6-9186-48e6-a662-64e951667bfa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078516 Aug 24 03:35:45.705099 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 648/1290] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:45.770879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lazy-loading 'services' on Instance uuid cf0590f4-ad3d-4016-b019-6e71212ff34e {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:45.791752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:45.792490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:45.808139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.808645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.809183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.809929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.810403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.810841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.158521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:46.233057 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-68a035ad-3bfc-4840-9e39-531fb90c7e7f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments/93393a76-274a-4e7b-a9ad-c8092fe9cbdf" status: 202 len: 0 microversion: 2.25 time: 0.770839 Aug 24 03:35:46.238091 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 643/1291] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 24 03:35:45 2022] DELETE /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments/93393a76-274a-4e7b-a9ad-c8092fe9cbdf => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:35:46.256568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:46.259314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:46.291028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.291539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.292022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.292994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.293577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.295373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.628199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:46.658106 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b3eb3ee-2bf5-49eb-88b4-384e1771c8c1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 0.865774 Aug 24 03:35:46.671740 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 649/1292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:45 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:46.671740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:46.683048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:46.706079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.707308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.708471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.709975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.710766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.711709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.803566 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c73bcd6-99e0-435a-a1ef-98d8da6c8ae9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142844 Aug 24 03:35:46.805975 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 650/1293] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:35:46 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:35:46.816872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:46.817681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:46.826045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.826833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.827374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.828291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.828851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.829440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.869397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:46.879397 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05103699-51c9-4508-b240-1062ac81f932 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1403 microversion: 2.1 time: 0.639477 Aug 24 03:35:46.898671 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 644/1294] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:46 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1403 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:46.904817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:46.905799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:46.914606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.916068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.916752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.917728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.918720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.919366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.335726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:47.359607 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-69a3a6c7-ea29-4ec0-afc7-cbe52d8dc834 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.458060 Aug 24 03:35:47.361432 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 645/1295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:46 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:47.420634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-906685f2-4fb4-46c1-9e40-5c16214bde15 req-579ddf45-0e1e-4f60-8f79-2fe233faba27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c36470a-8993-4954-8e70-f90a446a2240", "name": "network-vif-plugged", "status": "completed", "tag": "e79d43a2-9e92-4735-9ad0-3a655e27ce35"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:47.458658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-906685f2-4fb4-46c1-9e40-5c16214bde15 req-579ddf45-0e1e-4f60-8f79-2fe233faba27 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.463025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-906685f2-4fb4-46c1-9e40-5c16214bde15 req-579ddf45-0e1e-4f60-8f79-2fe233faba27 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.465494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-906685f2-4fb4-46c1-9e40-5c16214bde15 req-579ddf45-0e1e-4f60-8f79-2fe233faba27 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.509847 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-906685f2-4fb4-46c1-9e40-5c16214bde15 req-579ddf45-0e1e-4f60-8f79-2fe233faba27 service nova] Creating event network-vif-plugged:e79d43a2-9e92-4735-9ad0-3a655e27ce35 for instance 8c36470a-8993-4954-8e70-f90a446a2240 on n-h2-846470-15 Aug 24 03:35:47.524935 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-906685f2-4fb4-46c1-9e40-5c16214bde15 req-579ddf45-0e1e-4f60-8f79-2fe233faba27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107634 Aug 24 03:35:47.529738 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 646/1296] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:47.562089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:47.604894 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ed8b3473-df24-4fc7-bb62-6e0ba3ce615a tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1539 microversion: 2.1 time: 0.790494 Aug 24 03:35:47.609334 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 651/1297] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:46 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1539 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:47.659799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:47.661034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:47.694354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:47.702304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:47.704442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.715789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.717288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.719067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.725463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.730322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.743694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.745234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.753793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.759029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.771553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.773478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.287106 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-250761f4-de3f-4674-a745-53e3ebe5895c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.635725 Aug 24 03:35:48.288415 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 647/1298] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:35:47 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b/os-interface => generated 284 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:48.296344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:48.306067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:48.320536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.321306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.322015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.322947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.324671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.325316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.384568 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9841b4f9-6e08-4d2c-b2eb-776583a9da5d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093458 Aug 24 03:35:48.387046 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 648/1299] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:35:48 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:35:48.397324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:48.398594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:48.408245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.409103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.409746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.410747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.411520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.412178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.900555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:48.918529 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26ee1524-6fe2-4279-ae47-c7e2ae30494a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 1.231252 Aug 24 03:35:48.919743 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 652/1300] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:47 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:48.925950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:48.927198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:48.942662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.943526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.944209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.945227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.945946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.946608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.351257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:49.366785 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47768b06-8489-4a3c-8851-820d3de584e5 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.444725 Aug 24 03:35:49.384285 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 653/1301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:48 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:49.404798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4a1a4d69-1fe5-4fca-96d6-4046c92926c1 req-badd42c4-ceb5-4b05-a4db-cb80f9f9aba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5", "tag": "6417e561-953c-4945-a98d-b10ce4b9727d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:49.424422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a1a4d69-1fe5-4fca-96d6-4046c92926c1 req-badd42c4-ceb5-4b05-a4db-cb80f9f9aba3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.425928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a1a4d69-1fe5-4fca-96d6-4046c92926c1 req-badd42c4-ceb5-4b05-a4db-cb80f9f9aba3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.427948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a1a4d69-1fe5-4fca-96d6-4046c92926c1 req-badd42c4-ceb5-4b05-a4db-cb80f9f9aba3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.452661 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4a1a4d69-1fe5-4fca-96d6-4046c92926c1 req-badd42c4-ceb5-4b05-a4db-cb80f9f9aba3 service nova] Creating event network-changed:6417e561-953c-4945-a98d-b10ce4b9727d for instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 on n-h1-846470-15 Aug 24 03:35:49.462168 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4a1a4d69-1fe5-4fca-96d6-4046c92926c1 req-badd42c4-ceb5-4b05-a4db-cb80f9f9aba3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075198 Aug 24 03:35:49.464796 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 654/1302] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:49.471461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:49.474345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:49.481674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.482572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.483423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.484730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.485431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.486121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.537145 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b4bff96-f044-4901-9651-7cbab544e219 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070507 Aug 24 03:35:49.538082 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 655/1303] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:35:49 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:35:49.747217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:49.758986 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-94fcfebc-b69e-43eb-9e0f-a8a6db4acc45 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1403 microversion: 2.1 time: 1.369539 Aug 24 03:35:49.760325 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 649/1304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:48 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1403 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:49.946709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:49.948640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:49.973288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.974071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.974819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.979196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.986474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.987607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.245736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:50.256757 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87660c56-af04-4959-aaa3-e77e9a0ed3f1 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 0.314772 Aug 24 03:35:50.257640 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 656/1305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:49 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:50.406071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:50.407205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:50.415014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.415923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.416772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.417734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.418472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.419150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.556410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:50.562419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:50.568347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:50.577363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.578663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.579941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.582052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.582929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.583776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.619421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:50.644398 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-888a58bf-f912-462a-bdba-cd5b3d1a386d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095961 Aug 24 03:35:50.645763 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 657/1306] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:35:50 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:35:50.790854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:50.791799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:50.803630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.804902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.805670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.806943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:50.808308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:50.809838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.820045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:50.928079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:50.943088 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-25e852a2-4c3d-48ed-82b7-f2af8b08268b tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.541471 Aug 24 03:35:50.957238 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 650/1307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:50 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:51.007249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:51.017394 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3795bf13-1c7d-44b5-87f0-59e400907980 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1403 microversion: 2.1 time: 0.234414 Aug 24 03:35:51.018002 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 658/1308] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:50 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1403 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:51.279940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:51.280937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:51.284579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:51.289914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.290977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.291765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.293013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.295696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.296524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.662658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:51.665531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:51.691926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.693408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.694513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.695877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.697537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.698922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.751904 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-21572d92-84eb-4df2-9cff-1317c63d38d3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094935 Aug 24 03:35:51.757862 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 659/1309] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:35:51 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:35:52.018090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:52.050993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:52.144789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.146780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.148510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.152140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.154837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.155535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.206915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:52.237383 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-710637fb-016d-40e0-9d12-4dd7f117ace8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 0.957824 Aug 24 03:35:52.243622 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 651/1310] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:51 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:52.266446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:52.267782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:52.327077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.328012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.328842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.354772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.354772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.360448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.748348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:52.757160 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94f79cce-2a57-4bc1-8b3c-6e6482ad8680 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1317 microversion: 2.1 time: 0.783344 Aug 24 03:35:52.763457 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 660/1311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:51 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:52.764823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:52.774389 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a968112f-87b2-4c62-80c7-97d96c6f4018 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1403 microversion: 2.1 time: 0.529205 Aug 24 03:35:52.778114 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 652/1312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:52 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1403 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:52.789509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:52.793237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:52.822764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.823478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.824135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.825890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.830138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.830821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.889219 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-280ff46a-ce5e-4659-af96-15a452982867 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109492 Aug 24 03:35:52.901052 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 653/1313] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:35:52 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:35:53.090308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ddc0383d-9a1d-4f20-89df-8787373b11af req-1078a6c8-1fcf-4e97-826c-f5c08e25a093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60becdd0-8d76-430b-89c5-78ea632f808b", "tag": "5e05419e-f6a4-4d09-a5f5-5f31009c3f1e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:53.114142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ddc0383d-9a1d-4f20-89df-8787373b11af req-1078a6c8-1fcf-4e97-826c-f5c08e25a093 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.114674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ddc0383d-9a1d-4f20-89df-8787373b11af req-1078a6c8-1fcf-4e97-826c-f5c08e25a093 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.115117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ddc0383d-9a1d-4f20-89df-8787373b11af req-1078a6c8-1fcf-4e97-826c-f5c08e25a093 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.147621 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ddc0383d-9a1d-4f20-89df-8787373b11af req-1078a6c8-1fcf-4e97-826c-f5c08e25a093 service nova] Creating event network-changed:5e05419e-f6a4-4d09-a5f5-5f31009c3f1e for instance 60becdd0-8d76-430b-89c5-78ea632f808b on n-h1-846470-15 Aug 24 03:35:53.157494 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ddc0383d-9a1d-4f20-89df-8787373b11af req-1078a6c8-1fcf-4e97-826c-f5c08e25a093 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389387 Aug 24 03:35:53.168836 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 661/1314] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:53.265112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:53.273221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:53.304836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.305740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.319997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.323965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.324995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.332392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.783102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:53.784246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:53.799485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.800212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.800700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.810945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.811889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.814202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.313893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:54.327976 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-404b0562-b22b-4c1a-abe5-f97325a65782 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1507 microversion: 2.1 time: 0.546183 Aug 24 03:35:54.334147 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 662/1315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:53 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:54.339783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:54.350986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:54.389425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.390006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.390816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.391132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.391616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.392084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.460224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:54.486517 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9a647d85-7ae4-4c6f-b118-7eb58fda0fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 1.231506 Aug 24 03:35:54.504792 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 654/1316] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:53 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:54.510499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:54.513896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:54.521188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.522222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.522907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.524336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.525098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.525841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.608227 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7842440c-17ea-4f67-b04e-ad436fc5e389 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.101783 Aug 24 03:35:54.612118 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 655/1317] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 03:35:54 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:55.170918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:55.183536 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9673d0ca-23ed-4cba-b75c-bdb68d7e648d tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1403 microversion: 2.1 time: 0.848032 Aug 24 03:35:55.204566 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 663/1318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:54 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1403 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:55.510599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:55.511346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:55.535613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.536559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.537448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.538514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.541413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.546704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.836997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-51254a9f-5a2c-4643-a097-693bb78feed3 req-e202f942-c8de-4d93-b3c1-5e7869dfc1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b32a2f37-3a7c-442f-8148-40aa5541cae8", "name": "network-vif-plugged", "status": "completed", "tag": "d018d629-f0a8-454b-9e96-e8d6d2dda40b"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:55.864973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-51254a9f-5a2c-4643-a097-693bb78feed3 req-e202f942-c8de-4d93-b3c1-5e7869dfc1fa service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.872883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-51254a9f-5a2c-4643-a097-693bb78feed3 req-e202f942-c8de-4d93-b3c1-5e7869dfc1fa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.874203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-51254a9f-5a2c-4643-a097-693bb78feed3 req-e202f942-c8de-4d93-b3c1-5e7869dfc1fa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.906234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-51254a9f-5a2c-4643-a097-693bb78feed3 req-e202f942-c8de-4d93-b3c1-5e7869dfc1fa service nova] Creating event network-vif-plugged:d018d629-f0a8-454b-9e96-e8d6d2dda40b for instance b32a2f37-3a7c-442f-8148-40aa5541cae8 on n-h2-846470-15 Aug 24 03:35:55.925058 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-51254a9f-5a2c-4643-a097-693bb78feed3 req-e202f942-c8de-4d93-b3c1-5e7869dfc1fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090048 Aug 24 03:35:55.929447 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 664/1319] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:56.245898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:56.253884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:56.300591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:56.302609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:56.305626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:56.309671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:56.313034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:56.316218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:56.508141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:56.520663 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e395fa77-7b80-427c-9a97-26c4a77c8efd tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 1.014382 Aug 24 03:35:56.523630 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 656/1320] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:55 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:57.048021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:57.067849 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a041d15-a9fc-4ad6-8cab-1538a29a6faf tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1403 microversion: 2.1 time: 0.843188 Aug 24 03:35:57.072066 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 665/1321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:56 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1403 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:57.420120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "62de8225-432c-4dd5-bfb6-d599a123e1d5"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:57.425640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:57.439747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:57.441712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:57.442591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:57.443694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:57.445847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:57.448908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:57.544193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:57.544862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:57.549968 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] HTTP exception thrown: Volume 83292176-6c78-47f2-873a-5a325c76bc20 could not be found. Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Request method failure captured: Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: request: PUT /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240/os-volume_attachments/83292176-6c78-47f2-873a-5a325c76bc20 HTTP/1.1 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 74 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZuvHK67WFrUwj0gbHlEujLXmI7VpjGOxhye-yJgNKYE6-DVISmaYyhTDA3FCK9xxYPrCv0Kwcok3-zqdJFRl0DcR384UVMNMcUXewvzrR-q4510jbw2tR0hWI7xgboqvkbfSx7vuVkeH_ZYcL2uu0maqLHYk9bAD_xtI5y0ffmvPmI Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 4b7b32f8849944eda8f3587e18eb23a4 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesAdminNegativeTest-422920215 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4b7b32f8849944eda8f3587e18eb23a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4b7b32f8849944eda8f3587e18eb23a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b7b32f8849944eda8f3587e18eb23a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b7b32f8849944eda8f3587e18eb23a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesAdminNegativeTest-422920215 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 4b7b32f8849944eda8f3587e18eb23a4 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-422920215 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesAdminNegativeTest-422920215-project-admin Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 8539fbb1695548e8970a36388ad3a2e1 Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesAdminNegativeTest-422920215-project-admin Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: {"volumeAttachment": {"volumeId": "62de8225-432c-4dd5-bfb6-d599a123e1d5"}} Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: exception: Volume 83292176-6c78-47f2-873a-5a325c76bc20 could not be found. Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': '8c36470a-8993-4954-8e70-f90a446a2240', 'id': '83292176-6c78-47f2-873a-5a325c76bc20', 'body': {'volumeAttachment': {'volumeId': '62de8225-432c-4dd5-bfb6-d599a123e1d5'}}} Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83292176-6c78-47f2-873a-5a325c76bc20 could not be found. (HTTP 404) (Request-ID: req-dd6b7d54-bef8-4d59-b60a-8dcead447d9e) Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:35:57.555332 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83292176-6c78-47f2-873a-5a325c76bc20 could not be found. Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83292176-6c78-47f2-873a-5a325c76bc20 could not be found. Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83292176-6c78-47f2-873a-5a325c76bc20 could not be found. Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] Returning 404 to user: Volume 83292176-6c78-47f2-873a-5a325c76bc20 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:57.562162 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec9ff7b5-110e-4c69-a041-7d46f25d5622 tempest-VolumesAdminNegativeTest-422920215 tempest-VolumesAdminNegativeTest-422920215-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240/os-volume_attachments/83292176-6c78-47f2-873a-5a325c76bc20" status: 404 len: 109 microversion: 2.1 time: 0.147922 Aug 24 03:35:57.576999 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 657/1322] 10.222.0.58 () {60 vars in 1433 bytes} [Wed Aug 24 03:35:57 2022] PUT /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240/os-volume_attachments/83292176-6c78-47f2-873a-5a325c76bc20 => generated 109 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:57.587146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:57.588022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:57.589071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:57.590424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:57.591290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:57.591931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.079576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:58.094853 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6db06970-70f4-4b78-aff9-d2c62d13b80f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 0.557377 Aug 24 03:35:58.098527 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 666/1323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:57 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:58.121826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:58.121826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:58.131396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.132297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.132916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.133971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.134934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.135808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.621993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:58.638406 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-289249a1-a461-4504-9aad-305101d46919 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1591 microversion: 2.1 time: 0.528292 Aug 24 03:35:58.639065 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 658/1324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:58 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1591 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:58.663714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:58.664807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:58.676397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.681235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.682012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.682998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.683812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.690731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.054341 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88315a1b-383a-41b0-9233-872b75250ad5 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.394611 Aug 24 03:35:59.062809 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 667/1325] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:35:58 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8/os-interface => generated 285 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:59.122831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:59.123822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:59.145005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.145900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.149142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.150504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.157057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.157932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.244202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7b942508-27d1-4fa2-b3b1-64d6d446c4e6 req-e34619e3-6f75-48c8-b454-452fbbe99b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5", "name": "network-vif-plugged", "status": "completed", "tag": "6417e561-953c-4945-a98d-b10ce4b9727d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:59.268355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7b942508-27d1-4fa2-b3b1-64d6d446c4e6 req-e34619e3-6f75-48c8-b454-452fbbe99b56 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.270500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7b942508-27d1-4fa2-b3b1-64d6d446c4e6 req-e34619e3-6f75-48c8-b454-452fbbe99b56 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.271743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7b942508-27d1-4fa2-b3b1-64d6d446c4e6 req-e34619e3-6f75-48c8-b454-452fbbe99b56 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.321644 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7b942508-27d1-4fa2-b3b1-64d6d446c4e6 req-e34619e3-6f75-48c8-b454-452fbbe99b56 service nova] Creating event network-vif-plugged:6417e561-953c-4945-a98d-b10ce4b9727d for instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 on n-h1-846470-15 Aug 24 03:35:59.342823 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7b942508-27d1-4fa2-b3b1-64d6d446c4e6 req-e34619e3-6f75-48c8-b454-452fbbe99b56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102908 Aug 24 03:35:59.345355 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 668/1326] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:00.586760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:00.633780 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-715cebc1-87e0-4b0f-a95d-bdb1b4e83de7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 1.515549 Aug 24 03:36:00.639778 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 659/1327] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:59 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:01.660819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:01.662323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:01.680459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:01.685952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:01.687982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:01.689636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:01.690425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:01.693602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.121485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:02.156221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7ccc7e21-d258-4fd7-8515-e09ba7586b2d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1324 microversion: 2.1 time: 0.501827 Aug 24 03:36:02.157947 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 669/1328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:01 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:02.229065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:02.232212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:02.269535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.272768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.273781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.275362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.276443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.288815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.413401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:02.430077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:36:02.651223 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7d85d49f-f5a8-4c27-bc29-af0720d0f1ed tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 204 len: 0 microversion: 2.1 time: 0.427729 Aug 24 03:36:02.655813 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 660/1329] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:36:02 2022] DELETE /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:02.672909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:02.675627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:02.693024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.695441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.696604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.698462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.700622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.702072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.193537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:03.200003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:03.234504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.241374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.246073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.253569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.254695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.261617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.517660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:03.540635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dec32be3-6d36-40ad-8536-0df2ae369cb3 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1513 microversion: 2.1 time: 0.876749 Aug 24 03:36:03.543936 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 670/1330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:02 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1513 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:03.556087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:03.557029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:03.576649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.583050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.584766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.592079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.594854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.598444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.767347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:03.799484 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aca0c98c-e813-40af-9f04-00a6ddafbdbc tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1591 microversion: 2.1 time: 0.615177 Aug 24 03:36:03.813115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 661/1331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:03 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1591 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:03.828019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5e501d0a-72c7-42cf-98bf-d77fbfa91a33 req-89b06b96-ded6-4726-a39b-1321573ef415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b32a2f37-3a7c-442f-8148-40aa5541cae8", "tag": "d018d629-f0a8-454b-9e96-e8d6d2dda40b"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:03.872551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5e501d0a-72c7-42cf-98bf-d77fbfa91a33 req-89b06b96-ded6-4726-a39b-1321573ef415 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.882871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5e501d0a-72c7-42cf-98bf-d77fbfa91a33 req-89b06b96-ded6-4726-a39b-1321573ef415 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.884165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5e501d0a-72c7-42cf-98bf-d77fbfa91a33 req-89b06b96-ded6-4726-a39b-1321573ef415 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.936467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5e501d0a-72c7-42cf-98bf-d77fbfa91a33 req-89b06b96-ded6-4726-a39b-1321573ef415 service nova] Creating event network-changed:d018d629-f0a8-454b-9e96-e8d6d2dda40b for instance b32a2f37-3a7c-442f-8148-40aa5541cae8 on n-h2-846470-15 Aug 24 03:36:03.954812 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5e501d0a-72c7-42cf-98bf-d77fbfa91a33 req-89b06b96-ded6-4726-a39b-1321573ef415 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139033 Aug 24 03:36:03.955920 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 662/1332] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:04.571695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:04.572694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:04.605058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:04.610618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:04.611415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:04.612415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:04.624494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:04.626720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:04.755624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:04.775705 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-590f57f7-f4fb-482e-aecf-a609739a7aa7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 1.230240 Aug 24 03:36:04.792442 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 671/1333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:03 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:04.798613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:04.799152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:04.835416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:04.836287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:04.839124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:04.840591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:04.848260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:04.851916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:04.954701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:04.966061 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-477d2069-9fa7-4970-a964-e4781b96a062 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1513 microversion: 2.1 time: 0.401002 Aug 24 03:36:04.967755 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 663/1334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:04 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:05.544500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:05.580637 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67ba8c7d-c252-4236-b81d-59cc04241c0d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 0.786670 Aug 24 03:36:05.584626 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 672/1335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:04 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:05.613934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-038c4cc2-a137-47d4-8085-e8e15fb2b5cc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1375251309", "metadata": {"": ""}}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-038c4cc2-a137-47d4-8085-e8e15fb2b5cc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action HTTP/1.1 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 107 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1375251309", "metadata": {"": ""}}} Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1375251309', 'metadata': {'': ''}}}} Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'': ''} Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:36:05.647089 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:36:05.655440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:05.664160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-038c4cc2-a137-47d4-8085-e8e15fb2b5cc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:05.665544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-038c4cc2-a137-47d4-8085-e8e15fb2b5cc tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action" status: 400 len: 170 microversion: 2.1 time: 0.057302 Aug 24 03:36:05.678805 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 664/1336] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 24 03:36:05 2022] POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action => generated 170 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:36:05.690084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:05.691569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:05.736869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.737640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.742956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.742956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.742956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.742956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.989888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:05.991178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:06.003269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.004369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.005291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.006211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.007010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.008137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.262252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.271928 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86a95bbf-2cbb-4598-871b-9eb0cd17d90e tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1513 microversion: 2.1 time: 0.288203 Aug 24 03:36:06.272542 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 665/1337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:05 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:06.316777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.346332 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3e281e74-b5e0-4f68-9bff-096edc8de57e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 0.664070 Aug 24 03:36:06.354268 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 673/1338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:05 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:06.380214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:06.382595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:06.410769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.411286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.413574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.416012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:06.416810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:06.417430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.783203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.794556 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-416b70e6-3705-4a7f-91ba-05e33e33d4f5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 0.423436 Aug 24 03:36:06.797181 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 666/1339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:06 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:06.822786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-94487776-61a1-4fde-8da3-49c6095c8bb3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-720950078", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-94487776-61a1-4fde-8da3-49c6095c8bb3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action HTTP/1.1 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 618 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-720950078", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-720950078', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:36:06.827306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 03:36:06.832924 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:06.839447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-94487776-61a1-4fde-8da3-49c6095c8bb3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:06.840528 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-94487776-61a1-4fde-8da3-49c6095c8bb3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action" status: 400 len: 938 microversion: 2.1 time: 0.025050 Aug 24 03:36:06.845146 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 667/1340] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 24 03:36:06 2022] POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action => generated 938 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:36:06.854935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:06.855796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:06.876834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1851622382", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:07.026657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:07.336835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:07.339337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.340302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.340946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.341685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.342148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.342577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.571518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:07.588160 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03d0da49-7e9c-4be0-8ba9-18c2b0599c2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 0.741374 Aug 24 03:36:07.589479 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 668/1341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:06 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:07.603855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-88c1af7b-c0fa-4477-b977-0535d44cf08a req-90a128e0-6365-4b8f-a4f9-766a59e319bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c36470a-8993-4954-8e70-f90a446a2240", "name": "network-vif-deleted", "tag": "e79d43a2-9e92-4735-9ad0-3a655e27ce35"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:07.625126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:07.625880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:07.627076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:07.627879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:07.628530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:07.639626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-88c1af7b-c0fa-4477-b977-0535d44cf08a req-90a128e0-6365-4b8f-a4f9-766a59e319bf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.640418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-88c1af7b-c0fa-4477-b977-0535d44cf08a req-90a128e0-6365-4b8f-a4f9-766a59e319bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.641074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-88c1af7b-c0fa-4477-b977-0535d44cf08a req-90a128e0-6365-4b8f-a4f9-766a59e319bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.656023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.657817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.659180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.662814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.663866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.665881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.676862 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-88c1af7b-c0fa-4477-b977-0535d44cf08a req-90a128e0-6365-4b8f-a4f9-766a59e319bf service nova] Creating event network-vif-deleted:e79d43a2-9e92-4735-9ad0-3a655e27ce35 for instance 8c36470a-8993-4954-8e70-f90a446a2240 on n-h2-846470-15 Aug 24 03:36:07.695821 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-88c1af7b-c0fa-4477-b977-0535d44cf08a req-90a128e0-6365-4b8f-a4f9-766a59e319bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101894 Aug 24 03:36:07.700146 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 669/1342] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:07.713260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:07.719139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:07.729733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Getting quotas for project cda00288f6124296932f66d9db18d82f. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:07.733627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.738010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.738710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.739492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.740014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.742897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.745692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Getting quotas for user 9fabeab6f0f74b19be18070258631a7d and project cda00288f6124296932f66d9db18d82f. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:07.777847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:07.785269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:07.821231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.821810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.823420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.824121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lazy-loading 'fault' on Instance uuid 8c36470a-8993-4954-8e70-f90a446a2240 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:36:07.891277 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1df18c04-e7da-46e3-b81f-c0ce4529488f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330101 Aug 24 03:36:07.892784 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 674/1343] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:36:07.901095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:07.902694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:07.912459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.913369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.914535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.915551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.916244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.917637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.970331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:07.982781 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-365fb0c6-1002-4ace-b088-57a799450be6 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 200 len: 1307 microversion: 2.1 time: 0.280182 Aug 24 03:36:07.985936 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 670/1344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:07 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:07.993338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fcef13d6-54d7-4c30-94b4-6c9c49179df5 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:07.994281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fcef13d6-54d7-4c30-94b4-6c9c49179df5 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:08.081773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fcef13d6-54d7-4c30-94b4-6c9c49179df5 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.093340 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fcef13d6-54d7-4c30-94b4-6c9c49179df5 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1220 microversion: 2.1 time: 0.105850 Aug 24 03:36:08.094526 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 671/1345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:07 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:08.329650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.346702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d218229-8087-45e7-9765-0ec570d0f3db tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 0.451223 Aug 24 03:36:08.362567 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 675/1346] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:07 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:08.377915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c0d0af8-cb30-44d5-9f2b-e345195e4062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c0d0af8-cb30-44d5-9f2b-e345195e4062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action HTTP/1.1 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 285 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:08.394481 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c0d0af8-cb30-44d5-9f2b-e345195e4062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:08.399325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c0d0af8-cb30-44d5-9f2b-e345195e4062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action" status: 400 len: 619 microversion: 2.1 time: 0.028978 Aug 24 03:36:08.405420 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 672/1347] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 24 03:36:08 2022] POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:36:08.409544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:08.410261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:08.428868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:08.429674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:08.431030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:08.431995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:08.433930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:08.434759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:08.781090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.791618 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-632ecd65-7124-48e0-a8cc-345d1f5b995d tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 0.388124 Aug 24 03:36:08.792611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 676/1348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:08 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:08.816948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:08.817981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:08.829499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:08.831480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:08.832605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:08.834444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:08.835803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:08.837049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.007824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:09.008355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 8c36470a-8993-4954-8e70-f90a446a2240] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:09.021349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.021846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.022277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.022988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.023442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.023894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.060436 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] HTTP exception thrown: Instance 8c36470a-8993-4954-8e70-f90a446a2240 could not be found. Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Request method failure captured: Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 HTTP/1.1 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZufqaOnl1HLZGQv6HXrQed-F6kosxSVaY7TGhgTA5SSqj-9e5vvLlBv-cLtQvuw1Uo-lAHFtFs6dQ54cQ8bupzAj9fX8J3YbISTb0CWLBo1LgI7EQwWR8T85jUdWrO5jhDMF8nzf3us5zE6FqE8fMlSKO__D1_KzD4nZa_bakjO-0M Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 3835a5249c54414dbc3a19230c247072 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesAdminNegativeTest-395090970 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3835a5249c54414dbc3a19230c247072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3835a5249c54414dbc3a19230c247072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3835a5249c54414dbc3a19230c247072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3835a5249c54414dbc3a19230c247072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesAdminNegativeTest-395090970 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 3835a5249c54414dbc3a19230c247072 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-395090970 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesAdminNegativeTest-395090970-project Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: a9a7fe8630514ecba823e9834692cc77 Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesAdminNegativeTest-395090970-project Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 8c36470a-8993-4954-8e70-f90a446a2240 could not be found. Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '8c36470a-8993-4954-8e70-f90a446a2240'} Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c36470a-8993-4954-8e70-f90a446a2240 could not be found. Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c36470a-8993-4954-8e70-f90a446a2240 could not be found. Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:09.064358 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:09.068885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:09.068885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:09.068885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:09.068885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:09.068885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:09.068885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c36470a-8993-4954-8e70-f90a446a2240 could not be found. Aug 24 03:36:09.068885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:09.072380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Returning 404 to user: Instance 8c36470a-8993-4954-8e70-f90a446a2240 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:09.073590 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7ce4683e-9ef1-4cf3-8b19-2f7a614acf33 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240" status: 404 len: 111 microversion: 2.1 time: 0.070312 Aug 24 03:36:09.074365 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 677/1349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:09 2022] GET /compute/v2.1/servers/8c36470a-8993-4954-8e70-f90a446a2240 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:09.090680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:09.108680 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-38160b8f-011d-447c-8e33-91741978d0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 0.295829 Aug 24 03:36:09.109843 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 673/1350] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:08 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:09.130679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:09.132389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:09.132580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-97655271"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:09.135017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:09.145056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.145954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.146803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.147949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.148741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.149675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.162077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.163991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.169843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.171297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.173674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.174675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.244654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:09.605102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:09.647193 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-752635b3-8899-4a40-a4f4-38bf9dd2db06 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1272 microversion: 2.1 time: 0.525616 Aug 24 03:36:09.656314 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 678/1351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:09 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1272 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:09.878937 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-039f3a72-4fa6-485b-9704-ddff2861783e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action" status: 202 len: 0 microversion: 2.1 time: 0.747703 Aug 24 03:36:09.885440 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 674/1352] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:36:09 2022] POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 03:36:09.898631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-628398530"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:09.903336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:09.913761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.914734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.915530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.916549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.917305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.918000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.004055 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Cannot 'createImage' instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 while it is in task_state image_snapshot_pending Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action HTTP/1.1 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 84 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-628398530"}} Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot 'createImage' instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 while it is in task_state image_snapshot_pending Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-628398530'}}} Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:36:10.008944 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 while it is in task_state image_snapshot_pending Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 while it is in task_state image_snapshot_pending Aug 24 03:36:10.019460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:10.025366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 409 to user: Cannot 'createImage' instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 while it is in task_state image_snapshot_pending {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:10.028227 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3e0172aa-e53b-464c-a650-ed2527568d10 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action" status: 409 len: 167 microversion: 2.1 time: 0.137591 Aug 24 03:36:10.030059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 679/1353] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:36:09 2022] POST /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5/action => generated 167 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:36:10.040707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0985ffd-f16b-4128-96c9-10b5bba43897 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '.version_select at 0x7f10343844c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:10.358394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0985ffd-f16b-4128-96c9-10b5bba43897 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/images/8a6f2fd3-6ec0-4f86-ada4-13a5e70c54aa" status: 204 len: 0 microversion: 2.1 time: 0.323112 Aug 24 03:36:10.362952 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 675/1354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:10 2022] DELETE /compute/v2.1/images/8a6f2fd3-6ec0-4f86-ada4-13a5e70c54aa => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:10.373330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:10.374583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:10.381136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:10.402756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.405421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.407654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.411575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.413100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.413976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.623566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1215032750", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "3e369c64-1f0d-4dd6-abb1-54694e8a978c"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:10.731822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] validate_networks() for [('3e369c64-1f0d-4dd6-abb1-54694e8a978c', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:11.619498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:11.621693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:11.623025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:11.623760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:11.627718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:11.631848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:11.654187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0cb86df2-9ab4-4518-a158-26fdcd48fadb tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1532 microversion: 2.1 time: 1.289461 Aug 24 03:36:11.654992 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 680/1355] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:10 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1532 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:11.671081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:11.671081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:11.672876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.673551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.674296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.675706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.676438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.677150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.723495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.725032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.725503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.726288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:11.726808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:11.727237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:11.766400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Getting quotas for project b5b8c78f5a474fbc861ac709a237672b. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:11.788077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Getting quotas for user de02333710364e5ebe27916c7ef17c35 and project b5b8c78f5a474fbc861ac709a237672b. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:11.830108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:11.832942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:11.895283 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eba66031-5bf0-41cf-b0f5-52fcaa6a44c3 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.403000 Aug 24 03:36:11.903244 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 676/1356] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:36:11.910357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5af7df2a-55eb-4fd2-b8d7-a92472e176fc tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:11.911456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5af7df2a-55eb-4fd2-b8d7-a92472e176fc tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:12.007174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:12.025679 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d0ef0ad-20a9-4387-bb0b-b19acc46a754 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1278 microversion: 2.1 time: 0.369520 Aug 24 03:36:12.044131 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 681/1357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:11 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1278 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:12.102981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5af7df2a-55eb-4fd2-b8d7-a92472e176fc tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:12.128740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5af7df2a-55eb-4fd2-b8d7-a92472e176fc tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1216 microversion: 2.1 time: 0.223163 Aug 24 03:36:12.138998 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 677/1358] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:11 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1216 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:12.693002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:12.695268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:12.718251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.719620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.720792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.722769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.724024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.725240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.055296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:13.057349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.099411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.104004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.104839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.106365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.111012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.112168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.388040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.399289 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c08293e9-2dad-4876-8c89-d17e3f35c767 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1278 microversion: 2.1 time: 0.351391 Aug 24 03:36:13.413416 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 678/1359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:13 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1278 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:13.421598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:13.430700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.441682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.442965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.443623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.444637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.446611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.447826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.490383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.549284 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-99ded76e-d63f-42cc-bcba-4eec042fac2b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1532 microversion: 2.1 time: 0.870718 Aug 24 03:36:13.560254 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 682/1360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:12 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1532 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:13.633625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.654686 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bec7aee2-3a4b-4ab9-b58a-fa3c803274eb tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1220 microversion: 2.1 time: 0.238754 Aug 24 03:36:13.657028 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 679/1361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:13 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1220 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:14.426665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:14.428166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:14.459009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.473462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.474484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.479059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.480658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.492485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.619073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:14.622103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:14.644309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.646059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.647136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.649183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.650293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.651572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.092371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.123073 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7c78f855-47dd-44dd-ae19-c82f7d468576 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1538 microversion: 2.1 time: 0.535103 Aug 24 03:36:15.124887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.139831 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 680/1362] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:14 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1538 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:15.140106 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d93bff98-467e-480d-afc6-f67784e68c68 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.717322 Aug 24 03:36:15.146029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 683/1363] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:14 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:15.150410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:15.151530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:15.182951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.183975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.184784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.186092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.186957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.199842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.267382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:15.493015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.542968 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae4d8c54-90fe-48f2-991c-820545faa757 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1268 microversion: 2.1 time: 0.397377 Aug 24 03:36:15.555756 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 681/1364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:15 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1268 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:16.155943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:16.158444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:16.184686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:16.186342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:16.189347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.190175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.190796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.192009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.204372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.206774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.241534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.243179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.245356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.247282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.248133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.248865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.829248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:16.855445 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05df3efc-123f-4a69-b4ac-4e52ebc76b23 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.678442 Aug 24 03:36:16.859042 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 682/1365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:16 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:16.874764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:16.876830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:16.900130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.901655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.904688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.906886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.909096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.912004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.022933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:36:17.024630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:17.063448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7de30b61-8776-494e-b615-f833cf504a3c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1538 microversion: 2.1 time: 0.912469 Aug 24 03:36:17.084225 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 684/1366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:16 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1538 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:17.093379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-88b69afb-f275-4eeb-98ba-993b6a906c91 req-c46cf046-5ce0-472a-b05d-5185df036a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee682bd-78df-4d10-ab4e-f738f5db6e94", "tag": "fde9befc-9bdc-4894-b57d-4695fb2d7813"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:17.116977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-88b69afb-f275-4eeb-98ba-993b6a906c91 req-c46cf046-5ce0-472a-b05d-5185df036a6b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.117515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-88b69afb-f275-4eeb-98ba-993b6a906c91 req-c46cf046-5ce0-472a-b05d-5185df036a6b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.119808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-88b69afb-f275-4eeb-98ba-993b6a906c91 req-c46cf046-5ce0-472a-b05d-5185df036a6b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.152614 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-88b69afb-f275-4eeb-98ba-993b6a906c91 req-c46cf046-5ce0-472a-b05d-5185df036a6b service nova] Creating event network-changed:fde9befc-9bdc-4894-b57d-4695fb2d7813 for instance dee682bd-78df-4d10-ab4e-f738f5db6e94 on n-h2-846470-15 Aug 24 03:36:17.161771 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-88b69afb-f275-4eeb-98ba-993b6a906c91 req-c46cf046-5ce0-472a-b05d-5185df036a6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076004 Aug 24 03:36:17.171950 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 685/1367] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:17.178935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:17.180175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:17.202459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.203460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.210114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.211385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.212092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.212940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.395421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74461004-eafb-4b6d-841e-39e32f8e0ebf tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "DELETE /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 204 len: 0 microversion: 2.1 time: 0.531230 Aug 24 03:36:17.400380 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 683/1368] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:36:16 2022] DELETE /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:17.445753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:17.451293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:17.479908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.487961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.489517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.496008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.500387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.501776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.697357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:17.758939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:17.800596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:17.820780 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d936a879-dfa4-47c8-a240-5428cb2cb84d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.647040 Aug 24 03:36:17.821901 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 686/1369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:17 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:17.887579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:17.888768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:17.896848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.900568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.901579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.903043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.909370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.910759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.996590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.012281 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a6a1e9d3-5261-42eb-9d90-df62646a6b65 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1682 microversion: 2.1 time: 0.599994 Aug 24 03:36:18.013569 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 684/1370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:17 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1682 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:18.097112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:18.102978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:18.135480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.136539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.137540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.140036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.141489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.142803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.369200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.390004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7080d29f-2784-48de-bb5c-9a5aa51cc0ab tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.507476 Aug 24 03:36:18.391073 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 687/1371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:17 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:18.442149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.493072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fe086784-d862-45a5-bb66-67f792fba32c req-cfdaca8a-f8fd-42eb-8071-d8d43ab6899a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5", "name": "network-vif-plugged", "status": "completed", "tag": "6417e561-953c-4945-a98d-b10ce4b9727d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:18.498938 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d04a0c7-6288-4264-ad5b-5175f4119915 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1538 microversion: 2.1 time: 0.413093 Aug 24 03:36:18.499634 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 685/1372] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:18 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1538 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:18.518656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe086784-d862-45a5-bb66-67f792fba32c req-cfdaca8a-f8fd-42eb-8071-d8d43ab6899a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.519764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe086784-d862-45a5-bb66-67f792fba32c req-cfdaca8a-f8fd-42eb-8071-d8d43ab6899a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.520605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe086784-d862-45a5-bb66-67f792fba32c req-cfdaca8a-f8fd-42eb-8071-d8d43ab6899a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.548182 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fe086784-d862-45a5-bb66-67f792fba32c req-cfdaca8a-f8fd-42eb-8071-d8d43ab6899a service nova] Creating event network-vif-plugged:6417e561-953c-4945-a98d-b10ce4b9727d for instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 on n-h1-846470-15 Aug 24 03:36:18.558734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fe086784-d862-45a5-bb66-67f792fba32c req-cfdaca8a-f8fd-42eb-8071-d8d43ab6899a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089753 Aug 24 03:36:18.561574 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 688/1373] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:18.843744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:18.844609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:18.853911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.854769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.856050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.861140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.861876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.862719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.047883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:19.049584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:19.061936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.063050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.064045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.065511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.066533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.067524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.096714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.112885 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03301668-4cf6-4783-8f53-bbef8c9e578f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.273903 Aug 24 03:36:19.115202 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 686/1374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:18 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:19.317893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.333088 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7052dc4a-0f49-4d80-80e8-10667b320c60 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1682 microversion: 2.1 time: 0.298651 Aug 24 03:36:19.335741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 689/1375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:19 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1682 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:19.420285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:19.421291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:19.430066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.431536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.432088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.433112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.433694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.434368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.544671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:19.546044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:19.562082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.563621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.565482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.566815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.568070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.570126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.671610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.685372 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8490e024-d7fc-4d91-9259-19573cf42f9b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.273701 Aug 24 03:36:19.699941 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 687/1376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:19 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:19.840912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.862760 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5642dbc-ef7d-4f3e-9cb9-f3b6c0b64b80 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1538 microversion: 2.1 time: 0.330479 Aug 24 03:36:19.863774 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 690/1377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:19 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1538 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:20.143594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:20.144841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:20.166791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.167699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.168633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.169964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.170747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.171539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.265256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fdadbe7e-ec29-467e-abb1-7dd966b014e9 req-cdf8c7ff-a6dd-4470-9212-090f2df97728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a35df187-3cb4-4ba3-b577-db0383de2974", "tag": "6947eb0c-389b-479a-ab51-be18c5089577"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:20.301175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fdadbe7e-ec29-467e-abb1-7dd966b014e9 req-cdf8c7ff-a6dd-4470-9212-090f2df97728 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.302796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fdadbe7e-ec29-467e-abb1-7dd966b014e9 req-cdf8c7ff-a6dd-4470-9212-090f2df97728 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.303783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fdadbe7e-ec29-467e-abb1-7dd966b014e9 req-cdf8c7ff-a6dd-4470-9212-090f2df97728 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.335781 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fdadbe7e-ec29-467e-abb1-7dd966b014e9 req-cdf8c7ff-a6dd-4470-9212-090f2df97728 service nova] Creating event network-changed:6947eb0c-389b-479a-ab51-be18c5089577 for instance a35df187-3cb4-4ba3-b577-db0383de2974 on n-h1-846470-15 Aug 24 03:36:20.349657 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fdadbe7e-ec29-467e-abb1-7dd966b014e9 req-cdf8c7ff-a6dd-4470-9212-090f2df97728 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094599 Aug 24 03:36:20.351595 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 691/1378] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:20.374041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:20.376243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:20.389360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.390959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.391893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.394057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.395433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.396371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.734826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.751358 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6653475c-6a71-4044-8b1f-76a9da15eaca tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.614605 Aug 24 03:36:20.752683 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 688/1379] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:20 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:20.761181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:20.762170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:20.770285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.771086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.771861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.772785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.773566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.774427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.936254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.949863 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c89cf80d-df81-406e-a646-5a837293ec63 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1682 microversion: 2.1 time: 0.585861 Aug 24 03:36:20.951252 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 692/1380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:20 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1682 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:20.960224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:20.961736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:20.973328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.974626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.975889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.977464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.978601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.979478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.053845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:21.091562 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0717ed4c-9725-47e3-9be1-3cc49d27b105 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.337106 Aug 24 03:36:21.109431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 689/1381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:20 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:21.595440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:21.624063 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4550daf-49dc-4d79-a490-ec24e95c73c7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1538 microversion: 2.1 time: 0.659876 Aug 24 03:36:21.625734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 693/1382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:20 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1538 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:21.779789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:21.781303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:21.787131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:21.799494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.800555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.801600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.803028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.804460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.805433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.981749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:21.988706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:22.004705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.016571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.019144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.021146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.023160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.024315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.114824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.127612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=10 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:22.141999 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e32da831-57df-443f-bd97-48088e44df1c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.369912 Aug 24 03:36:22.143733 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 690/1383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:21 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:22.170906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:22.173186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:22.195230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.196187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.196999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.210745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.211850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.212686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.243992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.266396 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4bdac215-5c54-4146-be0a-cb70b965d59a tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1614 microversion: 2.1 time: 0.288968 Aug 24 03:36:22.275853 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 694/1384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:21 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1614 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:22.506365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.517220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e9a81587-3ff7-44b3-b3eb-3889da59dc36 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.355252 Aug 24 03:36:22.517839 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 691/1385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:22 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:22.660554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:22.661451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:22.679047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.683655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.684761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.685749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.686414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.688887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.703330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c9e2af81-3983-4bb4-aa05-6c7a97316075 req-e193675c-4334-41de-85cc-147d04e2e851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455cb13d-9183-4cac-9f96-22ac9340600d", "name": "network-vif-deleted", "tag": "01d404f5-80e4-44d7-800d-aff92275c86a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:22.730750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c9e2af81-3983-4bb4-aa05-6c7a97316075 req-e193675c-4334-41de-85cc-147d04e2e851 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.731943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c9e2af81-3983-4bb4-aa05-6c7a97316075 req-e193675c-4334-41de-85cc-147d04e2e851 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.732616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c9e2af81-3983-4bb4-aa05-6c7a97316075 req-e193675c-4334-41de-85cc-147d04e2e851 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.764787 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c9e2af81-3983-4bb4-aa05-6c7a97316075 req-e193675c-4334-41de-85cc-147d04e2e851 service nova] Creating event network-vif-deleted:01d404f5-80e4-44d7-800d-aff92275c86a for instance 455cb13d-9183-4cac-9f96-22ac9340600d on n-h1-846470-15 Aug 24 03:36:22.780465 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c9e2af81-3983-4bb4-aa05-6c7a97316075 req-e193675c-4334-41de-85cc-147d04e2e851 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087200 Aug 24 03:36:22.781716 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 692/1386] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 03:36:22.931221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.945920 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fdf0d475-24ce-480a-bcd7-ac4ed93d5c4e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1538 microversion: 2.1 time: 0.290369 Aug 24 03:36:22.946932 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 695/1387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:22 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1538 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:23.179230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:23.182604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:23.196794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.197307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.197768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.198540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.199352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.200891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.310895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:23.311954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:23.325474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.325983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.326429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.327171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.327636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.328109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.438666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:23.467982 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72df609b-6771-43b5-949b-a7b34ae4a58b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.302179 Aug 24 03:36:23.469118 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 693/1388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:23 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:23.498668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:23.529577 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-656eac60-54a4-4015-aa97-70460c765432 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1614 microversion: 2.1 time: 0.223118 Aug 24 03:36:23.531099 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 696/1389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:23 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1614 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:23.565128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:23.566547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:23.595484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.599344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.600647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.601542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:23.602127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:23.602757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:23.811807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:23.829301 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-add2bd2a-5745-42ca-a996-32fa199ed70d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.271538 Aug 24 03:36:23.830016 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 694/1390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:23 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:23.984933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:23.985889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:24.003910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.004706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.005361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.006327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.006972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.008524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.112410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:24.351214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:24.364148 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad22bfdf-73ed-47b6-b322-dfb50a8c0c6c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1538 microversion: 2.1 time: 0.384995 Aug 24 03:36:24.381188 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 697/1391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:23 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1538 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:24.490030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:24.492225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:24.521982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.523703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.524495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.525749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.526593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.528897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.567486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:24.568146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:24.615653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.622505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.632558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.643043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.646347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.649942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.863532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:24.902370 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1efb11c6-5d28-4103-a058-bf59a3b3f948 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1326 microversion: 2.1 time: 0.339059 Aug 24 03:36:24.919832 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 698/1392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:24 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1326 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:24.928942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:24.932796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:24.967825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.973591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.975317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.981616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.982643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.987215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:25.051602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:25.093338 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-01f83ac9-f3d1-4701-991c-858b7ec88eb0 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.607169 Aug 24 03:36:25.094614 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 695/1393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:24 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:25.360624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:25.377003 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6930fba9-0876-44c9-88ef-fbe7237febdb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.461506 Aug 24 03:36:25.378472 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 699/1394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:24 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:25.388217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:25.388853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:25.398098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:25.398793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:25.399359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:25.400236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:25.404711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:25.408982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:25.712038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:25.725488 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23f3ba1b-1193-478e-809d-ff358010cbe8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1538 microversion: 2.1 time: 0.341588 Aug 24 03:36:25.726511 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 696/1395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:25 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1538 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:25.937671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:25.938291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:25.945748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:25.946382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:25.947102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:25.948378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:25.949040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:25.949603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.001683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.002534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.003319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.004165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lazy-loading 'fault' on Instance uuid 455cb13d-9183-4cac-9f96-22ac9340600d {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:36:26.078506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a7fe8630514ecba823e9834692cc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3835a5249c54414dbc3a19230c247072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.092928 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-17d7ef82-731e-4a15-afcd-b72f2dc89e50 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 200 len: 1331 microversion: 2.1 time: 0.159825 Aug 24 03:36:26.094188 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 700/1396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:25 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:26.119564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:26.120853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:26.134456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.135325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.136830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.138427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.139515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.140593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.150619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:26.414962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:26.416136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.416528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:26.426691 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91214aae-494d-4a40-ad55-81a382fd1993 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.311912 Aug 24 03:36:26.440467 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 697/1397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:26 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:26.445033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.445638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.445999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.448547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.449871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.450592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.690271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.700958 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0ba0bd35-ae50-4ff0-beb1-61a652bae76e tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.289898 Aug 24 03:36:26.701779 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 701/1398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:26 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:26.754546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:26.755839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:26.770238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.770975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.771587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.773104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.773839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.774527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.054832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.070409 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-266112ab-2d01-4d10-a528-46fee8c6102f tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1520 microversion: 2.1 time: 0.320128 Aug 24 03:36:27.071743 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 698/1399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:26 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:27.111296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:27.112205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:27.122372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.123598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.124681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.126306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.126837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.127371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.134960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:27.135840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] [instance: 455cb13d-9183-4cac-9f96-22ac9340600d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:27.146440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.147373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.148245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.149596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.150852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.151933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.180650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] HTTP exception thrown: Instance 455cb13d-9183-4cac-9f96-22ac9340600d could not be found. Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Request method failure captured: Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d HTTP/1.1 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZufqaOnl1HLZGQv6HXrQed-F6kosxSVaY7TGhgTA5SSqj-9e5vvLlBv-cLtQvuw1Uo-lAHFtFs6dQ54cQ8bupzAj9fX8J3YbISTb0CWLBo1LgI7EQwWR8T85jUdWrO5jhDMF8nzf3us5zE6FqE8fMlSKO__D1_KzD4nZa_bakjO-0M Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 3835a5249c54414dbc3a19230c247072 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesAdminNegativeTest-395090970 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3835a5249c54414dbc3a19230c247072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3835a5249c54414dbc3a19230c247072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3835a5249c54414dbc3a19230c247072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3835a5249c54414dbc3a19230c247072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesAdminNegativeTest-395090970 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 3835a5249c54414dbc3a19230c247072 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-395090970 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesAdminNegativeTest-395090970-project Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: a9a7fe8630514ecba823e9834692cc77 Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesAdminNegativeTest-395090970-project Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 455cb13d-9183-4cac-9f96-22ac9340600d could not be found. Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '455cb13d-9183-4cac-9f96-22ac9340600d'} Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455cb13d-9183-4cac-9f96-22ac9340600d could not be found. Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455cb13d-9183-4cac-9f96-22ac9340600d could not be found. Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:27.184244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.193494 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:27.193494 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:27.193494 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:27.193494 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:27.193494 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:27.193494 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455cb13d-9183-4cac-9f96-22ac9340600d could not be found. Aug 24 03:36:27.193494 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.194470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:36:27.196326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Returning 404 to user: Instance 455cb13d-9183-4cac-9f96-22ac9340600d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:27.198228 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-770072f3-af6d-4c48-9a90-e0cc7eace5f7 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d" status: 404 len: 111 microversion: 2.1 time: 0.072102 Aug 24 03:36:27.199982 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 699/1400] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:27 2022] GET /compute/v2.1/servers/455cb13d-9183-4cac-9f96-22ac9340600d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:27.215177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e426e4e-473a-47ba-8173-fc5cfc90eb04 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] Calling method '.version_select at 0x7f10343a0ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:27.270953 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e426e4e-473a-47ba-8173-fc5cfc90eb04 tempest-VolumesAdminNegativeTest-395090970 tempest-VolumesAdminNegativeTest-395090970-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114960705" status: 202 len: 0 microversion: 2.1 time: 0.064042 Aug 24 03:36:27.272839 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 700/1401] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 03:36:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114960705 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:36:27.429992 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cd1746b8-11de-45d7-bd75-9816a54d04d0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 204 len: 0 microversion: 2.1 time: 0.322783 Aug 24 03:36:27.436283 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 702/1402] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:36:27 2022] DELETE /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:27.453944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:27.458423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:27.474699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:27.476197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:27.483184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.484534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.489138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.493331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.494613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.497460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.505135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.506190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.506968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.509257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.511124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.512341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.769221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.780090 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-41500df2-de72-4b94-bd8d-e5df701c626e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1526 microversion: 2.1 time: 0.337393 Aug 24 03:36:27.795780 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 701/1403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:27 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1526 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:27.795780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9a690b1e-95f6-4b62-91e4-4bf31c403a07 req-056437d9-71be-4f78-ab34-8d92ba5d6c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee682bd-78df-4d10-ab4e-f738f5db6e94", "name": "network-vif-plugged", "status": "completed", "tag": "fde9befc-9bdc-4894-b57d-4695fb2d7813"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:27.802555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9a690b1e-95f6-4b62-91e4-4bf31c403a07 req-056437d9-71be-4f78-ab34-8d92ba5d6c37 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.804193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9a690b1e-95f6-4b62-91e4-4bf31c403a07 req-056437d9-71be-4f78-ab34-8d92ba5d6c37 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.804873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9a690b1e-95f6-4b62-91e4-4bf31c403a07 req-056437d9-71be-4f78-ab34-8d92ba5d6c37 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.818756 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9a690b1e-95f6-4b62-91e4-4bf31c403a07 req-056437d9-71be-4f78-ab34-8d92ba5d6c37 service nova] Creating event network-vif-plugged:fde9befc-9bdc-4894-b57d-4695fb2d7813 for instance dee682bd-78df-4d10-ab4e-f738f5db6e94 on n-h2-846470-15 Aug 24 03:36:27.825350 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9a690b1e-95f6-4b62-91e4-4bf31c403a07 req-056437d9-71be-4f78-ab34-8d92ba5d6c37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043041 Aug 24 03:36:27.831798 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 702/1404] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:27.837671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:27.838389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:27.849075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.850151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.851280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.852988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.854121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.856712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:28.026427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:28.036464 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a92bc62-1604-446f-abfd-74418e10fc47 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.580235 Aug 24 03:36:28.037029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 703/1405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:27 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:28.182975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:28.208784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-35febbc5-2acb-405f-b576-c3eb97aaaab1 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.369325 Aug 24 03:36:28.208784 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 703/1406] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:27 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:28.822992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:28.825370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:28.838352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:28.839983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:28.842001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:28.843511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:28.844544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:28.845473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.095566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:29.096797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:29.111068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:29.111955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:29.112834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.114253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:29.115059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:29.116141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.446264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.472541 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc102089-d1cd-451c-bb17-fafef6b1b941 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.388317 Aug 24 03:36:29.476973 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 704/1407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:29 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:29.489605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:29.491474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:29.510021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:29.512683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:29.513760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.519146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:29.520195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:29.521241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.719909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.740048 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ca16627-1f89-4374-ac07-b0fa830f9656 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1526 microversion: 2.1 time: 0.924424 Aug 24 03:36:29.765521 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 704/1408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:28 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1526 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:29.794292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.807338 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-95ca883e-d5f6-4231-817f-0e842f300816 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1320 microversion: 2.1 time: 0.327585 Aug 24 03:36:29.809139 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 705/1409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:29 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:29.845693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0721eabc-17f4-40ac-b386-7f85dd8af037 req-82edceb9-6644-4764-91ed-adecc51ecd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35df187-3cb4-4ba3-b577-db0383de2974", "name": "network-vif-plugged", "status": "completed", "tag": "6947eb0c-389b-479a-ab51-be18c5089577"}, {"server_uuid": "fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5", "name": "network-vif-unplugged", "status": "completed", "tag": "6417e561-953c-4945-a98d-b10ce4b9727d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:29.859706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0721eabc-17f4-40ac-b386-7f85dd8af037 req-82edceb9-6644-4764-91ed-adecc51ecd8f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:29.860416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0721eabc-17f4-40ac-b386-7f85dd8af037 req-82edceb9-6644-4764-91ed-adecc51ecd8f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:29.860965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0721eabc-17f4-40ac-b386-7f85dd8af037 req-82edceb9-6644-4764-91ed-adecc51ecd8f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.876121 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0721eabc-17f4-40ac-b386-7f85dd8af037 req-82edceb9-6644-4764-91ed-adecc51ecd8f service nova] Creating event network-vif-plugged:6947eb0c-389b-479a-ab51-be18c5089577 for instance a35df187-3cb4-4ba3-b577-db0383de2974 on n-h1-846470-15 Aug 24 03:36:29.876654 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0721eabc-17f4-40ac-b386-7f85dd8af037 req-82edceb9-6644-4764-91ed-adecc51ecd8f service nova] Creating event network-vif-unplugged:6417e561-953c-4945-a98d-b10ce4b9727d for instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 on n-h1-846470-15 Aug 24 03:36:29.883635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0721eabc-17f4-40ac-b386-7f85dd8af037 req-82edceb9-6644-4764-91ed-adecc51ecd8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044071 Aug 24 03:36:29.884344 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 705/1410] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:30.471463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2014950014", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7cea5f7b-959c-4b39-9ec6-22b9a1e6db87"}], "block_device_mapping_v2": [{"uuid": "598f1353-7a9f-413a-9104-a826a5ed6cd6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:30.491446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:30.530843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:30.535875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:30.547124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.548037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.548800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.550014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.550826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.551908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.603784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] validate_networks() for [('7cea5f7b-959c-4b39-9ec6-22b9a1e6db87', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:30.902730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:30.915067 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-779b53cc-0682-4faf-9550-cb6b90131a2e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.399795 Aug 24 03:36:30.916395 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 706/1411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:30 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:30.922762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:30.924047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:30.936660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.937579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.938082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.939639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.940364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.941315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.187847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:31.188360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:31.188902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:31.189817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:31.190420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:31.209434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.211284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.212171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.213175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.213831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.215778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.244363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:31.251616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Getting quotas for user 6d8976135cf9461e8a0eda1658abeec9 and project db10cc10bf304404a9f4a82534d3c6b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:31.345524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:31.350053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='598f1353-7a9f-413a-9104-a826a5ed6cd6',volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:31.355289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.370589 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e35e38b7-f6eb-4a83-9a6b-2056f0ce9259 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1526 microversion: 2.1 time: 0.452610 Aug 24 03:36:31.372633 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 707/1412] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:30 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1526 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:31.377978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.379304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:31.391295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.393929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.394587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.395577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.398043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.399014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.645385 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1977eda3-7d2c-45f4-b36c-bdcdfd561a4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.182083 Aug 24 03:36:31.646391 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 706/1413] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:36:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:36:31.651575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5576bbfd-75a1-4ec5-9aa5-f9caea663223 req-f5165d35-17cf-4557-99f5-0ae448dded33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5", "name": "network-vif-deleted", "tag": "6417e561-953c-4945-a98d-b10ce4b9727d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:31.665074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5576bbfd-75a1-4ec5-9aa5-f9caea663223 req-f5165d35-17cf-4557-99f5-0ae448dded33 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.665290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5576bbfd-75a1-4ec5-9aa5-f9caea663223 req-f5165d35-17cf-4557-99f5-0ae448dded33 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.665730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5576bbfd-75a1-4ec5-9aa5-f9caea663223 req-f5165d35-17cf-4557-99f5-0ae448dded33 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.698331 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5576bbfd-75a1-4ec5-9aa5-f9caea663223 req-f5165d35-17cf-4557-99f5-0ae448dded33 service nova] Creating event network-vif-deleted:6417e561-953c-4945-a98d-b10ce4b9727d for instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 on n-h1-846470-15 Aug 24 03:36:31.698477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.703865 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5576bbfd-75a1-4ec5-9aa5-f9caea663223 req-f5165d35-17cf-4557-99f5-0ae448dded33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056131 Aug 24 03:36:31.705020 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 707/1414] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:31.712152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f32745ad-8272-4afd-a497-f700a4255472 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.713385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f32745ad-8272-4afd-a497-f700a4255472 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:31.726503 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26bc041b-7dd9-4971-9636-7dd24d390dff tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1469 microversion: 2.1 time: 0.352271 Aug 24 03:36:31.727111 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 708/1415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:31 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:31.824210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f32745ad-8272-4afd-a497-f700a4255472 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.848522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f32745ad-8272-4afd-a497-f700a4255472 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.850812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f32745ad-8272-4afd-a497-f700a4255472 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.856660 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f32745ad-8272-4afd-a497-f700a4255472 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1104 microversion: 2.25 time: 0.147668 Aug 24 03:36:31.858067 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 708/1416] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:31 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1104 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:31.921924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.922813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:31.934553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.935920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.937840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.940491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.941274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.941450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:31.943580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.945324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.951842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.952570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.953199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.955360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.956073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.956514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.025256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:36:32.233522 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7220f01a-b693-4c13-8c3a-badd12da77a2 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 204 len: 0 microversion: 2.1 time: 0.463639 Aug 24 03:36:32.244080 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 709/1417] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:36:31 2022] DELETE /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:32.262806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:32.264878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:32.283158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.289141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.290082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.292347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.293133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.295567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.362916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:32.374080 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8d5331a4-42cf-4b82-b2de-78416d8e572b tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1316 microversion: 2.1 time: 0.438300 Aug 24 03:36:32.375393 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 709/1418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:31 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:32.414483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:32.415257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:32.423207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.424079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.424954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.425967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.426729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.427239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.466936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.467432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.467933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.468397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lazy-loading 'fault' on Instance uuid fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:36:32.539820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:32.548838 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1905a93f-4246-40a2-ab1b-14c744984328 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 200 len: 1314 microversion: 2.1 time: 0.140200 Aug 24 03:36:32.549832 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 710/1419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:32 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:32.607390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:32.611500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:32.625465 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-640f6b49-abd4-4bd4-a9be-a0febfd33c33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1475 microversion: 2.1 time: 0.375586 Aug 24 03:36:32.626528 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 710/1420] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:32 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1475 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:32.896400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:32.897155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:32.913726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.914225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.914901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.915910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.917650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.920483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.101461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.129534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.136186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.138887 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bcb0a834-6229-46ad-a3db-834b4caec85a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1185 microversion: 2.25 time: 0.247221 Aug 24 03:36:33.140515 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 711/1421] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:32 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1185 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:33.408100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:33.410196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:33.433705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.435380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.436637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.440914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.442407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.443511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.584544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:33.586685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:33.606465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.608112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.609352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.610963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.613207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.614653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.651620 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 HTTP/1.1 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5'} Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:33.655848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:33.666240 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:33.666240 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:33.666240 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:33.666240 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:33.666240 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:33.666240 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:33.666240 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:36:33.666240 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:33.670584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:33.672469 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-005d211e-1a16-42ab-abd9-bafb3974d263 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 404 len: 111 microversion: 2.1 time: 0.100382 Aug 24 03:36:33.674216 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 712/1422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:33 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:33.686835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:33.688687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:33.702580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.703428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.704380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.705657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.706495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.707272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.826463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.835543 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd2ef4f4-2317-44b8-b468-f742f715a81f tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1505 microversion: 2.1 time: 0.443089 Aug 24 03:36:33.836354 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 711/1423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:33 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:33.842396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3b49194-560f-46d5-998f-24d8ff520295 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'create', calling method: .version_select at 0x7f102ad72280>, body: {"keypair": {"name": "tempest-keypair-158540608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvdFyLP2/2rrC/HkrTdqNh5lrI0K4dKsUf0XufDmJFPoetdqhkDidosc/FE2oB6qLPItE+kXPVzVn87c49efqbYIdNWV9no9L3TnXTVc41Iby+BNoru25AsDVUcIkT1EA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:33.860589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c3b49194-560f-46d5-998f-24d8ff520295 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Getting quotas for project 6251e0afcbcd4be99a11a20e42e5eea5. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:33.867532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c3b49194-560f-46d5-998f-24d8ff520295 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Getting quotas for user c3a7defb9bc748f684309d7a7674154b and project 6251e0afcbcd4be99a11a20e42e5eea5. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:33.907181 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c3b49194-560f-46d5-998f-24d8ff520295 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069177 Aug 24 03:36:33.908321 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 712/1424] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:36:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:33.921742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:33.923158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:33.933351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.934086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.934828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:33.936824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:33.937863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:33.938980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.066791 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b79248be-85c1-4380-9177-c52588dee6e5 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.152615 Aug 24 03:36:34.068482 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 713/1425] 10.222.0.58 () {58 vars in 1296 bytes} [Wed Aug 24 03:36:33 2022] DELETE /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974/os-server-password => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:34.082551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.083260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.092013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.092491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.092939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.093728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.094253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.094684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.105833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.122253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5318a91-66e1-4b62-83ee-9492bffa6c19 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1475 microversion: 2.1 time: 0.445641 Aug 24 03:36:34.122985 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 713/1426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:33 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1475 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:34.133557 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f6f5e775-abd2-4b84-aa91-1197a8e9796d tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.058289 Aug 24 03:36:34.141042 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 714/1427] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974/os-server-password => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:36:34.148897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.149415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.160538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.164023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.164796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.165926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.166650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.167433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.179026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.179778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.201639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.203253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.203253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.203554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.211820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.212970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.278078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:36:34.408057 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0299541-0125-4c10-b478-3822a5adaacf tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 204 len: 0 microversion: 2.1 time: 0.263038 Aug 24 03:36:34.410281 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 714/1428] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:36:34 2022] DELETE /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:34.422571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.423878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.435001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.436053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.436909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.438097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.439790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.440991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.447011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.469144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.471533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.473051 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-adaebd6b-a866-435a-a6e0-97d7101b05e6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1233 microversion: 2.25 time: 0.299412 Aug 24 03:36:34.489002 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 715/1429] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1233 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:34.920710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-afeb7290-d62d-4963-b34c-ff6a9f35ebe7 req-d6879f84-cb9d-4796-a227-6ce8377e2b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee682bd-78df-4d10-ab4e-f738f5db6e94", "name": "network-vif-deleted", "tag": "fde9befc-9bdc-4894-b57d-4695fb2d7813"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:34.951965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afeb7290-d62d-4963-b34c-ff6a9f35ebe7 req-d6879f84-cb9d-4796-a227-6ce8377e2b0f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.952483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afeb7290-d62d-4963-b34c-ff6a9f35ebe7 req-d6879f84-cb9d-4796-a227-6ce8377e2b0f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.953034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afeb7290-d62d-4963-b34c-ff6a9f35ebe7 req-d6879f84-cb9d-4796-a227-6ce8377e2b0f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.973584 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-afeb7290-d62d-4963-b34c-ff6a9f35ebe7 req-d6879f84-cb9d-4796-a227-6ce8377e2b0f service nova] Creating event network-vif-deleted:fde9befc-9bdc-4894-b57d-4695fb2d7813 for instance dee682bd-78df-4d10-ab4e-f738f5db6e94 on n-h2-846470-15 Aug 24 03:36:34.986685 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-afeb7290-d62d-4963-b34c-ff6a9f35ebe7 req-d6879f84-cb9d-4796-a227-6ce8377e2b0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072474 Aug 24 03:36:34.995518 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 716/1430] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:35.067464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:35.081643 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c1af88b7-efb5-45ea-a019-1c0de09efc0e tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1511 microversion: 2.1 time: 0.666465 Aug 24 03:36:35.087354 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 715/1431] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1511 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:35.165162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.165947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:35.182148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.182707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.183145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.184728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.185828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.196427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.284128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:35.290542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.292875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.294027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.294993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lazy-loading 'fault' on Instance uuid dee682bd-78df-4d10-ab4e-f738f5db6e94 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:36:35.416695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:35.440622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4438e4cb-c96b-4915-b461-ea044bafd05d tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 200 len: 1310 microversion: 2.1 time: 0.281329 Aug 24 03:36:35.441935 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 717/1432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:35 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 1310 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:35.500555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.501439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:35.512866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.512866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.512866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.512866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.512866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.513613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.127969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:36.133098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:36.171787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.179407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.181532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.184510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.189016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.190256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.193529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.201814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.206651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.208207 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6a2a9ffa-4536-4d61-85d2-ef454ea172de tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1251 microversion: 2.25 time: 0.713118 Aug 24 03:36:36.213547 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 716/1433] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:35 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1251 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:36.468628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:36.469547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:36.508520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.508520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.508520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.509576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:36.516920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:36.518795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.535071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:36.599477 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] HTTP exception thrown: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Request method failure captured: Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 HTTP/1.1 Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyka7TrkIds5u81EVQjpWCe7rYX_fUImEyBZKuA6T7DRddyauf_-VrZKQGYkvzWoGekblW2LhF-AbSbCn1TWr5U1XZUhfIm-k2i08v_6MgU_fWFM7gPSbPChRT47a-YKlE0STwmnjVnplYalW_PDmYwhmddk1CjVtW_XPiJFcs5faA Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cda00288f6124296932f66d9db18d82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cda00288f6124296932f66d9db18d82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 9fabeab6f0f74b19be18070258631a7d Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'dee682bd-78df-4d10-ab4e-f738f5db6e94'} Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:36.604932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:36.614457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:36.614457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:36.614457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:36.614457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:36.614457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:36.614457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:36:36.614457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:36:36.617660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Returning 404 to user: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:36.623288 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b58ff1b0-fb99-4263-b17d-dd02d04990be tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 404 len: 111 microversion: 2.1 time: 0.159556 Aug 24 03:36:36.637656 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 717/1434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:36 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:36.762073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-206900266", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:36.855843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.892727 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad6f6fb8-c1fa-4bea-9da6-322bee12e892 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1511 microversion: 2.1 time: 0.769694 Aug 24 03:36:36.893650 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 718/1435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:36 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1511 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:36.931056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:37.258597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:37.259618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:37.271764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.273118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.274261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.277372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.278094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.278680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.395222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.408276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.417355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.424877 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9a229ef8-cf68-416c-9396-505838f6a2e5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1251 microversion: 2.25 time: 0.175352 Aug 24 03:36:37.431023 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 719/1436] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:37 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1251 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:37.741268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:37.745412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:37.747264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:37.757733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:37.760761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:37.813074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.814444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.817426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.824141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.825249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.826416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.907813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Getting quotas for project cda00288f6124296932f66d9db18d82f. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:37.930620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Getting quotas for user 9fabeab6f0f74b19be18070258631a7d and project cda00288f6124296932f66d9db18d82f. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:37.934760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:37.940411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:37.984879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:37.991798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.998048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.998986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.999775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:38.001538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.004910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.027009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.193011 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81cb1b45-1ed0-4ed5-8836-88b4e5835106 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.438232 Aug 24 03:36:38.197253 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 718/1437] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:36:38.211877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24b10617-0037-40be-9339-ed1f8476835a tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:38.215389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-24b10617-0037-40be-9339-ed1f8476835a tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:38.386589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-24b10617-0037-40be-9339-ed1f8476835a tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.397815 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24b10617-0037-40be-9339-ed1f8476835a tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1219 microversion: 2.1 time: 0.190067 Aug 24 03:36:38.398530 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 719/1438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:38 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1219 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:38.460546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:38.461761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:38.498279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.499883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.500432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.501367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.501980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.502536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.561269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.572819 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16e0226e-1d41-4a2a-9dd1-224866a902a7 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1469 microversion: 2.1 time: 0.655067 Aug 24 03:36:38.588015 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 720/1439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:37 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1469 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:38.606196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1fc0def9-811e-408c-abf9-52e11a750de5 req-eb4f9075-b586-4826-9e94-e118a6c4ba0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35df187-3cb4-4ba3-b577-db0383de2974", "name": "network-vif-deleted", "tag": "6947eb0c-389b-479a-ab51-be18c5089577"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:38.647723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1fc0def9-811e-408c-abf9-52e11a750de5 req-eb4f9075-b586-4826-9e94-e118a6c4ba0b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.653541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1fc0def9-811e-408c-abf9-52e11a750de5 req-eb4f9075-b586-4826-9e94-e118a6c4ba0b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.655028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1fc0def9-811e-408c-abf9-52e11a750de5 req-eb4f9075-b586-4826-9e94-e118a6c4ba0b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.700982 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1fc0def9-811e-408c-abf9-52e11a750de5 req-eb4f9075-b586-4826-9e94-e118a6c4ba0b service nova] Creating event network-vif-deleted:6947eb0c-389b-479a-ab51-be18c5089577 for instance a35df187-3cb4-4ba3-b577-db0383de2974 on n-h1-846470-15 Aug 24 03:36:38.721974 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1fc0def9-811e-408c-abf9-52e11a750de5 req-eb4f9075-b586-4826-9e94-e118a6c4ba0b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131746 Aug 24 03:36:38.726641 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 721/1440] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:39.063078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.087454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.092986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.094876 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29413adf-d8a5-4917-a876-ebb831f69b18 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1251 microversion: 2.25 time: 0.643404 Aug 24 03:36:39.117370 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 720/1441] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:38 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1251 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:39.436389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:39.437394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:39.452982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.459879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.460526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.461592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.462247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.462861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.596457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:39.597741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:39.611227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.613480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.616509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.617590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.623695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.624441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.709596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.711650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.712446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.713303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lazy-loading 'fault' on Instance uuid a35df187-3cb4-4ba3-b577-db0383de2974 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:36:39.799944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.813294 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-acc4d66c-3fab-42b7-9901-6bef88a116ae tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1223 microversion: 2.1 time: 0.381948 Aug 24 03:36:39.831007 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 722/1442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:39 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1223 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:39.907482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02333710364e5ebe27916c7ef17c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b8c78f5a474fbc861ac709a237672b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.919410 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c4a193ca-9eb2-4e24-83e7-44046c687b2c tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 200 len: 1306 microversion: 2.1 time: 0.327862 Aug 24 03:36:39.944988 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 721/1443] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:39 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 1306 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:40.126378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:40.127018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:40.149735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.150251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.153310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:40.154131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.154629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.165843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:40.309335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-456477668", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:40.420427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] validate_networks() for [('e07f3288-7434-41be-a4ae-1a790904361f', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:40.562965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:40.576544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:40.586959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:40.588921 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-55ea3efd-8198-495c-a688-1f43292921e3 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1293 microversion: 2.25 time: 0.474434 Aug 24 03:36:40.607261 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 723/1444] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:40 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1293 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:40.838750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:40.840900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:40.853694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.854352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.862231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:40.865029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.869033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.869796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.013544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:41.048490 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-60e5d2bf-0ddb-491b-9eb6-b3f64d30e867 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1289 microversion: 2.1 time: 0.213748 Aug 24 03:36:41.054438 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 724/1445] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:40 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1289 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:41.081766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:41.081766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] [instance: a35df187-3cb4-4ba3-b577-db0383de2974] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:41.105033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.105954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.106725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.108109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.109240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.113478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.162016 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] HTTP exception thrown: Instance a35df187-3cb4-4ba3-b577-db0383de2974 could not be found. Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Request method failure captured: Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 HTTP/1.1 Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZyqlI4jJ-UrReq16W-k5c2A7Yqhlol4rXJgalg3guiCvrBMb_wrBTxvt25XdPo2yN6YKan5eZ_MjZjAmeSQ4eB-FC4jbvfobn2l0nKFbhO6dp2Damj46Qi0zcZy-OlaahHZF4edkfm87FOnNXr89-n1Uzlc0H_r_sILcTs_3h52mEY Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b5b8c78f5a474fbc861ac709a237672b Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerPasswordTestJSON-677575417 Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5b8c78f5a474fbc861ac709a237672b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5b8c78f5a474fbc861ac709a237672b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b8c78f5a474fbc861ac709a237672b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b8c78f5a474fbc861ac709a237672b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerPasswordTestJSON-677575417 Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b5b8c78f5a474fbc861ac709a237672b Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerPasswordTestJSON-677575417 Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerPasswordTestJSON-677575417-project Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: de02333710364e5ebe27916c7ef17c35 Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerPasswordTestJSON-677575417-project Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a35df187-3cb4-4ba3-b577-db0383de2974 could not be found. Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a35df187-3cb4-4ba3-b577-db0383de2974'} Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a35df187-3cb4-4ba3-b577-db0383de2974 could not be found. Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a35df187-3cb4-4ba3-b577-db0383de2974 could not be found. Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:41.167458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a35df187-3cb4-4ba3-b577-db0383de2974 could not be found. Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] Returning 404 to user: Instance a35df187-3cb4-4ba3-b577-db0383de2974 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:41.171972 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1994f2b2-f08c-4b5e-b09b-17c3d0e131a8 tempest-ServerPasswordTestJSON-677575417 tempest-ServerPasswordTestJSON-677575417-project] 10.222.0.58 "GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974" status: 404 len: 111 microversion: 2.1 time: 0.114303 Aug 24 03:36:41.179692 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 725/1446] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:41 2022] GET /compute/v2.1/servers/a35df187-3cb4-4ba3-b577-db0383de2974 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:41.187274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:41.187838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:41.188348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:41.188764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:41.189345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:41.209540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.210180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.210653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.211482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.212049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.224706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.280881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Getting quotas for project 6251e0afcbcd4be99a11a20e42e5eea5. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:41.292262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Getting quotas for user c3a7defb9bc748f684309d7a7674154b and project 6251e0afcbcd4be99a11a20e42e5eea5. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:41.313852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:41.317571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:41.414828 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-78111392-2375-4642-ac73-a48a2469788a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.109164 Aug 24 03:36:41.434936 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 722/1447] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:36:41.439719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a057538-647e-4c4c-93e2-f8a61cb1fc91 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:41.440347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a057538-647e-4c4c-93e2-f8a61cb1fc91 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:41.493851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2f59ae5-e767-4a1e-97ee-5fe757c21994"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:41.498743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:41.513512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.514358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.515119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.516473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.517312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.518063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.634967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2a057538-647e-4c4c-93e2-f8a61cb1fc91 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:41.669830 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a057538-647e-4c4c-93e2-f8a61cb1fc91 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1224 microversion: 2.1 time: 0.233835 Aug 24 03:36:41.694453 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 726/1448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:41 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1224 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:41.706201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:41.710537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:41.736446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.737343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.745811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.747298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:41.748217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:41.749023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.260293 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3030adec-db76-409a-be64-ea7107b0ab6f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "POST /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772756 Aug 24 03:36:42.263719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 723/1449] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:36:41 2022] POST /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:42.293245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:42.295096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:42.326518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.336864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.337662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.338800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.348971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.348971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.750116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.797364 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8b98bbef-f7c4-4b4a-8595-aede4825237f tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1277 microversion: 2.1 time: 0.528661 Aug 24 03:36:42.805020 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 724/1450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:42 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1277 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:42.831416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-66e61c9b-2de6-4674-b196-840545d02d46 req-9e185e69-8f00-4c61-9554-ab1cb2f08f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d3df78-a022-4bff-a0bf-210e185c3b52", "tag": "82f749ca-66d8-4fda-bf1a-42d024de909c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:42.868142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-66e61c9b-2de6-4674-b196-840545d02d46 req-9e185e69-8f00-4c61-9554-ab1cb2f08f27 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.870891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-66e61c9b-2de6-4674-b196-840545d02d46 req-9e185e69-8f00-4c61-9554-ab1cb2f08f27 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.872490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-66e61c9b-2de6-4674-b196-840545d02d46 req-9e185e69-8f00-4c61-9554-ab1cb2f08f27 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.916741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-66e61c9b-2de6-4674-b196-840545d02d46 req-9e185e69-8f00-4c61-9554-ab1cb2f08f27 service nova] Creating event network-changed:82f749ca-66d8-4fda-bf1a-42d024de909c for instance 43d3df78-a022-4bff-a0bf-210e185c3b52 on n-h1-846470-15 Aug 24 03:36:42.942294 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-66e61c9b-2de6-4674-b196-840545d02d46 req-9e185e69-8f00-4c61-9554-ab1cb2f08f27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134064 Aug 24 03:36:42.954355 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 725/1451] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:42.968494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:42.969766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:42.980390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.996273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.999332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.000796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.009740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.011215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.123398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.170569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.180110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.187326 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c3330488-6514-4da6-b030-6af5ce2c6dd4 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1293 microversion: 2.25 time: 1.501220 Aug 24 03:36:43.192274 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 727/1452] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:41 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1293 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:43.413252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.467140 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c03d0ea7-5d03-4c67-b59c-2168b4e29a2e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1220 microversion: 2.1 time: 0.509607 Aug 24 03:36:43.468471 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 726/1453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:42 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1220 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:43.832082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:43.833164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:43.859094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.862649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.863557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.867575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.868958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.869742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.233731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:44.234407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:44.248264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.248889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.249617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.250221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.250732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.251974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.681874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:44.700556 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b11f35a9-2d5c-4c8f-ba25-0beefd8c893c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1277 microversion: 2.1 time: 0.876293 Aug 24 03:36:44.737245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 728/1454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:43 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1277 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:44.742545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:44.743192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:44.758921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.759463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.759951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.760718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.763080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.763560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.008907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.033796 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-508559a6-af8a-4db7-9256-5f3bb28483d3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1282 microversion: 2.1 time: 0.295098 Aug 24 03:36:45.056508 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 729/1455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:44 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1282 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:45.403455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.431780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.433961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.436368 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-183e57ed-7d38-4a55-a321-8286891a2c4f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1293 microversion: 2.25 time: 1.207916 Aug 24 03:36:45.437346 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 727/1456] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:44 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1293 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:45.743152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:45.745771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:45.762508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.762508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.762977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.764340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.764340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.771056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.844990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:46.095699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:46.096953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:46.120121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:46.156414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.156940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.160314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.161424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.161982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.165754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.398326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.415812 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90a257c6-6bdb-4a7d-9348-614f968a2ab4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1282 microversion: 2.1 time: 0.354364 Aug 24 03:36:46.425087 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 728/1457] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:46 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:46.482809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:46.487094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:46.506199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.516426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.517356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.518831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.520609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.521528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.720501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.753155 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-34f67b87-c104-4623-8097-1686148e3960 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 1.016120 Aug 24 03:36:46.784434 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 730/1458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:45 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:47.073017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:47.110966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:47.116962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:47.142519 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-88b198d1-e7ef-413f-9d48-9ffaa35dbde7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1293 microversion: 2.25 time: 0.666826 Aug 24 03:36:47.150100 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 729/1459] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:46 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1293 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:47.474662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:47.475314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:47.495978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.497035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.498197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.499943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.502209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.503751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.803285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:47.804940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:47.817635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.823694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.824891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.825893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.826576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.830731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.143299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.162233 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e1a6119-fe60-41dc-b639-5047edff6b1b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 0.363301 Aug 24 03:36:48.163510 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 730/1460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:47 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:48.175623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:48.176551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:48.178789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.197636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:48.198142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:48.198896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.205108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:48.206009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:48.206724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.235512 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2e06804d-2303-47f0-8315-43c0a1226153 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1282 microversion: 2.1 time: 0.766190 Aug 24 03:36:48.239854 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 731/1461] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:47 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1282 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:48.577916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.602186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.604363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.607374 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4bae3be9-eb82-48e6-8faa-c3bee02db168 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.436693 Aug 24 03:36:48.627054 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 731/1462] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:48 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:49.215924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:49.221297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:49.248230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.253471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.254964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.256862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.259934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.262190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.286028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:49.291391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:49.334433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.336065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.343740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.346628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.347645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.348587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.607805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:49.629907 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-303c13fe-a09f-477d-8411-a5511dccec2a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.353538 Aug 24 03:36:49.631932 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 732/1463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:49 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:49.689738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:49.690205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:49.699352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.700670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.701590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.702504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.702986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.704099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.959873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:49.994934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.002940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.004433 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7f080abd-6b24-42b9-8047-17527e16fd37 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.339363 Aug 24 03:36:50.024104 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 733/1464] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:49 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:50.043171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.057865 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6dd9cb40-3546-4abb-96e7-e5ac81998eac tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 0.855886 Aug 24 03:36:50.059415 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 732/1465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:49 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:50.658757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:50.660837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:50.695385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:50.696171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:50.703422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:50.707164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ae17dacb-ca6f-4fdf-8f8d-652b4a27f9dc req-d947adff-1d27-4422-8cc6-c44940c0693e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f1c7bb-c9db-4e30-b8ce-673a4ac40d32", "tag": "045a54e2-0ca1-4355-ba64-d0f105174770"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:50.708631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:50.710755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:50.711544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:50.728632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ae17dacb-ca6f-4fdf-8f8d-652b4a27f9dc req-d947adff-1d27-4422-8cc6-c44940c0693e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:50.730112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ae17dacb-ca6f-4fdf-8f8d-652b4a27f9dc req-d947adff-1d27-4422-8cc6-c44940c0693e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:50.731292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ae17dacb-ca6f-4fdf-8f8d-652b4a27f9dc req-d947adff-1d27-4422-8cc6-c44940c0693e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:50.755357 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ae17dacb-ca6f-4fdf-8f8d-652b4a27f9dc req-d947adff-1d27-4422-8cc6-c44940c0693e service nova] Creating event network-changed:045a54e2-0ca1-4355-ba64-d0f105174770 for instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 on n-h2-846470-15 Aug 24 03:36:50.765959 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ae17dacb-ca6f-4fdf-8f8d-652b4a27f9dc req-d947adff-1d27-4422-8cc6-c44940c0693e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070346 Aug 24 03:36:50.768443 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 733/1466] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:50.916207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.926747 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed750644-5843-426c-805e-ae2d235e2523 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.276232 Aug 24 03:36:50.927862 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 734/1467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:50 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:51.033527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:51.034715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:51.041879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.042490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.043083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.044062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.044946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.045812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.099234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:51.100446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:51.113661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.115990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.117791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.121798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.122988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.124062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.253963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:51.306902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=22 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:51.629365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.660521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.664307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.666434 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c0ae6a09-f0f6-4242-9be5-f506b7ca1c3f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.636925 Aug 24 03:36:51.681039 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 734/1468] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:51 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:51.783083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.788318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:51.811653 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60492633-97a0-4381-be3e-797acb981bbe tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 0.724269 Aug 24 03:36:51.816051 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 735/1469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:51 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:51.973171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:51.975201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:52.003237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:52.014827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.025403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.026522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.028184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.029287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.030307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.715596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:52.718879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:52.756458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.757754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.759770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.761561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.763845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.764950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.784042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.798612 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81a32a61-37e0-453e-b440-d358229ba49e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.837298 Aug 24 03:36:52.812678 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 735/1470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:51 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:52.849285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:52.850202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:52.860305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.860791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.861270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.862028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.865372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.865987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.164897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.189046 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3765c8bc-1bb3-4a3e-a90c-157948df248b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 0.341434 Aug 24 03:36:53.195810 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 736/1471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:52 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:53.211130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fa23009e-a75d-45ed-8b54-a0f165c877b6 req-313b9169-6455-419f-b79e-623db104f90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5187bf32-b851-4395-acda-bba0943f99b3", "tag": "44e1352a-eb7d-4fbd-af15-185af6385e46"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:53.240196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fa23009e-a75d-45ed-8b54-a0f165c877b6 req-313b9169-6455-419f-b79e-623db104f90e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.254413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fa23009e-a75d-45ed-8b54-a0f165c877b6 req-313b9169-6455-419f-b79e-623db104f90e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.254413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fa23009e-a75d-45ed-8b54-a0f165c877b6 req-313b9169-6455-419f-b79e-623db104f90e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.279563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.290842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.292896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.294478 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d512feee-6597-4ef6-9fb6-1ee010df9394 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.593843 Aug 24 03:36:53.308539 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 736/1472] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:52 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:53.321634 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fa23009e-a75d-45ed-8b54-a0f165c877b6 req-313b9169-6455-419f-b79e-623db104f90e service nova] Creating event network-changed:44e1352a-eb7d-4fbd-af15-185af6385e46 for instance 5187bf32-b851-4395-acda-bba0943f99b3 on n-h2-846470-15 Aug 24 03:36:53.342519 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fa23009e-a75d-45ed-8b54-a0f165c877b6 req-313b9169-6455-419f-b79e-623db104f90e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143749 Aug 24 03:36:53.344057 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 737/1473] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:53.763363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-467bd909-f571-4c56-bd09-78335ada77a6 tempest-AbsoluteLimitsTestJSON-1740508614 tempest-AbsoluteLimitsTestJSON-1740508614-project] Calling method '.version_select at 0x7f1022f7caf0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:53.789806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-467bd909-f571-4c56-bd09-78335ada77a6 tempest-AbsoluteLimitsTestJSON-1740508614 tempest-AbsoluteLimitsTestJSON-1740508614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.790653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-467bd909-f571-4c56-bd09-78335ada77a6 tempest-AbsoluteLimitsTestJSON-1740508614 tempest-AbsoluteLimitsTestJSON-1740508614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.791311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-467bd909-f571-4c56-bd09-78335ada77a6 tempest-AbsoluteLimitsTestJSON-1740508614 tempest-AbsoluteLimitsTestJSON-1740508614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.793164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-467bd909-f571-4c56-bd09-78335ada77a6 tempest-AbsoluteLimitsTestJSON-1740508614 tempest-AbsoluteLimitsTestJSON-1740508614-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.794157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-467bd909-f571-4c56-bd09-78335ada77a6 tempest-AbsoluteLimitsTestJSON-1740508614 tempest-AbsoluteLimitsTestJSON-1740508614-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.794808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-467bd909-f571-4c56-bd09-78335ada77a6 tempest-AbsoluteLimitsTestJSON-1740508614 tempest-AbsoluteLimitsTestJSON-1740508614-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.821877 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-467bd909-f571-4c56-bd09-78335ada77a6 tempest-AbsoluteLimitsTestJSON-1740508614 tempest-AbsoluteLimitsTestJSON-1740508614-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.304586 Aug 24 03:36:53.835713 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 737/1474] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 03:36:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:53.849864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:53.851763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:53.863252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.865030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.871770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.873784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.875458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.879365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:54.229830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:54.233507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:54.268699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:54.270561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:54.271745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:54.276837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:54.278098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:54.280116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:54.354029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.389299 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af1aaf27-caae-43a2-918f-2354be215999 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.566276 Aug 24 03:36:54.390328 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 738/1475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:53 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:54.408308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:54.409395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:54.446889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:54.447717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:54.448464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:54.455179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:54.456046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:54.456829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:54.750218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.764460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.766735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.768272 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-248336f0-d0be-47e0-a766-778921bc6bd7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.370692 Aug 24 03:36:54.770025 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 739/1476] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:54 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:55.003434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.016077 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e6e80246-441d-42f5-9435-ee55fbbf4b90 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 0.804356 Aug 24 03:36:55.021710 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 738/1477] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:54 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:55.428461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:55.432503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:55.442093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.442581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.443040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.444131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.444591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.445016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.803001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:55.804289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:55.818302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.819254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.820132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.821450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.822941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.824192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.898110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.943035 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ce72b64c-b5b6-4d67-92c6-36dde98c174a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.517913 Aug 24 03:36:55.945769 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 740/1478] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:55 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:56.049786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:56.054645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:56.090330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.094938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.096782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.099552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.104240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.106640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.187763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.204015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.212307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.219605 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-34ed6d07-5b87-4d04-b8f2-2d5483ffbdc5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.427035 Aug 24 03:36:56.221723 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 739/1479] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:55 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:56.972513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:56.974789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:56.989062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.990457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.991503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.993246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.994532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.996155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:57.083597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.093655 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffe835dd-e11d-4b11-97ca-cf70eb05b934 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 1.053739 Aug 24 03:36:57.111500 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 741/1480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:57.259908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:57.261732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:57.279346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:57.286049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:57.287005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:57.289576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:57.290521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:57.291220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:57.371746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.392613 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5bd100ba-1c94-467d-8f0d-cb10afd5ad7e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.428818 Aug 24 03:36:57.393590 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 740/1481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:57.688455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.701453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.702954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.705717 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-80c1bd85-1be4-47d0-9010-029d9577c35f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.450038 Aug 24 03:36:57.723716 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 742/1482] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:57 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:58.119726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:58.120662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:58.128784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.129288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.129748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.130532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.131014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.131688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.422869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:58.425267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:58.436859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.438143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.439244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.440937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.442057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.443030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.523543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.538908 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5226dd8f-f1e7-406f-b0e8-f9acb336e24c tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 0.423081 Aug 24 03:36:58.539966 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 741/1483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:58 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:58.736455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:58.737726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:58.749668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.750996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.751889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.753080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.753844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.756431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.872454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.895272 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3f0b5a84-3806-40ed-8276-0d99ddfb7073 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.478958 Aug 24 03:36:58.902608 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 743/1484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:58 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:59.141425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.186932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.188943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.190878 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f86c0d16-6848-4cdf-8d76-bb69ea3eb6aa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.463114 Aug 24 03:36:59.191760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 742/1485] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:58 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:59.578105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:59.579404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:59.592831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.594143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.595138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.600534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.602874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.604319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.943327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:59.945603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:59.960258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.961928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.966499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.969138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.972405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.974874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.006446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.019058 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fd467cae-2699-4c62-b604-430d44ac9458 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 0.451653 Aug 24 03:37:00.022584 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 744/1486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:59 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:00.233799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:00.235204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:00.246661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.247874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.248773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.251009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.251835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.252528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.350421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.364768 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-636ac6e5-cc01-4b42-a0fd-7cdfd8058bc5 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.430100 Aug 24 03:37:00.366466 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 743/1487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:59 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:00.447845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.461616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.464550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.466629 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d93587ec-2217-407c-9a45-c3f92e24e296 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.237612 Aug 24 03:37:00.467280 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 745/1488] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:00 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:00.506666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c0da2a0e-7843-46b6-b258-7baa0720cb8a req-b4caa050-6d23-497d-981c-b651385f3420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f1c7bb-c9db-4e30-b8ce-673a4ac40d32", "name": "network-vif-plugged", "status": "completed", "tag": "045a54e2-0ca1-4355-ba64-d0f105174770"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:00.518575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c0da2a0e-7843-46b6-b258-7baa0720cb8a req-b4caa050-6d23-497d-981c-b651385f3420 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.519461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c0da2a0e-7843-46b6-b258-7baa0720cb8a req-b4caa050-6d23-497d-981c-b651385f3420 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.520081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c0da2a0e-7843-46b6-b258-7baa0720cb8a req-b4caa050-6d23-497d-981c-b651385f3420 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.535637 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c0da2a0e-7843-46b6-b258-7baa0720cb8a req-b4caa050-6d23-497d-981c-b651385f3420 service nova] Creating event network-vif-plugged:045a54e2-0ca1-4355-ba64-d0f105174770 for instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 on n-h2-846470-15 Aug 24 03:37:00.542819 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c0da2a0e-7843-46b6-b258-7baa0720cb8a req-b4caa050-6d23-497d-981c-b651385f3420 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040660 Aug 24 03:37:00.543791 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 744/1489] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:01.055593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:01.056948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:01.064732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.065512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.066127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.067045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.067727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.068446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.394128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:01.403186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:01.413975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.417914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.419215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.421521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.423238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.423783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.424944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.431336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31025829-d3ef-403c-8d56-0dcd5ad3be4b tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1319 microversion: 2.1 time: 0.378238 Aug 24 03:37:01.432122 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 746/1490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:01 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:01.492355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:01.493249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:01.517341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.517851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.518289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.519289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.519921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.520587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.779721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.789024 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c4cb8cb9-1ef6-4bd7-94d6-aec3354f82f2 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.405737 Aug 24 03:37:01.789695 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 745/1491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:01 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:01.954182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.969338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.977971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.979588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-753aad40-4d3b-4528-8aa5-864f06d7f2df tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.491779 Aug 24 03:37:02.000270 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 747/1492] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:01 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:02.455922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.456577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.467375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.467929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.468382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.469126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.469594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.470036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.580655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5050f3f9-16d3-4274-b2ff-134973d4588a req-fa925d8c-4bf9-49fc-b41c-18aac8f1d18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d3df78-a022-4bff-a0bf-210e185c3b52", "name": "network-vif-plugged", "status": "completed", "tag": "82f749ca-66d8-4fda-bf1a-42d024de909c"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:02.611080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5050f3f9-16d3-4274-b2ff-134973d4588a req-fa925d8c-4bf9-49fc-b41c-18aac8f1d18a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.621132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5050f3f9-16d3-4274-b2ff-134973d4588a req-fa925d8c-4bf9-49fc-b41c-18aac8f1d18a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.622030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5050f3f9-16d3-4274-b2ff-134973d4588a req-fa925d8c-4bf9-49fc-b41c-18aac8f1d18a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.634623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:02.662801 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5050f3f9-16d3-4274-b2ff-134973d4588a req-fa925d8c-4bf9-49fc-b41c-18aac8f1d18a service nova] Creating event network-vif-plugged:82f749ca-66d8-4fda-bf1a-42d024de909c for instance 43d3df78-a022-4bff-a0bf-210e185c3b52 on n-h1-846470-15 Aug 24 03:37:02.672905 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5050f3f9-16d3-4274-b2ff-134973d4588a req-fa925d8c-4bf9-49fc-b41c-18aac8f1d18a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099136 Aug 24 03:37:02.674625 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 748/1493] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:02.681606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.684846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.692284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.692946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.693713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.694754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.695319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.695950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.835389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8cef527b-3753-4bc8-bfa3-3d6d7b65ffa0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155483 Aug 24 03:37:02.842576 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 749/1494] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:02.858682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.859388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.880465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.882998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.883800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.889452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.890236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.890862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.080147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.109590 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ffe7fb5-0625-4f22-8408-3dc3d06297af tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1468 microversion: 2.1 time: 0.657745 Aug 24 03:37:03.113846 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 746/1495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1468 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:03.128642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.133453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.148975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.152368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.154030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.156568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.158501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.166426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.372652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lazy-loading 'services' on Instance uuid a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:03.539781 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-100266f9-7a2b-4eac-b0dd-d466ac1ad985 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments/a2f59ae5-e767-4a1e-97ee-5fe757c21994" status: 202 len: 0 microversion: 2.1 time: 0.409762 Aug 24 03:37:03.540504 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 747/1496] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 03:37:03 2022] DELETE /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments/a2f59ae5-e767-4a1e-97ee-5fe757c21994 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:03.569107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.573618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.591793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.592351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.592931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.593727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.594198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.594638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.704636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.748454 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-86ec5fdc-87da-4b19-b965-d3c4dc90c2f7 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.898949 Aug 24 03:37:03.749165 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 750/1497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:03.775033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:03.777772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.787687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:03.798285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.800138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.800814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.801789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.802442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.803044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.805699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:03.980405 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d308569-4950-4142-ad2d-34145a4f0f61 tempest-DeleteServersAdminTestJSON-1675033754 tempest-DeleteServersAdminTestJSON-1675033754-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32/action" status: 202 len: 0 microversion: 2.1 time: 0.225467 Aug 24 03:37:03.982368 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 751/1498] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:37:03 2022] POST /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:03.991437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.993311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.012585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.013730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.015328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.018640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.019339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.019977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.085036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.085533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.085977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.086448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lazy-loading 'fault' on Instance uuid 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:04.100895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.121962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.123615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.124859 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7248c9b6-c375-45b8-92a2-1b9c8074d50b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1281 microversion: 2.25 time: 0.577532 Aug 24 03:37:04.132334 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 748/1499] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1281 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:04.325372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.334170 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a98670d8-d9d7-49de-9d25-10e6a5eccad6 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1451 microversion: 2.1 time: 0.346811 Aug 24 03:37:04.348023 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 752/1500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1451 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:04.357762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.358857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.373576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.375255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.379493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.382407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.384830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.385841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.461829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:04.707252 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96d0b1e8-f240-48b7-8a3f-49a3f7eb9fc0 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 204 len: 0 microversion: 2.1 time: 0.354115 Aug 24 03:37:04.709684 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 749/1501] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:04 2022] DELETE /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:04.720374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.720924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.741086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.741577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.742013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.742738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.743191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.751125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.773165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.774209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.789747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.796520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.797326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.799794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.800351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.814242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.858629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.859974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.862478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.863362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lazy-loading 'fault' on Instance uuid 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:05.231094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.248112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac232668-0597-4bb4-b9f6-0e9fbf6ba298 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.480510 Aug 24 03:37:05.250231 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 750/1502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:04 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:05.269660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ddf1a229-1998-4ae4-9bbe-69314a73e70b req-3ffa23fd-5c99-4cad-afd2-e47c3a45cf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5187bf32-b851-4395-acda-bba0943f99b3", "name": "network-vif-plugged", "status": "completed", "tag": "44e1352a-eb7d-4fbd-af15-185af6385e46"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:05.320176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ddf1a229-1998-4ae4-9bbe-69314a73e70b req-3ffa23fd-5c99-4cad-afd2-e47c3a45cf56 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.322707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ddf1a229-1998-4ae4-9bbe-69314a73e70b req-3ffa23fd-5c99-4cad-afd2-e47c3a45cf56 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.323371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ddf1a229-1998-4ae4-9bbe-69314a73e70b req-3ffa23fd-5c99-4cad-afd2-e47c3a45cf56 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.367407 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ddf1a229-1998-4ae4-9bbe-69314a73e70b req-3ffa23fd-5c99-4cad-afd2-e47c3a45cf56 service nova] Creating event network-vif-plugged:44e1352a-eb7d-4fbd-af15-185af6385e46 for instance 5187bf32-b851-4395-acda-bba0943f99b3 on n-h2-846470-15 Aug 24 03:37:05.382159 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ddf1a229-1998-4ae4-9bbe-69314a73e70b req-3ffa23fd-5c99-4cad-afd2-e47c3a45cf56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127804 Aug 24 03:37:05.398022 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 751/1503] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:05.420664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.423404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.445532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.448340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.451806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.453781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.455442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.456214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.574352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.586138 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-68df454a-2136-49b4-b32e-83f19676a263 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1457 microversion: 2.1 time: 0.869996 Aug 24 03:37:05.590217 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 753/1504] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:04 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1457 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:05.632418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:06.108684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.124552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.134176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.135975 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dc1c076e-f24f-471d-9244-caa5ca0eaa81 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1477 microversion: 2.25 time: 0.733133 Aug 24 03:37:06.142490 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 752/1505] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1477 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:06.166291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.166953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.179452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=79 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:06.183098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.185323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.186800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.189935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.190701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.194460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.276804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.278290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.289499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.295227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.296083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.299057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.299751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.301353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.720728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid 43d3df78-a022-4bff-a0bf-210e185c3b52 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:06.789317 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f2d330c-18a5-40c2-af03-4ccf7d513130 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1972 microversion: 2.25 time: 0.623818 Aug 24 03:37:06.820537 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 754/1506] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1972 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:06.861806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.867001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.890110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.891347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.892778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.895417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.896548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.897534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.949209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.978657 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a09d02a-b3a0-4d69-9ff2-45bfbb2130d9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1324 microversion: 2.1 time: 0.709192 Aug 24 03:37:06.981717 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 753/1507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1324 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:06.996665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:07.000748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:07.032381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.035516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.037523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.047439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.049070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.051917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.359643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid 43d3df78-a022-4bff-a0bf-210e185c3b52 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:07.381925 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1f91ad94-4784-4698-8442-c3e8b9f0ea4c tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1972 microversion: 2.25 time: 0.395372 Aug 24 03:37:07.383138 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 754/1508] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1972 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:07.496985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.498109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.498714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.499608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lazy-loading 'fault' on Instance uuid 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:07.651393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8f97e0f-c0d4-4d85-a8eb-c100e8a8cea2 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f1022f330d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1041357796", "description": "tempest-description-431175211"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:07.858739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fabeab6f0f74b19be18070258631a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda00288f6124296932f66d9db18d82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:07.868108 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-86c33ca3-cdf6-4e97-9603-3d88052b1dc7 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 200 len: 1457 microversion: 2.1 time: 1.044854 Aug 24 03:37:07.874742 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 755/1509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 1457 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:07.880210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0191c082-55c2-4824-8e16-46a39b13d9d3 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:07.892537 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:07.892537 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:07.897543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0191c082-55c2-4824-8e16-46a39b13d9d3 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.898722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0191c082-55c2-4824-8e16-46a39b13d9d3 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.899400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0191c082-55c2-4824-8e16-46a39b13d9d3 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.900395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0191c082-55c2-4824-8e16-46a39b13d9d3 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.901019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0191c082-55c2-4824-8e16-46a39b13d9d3 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.901743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0191c082-55c2-4824-8e16-46a39b13d9d3 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.935838 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0191c082-55c2-4824-8e16-46a39b13d9d3 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.059216 Aug 24 03:37:07.937880 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 756/1510] 10.222.0.58 () {60 vars in 1217 bytes} [Wed Aug 24 03:37:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:37:07.945245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7a0a715a-56b4-4eda-bf99-07c53a183e5d req-2e3c0103-443b-44ef-b59b-042d6b1f8931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f1c7bb-c9db-4e30-b8ce-673a4ac40d32", "name": "network-vif-deleted", "tag": "045a54e2-0ca1-4355-ba64-d0f105174770"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:07.966204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7a0a715a-56b4-4eda-bf99-07c53a183e5d req-2e3c0103-443b-44ef-b59b-042d6b1f8931 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.967532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7a0a715a-56b4-4eda-bf99-07c53a183e5d req-2e3c0103-443b-44ef-b59b-042d6b1f8931 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.968928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7a0a715a-56b4-4eda-bf99-07c53a183e5d req-2e3c0103-443b-44ef-b59b-042d6b1f8931 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.016423 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7a0a715a-56b4-4eda-bf99-07c53a183e5d req-2e3c0103-443b-44ef-b59b-042d6b1f8931 service nova] Creating event network-vif-deleted:045a54e2-0ca1-4355-ba64-d0f105174770 for instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 on n-h2-846470-15 Aug 24 03:37:08.023653 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7a0a715a-56b4-4eda-bf99-07c53a183e5d req-2e3c0103-443b-44ef-b59b-042d6b1f8931 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083867 Aug 24 03:37:08.024279 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 757/1511] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:08.032257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846470-15", "block_migration": "auto"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:08.035709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:08.046655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.047889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.048681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.049965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.050616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.051222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.086172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'flavor' on Instance uuid 43d3df78-a022-4bff-a0bf-210e185c3b52 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:08.144525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Going to try to live migrate instance to n-h2-846470-15 {{(pid=122535) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:37:08.253523 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8f97e0f-c0d4-4d85-a8eb-c100e8a8cea2 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.868989 Aug 24 03:37:08.255734 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 755/1512] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:37:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:08.271001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:08.272406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:08.280459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.281245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.282185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.283119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.283806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.284906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.676863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.692625 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-56ca32a8-5a8a-4080-b090-889bb752490c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1521 microversion: 2.1 time: 0.425940 Aug 24 03:37:08.693667 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 756/1513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:08 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:08.700898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3746ab44-00fa-48d5-884e-a2096ebb72f3 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f1022e2d280>, body: {"security_group_rule": {"parent_group_id": "2f2875fa-aa85-42d4-a0d8-ef70baeae61b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:09.172939 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3746ab44-00fa-48d5-884e-a2096ebb72f3 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.477253 Aug 24 03:37:09.184633 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 757/1514] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:37:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:09.313717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2001399559", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:09.425515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] validate_networks() for [('ad414080-b44a-4df0-b628-fd9835917f80', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:37:10.092965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:37:10.093891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:37:10.094387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:37:10.094807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:37:10.095484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:37:10.114280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.115039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.115893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.116873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.117683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.118421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.153449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Getting quotas for project 04347edb8512486a8a8cf69229522348. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:37:10.165316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Getting quotas for user 31d9689ec7554610881c5683ca4ca405 and project 04347edb8512486a8a8cf69229522348. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:37:10.203068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:37:10.206530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:37:10.298915 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7d892d7f-0cf8-4750-9d6f-49871a1e1694 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.113014 Aug 24 03:37:10.300024 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 758/1515] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:37:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:37:10.323614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.334573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.337137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Searching by: {'deleted': False, 'project_id': '4106f94adf184471b76f1f81694ff161'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:37:10.381328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.397377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.398144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.399387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.404416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.405279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.459391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:37:10.498673 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0774081d-7935-4878-b774-bba56151524c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.197006 Aug 24 03:37:10.500456 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 759/1516] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers => generated 340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:10.516894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.517994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:10.527132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.532971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.533273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.534221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.534864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.535466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.756301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.780498 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8310a8e-a012-4ad3-9db1-a70ad2996581 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1521 microversion: 2.1 time: 0.264483 Aug 24 03:37:10.784358 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 760/1517] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:10.792540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.793750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:10.805502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.806707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.807411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.808530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.809423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.810413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.830653 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] HTTP exception thrown: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Request method failure captured: Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 HTTP/1.1 Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyka7TrkIds5u81EVQjpWCe7rYX_fUImEyBZKuA6T7DRddyauf_-VrZKQGYkvzWoGekblW2LhF-AbSbCn1TWr5U1XZUhfIm-k2i08v_6MgU_fWFM7gPSbPChRT47a-YKlE0STwmnjVnplYalW_PDmYwhmddk1CjVtW_XPiJFcs5faA Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cda00288f6124296932f66d9db18d82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cda00288f6124296932f66d9db18d82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 9fabeab6f0f74b19be18070258631a7d Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '25f1c7bb-c9db-4e30-b8ce-673a4ac40d32'} Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:10.832834 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.838674 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:10.838674 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:10.838674 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:10.838674 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:10.838674 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:10.838674 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:10.838674 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.841566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Returning 404 to user: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:10.842661 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7f110ac-05f3-44f1-9adf-5b4d7c66abeb tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 404 len: 111 microversion: 2.1 time: 0.056869 Aug 24 03:37:10.843547 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 761/1518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:10.853713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a13d52d6-0a3a-4a92-86fd-df0ecdacf843 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f1022f77280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1593914426", "description": "tempest-description-1054372397"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:11.134287 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a13d52d6-0a3a-4a92-86fd-df0ecdacf843 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.289085 Aug 24 03:37:11.134917 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 762/1519] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:37:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:11.138053 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-40e3d5b5-b70a-4dac-a761-f04d3723d3b5 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52/action" status: 202 len: 0 microversion: 2.25 time: 3.112080 Aug 24 03:37:11.140168 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 758/1520] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:37:08 2022] POST /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52/action => generated 0 bytes in 3115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:11.174492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90d94fc5-5bbb-4dec-b0c9-ea63487a724c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.175139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90d94fc5-5bbb-4dec-b0c9-ea63487a724c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.181257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.230632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.232247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Searching by: {'deleted': False, 'project_id': '4106f94adf184471b76f1f81694ff161'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:37:11.260716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.261658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.270007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.273045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.273961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.274640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.355051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:37:11.365753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90d94fc5-5bbb-4dec-b0c9-ea63487a724c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.375980 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90d94fc5-5bbb-4dec-b0c9-ea63487a724c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1214 microversion: 2.1 time: 0.227619 Aug 24 03:37:11.379931 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 763/1521] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:11 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:11.393750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-118817963"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:11.404377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.416207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.417256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.418123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.420643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.421387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.423581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.440969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.448887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.449640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.450263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.874896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b6be5963-2ad0-4f2d-ac0e-2c4225e4f0df tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3/action" status: 202 len: 0 microversion: 2.1 time: 0.489206 Aug 24 03:37:11.877480 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 764/1522] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:37:11 2022] POST /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 03:37:11.892622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.893240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.909937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.910453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.912378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.914447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.915392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.917443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.951234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b52792e1-4e14-47bc-a3a0-1bf39dfe020b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.801959 Aug 24 03:37:11.952741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 759/1523] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:37:11 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:11.974721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.979293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.985018 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] HTTP exception thrown: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Request method failure captured: Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 HTTP/1.1 Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyka7TrkIds5u81EVQjpWCe7rYX_fUImEyBZKuA6T7DRddyauf_-VrZKQGYkvzWoGekblW2LhF-AbSbCn1TWr5U1XZUhfIm-k2i08v_6MgU_fWFM7gPSbPChRT47a-YKlE0STwmnjVnplYalW_PDmYwhmddk1CjVtW_XPiJFcs5faA Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cda00288f6124296932f66d9db18d82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cda00288f6124296932f66d9db18d82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 9fabeab6f0f74b19be18070258631a7d Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '25f1c7bb-c9db-4e30-b8ce-673a4ac40d32'} Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:11.986910 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:11.993349 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:11.995950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.996655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.997112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.998526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Returning 404 to user: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:12.004203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.004844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.005306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.005474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0991c26e-b164-49ba-9add-f20c2af1c7fc tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 404 len: 111 microversion: 2.1 time: 0.125023 Aug 24 03:37:12.008436 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 765/1524] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:11 2022] DELETE /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:12.031192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0cb69baa-8867-449d-b062-4b2e3538ebf0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f10231f7040>, body: {"security_group_rule": {"parent_group_id": "d5cf2c6e-7c61-484a-98bd-8630959da437", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:12.359482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.400803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.411789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.413743 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9a3173fa-c1fa-49fd-b636-947de65da395 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.458883 Aug 24 03:37:12.414776 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 760/1525] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:11 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:12.421880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5a509b7-5ffc-4f3d-9677-154c17afe7af tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '.version_select at 0x7f102adbb3a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:12.503022 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0cb69baa-8867-449d-b062-4b2e3538ebf0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.487437 Aug 24 03:37:12.514027 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 766/1526] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:37:12 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:12.520626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10009913-ded6-44d4-9a84-914beb134996 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:12.540526 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10009913-ded6-44d4-9a84-914beb134996 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024833 Aug 24 03:37:12.551631 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 767/1527] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:37:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:12.560709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:12.566736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:12.580516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.581017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.593222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.594078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.594572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.598337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.634360 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] HTTP exception thrown: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Request method failure captured: Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 HTTP/1.1 Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyka7TrkIds5u81EVQjpWCe7rYX_fUImEyBZKuA6T7DRddyauf_-VrZKQGYkvzWoGekblW2LhF-AbSbCn1TWr5U1XZUhfIm-k2i08v_6MgU_fWFM7gPSbPChRT47a-YKlE0STwmnjVnplYalW_PDmYwhmddk1CjVtW_XPiJFcs5faA Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cda00288f6124296932f66d9db18d82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cda00288f6124296932f66d9db18d82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 9fabeab6f0f74b19be18070258631a7d Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '25f1c7bb-c9db-4e30-b8ce-673a4ac40d32'} Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:12.640929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.645866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.645866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:12.645866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:12.645866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:12.645866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:12.645866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. Aug 24 03:37:12.645866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.648100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Returning 404 to user: Instance 25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:12.649185 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-57c9730e-ab74-4470-ab8a-dc3b0dcf68ea tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32" status: 404 len: 111 microversion: 2.1 time: 0.096119 Aug 24 03:37:12.656749 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 768/1528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:12 2022] GET /compute/v2.1/servers/25f1c7bb-c9db-4e30-b8ce-673a4ac40d32 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:12.671315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:12.680548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:12.686750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:12.716388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.717514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.718127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.719555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.722082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.723175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.736669 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5a509b7-5ffc-4f3d-9677-154c17afe7af tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/images/8195948d-7560-43c1-bd2e-80459f91ca40" status: 204 len: 0 microversion: 2.1 time: 0.320606 Aug 24 03:37:12.737957 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 761/1529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:12 2022] DELETE /compute/v2.1/images/8195948d-7560-43c1-bd2e-80459f91ca40 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:12.744198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a3ed130b-1aa2-4377-99d6-af9f879d50ae tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f102acc9040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-910182010", "description": "tempest-description-2129783435"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:12.874854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:12.885446 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b9168bef-ef2f-43f8-ba0f-6074cccac62f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1274 microversion: 2.1 time: 0.223419 Aug 24 03:37:12.887027 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 769/1530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:12 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1274 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:12.892242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:12.893007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:12.905722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.906635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.907440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.908396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:12.909055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:12.909754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:12.927568 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] HTTP exception thrown: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Request method failure captured: Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 HTTP/1.1 Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyka7TrkIds5u81EVQjpWCe7rYX_fUImEyBZKuA6T7DRddyauf_-VrZKQGYkvzWoGekblW2LhF-AbSbCn1TWr5U1XZUhfIm-k2i08v_6MgU_fWFM7gPSbPChRT47a-YKlE0STwmnjVnplYalW_PDmYwhmddk1CjVtW_XPiJFcs5faA Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cda00288f6124296932f66d9db18d82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cda00288f6124296932f66d9db18d82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 9fabeab6f0f74b19be18070258631a7d Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'dee682bd-78df-4d10-ab4e-f738f5db6e94'} Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:12.929524 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:12.934581 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.936562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Returning 404 to user: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:12.938026 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aab0bf26-34f1-4aa8-ac88-d8d22f3dd5d8 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 404 len: 111 microversion: 2.1 time: 0.049493 Aug 24 03:37:12.940518 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 770/1531] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:12 2022] DELETE /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:12.946842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f06b26d5-4b29-42a5-8218-c9be24f88f55 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '.version_select at 0x7f1022dbddc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:12.978055 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f06b26d5-4b29-42a5-8218-c9be24f88f55 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Image not found. Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f06b26d5-4b29-42a5-8218-c9be24f88f55 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/images/8195948d-7560-43c1-bd2e-80459f91ca40 HTTP/1.1 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: exception: Image not found. Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8195948d-7560-43c1-bd2e-80459f91ca40'} Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8195948d-7560-43c1-bd2e-80459f91ca40 Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:37:12.982111 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8195948d-7560-43c1-bd2e-80459f91ca40 could not be found. Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:37:12.989829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:13.004190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f06b26d5-4b29-42a5-8218-c9be24f88f55 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Image not found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:13.009971 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f06b26d5-4b29-42a5-8218-c9be24f88f55 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/images/8195948d-7560-43c1-bd2e-80459f91ca40" status: 404 len: 62 microversion: 2.1 time: 0.066185 Aug 24 03:37:13.020552 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 771/1532] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:37:12 2022] GET /compute/v2.1/images/8195948d-7560-43c1-bd2e-80459f91ca40 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:37:13.045448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.048142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.070019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.071496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.079763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.081898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.083620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.084673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.188102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:13.392869 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0dfc8368-ccf0-45f4-a317-cb5b79bfad0e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 204 len: 0 microversion: 2.1 time: 0.370094 Aug 24 03:37:13.397371 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 772/1533] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:13 2022] DELETE /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:13.404620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.405535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] [instance: dee682bd-78df-4d10-ab4e-f738f5db6e94] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.414630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.415141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.415599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.416575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.417046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.418176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.447022 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] HTTP exception thrown: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Request method failure captured: Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 HTTP/1.1 Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyka7TrkIds5u81EVQjpWCe7rYX_fUImEyBZKuA6T7DRddyauf_-VrZKQGYkvzWoGekblW2LhF-AbSbCn1TWr5U1XZUhfIm-k2i08v_6MgU_fWFM7gPSbPChRT47a-YKlE0STwmnjVnplYalW_PDmYwhmddk1CjVtW_XPiJFcs5faA Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cda00288f6124296932f66d9db18d82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cda00288f6124296932f66d9db18d82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cda00288f6124296932f66d9db18d82f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cda00288f6124296932f66d9db18d82f Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-845072675 Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 9fabeab6f0f74b19be18070258631a7d Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersAdminTestJSON-845072675-project Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'dee682bd-78df-4d10-ab4e-f738f5db6e94'} Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:13.450460 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] Returning 404 to user: Instance dee682bd-78df-4d10-ab4e-f738f5db6e94 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b20fa4ef-6b73-4002-88b7-3a7a3f92aa33 tempest-DeleteServersAdminTestJSON-845072675 tempest-DeleteServersAdminTestJSON-845072675-project] 10.222.0.58 "GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94" status: 404 len: 111 microversion: 2.1 time: 0.056853 Aug 24 03:37:13.455024 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 773/1534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/dee682bd-78df-4d10-ab4e-f738f5db6e94 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:13.465147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.465665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.477656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.478803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.487718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.488678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.490252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.491059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.587095 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a3ed130b-1aa2-4377-99d6-af9f879d50ae tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.847633 Aug 24 03:37:13.587601 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 762/1535] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:37:12 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:13.599826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.600488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.628991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.631566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.632105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.634814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.638001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.642130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.664052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:13.827457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:13.844281 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e10993f-2132-4cd4-9b14-f474cb7ef9cf tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1533 microversion: 2.1 time: 0.389869 Aug 24 03:37:13.850594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 774/1536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1533 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:13.873300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.874716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.892234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.893520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.896285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.897813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.898868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.899605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.066289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:14.076194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef3490c5-d859-4f86-9667-7874d3c3359f tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1715 microversion: 2.1 time: 0.487068 Aug 24 03:37:14.083521 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 763/1537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1715 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:14.100561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c73a5c29-ecda-4b18-9a23-a5da90df90c3 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f102acc9430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1674882925", "description": "tempest-description-1707672696"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:14.135177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:14.157923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:14.160911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:14.162626 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2f7b6dc-29c1-4015-9625-48fd3fefdc97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.309869 Aug 24 03:37:14.164295 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 775/1538] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:14.174646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:14.175590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:14.198815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.199343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.200934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.202944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.203806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.204248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.218254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:14.397645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:14.409204 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91619d83-f1fa-4d85-b066-7394cbdea543 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1272 microversion: 2.1 time: 0.241470 Aug 24 03:37:14.409204 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 776/1539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:14 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:14.872965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:14.874728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:14.891887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.896421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.898508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.900821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c73a5c29-ecda-4b18-9a23-a5da90df90c3 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.815032 Aug 24 03:37:14.901313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.903703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.904718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.909758 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 764/1540] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:37:14 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:14.920803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9798a475-a591-4a34-8c6b-6d1a58279248 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f102adbb040>, body: {"security_group_rule": {"parent_group_id": "3da55279-c56a-46d0-89a6-27c678b124c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b3400ecc-303d-4108-ba8a-35d1fc3293ab"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:15.319732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.341793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-965807c8-524d-4ba5-b048-119229265974 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1539 microversion: 2.1 time: 0.470437 Aug 24 03:37:15.344013 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 777/1541] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:14 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1539 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:15.379913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:15.385645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:15.404868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.407589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.408226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.408994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.409472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.409909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.633962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.643998 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-051464f4-19a2-4a69-9b99-960798ae8a4e tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1715 microversion: 2.1 time: 0.297067 Aug 24 03:37:15.644944 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 778/1542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:15 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1715 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:15.650694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:15.655765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:15.661918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.662446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.664648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.664648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.664999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.665215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.704840 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d00f4d99-da25-4574-be44-cb3a894abfe0 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058411 Aug 24 03:37:15.708213 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 779/1543] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:37:15 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:37:15.723059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:15.724096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:15.731962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.732654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.733481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.734312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.735128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.735655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.948965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.961528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.965373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:15.967344 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66ac1129-eed2-4d3a-9d72-b63725e9fa02 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.257526 Aug 24 03:37:15.968373 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 780/1544] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:15 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:15.974392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:15.975136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:15.988961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.989581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.990129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.991028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:15.991565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:15.992251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.194349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.217065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-09a328f3-8822-480f-b2ff-3a7ed7e2a2a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1314 microversion: 2.1 time: 0.245108 Aug 24 03:37:16.243879 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 781/1545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:15 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:16.271463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:16.275187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:16.305420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.306185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.310317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.311721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.318010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.318744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.445201 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b7c708f-937a-469a-8d11-dfeda903267a tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.199155 Aug 24 03:37:16.448695 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 782/1546] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:37:16 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:37:16.463146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:16.470361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:16.483006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.489306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.493081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.495586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.507951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.512288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.749268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.757476 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-06127b10-286b-4f29-9777-e66630826062 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1539 microversion: 2.1 time: 0.304608 Aug 24 03:37:16.758068 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 783/1547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:16 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1539 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:16.763165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:16.763756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:16.777615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.778127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.778567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.779483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.779999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.780429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.815003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:16.944342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3fe2bfe9-0054-4224-a65c-2dacba6f9553 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 204 len: 0 microversion: 2.1 time: 0.183844 Aug 24 03:37:16.945735 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 784/1548] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:16 2022] DELETE /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:16.953674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:16.955886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:16.964797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.965805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.966508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.967490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.968263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.968941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.201254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.208213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9798a475-a591-4a34-8c6b-6d1a58279248 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.296916 Aug 24 03:37:17.221850 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 765/1549] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:37:14 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:17.222079 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-22c2ad6a-7ea0-4fa4-b5a6-627345d9d662 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1715 microversion: 2.1 time: 0.265922 Aug 24 03:37:17.222079 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 785/1550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:16 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1715 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:17.222079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.222079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.234976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.235330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.243512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.245747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.246206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.247038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.250747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.251515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.269843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.273534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.273534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.279337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.280918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.284340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.451429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.465888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.470000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.472655 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-02e31c41-864c-43f5-85f0-d080a0abcdd9 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.255725 Aug 24 03:37:17.474228 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 786/1551] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:17.479930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-41cd26f9-0725-4e05-b613-8a4e37f66cdc tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f10230d9310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-938631974", "description": "tempest-description-214171551"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:17.716333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.752436 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41e1f126-7004-4a2f-be92-a27199166e4f tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1681 microversion: 2.1 time: 0.537133 Aug 24 03:37:17.756475 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 766/1552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1681 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:17.805724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.806392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.821122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.821916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.822527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.824933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.825689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.826387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.842258 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-41cd26f9-0725-4e05-b613-8a4e37f66cdc tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.366606 Aug 24 03:37:17.842877 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 787/1553] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:37:17 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:17.851956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.854449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.876698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.877121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.881029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.882477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.882964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.883408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.329518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.350344 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e214601-15e8-4562-ac32-de342d98bb49 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1539 microversion: 2.1 time: 0.505899 Aug 24 03:37:18.352957 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 788/1554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1539 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:18.366725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1ecd9af6-b3ad-434b-9fc9-0e69432ee236 req-95c52247-9c0f-4725-a47f-5084a6977e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ee8347-236a-43a0-ad11-418f9e4d1dcf", "tag": "24db3f3d-9a35-4ed5-b252-ebb51e44b12a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:18.401993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ecd9af6-b3ad-434b-9fc9-0e69432ee236 req-95c52247-9c0f-4725-a47f-5084a6977e69 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.406622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ecd9af6-b3ad-434b-9fc9-0e69432ee236 req-95c52247-9c0f-4725-a47f-5084a6977e69 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.407100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ecd9af6-b3ad-434b-9fc9-0e69432ee236 req-95c52247-9c0f-4725-a47f-5084a6977e69 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.439432 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1ecd9af6-b3ad-434b-9fc9-0e69432ee236 req-95c52247-9c0f-4725-a47f-5084a6977e69 service nova] Creating event network-changed:24db3f3d-9a35-4ed5-b252-ebb51e44b12a for instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf on n-h2-846470-15 Aug 24 03:37:18.454723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.461599 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1ecd9af6-b3ad-434b-9fc9-0e69432ee236 req-95c52247-9c0f-4725-a47f-5084a6977e69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104944 Aug 24 03:37:18.467388 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 789/1555] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:18.474471 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f39eb3a8-607a-4e6c-a01e-62079f6847fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1314 microversion: 2.1 time: 0.714948 Aug 24 03:37:18.484528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7a8a941-ae23-44e2-a135-2b6fa162df78 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f1022edd1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-293736744", "description": "tempest-description-442656425"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:18.484835 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 767/1556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:18.511582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.511582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.529153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.529153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.529153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.529153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.529153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.529153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.934587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.962685 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7a8a941-ae23-44e2-a135-2b6fa162df78 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.493800 Aug 24 03:37:18.965324 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0f71b45c-69dc-4cba-9f01-c9b974eed68b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1647 microversion: 2.1 time: 0.479891 Aug 24 03:37:18.966699 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 768/1557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1647 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:18.970097 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 790/1558] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:37:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:18.979032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.980161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.980909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.985056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.997429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.000833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.001440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.006901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.010097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.010922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.013581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.015296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.017349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.023952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.025782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.028145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.364718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.410595 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31d23c12-97bb-497a-9290-7656f0501a38 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1681 microversion: 2.1 time: 0.438900 Aug 24 03:37:19.428526 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 791/1559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1681 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:19.444022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3c75eb79-093c-4e66-8780-8ae4a58a052f tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f1022eddc10>, body: {"security_group_rule": {"parent_group_id": "96d50192-d4d2-4bf2-a0c1-788a5fe337d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "46ba7736-293c-4670-a3ff-1694f01dba8b"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:19.536337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.553099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.558029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.564952 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8f208f44-e4f3-448c-9d24-3ddaebd9aee5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.592844 Aug 24 03:37:19.565873 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 769/1560] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:19.573626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:19.574780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:19.606931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.608077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.609035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.610245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.612142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.614792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.971023 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3c75eb79-093c-4e66-8780-8ae4a58a052f tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.540074 Aug 24 03:37:19.972305 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 792/1561] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:37:19 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:20.029622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.058814 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c6a86ea8-b82c-403c-89e0-c16a0f772fc9 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1521 microversion: 2.1 time: 0.490707 Aug 24 03:37:20.060622 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 770/1562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:19 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:20.094013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.097072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.110447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.111905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.112806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.116709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.117954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.118883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.328696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc04d199-6109-4ecf-9ca6-097e671def06 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-324559264", "id": 764054008, "os-flavor-access:is_public": "False"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:20.342190 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:20.342190 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:20.410119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc04d199-6109-4ecf-9ca6-097e671def06 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.435567 Aug 24 03:37:20.411392 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 793/1563] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:37:19 2022] POST /compute/v2.1/flavors => generated 427 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:20.429448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ceb549d9-b29c-4e09-b425-63e724ad0b33 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f1023613280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.454633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:20.516453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.540653 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ba16721-0c69-4d2f-b14a-58bf446c27b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1314 microversion: 2.1 time: 0.451932 Aug 24 03:37:20.542331 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 771/1564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:20 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:20.559575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.562541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.581990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.582981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.583693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.584750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.585497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.586249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.642757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.644249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.646857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.648162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lazy-loading 'fault' on Instance uuid b32a2f37-3a7c-442f-8148-40aa5541cae8 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:20.764242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.782485 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-efa9238a-3bed-4c2d-acda-ff2a9038fb5c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1367 microversion: 2.1 time: 0.238322 Aug 24 03:37:20.784154 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 772/1565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:20 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:20.809722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.819057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.842707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.844371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.845600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.847334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.848778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.849933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.904384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ceb549d9-b29c-4e09-b425-63e724ad0b33 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/46ba7736-293c-4670-a3ff-1694f01dba8b" status: 202 len: 0 microversion: 2.1 time: 0.491197 Aug 24 03:37:20.905358 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 794/1566] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:37:20 2022] DELETE /compute/v2.1/os-security-groups/46ba7736-293c-4670-a3ff-1694f01dba8b => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:20.910839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:20.911191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b4b043ea-9f21-4bc8-a591-f2bf00535059 req-4433c42f-5f86-4e5b-8cb5-fb838b3f2fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5187bf32-b851-4395-acda-bba0943f99b3", "name": "network-vif-plugged", "status": "completed", "tag": "44e1352a-eb7d-4fbd-af15-185af6385e46"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:20.976580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b4b043ea-9f21-4bc8-a591-f2bf00535059 req-4433c42f-5f86-4e5b-8cb5-fb838b3f2fdc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.977273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b4b043ea-9f21-4bc8-a591-f2bf00535059 req-4433c42f-5f86-4e5b-8cb5-fb838b3f2fdc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.977723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b4b043ea-9f21-4bc8-a591-f2bf00535059 req-4433c42f-5f86-4e5b-8cb5-fb838b3f2fdc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.009656 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b4b043ea-9f21-4bc8-a591-f2bf00535059 req-4433c42f-5f86-4e5b-8cb5-fb838b3f2fdc service nova] Creating event network-vif-plugged:44e1352a-eb7d-4fbd-af15-185af6385e46 for instance 5187bf32-b851-4395-acda-bba0943f99b3 on n-h2-846470-15 Aug 24 03:37:21.031045 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b4b043ea-9f21-4bc8-a591-f2bf00535059 req-4433c42f-5f86-4e5b-8cb5-fb838b3f2fdc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124041 Aug 24 03:37:21.032039 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 795/1567] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:21.049131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2041e857-35ab-48ee-ad44-9650cccf0f94 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "038c223c132248de8847efcd5e06b773"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:21.053059 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:21.053059 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:21.103037 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3977c7d3-ba72-469c-99e9-1b93c591bd3a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 204 len: 0 microversion: 2.1 time: 0.316561 Aug 24 03:37:21.104104 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 773/1568] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:20 2022] DELETE /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:21.112332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.113588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.122631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.123502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.124210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.125199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.125873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.126523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.222708 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2041e857-35ab-48ee-ad44-9650cccf0f94 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/764054008/action" status: 200 len: 96 microversion: 2.1 time: 0.189188 Aug 24 03:37:21.233564 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 796/1569] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 24 03:37:21 2022] POST /compute/v2.1/flavors/764054008/action => generated 96 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:37:21.243539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.245414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.257210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.260707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.261820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.266011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.267286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.268350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.292377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:21.305276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.333575 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-17472abe-8d74-4508-bc62-43cd5ecebcbf tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1613 microversion: 2.1 time: 0.227647 Aug 24 03:37:21.337336 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 774/1570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1613 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:21.344244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0fb1b606-16bb-4f8f-b3ed-823c5320d814 req-6d077f5e-69d1-4d53-abba-b25b507b6abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b32a2f37-3a7c-442f-8148-40aa5541cae8", "name": "network-vif-deleted", "tag": "d018d629-f0a8-454b-9e96-e8d6d2dda40b"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:21.364035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0fb1b606-16bb-4f8f-b3ed-823c5320d814 req-6d077f5e-69d1-4d53-abba-b25b507b6abe service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.365001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0fb1b606-16bb-4f8f-b3ed-823c5320d814 req-6d077f5e-69d1-4d53-abba-b25b507b6abe service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.365902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0fb1b606-16bb-4f8f-b3ed-823c5320d814 req-6d077f5e-69d1-4d53-abba-b25b507b6abe service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.371330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:21.382744 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0fb1b606-16bb-4f8f-b3ed-823c5320d814 req-6d077f5e-69d1-4d53-abba-b25b507b6abe service nova] Creating event network-vif-deleted:d018d629-f0a8-454b-9e96-e8d6d2dda40b for instance b32a2f37-3a7c-442f-8148-40aa5541cae8 on n-h2-846470-15 Aug 24 03:37:21.390949 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0fb1b606-16bb-4f8f-b3ed-823c5320d814 req-6d077f5e-69d1-4d53-abba-b25b507b6abe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051956 Aug 24 03:37:21.392353 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 775/1571] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:21.400275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b9c36a0b-4747-4aa7-bdce-2c8784428722 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f102ad72790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.440138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:21.510647 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b9c36a0b-4747-4aa7-bdce-2c8784428722 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/96d50192-d4d2-4bf2-a0c1-788a5fe337d5" status: 200 len: 246 microversion: 2.1 time: 0.115494 Aug 24 03:37:21.511718 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 776/1572] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/os-security-groups/96d50192-d4d2-4bf2-a0c1-788a5fe337d5 => generated 246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:21.529233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.530263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.539418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.540020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.540733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.541522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.542524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.543168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.646756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.663139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.666603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.669184 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d558028-c359-48a2-b67e-7c740b6d17c8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.432751 Aug 24 03:37:21.671594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 797/1573] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:21.927394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c2c4c59e-25f1-416f-98d8-6209da2dca69 tempest-FlavorsAccessTestJSON-959684371 tempest-FlavorsAccessTestJSON-959684371-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.956489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c2c4c59e-25f1-416f-98d8-6209da2dca69 tempest-FlavorsAccessTestJSON-959684371 tempest-FlavorsAccessTestJSON-959684371-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.282379 Aug 24 03:37:21.958042 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 798/1574] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:21.963796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b223a33a-be22-47b2-aab6-9ff235bf6c2a tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f1023284b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1263584329", "description": "tempest-description-1946254407"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:21.970342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.986200 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d8a0d9e-ae56-487b-a209-fbf8c48ae2f6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1527 microversion: 2.1 time: 0.461508 Aug 24 03:37:21.987343 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 777/1575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1527 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.008247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.010300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.032440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.032898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.033376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.034183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.034668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.035111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.293871 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b223a33a-be22-47b2-aab6-9ff235bf6c2a tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.333807 Aug 24 03:37:22.295645 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 799/1576] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:37:21 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:22.308281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.311344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.324355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.326054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.327443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.329208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.330914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.332059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.377634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:22.401986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.404343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.405047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.405681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.406372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lazy-loading 'fault' on Instance uuid b32a2f37-3a7c-442f-8148-40aa5541cae8 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:22.412178 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0479d6a-e900-49d2-a78b-b2d1ceee0596 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1314 microversion: 2.1 time: 0.423600 Aug 24 03:37:22.414169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 778/1577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.419954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a8309107-a2b0-435f-bf04-375418ced25f tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "038c223c132248de8847efcd5e06b773"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:22.423032 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:22.423032 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:22.500333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f453b3b603436795dc0b2507c18079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4106f94adf184471b76f1f81694ff161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.514981 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-13faad3b-5bf7-4eff-aa04-e525079a761c tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 200 len: 1367 microversion: 2.1 time: 0.216786 Aug 24 03:37:22.517864 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 800/1578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.543242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a47ccaac-c96f-4755-9bae-b903eb51c04a tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f1023284310>, body: {"security_group_rule": {"parent_group_id": "2eeb195b-264b-4735-96f8-953939e60a68", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:22.569792 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a8309107-a2b0-435f-bf04-375418ced25f tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/764054008/action" status: 200 len: 21 microversion: 2.1 time: 0.154371 Aug 24 03:37:22.571591 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 779/1579] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 24 03:37:22 2022] POST /compute/v2.1/flavors/764054008/action => generated 21 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:37:22.578173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.579874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.590651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.591748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.592481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.594936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.596338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.598365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.733524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.738903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.739933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.741582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lazy-loading 'fault' on Instance uuid a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:22.811132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0391b542eb6463ca68946e4d76cb551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4ede14edb348d2a7285cad101c81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.819883 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-087afc93-7ab0-491e-aa81-b2383e262893 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 200 len: 1330 microversion: 2.1 time: 0.246905 Aug 24 03:37:22.820783 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 780/1580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 1330 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.826072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3685906b-a853-4616-945c-d68191badd18 tempest-FlavorsAccessTestJSON-959684371 tempest-FlavorsAccessTestJSON-959684371-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.852984 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3685906b-a853-4616-945c-d68191badd18 tempest-FlavorsAccessTestJSON-959684371 tempest-FlavorsAccessTestJSON-959684371-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030714 Aug 24 03:37:22.853974 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 781/1581] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.865621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.866691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.880030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.885056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.885641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.886503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.887058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.887513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.468362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.486296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.490297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.492261 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ead0842a-776b-4906-8d73-db2ac881ce15 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.636665 Aug 24 03:37:23.493300 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 782/1582] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:23.513388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-33ff9692-be64-4e94-b163-4d6daa6cb85e tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.514457 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:23.514457 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:23.552134 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-33ff9692-be64-4e94-b163-4d6daa6cb85e tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/764054008" status: 202 len: 0 microversion: 2.1 time: 0.056952 Aug 24 03:37:23.559338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 783/1583] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:37:23 2022] DELETE /compute/v2.1/flavors/764054008 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:23.577151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.578555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.605820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.612680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.613849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.615765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.620701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.622936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.632635 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a47ccaac-c96f-4755-9bae-b903eb51c04a tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.113252 Aug 24 03:37:23.634730 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 801/1584] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:37:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:23.649415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.651232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.663645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.664985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.665777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.667772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.668779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.669880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.682108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:24.087287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.113114 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-114acf3a-a732-4ce3-ba8b-5fa41d3d6272 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1314 microversion: 2.1 time: 0.475744 Aug 24 03:37:24.113754 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 802/1585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:24.128361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-df243072-9dbd-4f90-b307-dab02492b9de req-87b4383f-6a12-4814-816a-b2e37d64e742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6", "name": "network-vif-deleted", "tag": "38c92963-f8fb-45f3-a11d-91993bd60399"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:24.151975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-df243072-9dbd-4f90-b307-dab02492b9de req-87b4383f-6a12-4814-816a-b2e37d64e742 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.152486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-df243072-9dbd-4f90-b307-dab02492b9de req-87b4383f-6a12-4814-816a-b2e37d64e742 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.153767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-df243072-9dbd-4f90-b307-dab02492b9de req-87b4383f-6a12-4814-816a-b2e37d64e742 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.179396 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-df243072-9dbd-4f90-b307-dab02492b9de req-87b4383f-6a12-4814-816a-b2e37d64e742 service nova] Creating event network-vif-deleted:38c92963-f8fb-45f3-a11d-91993bd60399 for instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 on n-h1-846470-15 Aug 24 03:37:24.185754 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-df243072-9dbd-4f90-b307-dab02492b9de req-87b4383f-6a12-4814-816a-b2e37d64e742 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070701 Aug 24 03:37:24.186549 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 803/1586] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:24.194647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.195373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] [instance: b32a2f37-3a7c-442f-8148-40aa5541cae8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:24.215466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.216015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.216460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.218158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.218654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.219308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.231703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.236657 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] HTTP exception thrown: Instance b32a2f37-3a7c-442f-8148-40aa5541cae8 could not be found. Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Request method failure captured: Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 HTTP/1.1 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZx_i5We1lJnBmDrIO10IPVQuaZR8UsyPOHONkJiV8_R8pirFqDOBw79B1eawBMJuZ2aOryz0AOWPKfGlPbJ0PzdksWBf4vJLBNLrEP8MU8xLZ5n4KNsc_COkvC2YgubvhFNldbhLbj7clGJI2ro11abwtB8_QAaEnG2M-Gmyi0OV2Y Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 4106f94adf184471b76f1f81694ff161 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestManualDisk-1178959206 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4106f94adf184471b76f1f81694ff161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4106f94adf184471b76f1f81694ff161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4106f94adf184471b76f1f81694ff161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4106f94adf184471b76f1f81694ff161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestManualDisk-1178959206 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 4106f94adf184471b76f1f81694ff161 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestManualDisk-1178959206 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestManualDisk-1178959206-project Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 41f453b3b603436795dc0b2507c18079 Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestManualDisk-1178959206-project Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance b32a2f37-3a7c-442f-8148-40aa5541cae8 could not be found. Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'b32a2f37-3a7c-442f-8148-40aa5541cae8'} Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b32a2f37-3a7c-442f-8148-40aa5541cae8 could not be found. Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b32a2f37-3a7c-442f-8148-40aa5541cae8 could not be found. Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:24.238960 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.244883 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:24.244883 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:24.244883 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:24.244883 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:24.244883 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:24.244883 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b32a2f37-3a7c-442f-8148-40aa5541cae8 could not be found. Aug 24 03:37:24.244883 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.247064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Returning 404 to user: Instance b32a2f37-3a7c-442f-8148-40aa5541cae8 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:24.248471 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f69157d-cedb-4456-b056-a4c187beb5c7 tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8" status: 404 len: 111 microversion: 2.1 time: 0.060769 Aug 24 03:37:24.248623 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0cc3dd90-0830-422e-a395-6e001544c611 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1527 microversion: 2.1 time: 0.684486 Aug 24 03:37:24.250213 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 804/1587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/servers/b32a2f37-3a7c-442f-8148-40aa5541cae8 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:24.258630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-98b12c09-f987-49ea-8c40-32485048f976 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.269082 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 784/1588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1527 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:24.275185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5550ea5-c924-40ce-b948-0560c4b56d1f tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Action: 'create', calling method: .version_select at 0x7f102b2ed040>, body: {"security_group_rule": {"parent_group_id": "2eeb195b-264b-4735-96f8-953939e60a68", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:24.287498 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-98b12c09-f987-49ea-8c40-32485048f976 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035378 Aug 24 03:37:24.289396 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 805/1589] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:24.296602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.298219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:24.309382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.310749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.311893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.313316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.314770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.315842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.345307 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] HTTP exception thrown: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Request method failure captured: Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 HTTP/1.1 Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZv8p-n0ycYJ4c5Uc3ldTGFX55S-I1Onw3b1kIlv1x0jjnsFWRdVxloftzElhqxH8vwYUc8dzt52ea1UEYSbVN-dC1mJR6qL6KgIPXMj11N70xtZmQAHENGPmRFsC3isTyDRc5vilDUnX8TtiOqli8bEGsbdyqgV660kkA7r0xI7hmM Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2b4ede14edb348d2a7285cad101c81bf Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2b4ede14edb348d2a7285cad101c81bf Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachSCSIVolumeTestJSON-1941167970-project Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d0391b542eb6463ca68946e4d76cb551 Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1941167970-project Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6'} Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:24.347372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.353413 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:24.353413 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:24.353413 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:24.353413 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:24.353413 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:24.353413 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:24.353413 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:24.355982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Returning 404 to user: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:24.357288 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7350e94c-0a58-4768-8548-b24b95c180ef tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 404 len: 111 microversion: 2.1 time: 0.066354 Aug 24 03:37:24.362015 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 806/1590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:24.370007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b3739ec-b104-4ef7-a094-0403b4bc994b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] Calling method '.version_select at 0x7f10232df430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.399089 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b3739ec-b104-4ef7-a094-0403b4bc994b tempest-ServersTestManualDisk-1178959206 tempest-ServersTestManualDisk-1178959206-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237924055" status: 202 len: 0 microversion: 2.1 time: 0.035453 Aug 24 03:37:24.400082 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 807/1591] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:37:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237924055 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:24.408374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f631f81-63f1-493d-8a24-c67fdb71f893 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-900407483", "id": 1803760072, "os-flavor-access:is_public": "False"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:24.413506 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:24.413506 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:24.443549 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f631f81-63f1-493d-8a24-c67fdb71f893 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.041512 Aug 24 03:37:24.444792 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 808/1592] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:37:24 2022] POST /compute/v2.1/flavors => generated 430 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:24.453943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b817fce-dc23-4e6e-944e-e7bfddb815e6 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '.version_select at 0x7f102327db80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.501034 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b817fce-dc23-4e6e-944e-e7bfddb815e6 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-157812234" status: 202 len: 0 microversion: 2.1 time: 0.049307 Aug 24 03:37:24.508849 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 809/1593] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:37:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-157812234 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:24.522849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ea3661c6-b3d9-481e-87ea-0c15d65bc26f tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.524706 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:24.524706 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:24.561501 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ea3661c6-b3d9-481e-87ea-0c15d65bc26f tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1803760072/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.049823 Aug 24 03:37:24.563821 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 810/1594] 10.222.0.58 () {58 vars in 1209 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/flavors/1803760072/os-flavor-access => generated 21 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:37:24.575545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-dec31cb4-cdab-4acc-b227-6ae8d42e1e35 req-c5187af9-6826-4b03-a209-3fea6e2c0e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5187bf32-b851-4395-acda-bba0943f99b3", "name": "network-vif-unplugged", "status": "completed", "tag": "44e1352a-eb7d-4fbd-af15-185af6385e46"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:24.597775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dec31cb4-cdab-4acc-b227-6ae8d42e1e35 req-c5187af9-6826-4b03-a209-3fea6e2c0e7e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.599028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dec31cb4-cdab-4acc-b227-6ae8d42e1e35 req-c5187af9-6826-4b03-a209-3fea6e2c0e7e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.599763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dec31cb4-cdab-4acc-b227-6ae8d42e1e35 req-c5187af9-6826-4b03-a209-3fea6e2c0e7e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.619886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-dec31cb4-cdab-4acc-b227-6ae8d42e1e35 req-c5187af9-6826-4b03-a209-3fea6e2c0e7e service nova] Creating event network-vif-unplugged:44e1352a-eb7d-4fbd-af15-185af6385e46 for instance 5187bf32-b851-4395-acda-bba0943f99b3 on n-h2-846470-15 Aug 24 03:37:24.629046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-dec31cb4-cdab-4acc-b227-6ae8d42e1e35 req-c5187af9-6826-4b03-a209-3fea6e2c0e7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063042 Aug 24 03:37:24.630806 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 811/1595] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:24.640172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.642296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:24.649726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:24.660941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.661554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.662230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.663223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.664402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.664955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.107250 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d5550ea5-c924-40ce-b948-0560c4b56d1f tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.836148 Aug 24 03:37:25.108676 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 785/1596] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:37:24 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:25.132953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e87efaac-7467-4f88-98bb-493b3ad96a18 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.135197 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:25.135197 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:25.223160 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e87efaac-7467-4f88-98bb-493b3ad96a18 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1803760072" status: 202 len: 0 microversion: 2.1 time: 0.101109 Aug 24 03:37:25.226423 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 786/1597] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:37:25 2022] DELETE /compute/v2.1/flavors/1803760072 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:25.245043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8beac349-78e6-43b6-98bb-4ea5e7cd47dc tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f102b4c0af0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.278674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.288146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.291485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.293368 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4deef723-b049-4766-874b-db0effc24ca6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.659676 Aug 24 03:37:25.297710 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 812/1598] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:25.334532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.334532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:25.385467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.386520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.402862 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8beac349-78e6-43b6-98bb-4ea5e7cd47dc tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/2eeb195b-264b-4735-96f8-953939e60a68" status: 200 len: 665 microversion: 2.1 time: 0.173725 Aug 24 03:37:25.403219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.404247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.404644 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 787/1599] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/os-security-groups/2eeb195b-264b-4735-96f8-953939e60a68 => generated 665 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:25.404836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.405253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.426507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81e82264-49c4-423a-87cd-2aeae5280578 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.480384 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81e82264-49c4-423a-87cd-2aeae5280578 tempest-FlavorsAccessTestJSON-871149005 tempest-FlavorsAccessTestJSON-871149005-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073792 Aug 24 03:37:25.483078 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 788/1600] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:25.489907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.491257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:25.501591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.502824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.503687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.505986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.506737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.507463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.557098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.558936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.559648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.560377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lazy-loading 'fault' on Instance uuid 5187bf32-b851-4395-acda-bba0943f99b3 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:25.697196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.724609 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-99aee33e-989e-4c65-af6d-03d6866f389a tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 200 len: 1314 microversion: 2.1 time: 0.239280 Aug 24 03:37:25.725521 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 789/1601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:25.740836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b43c416-0100-4812-9b7a-807233002b5c tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f102b4c0790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.857845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.873331 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-689d2e52-0c5b-414c-bee9-ea43daa0b6d1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1314 microversion: 2.1 time: 0.572927 Aug 24 03:37:25.884648 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 813/1602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:26.201313 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b43c416-0100-4812-9b7a-807233002b5c tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/be1f695f-f556-41c2-8760-381c963df42d" status: 202 len: 0 microversion: 2.1 time: 0.470821 Aug 24 03:37:26.203245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 790/1603] 10.222.0.58 () {58 vars in 1287 bytes} [Wed Aug 24 03:37:25 2022] DELETE /compute/v2.1/os-security-group-rules/be1f695f-f556-41c2-8760-381c963df42d => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:26.221161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7c0e22e-fd77-4861-9c8e-a17b99aef98e tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f102311a670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.236641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fe3a9cca-8289-410f-8801-367c2873c5e1 req-1d15ba53-fe06-4ce5-83d8-6d043ac3b2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5187bf32-b851-4395-acda-bba0943f99b3", "name": "network-vif-deleted", "tag": "44e1352a-eb7d-4fbd-af15-185af6385e46"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:26.263231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe3a9cca-8289-410f-8801-367c2873c5e1 req-1d15ba53-fe06-4ce5-83d8-6d043ac3b2d5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.264440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe3a9cca-8289-410f-8801-367c2873c5e1 req-1d15ba53-fe06-4ce5-83d8-6d043ac3b2d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.265136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe3a9cca-8289-410f-8801-367c2873c5e1 req-1d15ba53-fe06-4ce5-83d8-6d043ac3b2d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.317156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fe3a9cca-8289-410f-8801-367c2873c5e1 req-1d15ba53-fe06-4ce5-83d8-6d043ac3b2d5 service nova] Creating event network-vif-deleted:44e1352a-eb7d-4fbd-af15-185af6385e46 for instance 5187bf32-b851-4395-acda-bba0943f99b3 on n-h2-846470-15 Aug 24 03:37:26.337441 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fe3a9cca-8289-410f-8801-367c2873c5e1 req-1d15ba53-fe06-4ce5-83d8-6d043ac3b2d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105290 Aug 24 03:37:26.340329 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 791/1604] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:26.361122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.363487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.378027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.379182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.380224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.381406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.382257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.383365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.869342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7c0e22e-fd77-4861-9c8e-a17b99aef98e tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/2eeb195b-264b-4735-96f8-953939e60a68" status: 202 len: 0 microversion: 2.1 time: 0.659874 Aug 24 03:37:26.872105 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 814/1605] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:37:26 2022] DELETE /compute/v2.1/os-security-groups/2eeb195b-264b-4735-96f8-953939e60a68 => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:26.882208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2f704f8e-51d8-4005-8acc-92eab4322ae2 req-c72c9170-0dff-40e5-ad80-816e59ea6e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ee8347-236a-43a0-ad11-418f9e4d1dcf", "name": "network-vif-plugged", "status": "completed", "tag": "24db3f3d-9a35-4ed5-b252-ebb51e44b12a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:26.907603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2f704f8e-51d8-4005-8acc-92eab4322ae2 req-c72c9170-0dff-40e5-ad80-816e59ea6e21 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.908371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2f704f8e-51d8-4005-8acc-92eab4322ae2 req-c72c9170-0dff-40e5-ad80-816e59ea6e21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.910520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2f704f8e-51d8-4005-8acc-92eab4322ae2 req-c72c9170-0dff-40e5-ad80-816e59ea6e21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.948722 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2f704f8e-51d8-4005-8acc-92eab4322ae2 req-c72c9170-0dff-40e5-ad80-816e59ea6e21 service nova] Creating event network-vif-plugged:24db3f3d-9a35-4ed5-b252-ebb51e44b12a for instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf on n-h2-846470-15 Aug 24 03:37:26.958554 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2f704f8e-51d8-4005-8acc-92eab4322ae2 req-c72c9170-0dff-40e5-ad80-816e59ea6e21 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083740 Aug 24 03:37:26.959612 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 815/1606] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:26.971289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.972976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.987509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.988133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.989086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.990833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.992334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.993185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.031130 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 HTTP/1.1 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5187bf32-b851-4395-acda-bba0943f99b3'} Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.038673 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:27.054107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcde14a2-5eef-4848-ad3b-667f0c0f7c79 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 404 len: 111 microversion: 2.1 time: 0.089380 Aug 24 03:37:27.056755 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 816/1607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:27.068067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da92824b-3640-415e-b38c-107a6ad7fbb0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f10230d9b80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.154390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-da92824b-3640-415e-b38c-107a6ad7fbb0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 46ba7736-293c-4670-a3ff-1694f01dba8b does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:37:27.155927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-da92824b-3640-415e-b38c-107a6ad7fbb0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Neutron security group 46ba7736-293c-4670-a3ff-1694f01dba8b not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 03:37:27.157521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-da92824b-3640-415e-b38c-107a6ad7fbb0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] HTTP exception thrown: Security group 46ba7736-293c-4670-a3ff-1694f01dba8b does not exist Aug 24 03:37:27.157521 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-c4e22acb-817c-4fc7-aa43-7ead358a0ad0'] Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da92824b-3640-415e-b38c-107a6ad7fbb0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Request method failure captured: Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-security-groups/46ba7736-293c-4670-a3ff-1694f01dba8b HTTP/1.1 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZzidQQGxyG3zx9VT-NhhSQJokxsWPQoPNOWAZp4CJvYLoTDcNbdryjYHMphqiesYGrzSgoAZvOXpl6oLqOJvwAd37xYG7pylMdbPVjjWeCwwDpESqNKnW-sTXLPXD6RnHHSmSJfh7TIf_GJ5s9peI5wDAL8G0df9C7d6DzUS2LiT9w Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 8dad36887b434f20a79e2d99c773b35c Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1827542862 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8dad36887b434f20a79e2d99c773b35c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8dad36887b434f20a79e2d99c773b35c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dad36887b434f20a79e2d99c773b35c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8dad36887b434f20a79e2d99c773b35c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1827542862 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 8dad36887b434f20a79e2d99c773b35c Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1827542862 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupRulesTestJSON-1827542862-project Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 7e2eab71d9054705aaf02528aeae12b0 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1827542862-project Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group 46ba7736-293c-4670-a3ff-1694f01dba8b does not exist Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-c4e22acb-817c-4fc7-aa43-7ead358a0ad0'] Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '46ba7736-293c-4670-a3ff-1694f01dba8b'} Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:37:27.171180 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 46ba7736-293c-4670-a3ff-1694f01dba8b does not exist Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4e22acb-817c-4fc7-aa43-7ead358a0ad0'] Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 46ba7736-293c-4670-a3ff-1694f01dba8b does not exist Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4e22acb-817c-4fc7-aa43-7ead358a0ad0'] Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 46ba7736-293c-4670-a3ff-1694f01dba8b does not exist Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4e22acb-817c-4fc7-aa43-7ead358a0ad0'] Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 46ba7736-293c-4670-a3ff-1694f01dba8b does not exist Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4e22acb-817c-4fc7-aa43-7ead358a0ad0'] Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da92824b-3640-415e-b38c-107a6ad7fbb0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Returning 404 to user: Security group 46ba7736-293c-4670-a3ff-1694f01dba8b does not exist Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-c4e22acb-817c-4fc7-aa43-7ead358a0ad0'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da92824b-3640-415e-b38c-107a6ad7fbb0 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/46ba7736-293c-4670-a3ff-1694f01dba8b" status: 404 len: 194 microversion: 2.1 time: 0.114474 Aug 24 03:37:27.176745 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 817/1608] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:37:27 2022] DELETE /compute/v2.1/os-security-groups/46ba7736-293c-4670-a3ff-1694f01dba8b => generated 194 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:27.180876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.181709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:27.193613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.194240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.194689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.195532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.196499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.197090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.448411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.464230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.467240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.469798 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3e64e708-0794-40d1-9fa8-23cc36978b97 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 1.126851 Aug 24 03:37:27.471581 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 792/1609] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:27.487940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-439a7255-bf9d-479e-9b49-e23d065bec24 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f102adaeee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.515965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.528086 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a483c30-a3ae-4c79-a063-fb51cef44f49 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1314 microversion: 2.1 time: 0.351481 Aug 24 03:37:27.529737 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 818/1610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:27 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:27.535126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1353855004", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:27.606371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] validate_networks() for [('e07f3288-7434-41be-a4ae-1a790904361f', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:37:28.208775 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-439a7255-bf9d-479e-9b49-e23d065bec24 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/96d50192-d4d2-4bf2-a0c1-788a5fe337d5" status: 202 len: 0 microversion: 2.1 time: 0.733560 Aug 24 03:37:28.216281 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 793/1611] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:37:27 2022] DELETE /compute/v2.1/os-security-groups/96d50192-d4d2-4bf2-a0c1-788a5fe337d5 => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:28.247443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad0e6328-7665-4112-b40b-5a09bce93056 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f102adae820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:28.337581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:37:28.338253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:37:28.339860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:37:28.340976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:37:28.342031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:37:28.363954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.364553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.365469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.366647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.367794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.368954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.408901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Getting quotas for project 6251e0afcbcd4be99a11a20e42e5eea5. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:37:28.421710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Getting quotas for user c3a7defb9bc748f684309d7a7674154b and project 6251e0afcbcd4be99a11a20e42e5eea5. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:37:28.452915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:37:28.457847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:37:28.576920 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-acb903f0-f15c-4c70-bd36-5e80ed9ed2c4 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.045524 Aug 24 03:37:28.578820 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 819/1612] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:37:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:37:28.595176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:28.596402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:28.615289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.616402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.617928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.620506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.621347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.629071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.025259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.056958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.061390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.064428 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70a520d8-1c94-4a9d-8124-0fb9dfe89359 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.482739 Aug 24 03:37:29.089740 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 820/1613] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:28 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:29.108453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.109631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.128496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.130406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.131109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.132480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.135166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.137154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.492463 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad0e6328-7665-4112-b40b-5a09bce93056 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b3400ecc-303d-4108-ba8a-35d1fc3293ab" status: 202 len: 0 microversion: 2.1 time: 1.268280 Aug 24 03:37:29.494378 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 794/1614] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:37:28 2022] DELETE /compute/v2.1/os-security-groups/b3400ecc-303d-4108-ba8a-35d1fc3293ab => generated 0 bytes in 1272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:29.516092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-634300cc-f20e-4206-b6b6-e897f4c36e36 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.517570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-634300cc-f20e-4206-b6b6-e897f4c36e36 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.670320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.691113 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-19d0d156-df5e-409e-a367-a785144f3a54 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1500 microversion: 2.1 time: 0.599379 Aug 24 03:37:29.693286 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 821/1615] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1500 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:29.704699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e421e519-ca69-4208-bbd4-8aa45b2ed351 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f10231ff1f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.745934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-634300cc-f20e-4206-b6b6-e897f4c36e36 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.775336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-634300cc-f20e-4206-b6b6-e897f4c36e36 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1225 microversion: 2.1 time: 0.272120 Aug 24 03:37:29.790522 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 795/1616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1225 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:29.831456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:29.849622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.853180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:29.886405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.887139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.892503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.898407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.901183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.907044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.999518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lazy-loading 'flavor' on Instance uuid 80ee8347-236a-43a0-ad11-418f9e4d1dcf {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:30.236863 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e421e519-ca69-4208-bbd4-8aa45b2ed351 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/3da55279-c56a-46d0-89a6-27c678b124c9" status: 202 len: 0 microversion: 2.1 time: 0.541216 Aug 24 03:37:30.239624 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 822/1617] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:37:29 2022] DELETE /compute/v2.1/os-security-groups/3da55279-c56a-46d0-89a6-27c678b124c9 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:30.265890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:30.270127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:30.343168 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b48d16b4-ed87-4084-bfeb-150bf01c4f5a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "POST /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf/action" status: 200 len: 32 microversion: 2.1 time: 0.538709 Aug 24 03:37:30.354980 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 796/1618] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:37:29 2022] POST /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf/action => generated 32 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:37:30.365452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.367233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.371367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.375069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e7138763-5f8d-4c72-808a-01b9a9526e23 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f102ad36670>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:30.376934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.377915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.380969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.721023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.742414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.747378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.749261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8e37af85-a9fb-417d-8e9f-9565ba06357b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.507143 Aug 24 03:37:30.750219 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 823/1619] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:30 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:30.773117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:30.774713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:30.805989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.807118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.810182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.813725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.814454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.816480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.210647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.221177 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-12592689-0128-4bf4-8a4a-cb4f073c8b4c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.465767 Aug 24 03:37:31.222151 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 824/1620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:30 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:31.227519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:31.228080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:31.234975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.235713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.236220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.237020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.237707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.238305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.333599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.349041 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e390522-69fc-41b9-898d-5e87dd0d099c tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1277 microversion: 2.1 time: 0.124744 Aug 24 03:37:31.350247 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 825/1621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:31 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:31.781146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:31.782079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:31.804070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.809654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.811524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.812939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.814245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.815526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.947594 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e7138763-5f8d-4c72-808a-01b9a9526e23 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d5cf2c6e-7c61-484a-98bd-8630959da437" status: 202 len: 0 microversion: 2.1 time: 1.580937 Aug 24 03:37:31.948410 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 797/1622] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:37:30 2022] DELETE /compute/v2.1/os-security-groups/d5cf2c6e-7c61-484a-98bd-8630959da437 => generated 0 bytes in 1593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:31.957475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d66069d1-38e9-479f-851a-7115f8e69638 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] Calling method '.version_select at 0x7f102acc9a60>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:32.210492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.225020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.230455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.238889 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d4475dd-dae0-4be3-aafd-1a38e21fdc56 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.459366 Aug 24 03:37:32.239627 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 826/1623] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:31 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:32.280802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:32.282015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:32.328721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.328968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.329307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.334533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.336406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.340664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.673135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.688782 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58fccdad-b93c-4906-b428-38cf01aa9674 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.429895 Aug 24 03:37:32.689501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 827/1624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:32 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:32.703022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:32.703703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:32.721957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.723079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.723734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.724794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.725446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.726137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.813476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.831007 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba64034e-b8c2-4782-8541-ee1ea9788e07 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1283 microversion: 2.1 time: 0.140466 Aug 24 03:37:32.832488 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 828/1625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:32 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1283 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:32.837942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c8fef461-1290-4aad-9a81-8a2517cb628b req-45cb85e2-9045-4e3e-84b8-1e05902b4354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d3df78-a022-4bff-a0bf-210e185c3b52", "name": "network-vif-unplugged", "status": "completed", "tag": "82f749ca-66d8-4fda-bf1a-42d024de909c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:32.853343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c8fef461-1290-4aad-9a81-8a2517cb628b req-45cb85e2-9045-4e3e-84b8-1e05902b4354 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.854251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c8fef461-1290-4aad-9a81-8a2517cb628b req-45cb85e2-9045-4e3e-84b8-1e05902b4354 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.855599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c8fef461-1290-4aad-9a81-8a2517cb628b req-45cb85e2-9045-4e3e-84b8-1e05902b4354 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.875490 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c8fef461-1290-4aad-9a81-8a2517cb628b req-45cb85e2-9045-4e3e-84b8-1e05902b4354 service nova] Creating event network-vif-unplugged:82f749ca-66d8-4fda-bf1a-42d024de909c for instance 43d3df78-a022-4bff-a0bf-210e185c3b52 on n-h1-846470-15 Aug 24 03:37:32.885709 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c8fef461-1290-4aad-9a81-8a2517cb628b req-45cb85e2-9045-4e3e-84b8-1e05902b4354 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051462 Aug 24 03:37:32.890014 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 829/1626] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:33.117669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23299184-43b0-4736-a64b-5b7fde86b73b tempest-FlavorMetadataValidation-1284524992 tempest-FlavorMetadataValidation-1284524992-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-509611134", "id": 453997116, "os-flavor-access:is_public": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:33.121219 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:33.121219 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:33.145367 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23299184-43b0-4736-a64b-5b7fde86b73b tempest-FlavorMetadataValidation-1284524992 tempest-FlavorMetadataValidation-1284524992-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.253974 Aug 24 03:37:33.145946 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 830/1627] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:37:32 2022] POST /compute/v2.1/flavors => generated 467 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:37:33.160967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-434fda02-5ab9-4774-97ad-e8f57b89b422 tempest-FlavorMetadataValidation-1284524992 tempest-FlavorMetadataValidation-1284524992-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:33.164123 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:33.164123 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:33.569695 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-434fda02-5ab9-4774-97ad-e8f57b89b422 tempest-FlavorMetadataValidation-1284524992 tempest-FlavorMetadataValidation-1284524992-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/453997116/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.413733 Aug 24 03:37:33.578593 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 831/1628] 10.222.0.58 () {62 vars in 1262 bytes} [Wed Aug 24 03:37:33 2022] POST /compute/v2.1/flavors/453997116/os-extra_specs => generated 62 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:33.587283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.588637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.604914 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d66069d1-38e9-479f-851a-7115f8e69638 tempest-SecurityGroupRulesTestJSON-1827542862 tempest-SecurityGroupRulesTestJSON-1827542862-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/2f2875fa-aa85-42d4-a0d8-ef70baeae61b" status: 202 len: 0 microversion: 2.1 time: 1.646631 Aug 24 03:37:33.610394 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 798/1629] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:37:31 2022] DELETE /compute/v2.1/os-security-groups/2f2875fa-aa85-42d4-a0d8-ef70baeae61b => generated 0 bytes in 1658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:37:33.615517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5fb5d250-aa3f-4af7-841b-5a471d035ac9 tempest-FlavorMetadataValidation-1284524992 tempest-FlavorMetadataValidation-1284524992-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.616376 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:33.616376 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:33.638424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.641359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.642206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.645994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.646741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.647235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.698155 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5fb5d250-aa3f-4af7-841b-5a471d035ac9 tempest-FlavorMetadataValidation-1284524992 tempest-FlavorMetadataValidation-1284524992-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/453997116" status: 202 len: 0 microversion: 2.86 time: 0.086251 Aug 24 03:37:33.705229 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 799/1630] 10.222.0.58 () {60 vars in 1199 bytes} [Wed Aug 24 03:37:33 2022] DELETE /compute/v2.1/flavors/453997116 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:33.715433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae4b9357-6c89-44d9-a1b3-9119799341ff tempest-FlavorMetadataValidation-1284524992 tempest-FlavorMetadataValidation-1284524992-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.800903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae4b9357-6c89-44d9-a1b3-9119799341ff tempest-FlavorMetadataValidation-1284524992 tempest-FlavorMetadataValidation-1284524992-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.094228 Aug 24 03:37:33.825866 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 800/1631] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:33.842943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.843736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.865091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.865091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.868680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.869692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.870878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.871350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.297753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.319406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.321930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.340288 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e937bc12-7f14-4a08-8559-b952fea06374 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.743525 Aug 24 03:37:34.341477 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 832/1632] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:34.347209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:34.360718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:34.379561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.380402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.381087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.382060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.382753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.383393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.389190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:34.781980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.795011 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-105d3df9-3fcf-4554-9a11-d43e62b3ea5e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.967549 Aug 24 03:37:34.796773 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 801/1633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:34.828398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:34.829412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:34.847017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.851611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.853298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.855797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.856430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.857807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.980411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:35.160500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.185672 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-40f48ec3-07c5-4b6d-bff8-ee58363b1389 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1325 microversion: 2.1 time: 0.841382 Aug 24 03:37:35.188425 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 833/1634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:34 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1325 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:35.213419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-39d52e97-1a20-4537-ad8f-a190bf60e87e req-b051bd5c-7dfd-40b2-8116-3c48590456c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d3df78-a022-4bff-a0bf-210e185c3b52", "tag": "82f749ca-66d8-4fda-bf1a-42d024de909c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:35.254386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39d52e97-1a20-4537-ad8f-a190bf60e87e req-b051bd5c-7dfd-40b2-8116-3c48590456c7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.254908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39d52e97-1a20-4537-ad8f-a190bf60e87e req-b051bd5c-7dfd-40b2-8116-3c48590456c7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.255357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39d52e97-1a20-4537-ad8f-a190bf60e87e req-b051bd5c-7dfd-40b2-8116-3c48590456c7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.294629 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3acc1520-9f54-482d-b465-ff96e951eb4e tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "DELETE /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 204 len: 0 microversion: 2.1 time: 0.484134 Aug 24 03:37:35.299589 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 802/1635] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:34 2022] DELETE /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:35.303209 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-39d52e97-1a20-4537-ad8f-a190bf60e87e req-b051bd5c-7dfd-40b2-8116-3c48590456c7 service nova] Creating event network-changed:82f749ca-66d8-4fda-bf1a-42d024de909c for instance 43d3df78-a022-4bff-a0bf-210e185c3b52 on n-h1-846470-15 Aug 24 03:37:35.330268 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-39d52e97-1a20-4537-ad8f-a190bf60e87e req-b051bd5c-7dfd-40b2-8116-3c48590456c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135150 Aug 24 03:37:35.332708 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 834/1636] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:35.335624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.338902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.359181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.361502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.364142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.364746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.365281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.366193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.366660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.376363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.387570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.390561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.393712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.396324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.397259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.401245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.414224 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] HTTP exception thrown: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Request method failure captured: Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 HTTP/1.1 Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZv8p-n0ycYJ4c5Uc3ldTGFX55S-I1Onw3b1kIlv1x0jjnsFWRdVxloftzElhqxH8vwYUc8dzt52ea1UEYSbVN-dC1mJR6qL6KgIPXMj11N70xtZmQAHENGPmRFsC3isTyDRc5vilDUnX8TtiOqli8bEGsbdyqgV660kkA7r0xI7hmM Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2b4ede14edb348d2a7285cad101c81bf Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2b4ede14edb348d2a7285cad101c81bf Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachSCSIVolumeTestJSON-1941167970-project Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d0391b542eb6463ca68946e4d76cb551 Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1941167970-project Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6'} Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:35.420209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Returning 404 to user: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:35.427364 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a37a411e-df4c-4c49-accc-7fd178711844 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 404 len: 111 microversion: 2.1 time: 0.110363 Aug 24 03:37:35.428750 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 803/1637] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:35 2022] DELETE /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:35.436911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.437575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.451469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.452011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.452458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.456619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.459798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.460391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.832071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.851577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.854152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.857816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-535cb0f3-e4b4-408a-9da0-574fd87a313f tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.428684 Aug 24 03:37:35.862328 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 804/1638] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:35.878318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-67b42e88-4973-4b99-b949-dd597ec7ce11 req-4485dfaf-0e0c-4167-ad03-5a6410513702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c02d2c-bd2d-4282-843b-43838a323857", "tag": "3c99e5c2-21c4-449b-b6c3-ce953264a751"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:35.901815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-67b42e88-4973-4b99-b949-dd597ec7ce11 req-4485dfaf-0e0c-4167-ad03-5a6410513702 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.908655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-67b42e88-4973-4b99-b949-dd597ec7ce11 req-4485dfaf-0e0c-4167-ad03-5a6410513702 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.909422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-67b42e88-4973-4b99-b949-dd597ec7ce11 req-4485dfaf-0e0c-4167-ad03-5a6410513702 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.937188 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-67b42e88-4973-4b99-b949-dd597ec7ce11 req-4485dfaf-0e0c-4167-ad03-5a6410513702 service nova] Creating event network-changed:3c99e5c2-21c4-449b-b6c3-ce953264a751 for instance 56c02d2c-bd2d-4282-843b-43838a323857 on n-h2-846470-15 Aug 24 03:37:35.963013 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-67b42e88-4973-4b99-b949-dd597ec7ce11 req-4485dfaf-0e0c-4167-ad03-5a6410513702 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084046 Aug 24 03:37:35.964839 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 805/1639] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:35.973525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.974628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] [instance: a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.982063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.982971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.983646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.984660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.985394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.986030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.005805 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] HTTP exception thrown: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Request method failure captured: Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 HTTP/1.1 Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZv8p-n0ycYJ4c5Uc3ldTGFX55S-I1Onw3b1kIlv1x0jjnsFWRdVxloftzElhqxH8vwYUc8dzt52ea1UEYSbVN-dC1mJR6qL6KgIPXMj11N70xtZmQAHENGPmRFsC3isTyDRc5vilDUnX8TtiOqli8bEGsbdyqgV660kkA7r0xI7hmM Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2b4ede14edb348d2a7285cad101c81bf Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b4ede14edb348d2a7285cad101c81bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2b4ede14edb348d2a7285cad101c81bf Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1941167970 Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachSCSIVolumeTestJSON-1941167970-project Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d0391b542eb6463ca68946e4d76cb551 Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1941167970-project Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6'} Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:36.008884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:36.014446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:36.014446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:36.014446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:36.014446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:36.014446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:36.014446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. Aug 24 03:37:36.014446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:36.018182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] Returning 404 to user: Instance a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:36.020299 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6942c945-06e3-4f1b-84f9-a6ae0f2fc577 tempest-AttachSCSIVolumeTestJSON-1941167970 tempest-AttachSCSIVolumeTestJSON-1941167970-project] 10.222.0.58 "GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6" status: 404 len: 111 microversion: 2.1 time: 0.053675 Aug 24 03:37:36.022296 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 806/1640] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/a9ea1a99-c14d-49d5-b0f3-3de6fb8da9e6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:36.031965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:36.033081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:36.058583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.059087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.072408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.073848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.074065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.076873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.850809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.867833 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-daf827ac-a3f9-4b71-a8ce-86788d643ccd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.843392 Aug 24 03:37:36.868751 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 807/1641] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:36 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:36.876514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:36.877532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:36.897015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.898233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.898852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.899816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.903035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.903812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.091472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.113866 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1881b152-0980-4f86-b3fc-3ca21c0bf94b tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1663 microversion: 2.1 time: 1.777820 Aug 24 03:37:37.115447 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 835/1642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1663 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:37.124145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.125565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.133322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.134613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.135951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.137868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.138892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.140227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.281805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.293169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c7252ac0-baac-4749-952c-3b22680b9f50 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1325 microversion: 2.1 time: 0.423138 Aug 24 03:37:37.293775 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 808/1643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:36 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:37.779536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.793153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.795268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.796877 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8ec390ef-1a8e-4eb0-9d64-4d0ebd18052b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.679617 Aug 24 03:37:37.797604 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 836/1644] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:37.892865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.894196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.902478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.903293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.903939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.904996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.905640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.906265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.142022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.143081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.152073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.152847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.153407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.154396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.154965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.155564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.387526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:38.439930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:38.649488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.663142 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf198299-da9e-4387-b620-9c02849ef5b6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.774188 Aug 24 03:37:38.664413 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 809/1645] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:38.679730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.694014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.708816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.709955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.712667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.714577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.717817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.720819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.963802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.989828 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6fb9f16f-18f4-4dd7-b535-7ed158a01c16 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1663 microversion: 2.1 time: 0.855390 Aug 24 03:37:38.991938 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 837/1646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1663 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:38.998879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:39.000057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:39.038473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.039189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.039996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.045571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.048203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.049701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.205450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.215490 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f4ba453-94c4-41de-b7a6-32fc4c7c0a37 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1325 microversion: 2.1 time: 0.543396 Aug 24 03:37:39.216460 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 810/1647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:39.685210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:39.686040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:39.694825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.696635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.699056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.700436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.701077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.701688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.756403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:39.760080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:39.934639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.963817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.972501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.985433 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c9a7ffd1-478a-41ee-9172-355d9feb4567 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.980806 Aug 24 03:37:39.987725 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 838/1648] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:40.029172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:40.032946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:40.042592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.048823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.049700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.050691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.051415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.052101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.192108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.216308 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2500d2d1-49f3-40f9-b17f-891ee74e57a6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.534960 Aug 24 03:37:40.219227 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 811/1649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:39 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:40.238939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:40.240077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:40.256732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.257657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.258365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.259331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.260449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.261571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.864699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.883414 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d9428ffd-ab50-4b9b-8775-c1bdb2b12cee tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1596 microversion: 2.1 time: 0.857630 Aug 24 03:37:40.886483 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 839/1650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:40 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1596 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:40.951076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.973748 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a475676b-b361-47e3-b198-350dd60fdfd6 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1325 microversion: 2.1 time: 0.737980 Aug 24 03:37:40.975288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 812/1651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:40 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1325 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:41.017884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.019314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.032090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.032654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.036600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.037677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.041185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.041709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.249688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.250496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.264112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.265285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.268308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.269436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.271765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.272704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.817031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.840449 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1bcb88ac-9405-4d9b-84fb-6bacbf616be4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.588824 Aug 24 03:37:41.841115 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 813/1652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:41.875021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.899295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.907930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.910349 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d3a17f80-7824-4c4e-b2da-5f00d318f8d1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.896891 Aug 24 03:37:41.913652 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 840/1653] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:41.918800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.919917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.953068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.954200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.954857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.957498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.959131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.963078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.001284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:42.002074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:42.047792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.053535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.056668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.065560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.067394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.069720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.332799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8941377734c788dd8411f46ee0b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3539cede59d0402f982520a408682e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.354477 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fe00afe7-9920-4727-ac88-70e9d22d951c tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 200 len: 1596 microversion: 2.1 time: 0.441384 Aug 24 03:37:42.355946 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 814/1654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 1596 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:42.361311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1685ea4e-80c4-491d-b150-a6ff2964bb38 req-3b0d4209-c2ab-49c8-921b-680c7c2b786e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60becdd0-8d76-430b-89c5-78ea632f808b", "name": "network-vif-deleted", "tag": "5e05419e-f6a4-4d09-a5f5-5f31009c3f1e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:42.400786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1685ea4e-80c4-491d-b150-a6ff2964bb38 req-3b0d4209-c2ab-49c8-921b-680c7c2b786e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.406747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1685ea4e-80c4-491d-b150-a6ff2964bb38 req-3b0d4209-c2ab-49c8-921b-680c7c2b786e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.408080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1685ea4e-80c4-491d-b150-a6ff2964bb38 req-3b0d4209-c2ab-49c8-921b-680c7c2b786e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.465432 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1685ea4e-80c4-491d-b150-a6ff2964bb38 req-3b0d4209-c2ab-49c8-921b-680c7c2b786e service nova] Creating event network-vif-deleted:5e05419e-f6a4-4d09-a5f5-5f31009c3f1e for instance 60becdd0-8d76-430b-89c5-78ea632f808b on n-h1-846470-15 Aug 24 03:37:42.497818 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1685ea4e-80c4-491d-b150-a6ff2964bb38 req-3b0d4209-c2ab-49c8-921b-680c7c2b786e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140244 Aug 24 03:37:42.498484 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 815/1655] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:42.869147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:42.870947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:42.886608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.887409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.889674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.892558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.893305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.893992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.136762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.153456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8a2831d8-e7a9-4173-8360-f7631217f4e0 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1325 microversion: 2.1 time: 1.158619 Aug 24 03:37:43.158360 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 841/1656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1325 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:43.181786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.183299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.193800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.195282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.195959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.197481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.199070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.199727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.592528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.614306 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.750077 Aug 24 03:37:43.635956 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 816/1657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:42 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:43.639835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.642413 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81a89d2e-11cf-4bfb-aeb9-b6c6b83ec038 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005116 Aug 24 03:37:43.643915 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 817/1658] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 03:37:43.658803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.662595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] [instance: 60becdd0-8d76-430b-89c5-78ea632f808b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.698958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.700338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.704203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.706635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.707981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.709316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.756200 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] HTTP exception thrown: Instance 60becdd0-8d76-430b-89c5-78ea632f808b could not be found. Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Request method failure captured: Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b HTTP/1.1 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZxqQGLe5r_iZKiwabVEWRBjapg2dRsTAMYkTAa62RaYK5MpweBqTvPYTBqISV6nloDakNu5eqw4hAur8hVDXYGFHdI4Tw57G-zoJGvC7BT376shu4UkmhZ8Yuci9xJNLtvYjC90MR_jX_LRzbxz-yMiSZeXNwRW4vhd06O2VM54DEI Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 3539cede59d0402f982520a408682e75 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestFqdnHostnames-765217232 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3539cede59d0402f982520a408682e75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3539cede59d0402f982520a408682e75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3539cede59d0402f982520a408682e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3539cede59d0402f982520a408682e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestFqdnHostnames-765217232 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 3539cede59d0402f982520a408682e75 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-765217232 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestFqdnHostnames-765217232-project Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 46f8941377734c788dd8411f46ee0b65 Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestFqdnHostnames-765217232-project Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 60becdd0-8d76-430b-89c5-78ea632f808b could not be found. Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '60becdd0-8d76-430b-89c5-78ea632f808b'} Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60becdd0-8d76-430b-89c5-78ea632f808b could not be found. Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60becdd0-8d76-430b-89c5-78ea632f808b could not be found. Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:43.758465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:43.763864 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:43.763864 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:43.763864 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:43.763864 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:43.763864 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:43.763864 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60becdd0-8d76-430b-89c5-78ea632f808b could not be found. Aug 24 03:37:43.763864 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:43.767423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Returning 404 to user: Instance 60becdd0-8d76-430b-89c5-78ea632f808b could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:43.768584 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74a61ee7-6d35-4bf9-8b45-b3b8f86ea051 tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b" status: 404 len: 111 microversion: 2.1 time: 0.123503 Aug 24 03:37:43.770300 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 818/1659] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/60becdd0-8d76-430b-89c5-78ea632f808b => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:43.779492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d1ce1e8c-b7a4-40f2-bc92-c871a901496d tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] Calling method '.version_select at 0x7f102af15ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.790856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.805170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.806662 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d1ce1e8c-b7a4-40f2-bc92-c871a901496d tempest-ServersTestFqdnHostnames-765217232 tempest-ServersTestFqdnHostnames-765217232-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-544542039" status: 202 len: 0 microversion: 2.1 time: 0.031926 Aug 24 03:37:43.807241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.808542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0aadbcf-a415-4e14-a57a-b62dbb82ad23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.647704 Aug 24 03:37:43.812642 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 819/1660] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:37:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-544542039 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:43.825532 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 842/1661] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:44.177487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.178600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.202633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.203641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.204531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.206004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.207135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.213542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.644339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.645610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.662198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.662677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.663317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.672019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.672916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.673523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.811904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.820688 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aa7015ea-19c1-465c-ac99-a9dc487cbe4b tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1325 microversion: 2.1 time: 0.649506 Aug 24 03:37:44.826808 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 820/1662] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1325 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:44.848075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.848706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.866377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.866875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.867305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.878270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.879526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.888949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.182702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.200785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.202925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.204551 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-168d0fe4-39c7-4392-9cbe-99998935edca tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.366516 Aug 24 03:37:45.205777 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 821/1663] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:45.490756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.501811 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6980da3-7a9b-4094-a4f1-09815f68c1c4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.864028 Aug 24 03:37:45.503586 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 843/1664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:45.852547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.854057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.862192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.863107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.863900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.865071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.865814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.866502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.235017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.236793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:46.253660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.255870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.256466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.257575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.258592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.259246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.513809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.535770 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-df6d3e91-f105-475a-9076-46a610588858 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1325 microversion: 2.1 time: 0.686283 Aug 24 03:37:46.536751 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 822/1665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1325 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:46.548801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.549507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:46.559293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.560905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.563097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.566686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.567503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.568336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.996063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.017815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.032419 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-325dea49-c608-46a0-a952-5d96e6bea3e4 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.490321 Aug 24 03:37:47.038247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.040685 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 823/1666] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:47.041670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.044582 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d67d080b-7cc9-47f0-98f7-8027eb99c537 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.816755 Aug 24 03:37:47.046362 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 844/1667] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:47.051009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e4b7fff4-1f18-4315-a902-1e5e80e5a7b3 req-619ee79e-5215-4997-9ed1-b9ae2ca6d135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c02d2c-bd2d-4282-843b-43838a323857", "name": "network-vif-plugged", "status": "completed", "tag": "3c99e5c2-21c4-449b-b6c3-ce953264a751"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:47.085840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e4b7fff4-1f18-4315-a902-1e5e80e5a7b3 req-619ee79e-5215-4997-9ed1-b9ae2ca6d135 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.086222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e4b7fff4-1f18-4315-a902-1e5e80e5a7b3 req-619ee79e-5215-4997-9ed1-b9ae2ca6d135 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.086867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e4b7fff4-1f18-4315-a902-1e5e80e5a7b3 req-619ee79e-5215-4997-9ed1-b9ae2ca6d135 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.103501 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e4b7fff4-1f18-4315-a902-1e5e80e5a7b3 req-619ee79e-5215-4997-9ed1-b9ae2ca6d135 service nova] Creating event network-vif-plugged:3c99e5c2-21c4-449b-b6c3-ce953264a751 for instance 56c02d2c-bd2d-4282-843b-43838a323857 on n-h2-846470-15 Aug 24 03:37:47.109666 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e4b7fff4-1f18-4315-a902-1e5e80e5a7b3 req-619ee79e-5215-4997-9ed1-b9ae2ca6d135 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065156 Aug 24 03:37:47.113422 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 824/1668] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:47.563691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.567140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.582254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.584347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.585640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.586877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.588366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.589443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.974769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.984117 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c3dcd54-e07d-4512-b54c-dab6f0e8b82e tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1325 microversion: 2.1 time: 0.425941 Aug 24 03:37:47.999200 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 845/1669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:47 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:48.086688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.087402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.096173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.104074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.152444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.154050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.155376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.155640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.156640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.156980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.157911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.158836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.162778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.163948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.164837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.165443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.571367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.586783 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d245a85c-4882-498d-a041-e5634e7ed648 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.514865 Aug 24 03:37:48.587783 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 825/1670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:48.641735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.662312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.664284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.665739 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c7807ae-9161-4546-bb6d-481b20949d3d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1487 microversion: 2.25 time: 0.590030 Aug 24 03:37:48.666613 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 846/1671] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1487 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:49.006947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.007824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.019031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.019031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.019528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.019975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.020428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.020913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.417459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.428063 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9dfe73c5-1bfb-4301-9c10-978671542a41 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1522 microversion: 2.1 time: 0.425075 Aug 24 03:37:49.436657 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 826/1672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:49.466988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.468016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.481567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.482439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.483819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.485111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.485846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.486829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.561830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:49.611894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.612798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.628618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.629454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.630088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.631149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.631899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.632745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.733929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-46169b7d-7409-44b4-927e-51c8fdbaa1ca tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 204 len: 0 microversion: 2.1 time: 0.271170 Aug 24 03:37:49.736452 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 847/1673] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:49 2022] DELETE /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:49.747274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.748299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.759403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.760723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.761631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.763004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.766196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.769385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.278695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:50.324116 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e7f2eaba-7dc5-497c-956b-6100d67ad66d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.705782 Aug 24 03:37:50.328022 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 827/1674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:50.345084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.346106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.360535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.366362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.366941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.369117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.371007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.372137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.157886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.165179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:51.186277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.188114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.195353 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8e56ec0f-8054-4307-a6e8-ecaebe2158a6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1477 microversion: 2.25 time: 1.447674 Aug 24 03:37:51.197396 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 848/1675] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1477 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:51.223729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-87a86ef2-946f-4c71-9364-d556da234c6d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '.version_select at 0x7f1023548670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:51.227888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a86ef2-946f-4c71-9364-d556da234c6d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.228584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a86ef2-946f-4c71-9364-d556da234c6d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.229056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a86ef2-946f-4c71-9364-d556da234c6d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.252119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-87a86ef2-946f-4c71-9364-d556da234c6d tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.032114 Aug 24 03:37:51.266805 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 849/1676] 10.222.0.58 () {60 vars in 1184 bytes} [Wed Aug 24 03:37:51 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:51.273227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:51.274223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:51.295077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:51.304996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.307177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.310810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.312298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.313346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.314130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.812248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.826546 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07e2d13a-9e21-4256-bb74-01c5aabe13ed tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1528 microversion: 2.1 time: 1.496220 Aug 24 03:37:51.843358 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 828/1677] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:50 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1528 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:51.849399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:51.850606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:51.864190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.864863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.865624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.867560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.868338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.870521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.989128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] Lazy-loading 'services' on Instance uuid 43d3df78-a022-4bff-a0bf-210e185c3b52 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:52.015880 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-150ef2b5-f440-468b-ba6f-cf5a20889662 tempest-LiveAutoBlockMigrationV225Test-219087620 tempest-LiveAutoBlockMigrationV225Test-219087620-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1972 microversion: 2.25 time: 0.742404 Aug 24 03:37:52.017374 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 850/1678] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:51 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1972 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:52.079023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.082843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:52.095446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.095971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.102605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.104011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.110298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.110914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.237821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:52.464807 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32eaa08d-a85e-4be9-b075-96a101097cfa tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 204 len: 0 microversion: 2.25 time: 0.393723 Aug 24 03:37:52.466918 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 851/1679] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:37:52 2022] DELETE /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:37:52.696734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9704105f-9feb-47ae-82ea-b602786463b4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Calling method '.version_select at 0x7f102327d790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.701391 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:52.701391 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:52.703186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9704105f-9feb-47ae-82ea-b602786463b4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.704969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9704105f-9feb-47ae-82ea-b602786463b4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.705984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9704105f-9feb-47ae-82ea-b602786463b4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.707580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9704105f-9feb-47ae-82ea-b602786463b4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.708346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9704105f-9feb-47ae-82ea-b602786463b4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.709008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9704105f-9feb-47ae-82ea-b602786463b4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.748341 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9704105f-9feb-47ae-82ea-b602786463b4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.279687 Aug 24 03:37:52.749292 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 852/1680] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:52.761033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.762419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:52.770143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.771604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.772508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.773446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.774419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.775703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.785941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.822986 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d9f5f897-a167-402f-9624-3c97c27576bd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.972089 Aug 24 03:37:52.835427 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 829/1681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:51 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:53.250028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-78f303c6-3d9b-4844-8fad-fbf4758d20ae tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Calling method '.version_select at 0x7f102ad08280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.254324 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:53.254324 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:53.255829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-78f303c6-3d9b-4844-8fad-fbf4758d20ae tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '5352e74c7c774640a977afe3518e288a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f4f305590742bc95c83b5086544e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-78f303c6-3d9b-4844-8fad-fbf4758d20ae tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Request method failure captured: Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0OQGo1Fo02J_v_pepBuirYWiQAONnpofp80OPlKZuEJpr_FJXQGj_FZ4AJp4JXQS3HS2nOmcTldDcgSPDMbz7Ho55I6jnU1uBa0Qc2HvssThg5t3OfC3c5D9UT_T8q5Hm8j6CWvbh94vwdzTusb-I-T8Kc8WtFUHiA-8qdRv6fLik Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5352e74c7c774640a977afe3518e288a Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: action_args: {} Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.276248 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.283198 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.283198 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.283198 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.283198 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:37:53.283198 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:37:53.283198 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 03:37:53.283198 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.285299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-78f303c6-3d9b-4844-8fad-fbf4758d20ae tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.286409 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-78f303c6-3d9b-4844-8fad-fbf4758d20ae tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.458407 Aug 24 03:37:53.287491 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 830/1682] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 461 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:53.301001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.302160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:53.315442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.316481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.317405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.318886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.319560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.321474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.428807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.461283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.468077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.473657 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-101cc836-4913-41d3-a22c-35ac44ca100b tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1483 microversion: 2.25 time: 0.720705 Aug 24 03:37:53.478125 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 853/1683] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1483 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:53.493556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8310add7-438c-4f6d-a7c7-e0bfb4d77be7 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Calling method '.version_select at 0x7f10232be550>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.494485 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:53.494485 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:53.495827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8310add7-438c-4f6d-a7c7-e0bfb4d77be7 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '5352e74c7c774640a977afe3518e288a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f4f305590742bc95c83b5086544e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8310add7-438c-4f6d-a7c7-e0bfb4d77be7 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Request method failure captured: Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hosts/n-d-846470-15/reboot HTTP/1.1 Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0OQGo1Fo02J_v_pepBuirYWiQAONnpofp80OPlKZuEJpr_FJXQGj_FZ4AJp4JXQS3HS2nOmcTldDcgSPDMbz7Ho55I6jnU1uBa0Qc2HvssThg5t3OfC3c5D9UT_T8q5Hm8j6CWvbh94vwdzTusb-I-T8Kc8WtFUHiA-8qdRv6fLik Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5352e74c7c774640a977afe3518e288a Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'n-d-846470-15'} Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.512582 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.518395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.518395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.518395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:37:53.518395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:37:53.518395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 03:37:53.518395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.518395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8310add7-438c-4f6d-a7c7-e0bfb4d77be7 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.518395 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8310add7-438c-4f6d-a7c7-e0bfb4d77be7 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-846470-15/reboot" status: 403 len: 111 microversion: 2.1 time: 0.032704 Aug 24 03:37:53.520013 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 854/1684] 10.222.0.58 () {58 vars in 1191 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/os-hosts/n-d-846470-15/reboot => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:53.533977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-3396ad2f-91f2-49b8-add2-266f98ea5791 req-03adf429-d950-4d16-ad9c-fd6bc7fbdec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c02d2c-bd2d-4282-843b-43838a323857", "name": "network-vif-deleted", "tag": "3c99e5c2-21c4-449b-b6c3-ce953264a751"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:53.553721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7defb9bc748f684309d7a7674154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6251e0afcbcd4be99a11a20e42e5eea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.566833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3396ad2f-91f2-49b8-add2-266f98ea5791 req-03adf429-d950-4d16-ad9c-fd6bc7fbdec7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.571256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3396ad2f-91f2-49b8-add2-266f98ea5791 req-03adf429-d950-4d16-ad9c-fd6bc7fbdec7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.573675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3396ad2f-91f2-49b8-add2-266f98ea5791 req-03adf429-d950-4d16-ad9c-fd6bc7fbdec7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.579832 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2be9d43b-ef57-417e-9ee2-2a45908673c3 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 200 len: 1486 microversion: 2.1 time: 0.289636 Aug 24 03:37:53.583768 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 831/1685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 1486 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:53.625047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-3396ad2f-91f2-49b8-add2-266f98ea5791 req-03adf429-d950-4d16-ad9c-fd6bc7fbdec7 service nova] Creating event network-vif-deleted:3c99e5c2-21c4-449b-b6c3-ce953264a751 for instance 56c02d2c-bd2d-4282-843b-43838a323857 on n-h2-846470-15 Aug 24 03:37:53.634135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be257e84-f15a-43c6-b69a-bed4afd36baf tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Calling method '.version_select at 0x7f102ad36280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.635827 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:53.635827 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:53.638936 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-3396ad2f-91f2-49b8-add2-266f98ea5791 req-03adf429-d950-4d16-ad9c-fd6bc7fbdec7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116165 Aug 24 03:37:53.639592 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 855/1686] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:53.661961 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-be257e84-f15a-43c6-b69a-bed4afd36baf tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be257e84-f15a-43c6-b69a-bed4afd36baf tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Request method failure captured: Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0Qk4vg4SgH9aqaGFZqRvCMa09DGjH78h4dhZcaV81gEE-A0zRl6_l1TjWxDSZ8raKDIvScNvHtEh-U5BgF2cfmWfg1OYVjpJbOpOMRyvQJJKjGKq3-dC1SQCfKX1kkYQxvl0aiAH5OcXdjAlxauzqOifll0BPGILuj8ymZehgjgSI Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1af304301da845868614e7321d5ad4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1af304301da845868614e7321d5ad4b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 751945f0d05f49ae9fc0de17818c7d97 Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'nonexistent_hostname'} Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.668442 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.674847 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.678617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be257e84-f15a-43c6-b69a-bed4afd36baf tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.694707 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be257e84-f15a-43c6-b69a-bed4afd36baf tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.094138 Aug 24 03:37:53.701791 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 832/1687] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:37:53.708070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1efb573-c3ae-4540-a944-2329148c1adf tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Calling method '.version_select at 0x7f1023438820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.709319 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:53.709319 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:53.710756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1efb573-c3ae-4540-a944-2329148c1adf tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '5352e74c7c774640a977afe3518e288a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f4f305590742bc95c83b5086544e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1efb573-c3ae-4540-a944-2329148c1adf tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Request method failure captured: Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hosts/n-d-846470-15 HTTP/1.1 Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0OQGo1Fo02J_v_pepBuirYWiQAONnpofp80OPlKZuEJpr_FJXQGj_FZ4AJp4JXQS3HS2nOmcTldDcgSPDMbz7Ho55I6jnU1uBa0Qc2HvssThg5t3OfC3c5D9UT_T8q5Hm8j6CWvbh94vwdzTusb-I-T8Kc8WtFUHiA-8qdRv6fLik Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5352e74c7c774640a977afe3518e288a Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'n-d-846470-15'} Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.713036 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1efb573-c3ae-4540-a944-2329148c1adf tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1efb573-c3ae-4540-a944-2329148c1adf tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-846470-15" status: 403 len: 109 microversion: 2.1 time: 0.012311 Aug 24 03:37:53.724545 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 856/1688] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/os-hosts/n-d-846470-15 => generated 109 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:37:53.732547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7bf5bb2-f099-43f1-872a-89c5269705a2 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Calling method '.version_select at 0x7f102ae070d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.733714 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:53.733714 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:53.742402 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-c7bf5bb2-f099-43f1-872a-89c5269705a2 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7bf5bb2-f099-43f1-872a-89c5269705a2 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Request method failure captured: Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0Qk4vg4SgH9aqaGFZqRvCMa09DGjH78h4dhZcaV81gEE-A0zRl6_l1TjWxDSZ8raKDIvScNvHtEh-U5BgF2cfmWfg1OYVjpJbOpOMRyvQJJKjGKq3-dC1SQCfKX1kkYQxvl0aiAH5OcXdjAlxauzqOifll0BPGILuj8ymZehgjgSI Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1af304301da845868614e7321d5ad4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1af304301da845868614e7321d5ad4b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 751945f0d05f49ae9fc0de17818c7d97 Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'nonexistent_hostname'} Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.750461 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.757511 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.757511 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.757511 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.757511 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:53.757511 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:53.757511 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.757511 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.761022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7bf5bb2-f099-43f1-872a-89c5269705a2 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.762281 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c7bf5bb2-f099-43f1-872a-89c5269705a2 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.034698 Aug 24 03:37:53.776271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec81ca74-cbfe-44b7-8a3e-7f94e8ee63e3 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Calling method '.version_select at 0x7f10232df0d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.777484 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:53.777484 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:37:53.779110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec81ca74-cbfe-44b7-8a3e-7f94e8ee63e3 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '5352e74c7c774640a977afe3518e288a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f4f305590742bc95c83b5086544e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.782147 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 833/1689] 10.222.0.58 () {58 vars in 1191 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec81ca74-cbfe-44b7-8a3e-7f94e8ee63e3 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Request method failure captured: Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-hosts/n-d-846470-15/shutdown HTTP/1.1 Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0OQGo1Fo02J_v_pepBuirYWiQAONnpofp80OPlKZuEJpr_FJXQGj_FZ4AJp4JXQS3HS2nOmcTldDcgSPDMbz7Ho55I6jnU1uBa0Qc2HvssThg5t3OfC3c5D9UT_T8q5Hm8j6CWvbh94vwdzTusb-I-T8Kc8WtFUHiA-8qdRv6fLik Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5352e74c7c774640a977afe3518e288a Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'n-d-846470-15'} Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.783229 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.788706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.788706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.788706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:37:53.788706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:37:53.788706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 03:37:53.788706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.789368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec81ca74-cbfe-44b7-8a3e-7f94e8ee63e3 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.790845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec81ca74-cbfe-44b7-8a3e-7f94e8ee63e3 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-846470-15/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.021296 Aug 24 03:37:53.790845 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 857/1690] 10.222.0.58 () {58 vars in 1197 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/os-hosts/n-d-846470-15/shutdown => generated 113 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:53.805046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f840c600-3581-4b40-b0c0-491de50e1fe9 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Calling method '.version_select at 0x7f102ae06dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.806282 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:53.806282 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:53.819482 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f840c600-3581-4b40-b0c0-491de50e1fe9 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f840c600-3581-4b40-b0c0-491de50e1fe9 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Request method failure captured: Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0Qk4vg4SgH9aqaGFZqRvCMa09DGjH78h4dhZcaV81gEE-A0zRl6_l1TjWxDSZ8raKDIvScNvHtEh-U5BgF2cfmWfg1OYVjpJbOpOMRyvQJJKjGKq3-dC1SQCfKX1kkYQxvl0aiAH5OcXdjAlxauzqOifll0BPGILuj8ymZehgjgSI Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1af304301da845868614e7321d5ad4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1af304301da845868614e7321d5ad4b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 751945f0d05f49ae9fc0de17818c7d97 Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'nonexistent_hostname'} Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.824129 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.829648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.833497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f840c600-3581-4b40-b0c0-491de50e1fe9 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.835691 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f840c600-3581-4b40-b0c0-491de50e1fe9 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.037379 Aug 24 03:37:53.843343 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 834/1691] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:37:53.851269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d7de17e1-490d-41d1-bfdd-05637534a135 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Calling method '.version_select at 0x7f102acc9ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.852986 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:53.852986 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:53.858085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d7de17e1-490d-41d1-bfdd-05637534a135 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '5352e74c7c774640a977afe3518e288a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f4f305590742bc95c83b5086544e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.859587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.860407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d7de17e1-490d-41d1-bfdd-05637534a135 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Request method failure captured: Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hosts/n-d-846470-15/startup HTTP/1.1 Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0OQGo1Fo02J_v_pepBuirYWiQAONnpofp80OPlKZuEJpr_FJXQGj_FZ4AJp4JXQS3HS2nOmcTldDcgSPDMbz7Ho55I6jnU1uBa0Qc2HvssThg5t3OfC3c5D9UT_T8q5Hm8j6CWvbh94vwdzTusb-I-T8Kc8WtFUHiA-8qdRv6fLik Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5352e74c7c774640a977afe3518e288a Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'n-d-846470-15'} Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.861382 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.868641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.868641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.868641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:37:53.868641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:37:53.868641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 03:37:53.868641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.870596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d7de17e1-490d-41d1-bfdd-05637534a135 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.872129 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d7de17e1-490d-41d1-bfdd-05637534a135 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-846470-15/startup" status: 403 len: 110 microversion: 2.1 time: 0.027067 Aug 24 03:37:53.878868 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 835/1692] 10.222.0.58 () {58 vars in 1194 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/os-hosts/n-d-846470-15/startup => generated 110 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:53.884199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.886016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dbdc7fb6-6b34-44d6-98c6-f074494cbc75 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Calling method '.version_select at 0x7f102ad08d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.890740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.891318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.892210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.897145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.898377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.901707 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-dbdc7fb6-6b34-44d6-98c6-f074494cbc75 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dbdc7fb6-6b34-44d6-98c6-f074494cbc75 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Request method failure captured: Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0Qk4vg4SgH9aqaGFZqRvCMa09DGjH78h4dhZcaV81gEE-A0zRl6_l1TjWxDSZ8raKDIvScNvHtEh-U5BgF2cfmWfg1OYVjpJbOpOMRyvQJJKjGKq3-dC1SQCfKX1kkYQxvl0aiAH5OcXdjAlxauzqOifll0BPGILuj8ymZehgjgSI Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1af304301da845868614e7321d5ad4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1af304301da845868614e7321d5ad4b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 751945f0d05f49ae9fc0de17818c7d97 Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'nonexistent_hostname'} Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.904468 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:53.911302 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.914558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dbdc7fb6-6b34-44d6-98c6-f074494cbc75 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.916741 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dbdc7fb6-6b34-44d6-98c6-f074494cbc75 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.034357 Aug 24 03:37:53.927985 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 836/1693] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:37:53.941537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-96e0813b-a798-4b94-8a17-2c96161ec984 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Action: 'update', calling method: .version_select at 0x7f102ad36040>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-96e0813b-a798-4b94-8a17-2c96161ec984 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Request method failure captured: Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/os-hosts/n-d-846470-15 HTTP/1.1 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 51 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0Qk4vg4SgH9aqaGFZqRvCMa09DGjH78h4dhZcaV81gEE-A0zRl6_l1TjWxDSZ8raKDIvScNvHtEh-U5BgF2cfmWfg1OYVjpJbOpOMRyvQJJKjGKq3-dC1SQCfKX1kkYQxvl0aiAH5OcXdjAlxauzqOifll0BPGILuj8ymZehgjgSI Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1af304301da845868614e7321d5ad4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1af304301da845868614e7321d5ad4b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 751945f0d05f49ae9fc0de17818c7d97 Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: {"status": "enable", "maintenance_mode": "invalid"} Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'n-d-846470-15', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance: Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:37:53.949957 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 03:37:53.956804 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:53.969819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-96e0813b-a798-4b94-8a17-2c96161ec984 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:53.970747 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-96e0813b-a798-4b94-8a17-2c96161ec984 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-846470-15" status: 400 len: 199 microversion: 2.1 time: 0.041622 Aug 24 03:37:53.973394 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 837/1694] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 03:37:53 2022] PUT /compute/v2.1/os-hosts/n-d-846470-15 => generated 199 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:37:53.996839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8099428-12af-4ffc-9ba4-c3d790f801d4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Action: 'update', calling method: .version_select at 0x7f102ae073a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8099428-12af-4ffc-9ba4-c3d790f801d4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Request method failure captured: Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/os-hosts/n-d-846470-15 HTTP/1.1 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 51 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0Qk4vg4SgH9aqaGFZqRvCMa09DGjH78h4dhZcaV81gEE-A0zRl6_l1TjWxDSZ8raKDIvScNvHtEh-U5BgF2cfmWfg1OYVjpJbOpOMRyvQJJKjGKq3-dC1SQCfKX1kkYQxvl0aiAH5OcXdjAlxauzqOifll0BPGILuj8ymZehgjgSI Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1af304301da845868614e7321d5ad4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1af304301da845868614e7321d5ad4b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 751945f0d05f49ae9fc0de17818c7d97 Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: {"status": "invalid", "maintenance_mode": "enable"} Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'n-d-846470-15', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance: Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:37:54.002050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 03:37:54.007799 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.012545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8099428-12af-4ffc-9ba4-c3d790f801d4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:54.017160 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8099428-12af-4ffc-9ba4-c3d790f801d4 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-846470-15" status: 400 len: 189 microversion: 2.1 time: 0.039486 Aug 24 03:37:54.018356 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 838/1695] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 03:37:53 2022] PUT /compute/v2.1/os-hosts/n-d-846470-15 => generated 189 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:37:54.040691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8fba4ff5-053c-4de3-a43c-b7282993c846 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Action: 'update', calling method: .version_select at 0x7f102b02a0d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:54.044615 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:37:54.044615 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:37:54.046214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8fba4ff5-053c-4de3-a43c-b7282993c846 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '5352e74c7c774640a977afe3518e288a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f4f305590742bc95c83b5086544e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8fba4ff5-053c-4de3-a43c-b7282993c846 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Request method failure captured: Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/os-hosts/n-d-846470-15 HTTP/1.1 Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 50 Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0OQGo1Fo02J_v_pepBuirYWiQAONnpofp80OPlKZuEJpr_FJXQGj_FZ4AJp4JXQS3HS2nOmcTldDcgSPDMbz7Ho55I6jnU1uBa0Qc2HvssThg5t3OfC3c5D9UT_T8q5Hm8j6CWvbh94vwdzTusb-I-T8Kc8WtFUHiA-8qdRv6fLik Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0f4f305590742bc95c83b5086544e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: e0f4f305590742bc95c83b5086544e5f Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956018521 Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5352e74c7c774640a977afe3518e288a Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956018521-project Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: {"status": "enable", "maintenance_mode": "enable"} Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'n-d-846470-15', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 03:37:54.048106 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 03:37:54.053257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.055041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8fba4ff5-053c-4de3-a43c-b7282993c846 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:54.058966 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8fba4ff5-053c-4de3-a43c-b7282993c846 tempest-HostsAdminNegativeTestJSON-1956018521 tempest-HostsAdminNegativeTestJSON-1956018521-project] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-846470-15" status: 403 len: 111 microversion: 2.1 time: 0.033698 Aug 24 03:37:54.064622 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 839/1696] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 03:37:54 2022] PUT /compute/v2.1/os-hosts/n-d-846470-15 => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:54.077629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e225d4c2-c99e-4a3b-9159-a3b4b49a69f7 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Action: 'update', calling method: .version_select at 0x7f102aec2b80>, body: {"status": null, "maintenance_mode": null} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e225d4c2-c99e-4a3b-9159-a3b4b49a69f7 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Request method failure captured: Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/os-hosts/n-d-846470-15 HTTP/1.1 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 42 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0Qk4vg4SgH9aqaGFZqRvCMa09DGjH78h4dhZcaV81gEE-A0zRl6_l1TjWxDSZ8raKDIvScNvHtEh-U5BgF2cfmWfg1OYVjpJbOpOMRyvQJJKjGKq3-dC1SQCfKX1kkYQxvl0aiAH5OcXdjAlxauzqOifll0BPGILuj8ymZehgjgSI Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1af304301da845868614e7321d5ad4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1af304301da845868614e7321d5ad4b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 751945f0d05f49ae9fc0de17818c7d97 Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: {"status": null, "maintenance_mode": null} Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'n-d-846470-15', 'body': {'status': None, 'maintenance_mode': None}} Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance: Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi None Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:37:54.082905 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e225d4c2-c99e-4a3b-9159-a3b4b49a69f7 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:54.090044 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e225d4c2-c99e-4a3b-9159-a3b4b49a69f7 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-846470-15" status: 400 len: 127 microversion: 2.1 time: 0.012350 Aug 24 03:37:54.100677 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 840/1697] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 24 03:37:54 2022] PUT /compute/v2.1/os-hosts/n-d-846470-15 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:37:54.108137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a026b81-1959-4400-bd17-54ad8d0cfc23 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Action: 'update', calling method: .version_select at 0x7f102b620670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:54.111542 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.hosts [None req-3a026b81-1959-4400-bd17-54ad8d0cfc23 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Enabling host nonexistent_hostname. Aug 24 03:37:54.133013 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3a026b81-1959-4400-bd17-54ad8d0cfc23 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a026b81-1959-4400-bd17-54ad8d0cfc23 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Request method failure captured: Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 50 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0Qk4vg4SgH9aqaGFZqRvCMa09DGjH78h4dhZcaV81gEE-A0zRl6_l1TjWxDSZ8raKDIvScNvHtEh-U5BgF2cfmWfg1OYVjpJbOpOMRyvQJJKjGKq3-dC1SQCfKX1kkYQxvl0aiAH5OcXdjAlxauzqOifll0BPGILuj8ymZehgjgSI Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1af304301da845868614e7321d5ad4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1af304301da845868614e7321d5ad4b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1af304301da845868614e7321d5ad4b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1af304301da845868614e7321d5ad4b9 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-792366468 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 751945f0d05f49ae9fc0de17818c7d97 Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-HostsAdminNegativeTestJSON-792366468-project-admin Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: {"status": "enable", "maintenance_mode": "enable"} Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:54.135803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a026b81-1959-4400-bd17-54ad8d0cfc23 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:54.140581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a026b81-1959-4400-bd17-54ad8d0cfc23 tempest-HostsAdminNegativeTestJSON-792366468 tempest-HostsAdminNegativeTestJSON-792366468-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035952 Aug 24 03:37:54.142435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 841/1698] 10.222.0.58 () {60 vars in 1211 bytes} [Wed Aug 24 03:37:54 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:37:54.505067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:54.505903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:54.516147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.518515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.518971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.519749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.520217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.524339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.117975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.131400 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab8d4ab3-3ebd-4893-a361-75d34807f5e3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 1.290505 Aug 24 03:37:55.134223 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 858/1699] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:55.152446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.203049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.205953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 56c02d2c-bd2d-4282-843b-43838a323857] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.215040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.227073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.234039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8343526-aaa5-40b1-889d-e81f1bab962a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1483 microversion: 2.25 time: 0.729268 Aug 24 03:37:55.235760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.237020 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 842/1700] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:54 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1483 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:55.237863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.239063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.240406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.244019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.244878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.288713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Instance 56c02d2c-bd2d-4282-843b-43838a323857 could not be found. Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 HTTP/1.1 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 56c02d2c-bd2d-4282-843b-43838a323857 could not be found. Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '56c02d2c-bd2d-4282-843b-43838a323857'} Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c02d2c-bd2d-4282-843b-43838a323857 could not be found. Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c02d2c-bd2d-4282-843b-43838a323857 could not be found. Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.294115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c02d2c-bd2d-4282-843b-43838a323857 could not be found. Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.299722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Instance 56c02d2c-bd2d-4282-843b-43838a323857 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:55.301081 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-abd3ce21-18fb-4d84-b76d-e3e45e71beab tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857" status: 404 len: 111 microversion: 2.1 time: 0.164672 Aug 24 03:37:55.302173 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 859/1701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/56c02d2c-bd2d-4282-843b-43838a323857 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:55.311118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5e0bc0d-528e-4d3f-96a1-c8c1861c3381 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '.version_select at 0x7f102b0f0430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.414984 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-c5e0bc0d-528e-4d3f-96a1-c8c1861c3381 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Image not found. Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5e0bc0d-528e-4d3f-96a1-c8c1861c3381 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/images/8195948d-7560-43c1-bd2e-80459f91ca40 HTTP/1.1 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '8195948d-7560-43c1-bd2e-80459f91ca40'} Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8195948d-7560-43c1-bd2e-80459f91ca40 to delete Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8195948d-7560-43c1-bd2e-80459f91ca40 could not be found. Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.417114 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:37:55.423792 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.428084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5e0bc0d-528e-4d3f-96a1-c8c1861c3381 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:55.430136 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5e0bc0d-528e-4d3f-96a1-c8c1861c3381 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/images/8195948d-7560-43c1-bd2e-80459f91ca40" status: 404 len: 62 microversion: 2.1 time: 0.123655 Aug 24 03:37:55.443535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 843/1702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] DELETE /compute/v2.1/images/8195948d-7560-43c1-bd2e-80459f91ca40 => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:37:55.452548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.453182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.468134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.470466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.471384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.475997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.483324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.483972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.537809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 HTTP/1.1 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5187bf32-b851-4395-acda-bba0943f99b3'} Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:55.540423 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.548749 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.550776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:55.551858 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe94f8e9-a1d4-47c3-92d5-bd38723e8e70 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 404 len: 111 microversion: 2.1 time: 0.103602 Aug 24 03:37:55.560101 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 860/1703] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:55 2022] DELETE /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:37:55.561588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.562340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: 5187bf32-b851-4395-acda-bba0943f99b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.572827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.575915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.577745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.578685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.581361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.581966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.596822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:55.610791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c8c24059-775b-4472-8721-d598dd437061 req-3fa3da24-4fa1-4fa1-aa94-a8b4f4957e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d3df78-a022-4bff-a0bf-210e185c3b52", "name": "network-vif-deleted", "tag": "82f749ca-66d8-4fda-bf1a-42d024de909c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:55.622187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 HTTP/1.1 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '5187bf32-b851-4395-acda-bba0943f99b3'} Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.625697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:55.632320 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.632320 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:55.632320 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:55.632320 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:55.632320 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:55.632320 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:55.632320 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. Aug 24 03:37:55.632320 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:37:55.633861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Instance 5187bf32-b851-4395-acda-bba0943f99b3 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:55.635743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c8c24059-775b-4472-8721-d598dd437061 req-3fa3da24-4fa1-4fa1-aa94-a8b4f4957e3c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.635743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c8c24059-775b-4472-8721-d598dd437061 req-3fa3da24-4fa1-4fa1-aa94-a8b4f4957e3c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.636193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c8c24059-775b-4472-8721-d598dd437061 req-3fa3da24-4fa1-4fa1-aa94-a8b4f4957e3c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.641905 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52ab7c52-d422-424f-9310-3a43777371d8 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3" status: 404 len: 111 microversion: 2.1 time: 0.085088 Aug 24 03:37:55.646357 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 844/1704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/5187bf32-b851-4395-acda-bba0943f99b3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:55.659602 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c8c24059-775b-4472-8721-d598dd437061 req-3fa3da24-4fa1-4fa1-aa94-a8b4f4957e3c service nova] Creating event network-vif-deleted:82f749ca-66d8-4fda-bf1a-42d024de909c for instance 43d3df78-a022-4bff-a0bf-210e185c3b52 on n-h2-846470-15 Aug 24 03:37:55.662841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af32bf0f-c0aa-4ba3-8176-39ad154de116 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '.version_select at 0x7f102afaa790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.684890 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c8c24059-775b-4472-8721-d598dd437061 req-3fa3da24-4fa1-4fa1-aa94-a8b4f4957e3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075874 Aug 24 03:37:55.685506 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 861/1705] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:37:55.703049 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af32bf0f-c0aa-4ba3-8176-39ad154de116 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158540608" status: 202 len: 0 microversion: 2.1 time: 0.055356 Aug 24 03:37:55.712849 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 845/1706] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158540608 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:37:56.155836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.157265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:56.182506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.184052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.185625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.188387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.188947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.190212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.274419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.275482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:56.289211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.290008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.290724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.295503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.296250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.296844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.210259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.236514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.246612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.248569 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a7d129b0-5a89-4cb5-a5a2-43db89eaf96d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1266 microversion: 2.25 time: 0.978805 Aug 24 03:37:57.252978 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 846/1707] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:56 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1266 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:57.548263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.559117 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ac7c68f-ea53-4813-a7f0-e9e56cc96e1a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 1.409437 Aug 24 03:37:57.559834 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 862/1708] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:56 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:58.276449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:58.278314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.289846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.299614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.303891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.305184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.307878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.311544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.601056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:58.606770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.638773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.641805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.642805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.649754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.660854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.677566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.911473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.963007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.966687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.991821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea806b0a-f748-4b1f-b529-9b4cf19620dd tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1266 microversion: 2.25 time: 0.720491 Aug 24 03:37:58.992916 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 847/1709] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:58 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1266 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:59.773165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:59.820929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c35a2bb9-cb4d-4a37-b349-86bc413a40db tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 1.234707 Aug 24 03:37:59.847152 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 863/1710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:58 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:00.092869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:00.096929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:00.124284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:00.126444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.129951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.130696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.137053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.137855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.138577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.455049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.467896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.469477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.470699 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5f3751d-493a-422e-a0a0-3c74298e25a8 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1266 microversion: 2.25 time: 0.438803 Aug 24 03:38:00.471299 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 848/1711] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:00 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1266 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:00.866405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:00.871485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:00.895578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.896435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.897244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.898598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.899329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.900209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.415777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-baa59948-3cb6-4922-85ce-33190de52067 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '.version_select at 0x7f102ae07b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.469810 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-baa59948-3cb6-4922-85ce-33190de52067 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Image not found. Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-baa59948-3cb6-4922-85ce-33190de52067 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/images/8a6f2fd3-6ec0-4f86-ada4-13a5e70c54aa HTTP/1.1 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '8a6f2fd3-6ec0-4f86-ada4-13a5e70c54aa'} Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8a6f2fd3-6ec0-4f86-ada4-13a5e70c54aa to delete Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a6f2fd3-6ec0-4f86-ada4-13a5e70c54aa could not be found. Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:01.471754 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:38:01.477206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.481483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-baa59948-3cb6-4922-85ce-33190de52067 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:01.482953 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-baa59948-3cb6-4922-85ce-33190de52067 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/images/8a6f2fd3-6ec0-4f86-ada4-13a5e70c54aa" status: 404 len: 62 microversion: 2.1 time: 0.072946 Aug 24 03:38:01.483641 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 849/1712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:01 2022] DELETE /compute/v2.1/images/8a6f2fd3-6ec0-4f86-ada4-13a5e70c54aa => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:38:01.492936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.493443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.510837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.512096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.512824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.513931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.514722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.516281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.548899 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 HTTP/1.1 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5'} Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:01.554738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.563829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.568846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:01.568846 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de5407ea-a79c-42c9-8ad8-25cef2ff2c52 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 404 len: 111 microversion: 2.1 time: 0.079564 Aug 24 03:38:01.580923 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 850/1713] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:01 2022] DELETE /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:38:01.620067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.624605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.644528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.645562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.647476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.650155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.650883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.651409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.711080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.729429 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5554f1ec-63a0-49d1-81de-d64c84cdb9e5 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1506 microversion: 2.1 time: 0.870347 Aug 24 03:38:01.747181 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 864/1714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:00 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1506 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:01.751221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.756022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] [instance: fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.785449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.790641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.794773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.798946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.801065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.801529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.853622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.859935 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] HTTP exception thrown: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Request method failure captured: Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 HTTP/1.1 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZyJrhzwpPcyLotRhkb0-i2dHG5EJwUZqb0CbZNf8tjSMbe39yvIVR1z0vDukRdXJ59M_z2y1GPy9C2KkhBDf863fhyw2MnlwlOsPivexiN-_pyEqq28Iqsw5UUSZTyq6sdI9_IRhOdZJU5Md1IUXrkGvX-zRjahbGGa0VibEHUTaeA Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6251e0afcbcd4be99a11a20e42e5eea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6251e0afcbcd4be99a11a20e42e5eea5 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119 Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c3a7defb9bc748f684309d7a7674154b Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1818779119-project Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5'} Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.865928 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] Returning 404 to user: Instance fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7c22f46a-f086-4e1c-8a77-e0a354227843 tempest-ImagesOneServerNegativeTestJSON-1818779119 tempest-ImagesOneServerNegativeTestJSON-1818779119-project] 10.222.0.58 "GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5" status: 404 len: 111 microversion: 2.1 time: 0.129403 Aug 24 03:38:01.871065 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 865/1715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:01 2022] GET /compute/v2.1/servers/fb12ac1e-bb71-484e-a0cc-c88ea9ad70f5 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:01.878980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.889352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.894517 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74df14e7-f120-4d1c-a312-ad49455a7b45 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1266 microversion: 2.25 time: 0.308914 Aug 24 03:38:01.895466 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 851/1716] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:01 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:02.764873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:02.790752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:02.796708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:02.841007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.844876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.846459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.851708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.854878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.858210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.920635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:02.921409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:02.937820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.938750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.939477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.940564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.941329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.942083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.100990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.125054 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd6b524b-3b4f-45ee-83bd-fd1c9a4412fa tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1486 microversion: 2.1 time: 0.363016 Aug 24 03:38:03.128048 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 866/1717] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:02 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1486 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:03.418860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.453455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.460749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.472000 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2137530-ff00-4c7e-ab92-01f51d90382d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1266 microversion: 2.25 time: 0.556477 Aug 24 03:38:03.480087 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 852/1718] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:02 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1266 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:03.498437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1314813521", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:03.707355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] validate_networks() for [('ad414080-b44a-4df0-b628-fd9835917f80', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:04.500493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:04.501251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:04.520887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.521647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.522291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.529612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.529612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.529612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.973916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.015012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.016776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.035249 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e0de27a7-74f4-4c68-b0a9-1c68c1fffc23 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1266 microversion: 2.25 time: 0.538817 Aug 24 03:38:05.040430 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 853/1719] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:04 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1266 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:38:05.046741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:38:05.048229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:38:05.048899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:38:05.050029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:38:05.052135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:38:05.081779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.082478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.082988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.083957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.089912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.090472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.216036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Getting quotas for project 04347edb8512486a8a8cf69229522348. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:05.240277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Getting quotas for user 31d9689ec7554610881c5683ca4ca405 and project 04347edb8512486a8a8cf69229522348. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:05.291103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:38:05.301103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:38:05.454047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e4b8786c-f306-4720-a0f4-9c6336f7e8c6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.993996 Aug 24 03:38:05.464326 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 867/1720] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:38:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:38:05.469104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e785350-ab8e-4298-a93b-3225082ebda7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:05.469728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7e785350-ab8e-4298-a93b-3225082ebda7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:06.090915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:06.094682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:06.141389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.144407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.146182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.148204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.148917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.149968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.250758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7e785350-ab8e-4298-a93b-3225082ebda7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.265543 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7e785350-ab8e-4298-a93b-3225082ebda7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1214 microversion: 2.1 time: 0.803037 Aug 24 03:38:06.286694 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 854/1721] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:05 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1214 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:06.499412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.518662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.524028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.531044 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c99d903-4b9e-42d8-9f81-7062a6fdf797 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 200 len: 1266 microversion: 2.25 time: 0.475425 Aug 24 03:38:06.532582 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 868/1722] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:06 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 1266 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:07.305543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:07.306253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:07.341008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.344255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.344370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.349048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.349556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.349992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.668373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:07.685073 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3bcf6ac0-cb75-477f-89ee-e2537db57c70 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1266 microversion: 2.1 time: 0.386647 Aug 24 03:38:07.685671 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 855/1723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:07 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:07.699913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:07.700879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 43d3df78-a022-4bff-a0bf-210e185c3b52] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:07.729725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.730262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.730700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.731604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.739423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.739624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.835353 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] HTTP exception thrown: Instance 43d3df78-a022-4bff-a0bf-210e185c3b52 could not be found. Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Request method failure captured: Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 HTTP/1.1 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs4tMynpw-ti1SNFeIDiBu0EjMWrzeKRtBhxeB79v9cLU31kL4beUm6KYcXuGXaeIg6qalK9WOzhc91So4W0RSHDdNURSOSYRYSRKdovk3F5aKtuVAG5Hp00O6K2sv--ip87pLqLy0fccsoLon0DxbxqPfQwXXzAEry4qkqiTej68Y Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: db10cc10bf304404a9f4a82534d3c6b5 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: db10cc10bf304404a9f4a82534d3c6b5 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-LiveAutoBlockMigrationV225Test-1283169469-project Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6d8976135cf9461e8a0eda1658abeec9 Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469-project Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 43d3df78-a022-4bff-a0bf-210e185c3b52 could not be found. Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '43d3df78-a022-4bff-a0bf-210e185c3b52'} Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d3df78-a022-4bff-a0bf-210e185c3b52 could not be found. Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d3df78-a022-4bff-a0bf-210e185c3b52 could not be found. Aug 24 03:38:07.844465 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d3df78-a022-4bff-a0bf-210e185c3b52 could not be found. Aug 24 03:38:07.852898 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:07.854008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Returning 404 to user: Instance 43d3df78-a022-4bff-a0bf-210e185c3b52 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:07.860500 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b42e7fcb-1ad7-48c7-9b41-7d2da58c8a0d tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52" status: 404 len: 111 microversion: 2.25 time: 0.167928 Aug 24 03:38:07.860500 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 856/1724] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:07 2022] GET /compute/v2.1/servers/43d3df78-a022-4bff-a0bf-210e185c3b52 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:38:08.317426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f10232be820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.318356 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:08.318356 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:38:08.319485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.320544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.320996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.390127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.396868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.401461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.446286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.454852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.456022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.477012 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-857f4a36-37e6-4e98-93b7-5564d8ac5bbb tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.159758 Aug 24 03:38:08.479164 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 869/1725] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:38:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:08.492200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f102aec2d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.493038 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:08.493038 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:38:08.494411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.494908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.495353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.531822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.532606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.533257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.552477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.553394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.554012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.575985 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f284cce1-8f50-463a-8f08-2937ce555872 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.088034 Aug 24 03:38:08.598808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f1023561b80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.600081 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:08.600081 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:38:08.601004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.601714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.602323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.608184 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 857/1726] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:08.639825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.640595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.641209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.655080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.655854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.656855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.682256 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9820685b-d002-45e3-b4e4-effc42287db1 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.087260 Aug 24 03:38:08.686452 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 870/1727] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:08.710898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.712183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:08.723762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.726364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8e73dcdc-dcba-428d-8f4a-9bc9a2c7553c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f102aec28b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.730111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.734885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.736388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.737429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.740955 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:08.740955 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:38:08.742334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.758553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e73dcdc-dcba-428d-8f4a-9bc9a2c7553c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.759814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e73dcdc-dcba-428d-8f4a-9bc9a2c7553c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.765999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e73dcdc-dcba-428d-8f4a-9bc9a2c7553c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.831369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e73dcdc-dcba-428d-8f4a-9bc9a2c7553c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.831928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e73dcdc-dcba-428d-8f4a-9bc9a2c7553c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.832381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e73dcdc-dcba-428d-8f4a-9bc9a2c7553c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.852698 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8e73dcdc-dcba-428d-8f4a-9bc9a2c7553c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.160337 Aug 24 03:38:08.858208 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 858/1728] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:08.872408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29b3e2cd-57af-4c5c-8b40-ce82d0b88968 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f102aec2b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.881820 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:08.881820 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:38:08.883458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29b3e2cd-57af-4c5c-8b40-ce82d0b88968 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.884296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29b3e2cd-57af-4c5c-8b40-ce82d0b88968 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.885095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29b3e2cd-57af-4c5c-8b40-ce82d0b88968 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.927054 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-29b3e2cd-57af-4c5c-8b40-ce82d0b88968 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.058811 Aug 24 03:38:08.928354 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 859/1729] 10.222.0.58 () {58 vars in 1179 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:08.940622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f102aec21f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.941749 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:08.941749 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:38:08.943236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.946778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.958810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.961206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:08.965732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:08.985500 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e796f72c-61a2-4fa8-9ee4-19136d7fa895 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1272 microversion: 2.1 time: 0.279654 Aug 24 03:38:08.987152 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 871/1730] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:08.987682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.988481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.989108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.020844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.021631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.030655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.048408 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a19571e9-ab2a-4f68-a16c-761283bfd75c tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.102469 Aug 24 03:38:09.049888 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 860/1731] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:09.060475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-216560ee-6ad2-4675-ad00-613c457e6b49 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f10231ce790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:09.061301 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:09.061301 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:38:09.062475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216560ee-6ad2-4675-ad00-613c457e6b49 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.062974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216560ee-6ad2-4675-ad00-613c457e6b49 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.063622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216560ee-6ad2-4675-ad00-613c457e6b49 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.134379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216560ee-6ad2-4675-ad00-613c457e6b49 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.149336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216560ee-6ad2-4675-ad00-613c457e6b49 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.150265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216560ee-6ad2-4675-ad00-613c457e6b49 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.164661 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-216560ee-6ad2-4675-ad00-613c457e6b49 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.107781 Aug 24 03:38:09.176031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 872/1732] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:38:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:09.180550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2d19646-aad2-4b1c-857b-91bb41867820 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f102aec2dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:09.181748 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:09.181748 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:38:09.183193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2d19646-aad2-4b1c-857b-91bb41867820 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.183801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2d19646-aad2-4b1c-857b-91bb41867820 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.184206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2d19646-aad2-4b1c-857b-91bb41867820 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.212240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2d19646-aad2-4b1c-857b-91bb41867820 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.212745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2d19646-aad2-4b1c-857b-91bb41867820 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.213184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2d19646-aad2-4b1c-857b-91bb41867820 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.230013 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2d19646-aad2-4b1c-857b-91bb41867820 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.053951 Aug 24 03:38:09.235150 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 861/1733] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:38:09 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:09.247892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Calling method '.version_select at 0x7f10235a10d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:09.248838 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:09.248838 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:38:09.251379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.252669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.253223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.303925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.308143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.314903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.349950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.351305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.352021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.375892 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-78260415-8b19-4252-8d50-c23c96ea9c01 tempest-HypervisorAdminTestJSON-846821327 tempest-HypervisorAdminTestJSON-846821327-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.132217 Aug 24 03:38:09.377253 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 873/1734] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 24 03:38:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:10.013823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:10.014727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:10.042631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.043044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.048170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.052765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.055198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.055952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.309654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:10.319148 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5e2552e-24d9-4655-b3f0-5b6e3c441af6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1272 microversion: 2.1 time: 0.310529 Aug 24 03:38:10.323262 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 862/1735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:10 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:11.350427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:11.354275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:11.407739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.410176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.412454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:11.413482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.419974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.421003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.546162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:12.561259 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92e0db4a-dc5c-4bd4-974d-8dd354c25a9d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 1.215796 Aug 24 03:38:12.562547 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 874/1736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:11 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:13.586389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:13.587997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:13.600381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:13.606598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:13.606598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:13.606598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:13.606598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:13.606598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.975908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:15.005312 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0b2d4a7-c520-42ba-a2d1-1f510a70d465 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 1.423207 Aug 24 03:38:15.008887 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 863/1737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:13 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:15.982225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:15.982854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:16.000326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:16.031530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:16.033066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:16.038449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:16.047967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.048557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.049008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:16.054355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.054985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.055450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:16.055851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.056509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.062335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:16.067338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.070696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.072426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:16.149672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:16.262295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:16.383470 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20b8d33e-ade6-4f34-b92a-1761222fa423 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 204 len: 0 microversion: 2.25 time: 0.407037 Aug 24 03:38:16.384727 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 875/1738] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:38:15 2022] DELETE /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:38:16.394969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:16.396134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:16.405190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.406591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.407245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:16.408497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.409331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.410089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:17.844595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:17.864197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:17.865850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:17.867184 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-62981aee-b322-4049-ba01-7e568d95e58e tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1731 microversion: 2.25 time: 1.477499 Aug 24 03:38:17.876821 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 876/1739] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:16 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1731 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:18.146792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:18.160125 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6cdf6395-42ec-466f-aeea-e4b2b69893e7 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 2.133118 Aug 24 03:38:18.160737 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 864/1740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:16 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:18.579484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70917041-d5ac-4a83-a802-ba8fcc2cbdaa tempest-InstanceUsageAuditLogNegativeTestJSON-741119724 tempest-InstanceUsageAuditLogNegativeTestJSON-741119724-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:18.580373 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:18.580373 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:38:18.581221 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-70917041-d5ac-4a83-a802-ba8fcc2cbdaa tempest-InstanceUsageAuditLogNegativeTestJSON-741119724 tempest-InstanceUsageAuditLogNegativeTestJSON-741119724-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70917041-d5ac-4a83-a802-ba8fcc2cbdaa tempest-InstanceUsageAuditLogNegativeTestJSON-741119724 tempest-InstanceUsageAuditLogNegativeTestJSON-741119724-project-admin] Request method failure captured: Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0pKZ4_cdk49XP4_UCZWvJvWW_OUYm4uacQPcm-2O-e6jOitOomcKuBtkdy5Ix-iLKIAgf8FuOigXtOfIFYWEyk_kQULszQOUHSg9g8D-xzSsazWoUgZu-Ay5_ZvTiBMNIEp6zZBAIAj-CPGPRsHnS52emFrIVdxDsq7tEiT-D-Ghg Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 83104eff55be4aaeaefbf0b160e14cbd Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-741119724 Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_83104eff55be4aaeaefbf0b160e14cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/83104eff55be4aaeaefbf0b160e14cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/83104eff55be4aaeaefbf0b160e14cbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/83104eff55be4aaeaefbf0b160e14cbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-741119724 Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 83104eff55be4aaeaefbf0b160e14cbd Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-741119724 Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-741119724-project-admin Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5be72d848d51464187ae104935cc7803 Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-741119724-project-admin Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid timestamp for date invalid_time Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'invalid_time'} Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:18.597334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:18.603809 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 24 03:38:18.603809 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.608239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70917041-d5ac-4a83-a802-ba8fcc2cbdaa tempest-InstanceUsageAuditLogNegativeTestJSON-741119724 tempest-InstanceUsageAuditLogNegativeTestJSON-741119724-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:18.610706 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70917041-d5ac-4a83-a802-ba8fcc2cbdaa tempest-InstanceUsageAuditLogNegativeTestJSON-741119724 tempest-InstanceUsageAuditLogNegativeTestJSON-741119724-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.292444 Aug 24 03:38:18.611991 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 877/1741] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 03:38:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 296 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:18.864291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1bcab312-828e-4a8d-95fd-9ccafa3ca7c9 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:18.865452 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:38:18.865452 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:38:18.866906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1bcab312-828e-4a8d-95fd-9ccafa3ca7c9 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5a9641d750024a99881532c6ec5b182a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b3ad67006247d4a3e80cbf1d358ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1bcab312-828e-4a8d-95fd-9ccafa3ca7c9 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] Request method failure captured: Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0oan3N4LK3hY6IHTUE7PissVLU8OAStI-mwSWgyud2n-u6BJgx-TxThUhjRTWEU1Kbj3U3njH6dZf6JUG0LuJ98_tbdIN_rrPOxrBDWRXNv4o9Go1l7L1HY_YSlmpvN7ZDqkpoMmJszDdva4grmgQNsItoDaZYJgT30bXG3q9WGQs Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 79b3ad67006247d4a3e80cbf1d358ea2 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79b3ad67006247d4a3e80cbf1d358ea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79b3ad67006247d4a3e80cbf1d358ea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79b3ad67006247d4a3e80cbf1d358ea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79b3ad67006247d4a3e80cbf1d358ea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 79b3ad67006247d4a3e80cbf1d358ea2 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5a9641d750024a99881532c6ec5b182a Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: action_args: {} Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.870003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:18.874560 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:18.874560 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:18.874560 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:38:18.874560 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:38:18.874560 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 03:38:18.874560 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.877520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1bcab312-828e-4a8d-95fd-9ccafa3ca7c9 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:18.879365 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1bcab312-828e-4a8d-95fd-9ccafa3ca7c9 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.257650 Aug 24 03:38:18.880206 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 865/1742] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 24 03:38:18 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:18.894378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e281506-d25c-4f52-8e11-cfb6d77edf47 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:18.897512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e281506-d25c-4f52-8e11-cfb6d77edf47 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5a9641d750024a99881532c6ec5b182a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b3ad67006247d4a3e80cbf1d358ea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e281506-d25c-4f52-8e11-cfb6d77edf47 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] Request method failure captured: Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2003:38:18 HTTP/1.1 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0oan3N4LK3hY6IHTUE7PissVLU8OAStI-mwSWgyud2n-u6BJgx-TxThUhjRTWEU1Kbj3U3njH6dZf6JUG0LuJ98_tbdIN_rrPOxrBDWRXNv4o9Go1l7L1HY_YSlmpvN7ZDqkpoMmJszDdva4grmgQNsItoDaZYJgT30bXG3q9WGQs Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 79b3ad67006247d4a3e80cbf1d358ea2 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79b3ad67006247d4a3e80cbf1d358ea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79b3ad67006247d4a3e80cbf1d358ea2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79b3ad67006247d4a3e80cbf1d358ea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79b3ad67006247d4a3e80cbf1d358ea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 79b3ad67006247d4a3e80cbf1d358ea2 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5a9641d750024a99881532c6ec5b182a Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '2022-08-24 03:38:18'} Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.904038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:18.911029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:18.911029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:18.911029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 03:38:18.911029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 03:38:18.911029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 03:38:18.911029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:18.914097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e281506-d25c-4f52-8e11-cfb6d77edf47 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:18.923517 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8e281506-d25c-4f52-8e11-cfb6d77edf47 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667 tempest-InstanceUsageAuditLogNegativeTestJSON-1467796667-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24 03:38:18" status: 403 len: 128 microversion: 2.1 time: 0.036742 Aug 24 03:38:18.932126 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 878/1743] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:38:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2003%3A38%3A18 => generated 128 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:18.934745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:18.935721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:18.946709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:18.947973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:18.948942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:18.950692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:18.951652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:18.952471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.112335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1e71c344-5c0f-4567-92ae-18ba46438481 req-c42690da-2fed-4adf-8317-1083d10cac21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a88c6df-91cd-486d-aae0-9be3bf679962", "tag": "3839be9d-1381-43cc-a476-105a79d25947"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:19.140234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e71c344-5c0f-4567-92ae-18ba46438481 req-c42690da-2fed-4adf-8317-1083d10cac21 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.141667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e71c344-5c0f-4567-92ae-18ba46438481 req-c42690da-2fed-4adf-8317-1083d10cac21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.144668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e71c344-5c0f-4567-92ae-18ba46438481 req-c42690da-2fed-4adf-8317-1083d10cac21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.178556 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1e71c344-5c0f-4567-92ae-18ba46438481 req-c42690da-2fed-4adf-8317-1083d10cac21 service nova] Creating event network-changed:3839be9d-1381-43cc-a476-105a79d25947 for instance 6a88c6df-91cd-486d-aae0-9be3bf679962 on n-h1-846470-15 Aug 24 03:38:19.201785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1e71c344-5c0f-4567-92ae-18ba46438481 req-c42690da-2fed-4adf-8317-1083d10cac21 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096665 Aug 24 03:38:19.204513 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 879/1744] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:19.224196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:19.229316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:19.250373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.251133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.251879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.252768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.253449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.254225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.824340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:19.840817 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db698abd-259c-4fe9-a162-bf8382d5734d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 0.632159 Aug 24 03:38:19.841860 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 880/1745] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:19 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:19.898618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:19.917917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:19.920437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:19.922516 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a55dbbe-f8be-4818-ab07-5dfa457cfcde tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1731 microversion: 2.25 time: 1.020035 Aug 24 03:38:19.930435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 866/1746] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:18 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1731 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:20.867970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:20.869772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:20.902361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:20.902962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:20.903452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:20.904333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:20.929460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:20.929924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:20.956316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:20.957847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:20.969729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:20.970988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:20.975379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:20.976446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:20.977096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:20.978124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.435312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:21.447371 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e495cff5-17b4-4eea-8ecd-b2a846788aed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 0.586534 Aug 24 03:38:21.448381 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 881/1747] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:20 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:21.621696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6628e577-cef7-4fcb-a19f-7dbb4ca7e686 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Calling method '.version_select at 0x7f10342c94c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:21.671262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-6628e577-cef7-4fcb-a19f-7dbb4ca7e686 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:38:21.672161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-6628e577-cef7-4fcb-a19f-7dbb4ca7e686 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Neutron security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 03:38:21.672999 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6628e577-cef7-4fcb-a19f-7dbb4ca7e686 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] HTTP exception thrown: Security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 does not exist Aug 24 03:38:21.672999 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-352da607-81f7-49f3-8e53-51220ba1ee1c'] Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6628e577-cef7-4fcb-a19f-7dbb4ca7e686 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Request method failure captured: Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-security-groups/f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 HTTP/1.1 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0s8KdHpWKV4sOnS4LuDbQla6wfM1MU10VokmWWH9m0RWVv8KC9GkXNNH9HYjhO4-Ls1eFhuyxJ2hl6CF58MSd6seF7INPzF1Eu--yBRsrrsOFrlONbcyidX2mKeJ-zVPoJPxfgXjDmmfBqqR2YCJWZ33fSFwP2dLvj2XvO2uq9QY4 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: dd660377368b4c949160e85fef17a3bf Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd660377368b4c949160e85fef17a3bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: dd660377368b4c949160e85fef17a3bf Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsNegativeTestJSON-1231723546-project Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: e152f7f842e841519b249f1986fce5c7 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546-project Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 does not exist Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-352da607-81f7-49f3-8e53-51220ba1ee1c'] Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71'} Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:38:21.675649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 does not exist Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352da607-81f7-49f3-8e53-51220ba1ee1c'] Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 does not exist Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352da607-81f7-49f3-8e53-51220ba1ee1c'] Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 does not exist Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352da607-81f7-49f3-8e53-51220ba1ee1c'] Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 does not exist Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352da607-81f7-49f3-8e53-51220ba1ee1c'] Aug 24 03:38:21.682510 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:21.696969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6628e577-cef7-4fcb-a19f-7dbb4ca7e686 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Returning 404 to user: Security group f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 does not exist Aug 24 03:38:21.696969 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-352da607-81f7-49f3-8e53-51220ba1ee1c'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:21.698589 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6628e577-cef7-4fcb-a19f-7dbb4ca7e686 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71" status: 404 len: 194 microversion: 2.1 time: 0.248985 Aug 24 03:38:21.704447 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 882/1748] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:38:21 2022] DELETE /compute/v2.1/os-security-groups/f02d4a2d-e4f0-40b1-8f87-d3dea8f6fb71 => generated 194 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:21.710964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ecc695d9-7bee-4fa2-938e-2d59c4c638b8 req-77d3e690-f9fd-4cd7-911e-616bf39d10da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0590f4-ad3d-4016-b019-6e71212ff34e", "name": "network-vif-deleted", "tag": "88ddc8b2-32ba-4d59-a1fe-dc8334535167"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:21.720532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:21.739169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ecc695d9-7bee-4fa2-938e-2d59c4c638b8 req-77d3e690-f9fd-4cd7-911e-616bf39d10da service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:21.740182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ecc695d9-7bee-4fa2-938e-2d59c4c638b8 req-77d3e690-f9fd-4cd7-911e-616bf39d10da service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:21.740997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ecc695d9-7bee-4fa2-938e-2d59c4c638b8 req-77d3e690-f9fd-4cd7-911e-616bf39d10da service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.756432 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ecc695d9-7bee-4fa2-938e-2d59c4c638b8 req-77d3e690-f9fd-4cd7-911e-616bf39d10da service nova] Creating event network-vif-deleted:88ddc8b2-32ba-4d59-a1fe-dc8334535167 for instance cf0590f4-ad3d-4016-b019-6e71212ff34e on n-h1-846470-15 Aug 24 03:38:21.765227 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ecc695d9-7bee-4fa2-938e-2d59c4c638b8 req-77d3e690-f9fd-4cd7-911e-616bf39d10da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058638 Aug 24 03:38:21.770644 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 883/1749] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:21.784727 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-977f889c-4c56-4b33-a939-a0bfea48d8fd tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.012236 Aug 24 03:38:21.791252 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 884/1750] 10.222.0.58 () {58 vars in 1164 bytes} [Wed Aug 24 03:38:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:38:21.797788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ebcb1c8-ecc8-4dc3-a987-0e73c84a26d9 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Calling method '.version_select at 0x7f10342c9670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:22.393977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:22.419998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:22.436545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:22.441779 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c32f67f1-b541-40ae-9c4b-cbda03b33cc6 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 200 len: 1664 microversion: 2.25 time: 1.485786 Aug 24 03:38:22.470912 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 867/1751] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:20 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 1664 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:38:22.492844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:22.493786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:22.516050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.518742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.519377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.520249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.522294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.528304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.625921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:23.123027 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ebcb1c8-ecc8-4dc3-a987-0e73c84a26d9 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.330150 Aug 24 03:38:23.123543 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 885/1752] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:38:21 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:23.142970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f27828ad-11cd-450e-a4b8-96fea402cbe3 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Calling method '.version_select at 0x7f1022efd700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:23.683649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-f27828ad-11cd-450e-a4b8-96fea402cbe3 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:38:23.684378 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f27828ad-11cd-450e-a4b8-96fea402cbe3 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 24 03:38:23.684378 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-9d9b2136-00c1-4239-812e-8ebda2a1f7e2'] Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f27828ad-11cd-450e-a4b8-96fea402cbe3 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Request method failure captured: Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-security-groups/ce41c34d-48b8-41a1-bdee-3af294469513 HTTP/1.1 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0s8KdHpWKV4sOnS4LuDbQla6wfM1MU10VokmWWH9m0RWVv8KC9GkXNNH9HYjhO4-Ls1eFhuyxJ2hl6CF58MSd6seF7INPzF1Eu--yBRsrrsOFrlONbcyidX2mKeJ-zVPoJPxfgXjDmmfBqqR2YCJWZ33fSFwP2dLvj2XvO2uq9QY4 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: dd660377368b4c949160e85fef17a3bf Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd660377368b4c949160e85fef17a3bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: dd660377368b4c949160e85fef17a3bf Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsNegativeTestJSON-1231723546-project Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: e152f7f842e841519b249f1986fce5c7 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546-project Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: exception: Insufficient rights for removing default security group. Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-9d9b2136-00c1-4239-812e-8ebda2a1f7e2'] Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'ce41c34d-48b8-41a1-bdee-3af294469513'} Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:38:23.686383 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d9b2136-00c1-4239-812e-8ebda2a1f7e2'] Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d9b2136-00c1-4239-812e-8ebda2a1f7e2'] Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d9b2136-00c1-4239-812e-8ebda2a1f7e2'] Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d9b2136-00c1-4239-812e-8ebda2a1f7e2'] Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f27828ad-11cd-450e-a4b8-96fea402cbe3 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-9d9b2136-00c1-4239-812e-8ebda2a1f7e2'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f27828ad-11cd-450e-a4b8-96fea402cbe3 tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ce41c34d-48b8-41a1-bdee-3af294469513" status: 400 len: 182 microversion: 2.1 time: 0.554303 Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 886/1753] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:38:23 2022] DELETE /compute/v2.1/os-security-groups/ce41c34d-48b8-41a1-bdee-3af294469513 => generated 182 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:23.697029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: cf0590f4-ad3d-4016-b019-6e71212ff34e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:23.722455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:23.722954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:23.723404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:23.724165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:23.724628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:23.725066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:23.801823 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] HTTP exception thrown: Instance cf0590f4-ad3d-4016-b019-6e71212ff34e could not be found. Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Request method failure captured: Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e HTTP/1.1 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs4tMynpw-ti1SNFeIDiBu0EjMWrzeKRtBhxeB79v9cLU31kL4beUm6KYcXuGXaeIg6qalK9WOzhc91So4W0RSHDdNURSOSYRYSRKdovk3F5aKtuVAG5Hp00O6K2sv--ip87pLqLy0fccsoLon0DxbxqPfQwXXzAEry4qkqiTej68Y Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: db10cc10bf304404a9f4a82534d3c6b5 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: db10cc10bf304404a9f4a82534d3c6b5 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-LiveAutoBlockMigrationV225Test-1283169469-project Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6d8976135cf9461e8a0eda1658abeec9 Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469-project Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance cf0590f4-ad3d-4016-b019-6e71212ff34e could not be found. Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'cf0590f4-ad3d-4016-b019-6e71212ff34e'} Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf0590f4-ad3d-4016-b019-6e71212ff34e could not be found. Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf0590f4-ad3d-4016-b019-6e71212ff34e could not be found. Aug 24 03:38:23.803622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf0590f4-ad3d-4016-b019-6e71212ff34e could not be found. Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Returning 404 to user: Instance cf0590f4-ad3d-4016-b019-6e71212ff34e could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-931449cc-77e0-47c3-8dfc-9a749cc5e71c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e" status: 404 len: 111 microversion: 2.25 time: 0.115242 Aug 24 03:38:23.810599 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 887/1754] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:23 2022] GET /compute/v2.1/servers/cf0590f4-ad3d-4016-b019-6e71212ff34e => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:38:23.814897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e975a550-e521-4e0a-b48e-5a5f7260117c tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Calling method '.version_select at 0x7f1023551c10>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:23.853097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-e975a550-e521-4e0a-b48e-5a5f7260117c tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:38:23.854240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-e975a550-e521-4e0a-b48e-5a5f7260117c tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Neutron security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 03:38:23.854879 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-e975a550-e521-4e0a-b48e-5a5f7260117c tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] HTTP exception thrown: Security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c does not exist Aug 24 03:38:23.854879 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-ab76f3ae-c637-4888-b603-66cb417906f3'] Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e975a550-e521-4e0a-b48e-5a5f7260117c tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Request method failure captured: Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-security-groups/0dac852e-e3a3-455e-a49b-0b0b0c12cf2c HTTP/1.1 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0s8KdHpWKV4sOnS4LuDbQla6wfM1MU10VokmWWH9m0RWVv8KC9GkXNNH9HYjhO4-Ls1eFhuyxJ2hl6CF58MSd6seF7INPzF1Eu--yBRsrrsOFrlONbcyidX2mKeJ-zVPoJPxfgXjDmmfBqqR2YCJWZ33fSFwP2dLvj2XvO2uq9QY4 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: dd660377368b4c949160e85fef17a3bf Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd660377368b4c949160e85fef17a3bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: dd660377368b4c949160e85fef17a3bf Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsNegativeTestJSON-1231723546-project Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: e152f7f842e841519b249f1986fce5c7 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546-project Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c does not exist Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-ab76f3ae-c637-4888-b603-66cb417906f3'] Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '0dac852e-e3a3-455e-a49b-0b0b0c12cf2c'} Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:38:23.857374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c does not exist Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab76f3ae-c637-4888-b603-66cb417906f3'] Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c does not exist Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab76f3ae-c637-4888-b603-66cb417906f3'] Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c does not exist Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab76f3ae-c637-4888-b603-66cb417906f3'] Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c does not exist Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab76f3ae-c637-4888-b603-66cb417906f3'] Aug 24 03:38:23.862247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:23.870010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e975a550-e521-4e0a-b48e-5a5f7260117c tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Returning 404 to user: Security group 0dac852e-e3a3-455e-a49b-0b0b0c12cf2c does not exist Aug 24 03:38:23.870010 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-ab76f3ae-c637-4888-b603-66cb417906f3'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:23.870010 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e975a550-e521-4e0a-b48e-5a5f7260117c tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/0dac852e-e3a3-455e-a49b-0b0b0c12cf2c" status: 404 len: 194 microversion: 2.1 time: 0.056871 Aug 24 03:38:23.875705 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 888/1755] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:38:23 2022] GET /compute/v2.1/os-security-groups/0dac852e-e3a3-455e-a49b-0b0b0c12cf2c => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:23.886079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-659daad5-e0f1-40b9-ad5d-0545c1d374f1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '.version_select at 0x7f10342b6b80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:23.939540 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-659daad5-e0f1-40b9-ad5d-0545c1d374f1 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244273868" status: 204 len: 0 microversion: 2.25 time: 0.065862 Aug 24 03:38:23.950386 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 889/1756] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:38:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244273868 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:38:23.955960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-edc6dabd-8862-4505-8d25-42639f4d12eb tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Action: 'update', calling method: .version_select at 0x7f1022efd820>, body: {"security_group": {"name": "tempest-sg-859148209", "description": "tempest-description-135833335"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:23.975795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:23.993412 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8684a152-3adc-4965-98a9-46ad1c4d04da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 1.520367 Aug 24 03:38:23.999415 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 868/1757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:22 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:24.100770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-edc6dabd-8862-4505-8d25-42639f4d12eb tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:38:24.101662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-edc6dabd-8862-4505-8d25-42639f4d12eb tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Neutron security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 03:38:24.102488 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-edc6dabd-8862-4505-8d25-42639f4d12eb tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] HTTP exception thrown: Security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 does not exist Aug 24 03:38:24.102488 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-8cedde86-ea7d-4439-a179-2805bb88ed48'] Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-edc6dabd-8862-4505-8d25-42639f4d12eb tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Request method failure captured: Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: request: PUT /compute/v2.1/os-security-groups/7fdbc9ea-64ac-41eb-99e7-20b41204e354 HTTP/1.1 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 100 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0s8KdHpWKV4sOnS4LuDbQla6wfM1MU10VokmWWH9m0RWVv8KC9GkXNNH9HYjhO4-Ls1eFhuyxJ2hl6CF58MSd6seF7INPzF1Eu--yBRsrrsOFrlONbcyidX2mKeJ-zVPoJPxfgXjDmmfBqqR2YCJWZ33fSFwP2dLvj2XvO2uq9QY4 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: dd660377368b4c949160e85fef17a3bf Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd660377368b4c949160e85fef17a3bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd660377368b4c949160e85fef17a3bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: dd660377368b4c949160e85fef17a3bf Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsNegativeTestJSON-1231723546-project Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: e152f7f842e841519b249f1986fce5c7 Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1231723546-project Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: {"security_group": {"name": "tempest-sg-859148209", "description": "tempest-description-135833335"}} Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 does not exist Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-8cedde86-ea7d-4439-a179-2805bb88ed48'] Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '7fdbc9ea-64ac-41eb-99e7-20b41204e354', 'body': {'security_group': {'name': 'tempest-sg-859148209', 'description': 'tempest-description-135833335'}}} Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:38:24.105061 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 does not exist Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cedde86-ea7d-4439-a179-2805bb88ed48'] Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 does not exist Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cedde86-ea7d-4439-a179-2805bb88ed48'] Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 does not exist Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cedde86-ea7d-4439-a179-2805bb88ed48'] Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 does not exist Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cedde86-ea7d-4439-a179-2805bb88ed48'] Aug 24 03:38:24.109521 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:24.117183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-edc6dabd-8862-4505-8d25-42639f4d12eb tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] Returning 404 to user: Security group 7fdbc9ea-64ac-41eb-99e7-20b41204e354 does not exist Aug 24 03:38:24.117183 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-8cedde86-ea7d-4439-a179-2805bb88ed48'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:24.118605 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-edc6dabd-8862-4505-8d25-42639f4d12eb tempest-SecurityGroupsNegativeTestJSON-1231723546 tempest-SecurityGroupsNegativeTestJSON-1231723546-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/7fdbc9ea-64ac-41eb-99e7-20b41204e354" status: 404 len: 194 microversion: 2.1 time: 0.166755 Aug 24 03:38:24.119852 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 890/1758] 10.222.0.58 () {60 vars in 1290 bytes} [Wed Aug 24 03:38:23 2022] PUT /compute/v2.1/os-security-groups/7fdbc9ea-64ac-41eb-99e7-20b41204e354 => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:25.026417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:25.027851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:25.053694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.054495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.055621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.056620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.060029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.060650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:26.092310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:26.103011 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9c5864d0-d145-4632-a68c-2651efd28bd3 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 1.085860 Aug 24 03:38:26.111894 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 869/1759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:25 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:27.137300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:27.138687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:27.164922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.173701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.182665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.182665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.182665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.182665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:28.266330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:28.284684 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6aa7d498-96f0-458b-8560-13242218884d tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 1.150891 Aug 24 03:38:28.296776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 891/1760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:27 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:29.322085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.322809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.337095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.358001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.358762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.359827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.360481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.361134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.740592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.743094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.769545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.772004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.773357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.777683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.778991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.779709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.830449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:30.011397 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-88a54f69-03ed-435e-9c25-521787e94bed tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 204 len: 0 microversion: 2.25 time: 0.279429 Aug 24 03:38:30.012451 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 892/1761] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:38:29 2022] DELETE /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:38:30.031887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:30.039390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:30.045767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:30.048025 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a825ffb-6ffa-4fbe-b749-e84a67153f46 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 0.734361 Aug 24 03:38:30.053024 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 870/1762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:29 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:30.064591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.066239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.068739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.069784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.075071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.075789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.033765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:31.048821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:31.056645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:31.061062 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2fcc67f4-53d9-409d-b61f-3d4d9f4d928c tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1549 microversion: 2.25 time: 1.040965 Aug 24 03:38:31.063487 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 893/1763] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:30 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1549 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:31.074790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:31.075509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:31.084031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=46 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:31.089370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.090037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.092243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.093435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.093916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.094413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.919358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:31.929469 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-03f120b8-f8ee-49d9-8fbf-6b41bee5e1d9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 0.859821 Aug 24 03:38:31.930437 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 871/1764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:31 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:32.024930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-03eddcd4-2a70-4905-a484-688ce72034a1 req-7860db11-d10f-4234-a181-d0e6b1dffbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c", "name": "network-vif-deleted", "tag": "bf3f1eec-aa98-4265-993e-6bc0ec631b29"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:32.063368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-03eddcd4-2a70-4905-a484-688ce72034a1 req-7860db11-d10f-4234-a181-d0e6b1dffbd5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.064160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-03eddcd4-2a70-4905-a484-688ce72034a1 req-7860db11-d10f-4234-a181-d0e6b1dffbd5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.064315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-03eddcd4-2a70-4905-a484-688ce72034a1 req-7860db11-d10f-4234-a181-d0e6b1dffbd5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.089861 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-03eddcd4-2a70-4905-a484-688ce72034a1 req-7860db11-d10f-4234-a181-d0e6b1dffbd5 service nova] Creating event network-vif-deleted:bf3f1eec-aa98-4265-993e-6bc0ec631b29 for instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c on n-h2-846470-15 Aug 24 03:38:32.093542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:32.094758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:32.103480 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-03eddcd4-2a70-4905-a484-688ce72034a1 req-7860db11-d10f-4234-a181-d0e6b1dffbd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090393 Aug 24 03:38:32.104881 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 894/1765] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:32.117958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.126653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.127123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.130529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.131168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.131701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.479480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:32.489071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:32.490491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:32.491734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1b64b428-9e95-4a89-a545-0784f383ea32 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 200 len: 1332 microversion: 2.25 time: 0.402743 Aug 24 03:38:32.505632 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 872/1766] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:32 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 1332 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:38:32.853704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75d7cd87-62db-4513-90f9-4543e694a937 tempest-ListImagesTestJSON-1133477272 tempest-ListImagesTestJSON-1133477272-project] Calling method '.version_select at 0x7f10342c98b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:32.961352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:32.962473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:32.975370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.975898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.976339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.977180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.977640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.978066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.984764 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75d7cd87-62db-4513-90f9-4543e694a937 tempest-ListImagesTestJSON-1133477272 tempest-ListImagesTestJSON-1133477272-project] 10.222.0.58 "GET /compute/v2.1/images/940ed0d3-700a-4ac5-a26b-97e9311e8ce3" status: 200 len: 784 microversion: 2.1 time: 0.372188 Aug 24 03:38:33.011801 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 895/1767] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:38:32 2022] GET /compute/v2.1/images/940ed0d3-700a-4ac5-a26b-97e9311e8ce3 => generated 784 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:33.024943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ecd3ac3-a59f-42a9-9d33-82d4f50bdf53 tempest-ListImagesTestJSON-1133477272 tempest-ListImagesTestJSON-1133477272-project] Calling method '.version_select at 0x7f102315eee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:33.250758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ecd3ac3-a59f-42a9-9d33-82d4f50bdf53 tempest-ListImagesTestJSON-1133477272 tempest-ListImagesTestJSON-1133477272-project] 10.222.0.58 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.233814 Aug 24 03:38:33.263177 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 896/1768] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 03:38:33 2022] GET /compute/v2.1/images => generated 445 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:33.270931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b4b5b6e-86c8-4f49-952d-7e6f366ddcca tempest-ListImagesTestJSON-1133477272 tempest-ListImagesTestJSON-1133477272-project] Calling method '.version_select at 0x7f10342c9e50>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:33.408577 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b4b5b6e-86c8-4f49-952d-7e6f366ddcca tempest-ListImagesTestJSON-1133477272 tempest-ListImagesTestJSON-1133477272-project] 10.222.0.58 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.141389 Aug 24 03:38:33.446469 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 897/1769] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:38:33 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:33.518744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:33.519947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:33.535994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.537250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.538099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.539474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.540313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.541142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.558701 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] HTTP exception thrown: Instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c could not be found. Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Request method failure captured: Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c HTTP/1.1 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZs4tMynpw-ti1SNFeIDiBu0EjMWrzeKRtBhxeB79v9cLU31kL4beUm6KYcXuGXaeIg6qalK9WOzhc91So4W0RSHDdNURSOSYRYSRKdovk3F5aKtuVAG5Hp00O6K2sv--ip87pLqLy0fccsoLon0DxbxqPfQwXXzAEry4qkqiTej68Y Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: db10cc10bf304404a9f4a82534d3c6b5 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: db10cc10bf304404a9f4a82534d3c6b5 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-LiveAutoBlockMigrationV225Test-1283169469-project Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6d8976135cf9461e8a0eda1658abeec9 Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469-project Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c could not be found. Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c'} Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c could not be found. Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c could not be found. Aug 24 03:38:33.561171 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c could not be found. Aug 24 03:38:33.566535 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:33.569005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Returning 404 to user: Instance c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:33.570381 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5cb4471b-2537-4c9a-8050-9ab4f780e67a tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c" status: 404 len: 111 microversion: 2.25 time: 0.058998 Aug 24 03:38:33.576765 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 898/1770] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:33 2022] GET /compute/v2.1/servers/c7d1766f-f006-47f8-8bdd-ee6bcae2fe3c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:38:33.591406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:33.597578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:33.615769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.616533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.617312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.619862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.620867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.621505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.666117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:33.753998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:33.888348 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7150ee1e-eab5-490e-a028-accacbe32700 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 204 len: 0 microversion: 2.25 time: 0.306720 Aug 24 03:38:33.890805 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 899/1771] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:38:33 2022] DELETE /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:38:33.918631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:33.927313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:33.962837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.965752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.967823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.968888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.970355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.972205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.664375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:34.718007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:34.734065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:34.742962 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-109d9900-98e4-4a9f-a231-128360a30780 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1564 microversion: 2.25 time: 0.842268 Aug 24 03:38:34.749907 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 900/1772] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:33 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1564 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:38:35.009474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:35.017415 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fcc807db-80a2-497b-be13-053181e8708a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 2.069410 Aug 24 03:38:35.044075 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 873/1773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:32 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:35.049295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cfade5d9-1e2a-43e1-8e87-af3a4525f65c req-8beb75e1-3b14-45dc-af62-5328263e81a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a88c6df-91cd-486d-aae0-9be3bf679962", "name": "network-vif-plugged", "status": "completed", "tag": "3839be9d-1381-43cc-a476-105a79d25947"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:35.070100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfade5d9-1e2a-43e1-8e87-af3a4525f65c req-8beb75e1-3b14-45dc-af62-5328263e81a3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.075816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfade5d9-1e2a-43e1-8e87-af3a4525f65c req-8beb75e1-3b14-45dc-af62-5328263e81a3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.076758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfade5d9-1e2a-43e1-8e87-af3a4525f65c req-8beb75e1-3b14-45dc-af62-5328263e81a3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.104861 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cfade5d9-1e2a-43e1-8e87-af3a4525f65c req-8beb75e1-3b14-45dc-af62-5328263e81a3 service nova] Creating event network-vif-plugged:3839be9d-1381-43cc-a476-105a79d25947 for instance 6a88c6df-91cd-486d-aae0-9be3bf679962 on n-h1-846470-15 Aug 24 03:38:35.119478 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cfade5d9-1e2a-43e1-8e87-af3a4525f65c req-8beb75e1-3b14-45dc-af62-5328263e81a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073682 Aug 24 03:38:35.120763 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 874/1774] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:35.282237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2000410687", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "523345b3-3b31-4398-81f6-32e2319a7503"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:35.434164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] validate_networks() for [('523345b3-3b31-4398-81f6-32e2319a7503', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:35.792609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:35.793639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:35.811286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.812347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.813196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.814815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.823247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.824087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.187970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:36.204820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:36.212242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:36.216449 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ec7fc46-1e83-412a-9ac4-7a48c3828b75 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1564 microversion: 2.25 time: 0.431240 Aug 24 03:38:36.238183 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 875/1775] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:35 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1564 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:36.254346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:36.255319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:36.269845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:36.270600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:36.275758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.276943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:36.277700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:36.278405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.161297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:37.218059 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dde41d9d-368e-40e7-b101-f154d33d3f37 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1314 microversion: 2.1 time: 0.978351 Aug 24 03:38:37.227171 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 876/1776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:36 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:37.249375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:37.250586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:37.262757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.267470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.268613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.270189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.271498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.272596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.632922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:37.670155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:37.673256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:37.675239 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-364dd635-3685-457b-bff3-67e393b9c2d5 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1522 microversion: 2.25 time: 0.434959 Aug 24 03:38:37.676513 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 877/1777] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:37 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:38:37.842416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5253b2e6-c2f1-4da1-9a4e-0ae75e0a5fb6 req-1da91f58-8c14-4371-a895-6a96c07724dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b47212e-05a1-45a2-9cb6-0cc6b445ada0", "name": "network-vif-deleted", "tag": "9cdcacd1-2971-4051-893c-f6ada06261b9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:37.885620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5253b2e6-c2f1-4da1-9a4e-0ae75e0a5fb6 req-1da91f58-8c14-4371-a895-6a96c07724dd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.886487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5253b2e6-c2f1-4da1-9a4e-0ae75e0a5fb6 req-1da91f58-8c14-4371-a895-6a96c07724dd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.901680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5253b2e6-c2f1-4da1-9a4e-0ae75e0a5fb6 req-1da91f58-8c14-4371-a895-6a96c07724dd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.947976 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5253b2e6-c2f1-4da1-9a4e-0ae75e0a5fb6 req-1da91f58-8c14-4371-a895-6a96c07724dd service nova] Creating event network-vif-deleted:9cdcacd1-2971-4051-893c-f6ada06261b9 for instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 on n-h1-846470-15 Aug 24 03:38:37.965115 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5253b2e6-c2f1-4da1-9a4e-0ae75e0a5fb6 req-1da91f58-8c14-4371-a895-6a96c07724dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133626 Aug 24 03:38:37.970974 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 878/1778] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:38.258060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:38.259909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:38.263367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:38:38.268587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.269119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.269980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.270913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.271370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:38:38.271564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.272706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:38:38.273731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:38:38.274343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.275381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:38:38.311957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.315195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.317234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.318675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.331931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.333201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.455915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Getting quotas for project 8346bc75f4de4e9b9c864d4f7c8b6e75. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:38.484662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Getting quotas for user 3188bf58d3da43ec9859894ebbee70e5 and project 8346bc75f4de4e9b9c864d4f7c8b6e75. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:38.586932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:38:38.597703 n-d-846470-15 devstack@n-api.service[122536]: WARNING nova.utils [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2000410687 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-200041068 Aug 24 03:38:38.601990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:38:38.767529 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-416c84fe-aac7-4603-b39f-51a37798cc18 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.015523 Aug 24 03:38:38.770361 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 901/1779] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:38:38.777869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:38.778771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:38.788938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.789960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.790703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.791778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.793761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.795059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.988205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.997798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.998567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.999389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lazy-loading 'fault' on Instance uuid 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:39.438383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:39.455418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:39.459574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8976135cf9461e8a0eda1658abeec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db10cc10bf304404a9f4a82534d3c6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:39.464608 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd2389d1-45f2-49b5-88cc-ec86bbea64d7 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 200 len: 1351 microversion: 2.25 time: 0.693009 Aug 24 03:38:39.466886 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 902/1780] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:38 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 1351 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:39.478424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4032acf1-6d25-42dc-a8a4-ef4c2b9e7f0d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:39.484616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4032acf1-6d25-42dc-a8a4-ef4c2b9e7f0d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:39.765458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4032acf1-6d25-42dc-a8a4-ef4c2b9e7f0d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:39.782730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4032acf1-6d25-42dc-a8a4-ef4c2b9e7f0d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1232 microversion: 2.1 time: 0.313674 Aug 24 03:38:39.796365 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 903/1781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:39 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1232 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:39.812787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:39.839640 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea1595b4-7d01-4d67-bdf2-8757d06f4f94 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1500 microversion: 2.1 time: 1.588165 Aug 24 03:38:39.845838 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 879/1782] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:38 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1500 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:39.869662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:39.873270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:39.935793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.936341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.936818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.937980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.938827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.956931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.174359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lazy-loading 'flavor' on Instance uuid 6a88c6df-91cd-486d-aae0-9be3bf679962 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:40.492715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:40.493369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] [instance: 9b47212e-05a1-45a2-9cb6-0cc6b445ada0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:40.508972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.514830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.520028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.523347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.524110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.524767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.578607 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] HTTP exception thrown: Instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 could not be found. Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Request method failure captured: Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 HTTP/1.1 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZs4tMynpw-ti1SNFeIDiBu0EjMWrzeKRtBhxeB79v9cLU31kL4beUm6KYcXuGXaeIg6qalK9WOzhc91So4W0RSHDdNURSOSYRYSRKdovk3F5aKtuVAG5Hp00O6K2sv--ip87pLqLy0fccsoLon0DxbxqPfQwXXzAEry4qkqiTej68Y Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: db10cc10bf304404a9f4a82534d3c6b5 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db10cc10bf304404a9f4a82534d3c6b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: db10cc10bf304404a9f4a82534d3c6b5 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-LiveAutoBlockMigrationV225Test-1283169469-project Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6d8976135cf9461e8a0eda1658abeec9 Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1283169469-project Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 could not be found. Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9b47212e-05a1-45a2-9cb6-0cc6b445ada0'} Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 could not be found. Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 could not be found. Aug 24 03:38:40.585582 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 could not be found. Aug 24 03:38:40.592162 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.605052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] Returning 404 to user: Instance 9b47212e-05a1-45a2-9cb6-0cc6b445ada0 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:40.609694 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3504a801-2eb1-45a9-bb7a-77733fd9ad69 tempest-LiveAutoBlockMigrationV225Test-1283169469 tempest-LiveAutoBlockMigrationV225Test-1283169469-project] 10.222.0.58 "GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0" status: 404 len: 111 microversion: 2.25 time: 0.121179 Aug 24 03:38:40.620292 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 880/1783] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:40 2022] GET /compute/v2.1/servers/9b47212e-05a1-45a2-9cb6-0cc6b445ada0 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:38:40.812948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aad4f75c-41ba-49ee-bcb0-7e098e1fb7f2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:40.814818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aad4f75c-41ba-49ee-bcb0-7e098e1fb7f2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:41.043447 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c35bf1a5-4412-4536-b805-424efc2f209e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "POST /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962/action" status: 200 len: 32 microversion: 2.1 time: 1.173784 Aug 24 03:38:41.052014 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 904/1784] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:38:39 2022] POST /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962/action => generated 32 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:38:41.089882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:41.095498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:41.121788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.134278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:41.135185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.137714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.139346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:41.151341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.454800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aad4f75c-41ba-49ee-bcb0-7e098e1fb7f2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:41.469262 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aad4f75c-41ba-49ee-bcb0-7e098e1fb7f2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1232 microversion: 2.1 time: 0.658676 Aug 24 03:38:41.469939 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 881/1785] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:40 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1232 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:42.081286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:42.116489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f77b181d-e7f0-41fe-b392-951e0b2a76da tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 1.060912 Aug 24 03:38:42.120609 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 905/1786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:41 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:42.177490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e37bd3d3-b418-4d78-a1f1-490ae7d2b54a tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Calling method '.version_select at 0x7f102afe5040>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:42.210556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e37bd3d3-b418-4d78-a1f1-490ae7d2b54a tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.213432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e37bd3d3-b418-4d78-a1f1-490ae7d2b54a tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.216006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e37bd3d3-b418-4d78-a1f1-490ae7d2b54a tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.217149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e37bd3d3-b418-4d78-a1f1-490ae7d2b54a tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.222123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e37bd3d3-b418-4d78-a1f1-490ae7d2b54a tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.223019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e37bd3d3-b418-4d78-a1f1-490ae7d2b54a tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.285934 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e37bd3d3-b418-4d78-a1f1-490ae7d2b54a tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.445638 Aug 24 03:38:42.299706 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 882/1787] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 03:38:41 2022] GET /compute/v2.1/limits => generated 511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:42.367408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0e9bac8-41c1-40a7-ba1c-a42f581484f7 tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1626395766", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:42.491560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:42.492719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:42.506986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.507895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.508519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.509503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.510196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.510942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.585296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e0e9bac8-41c1-40a7-ba1c-a42f581484f7 tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:42.864568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:42.888316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8fcce0f-bf8b-47ee-aa4a-75fb1a1ff5bd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1302 microversion: 2.1 time: 0.400867 Aug 24 03:38:42.890019 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 883/1788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:42 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1302 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:43.143320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:43.144559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:43.176139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.187161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.188279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.189535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.190424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.215929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:44.080395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:44.090882 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-932204c9-d363-4332-9b14-16eccbd0535f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 0.953561 Aug 24 03:38:44.096234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 884/1789] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:43 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:44.102408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:44.126949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:44.144191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:44.146512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:44.147225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:44.152586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:44.157473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:44.158953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:44.208413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e0e9bac8-41c1-40a7-ba1c-a42f581484f7 tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Getting quotas for project a50b758de8714a5a83138e5aa1febe49. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:44.240129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e0e9bac8-41c1-40a7-ba1c-a42f581484f7 tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Getting quotas for user 8f8bd32124fe4be4b64bb6ab5a5cc7c6 and project a50b758de8714a5a83138e5aa1febe49. Resources: dict_keys(['metadata_items']) {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:44.278342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-e0e9bac8-41c1-40a7-ba1c-a42f581484f7 tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0e9bac8-41c1-40a7-ba1c-a42f581484f7 tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Request method failure captured: Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 1752 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ1BfAjWw_Zj26hJURyZ5ufimALfg8Gzm56j2gCCwRiIm09C_uWjA2wJyFCk2Xmqt586iWv1EfqD7m6ecfBWtzSzDDwScFtA9BLIS85Xutzz2I1uI-AmOGbDwq66JzUTMyKA15mi3_bJMjSz8ik3YZXLpGygPtrLg0hg7nUIhVhveQU Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a50b758de8714a5a83138e5aa1febe49 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1041633770 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a50b758de8714a5a83138e5aa1febe49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a50b758de8714a5a83138e5aa1febe49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a50b758de8714a5a83138e5aa1febe49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a50b758de8714a5a83138e5aa1febe49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1041633770 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a50b758de8714a5a83138e5aa1febe49 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1041633770 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 8f8bd32124fe4be4b64bb6ab5a5cc7c6 Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1626395766", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:38:44.283576 n-d-846470-15 devstack@n-api.service[122536]: exception: Maximum number of metadata items exceeds 128 Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1626395766', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 463, in _check_metadata_properties_quota Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1003, in _checks_for_create_and_rebuild Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 470, in _check_metadata_properties_quota Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:38:44.287528 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 24 03:38:44.293448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:38:44.301501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0e9bac8-41c1-40a7-ba1c-a42f581484f7 tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:44.307392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0e9bac8-41c1-40a7-ba1c-a42f581484f7 tempest-AbsoluteLimitsNegativeTestJSON-1041633770 tempest-AbsoluteLimitsNegativeTestJSON-1041633770-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.947846 Aug 24 03:38:44.309804 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 906/1790] 10.222.0.58 () {60 vars in 1148 bytes} [Wed Aug 24 03:38:42 2022] POST /compute/v2.1/servers => generated 87 bytes in 1954 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:38:44.469198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:44.486149 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-85b8f081-3628-4f36-899b-64fa75ffde3d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1290 microversion: 2.1 time: 0.388389 Aug 24 03:38:44.489234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 885/1791] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:44 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1290 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:45.126796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:45.132832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:45.150122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.177546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.182483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.184399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.186413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.190873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.510469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:45.511268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:45.525110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.525617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.526064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.527094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.527567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.528273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.714131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:45.741535 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88f8de46-cbfe-4001-aee3-7241491cd977 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1290 microversion: 2.1 time: 0.236235 Aug 24 03:38:45.745341 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 886/1792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:45 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1290 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:46.709126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:46.740477 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd16a760-bc92-42c0-92e6-bc67a282c1cd tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 1.621205 Aug 24 03:38:46.748837 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 907/1793] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:45 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:46.764979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:46.765624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:46.791510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.792115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.792598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.793400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.793957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.799914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.042627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:47.063716 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9e8e68b9-9cf6-4f14-9c2a-76a79adcc858 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1290 microversion: 2.1 time: 0.302974 Aug 24 03:38:47.068503 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 887/1794] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:46 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1290 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:47.773104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:47.774870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:47.821854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.842190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.844474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.846234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.847802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.848475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.087114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:48.089587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:48.115204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.119955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.121068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.124949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.129712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.132867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.228333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:48.398497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:49.356675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:49.372454 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-700bba3e-bef9-4bea-8968-94025ba9f10f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 1.289685 Aug 24 03:38:49.375057 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 888/1795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:48 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:49.471782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:49.517127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-630d62aa-fc7d-482c-ae85-39c127ece772 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 1.749766 Aug 24 03:38:49.521417 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 908/1796] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:47 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:50.405581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:50.408157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:50.435333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.438381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.439725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.446888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.449076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.450543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.561512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:50.562016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:50.573518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.574007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.574441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.575173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.577765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.580058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.509292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:51.545234 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-596d920e-0089-4504-b9b2-eb11ce12da6f tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 0.986843 Aug 24 03:38:51.555771 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 909/1797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:50 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:51.633832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:51.669376 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3501f587-6ff8-4b62-91c5-ccd39dbb3056 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 1.268792 Aug 24 03:38:51.688197 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 889/1798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:50 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:52.588246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:52.595812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:52.615237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:52.660483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.661337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.662081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.663510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.705496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.708074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.714143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:52.715229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:52.792444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:52.799282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:52.807610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.811523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.814228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.818511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.820537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.822969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.262058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:55.046171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:55.079739 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c969e4d2-0dd1-4cdc-a0ae-f32a52fe0fec tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 2.488086 Aug 24 03:38:55.080757 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 910/1799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:52 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 2501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:55.505281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f061ac98-d0aa-4947-8e5c-0c1fa425dd6e req-9fff76b4-1a77-461c-b93a-da01c62f4432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b6d358-1b82-4c99-8bab-048d28385fe5", "tag": "3e07d450-4b64-4d9b-b95e-f418dde28d80"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:55.554093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f061ac98-d0aa-4947-8e5c-0c1fa425dd6e req-9fff76b4-1a77-461c-b93a-da01c62f4432 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.558668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f061ac98-d0aa-4947-8e5c-0c1fa425dd6e req-9fff76b4-1a77-461c-b93a-da01c62f4432 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.560484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f061ac98-d0aa-4947-8e5c-0c1fa425dd6e req-9fff76b4-1a77-461c-b93a-da01c62f4432 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.602434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f061ac98-d0aa-4947-8e5c-0c1fa425dd6e req-9fff76b4-1a77-461c-b93a-da01c62f4432 service nova] Creating event network-changed:3e07d450-4b64-4d9b-b95e-f418dde28d80 for instance 04b6d358-1b82-4c99-8bab-048d28385fe5 on n-h1-846470-15 Aug 24 03:38:55.612261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:55.634754 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0335c6c1-abb3-4f19-8002-2b0047a82b7d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 2.933941 Aug 24 03:38:55.640134 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f061ac98-d0aa-4947-8e5c-0c1fa425dd6e req-9fff76b4-1a77-461c-b93a-da01c62f4432 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140547 Aug 24 03:38:55.643498 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 911/1800] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:55.656849 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 890/1801] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:52 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 2961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:56.113233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:56.115529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:56.144073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.150593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.151067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.151948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.156005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.156550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.666690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:56.668845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:56.689370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.692489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.705513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.708046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.720741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.721755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.559112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:57.575364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:57.594556 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8ee1a1c1-b579-4912-80b2-d7e83cd2921e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 1.494424 Aug 24 03:38:57.600349 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 912/1802] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:56 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:57.619711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4730d438-2c49-47c5-9714-1d97ebb372ce tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 0.958982 Aug 24 03:38:57.640107 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 891/1803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:56 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:58.625693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:58.626722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:58.642638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.645004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.649396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.652611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.653332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.653633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:58.654123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.655071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:58.680290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.681400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.682852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.683963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.684629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.685524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.750506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:59.796291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:59.802765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1bd558f3-a424-4181-a8e9-8611a9a05df0 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 1.155566 Aug 24 03:38:59.809493 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7576db3-9840-4192-b77a-233f6fc3f10e tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 1.189684 Aug 24 03:38:59.813939 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 913/1804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:58 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:59.829135 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 892/1805] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:58 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:00.846991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:00.859575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:00.860377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:00.863648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:00.881157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.881659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.882332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.883085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.883548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.884021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.888759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.889265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.889706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.890441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.890923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.891365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:01.845138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:01.869898 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eab0632d-f441-405d-8a38-157ac3a92a4f tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 1.027639 Aug 24 03:39:01.877468 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 914/1806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:00 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:02.148203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:02.196791 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6443540a-38e2-4823-91bc-3dc22dbcbc63 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 1.337537 Aug 24 03:39:02.197879 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 893/1807] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:00 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:02.918713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:02.919470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:02.936290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.937321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.938013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.948793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.950193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.951158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.247548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:03.248568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:03.259109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=52 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:03.277776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.278556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.279229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.280376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.281655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.282705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.145813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:04.180283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:04.183834 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc396382-384d-4ed0-8ec7-0da4944a44fb tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 1.269895 Aug 24 03:39:04.197125 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 915/1808] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:02 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:04.525497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:04.554957 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9441e8c0-269b-4ffa-867a-e932bdcbbbc9 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 1.309816 Aug 24 03:39:04.558239 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 894/1809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:03 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:05.221419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:05.222151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:05.244194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.246223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.250882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.253485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.256487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.257326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.580833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:05.581515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:05.600559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.601242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.601875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.602611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.603088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.604776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.322088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:06.337562 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba9c8b5f-c9d0-4c2c-90a2-03e5aa93fa03 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1486 microversion: 2.1 time: 0.760888 Aug 24 03:39:06.341011 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 895/1810] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:05 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1486 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:06.362655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:06.363587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.386286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.387368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.392235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.395350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.397358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.400865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.442748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:06.474974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-efddb12a-21fe-4c77-bd0e-b63b8311c51c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 1.250728 Aug 24 03:39:06.476321 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 916/1811] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:05 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:06.613972 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b7c027ec-6709-49b1-a1fe-0f9a6fdf51ee tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "POST /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962/action" status: 202 len: 0 microversion: 2.1 time: 0.255901 Aug 24 03:39:06.635492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.640425 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 896/1812] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:39:06 2022] POST /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:39:06.644635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.670351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.671295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.672080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.673116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.673893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.674568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.503450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:07.509476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:07.535263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.540720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.541538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.542647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.544578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.546284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.561405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:07.591650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-104ea026-4337-4d28-81f8-ee184560e149 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1494 microversion: 2.1 time: 0.970598 Aug 24 03:39:07.599814 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 917/1813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1494 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:07.991928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:08.006030 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2c2d04d8-156c-482c-b93a-b10f2df27609 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 0.507492 Aug 24 03:39:08.007071 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 897/1814] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:07 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:08.622327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:08.623274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:08.637961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.648652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.649315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.650258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.650919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.651527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.027784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:09.028334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:09.043377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.048120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.049198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.050310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.051097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.052151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.741597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:09.746314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:09.766818 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-851366aa-207b-4a20-a4a4-8a1602430a62 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 0.743650 Aug 24 03:39:09.769218 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a9f9960-7a25-416b-a61a-24df09662ae6 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1494 microversion: 2.1 time: 1.151849 Aug 24 03:39:09.786637 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 898/1815] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:09 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:09.787276 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 918/1816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:08 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1494 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:09.793523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-15108db7-ff36-4c17-b482-b68e90dbbdb9 req-88a8d171-f51f-49fa-8fe2-bc0f2acd9034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b6d358-1b82-4c99-8bab-048d28385fe5", "name": "network-vif-plugged", "status": "completed", "tag": "3e07d450-4b64-4d9b-b95e-f418dde28d80"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:09.805376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-15108db7-ff36-4c17-b482-b68e90dbbdb9 req-88a8d171-f51f-49fa-8fe2-bc0f2acd9034 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.806310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-15108db7-ff36-4c17-b482-b68e90dbbdb9 req-88a8d171-f51f-49fa-8fe2-bc0f2acd9034 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.807014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-15108db7-ff36-4c17-b482-b68e90dbbdb9 req-88a8d171-f51f-49fa-8fe2-bc0f2acd9034 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.838692 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-15108db7-ff36-4c17-b482-b68e90dbbdb9 req-88a8d171-f51f-49fa-8fe2-bc0f2acd9034 service nova] Creating event network-vif-plugged:3e07d450-4b64-4d9b-b95e-f418dde28d80 for instance 04b6d358-1b82-4c99-8bab-048d28385fe5 on n-h1-846470-15 Aug 24 03:39:09.844371 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-15108db7-ff36-4c17-b482-b68e90dbbdb9 req-88a8d171-f51f-49fa-8fe2-bc0f2acd9034 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055297 Aug 24 03:39:09.845366 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 919/1817] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:10.791595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.792477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.808035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.809501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.811870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.821531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.827718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.833657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.834609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.835087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.895476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.896760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.900794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.926012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.927091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.935565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.652122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:12.661697 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76085a46-ce12-4153-b317-be14693b1987 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 1.856441 Aug 24 03:39:12.679081 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 920/1818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:13.094167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:13.104569 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-989e0628-5931-45c7-9071-06c6c1a78533 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1494 microversion: 2.1 time: 2.317648 Aug 24 03:39:13.110895 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 899/1819] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1494 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:13.692395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:13.692989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:13.744429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.745145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.745599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.756515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.765409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.766159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.070531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91319b41-a81f-4c5f-a04b-6838aaad682e tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102b111ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1866199773", "description": "tempest-description-833302615"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:14.524923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.539190 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2f89d7c-d977-47cf-9856-b8c141a8e124 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1332 microversion: 2.1 time: 0.856312 Aug 24 03:39:14.562491 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 921/1820] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:13 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1332 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:14.582680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:14.583334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:14.629173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.630230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.631346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.636668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.639194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.640058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.617266 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91319b41-a81f-4c5f-a04b-6838aaad682e tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.927336 Aug 24 03:39:15.618751 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 900/1821] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:39:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:39:15.624462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:15.625141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:15.635244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.635805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.636474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.637235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.637711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.638147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.565650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:16.582869 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d000d128-ee8d-428d-b948-229284cc4fc4 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1535 microversion: 2.1 time: 0.962856 Aug 24 03:39:16.599712 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 901/1822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:15 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1535 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:16.602113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a3ec398-9d1f-4543-877e-43be8cd2c52c tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102b2b5ee0>, body: {"security_group_rule": {"parent_group_id": "f2de8ced-0e99-44b3-a27e-92968f6a1555", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:16.784616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:16.804976 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-64a70724-52f6-4b8a-93ef-82ac681caf30 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1500 microversion: 2.1 time: 2.241094 Aug 24 03:39:16.823706 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 922/1823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:14 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1500 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:16.833039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d23e9f5d-2d92-41e7-9597-6ff648608dc5 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'create', calling method: .version_select at 0x7f102323bb80>, body: {"pool": "675efafd-0e2c-48c3-ab9a-d342ba711621"} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:18.325970 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a3ec398-9d1f-4543-877e-43be8cd2c52c tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.733454 Aug 24 03:39:18.333525 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 902/1824] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:39:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:18.333885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:18.334653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:18.384268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.388006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.393939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.394770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.399609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.409147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.449236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:18.596479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:18.917316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffd34a15-7c80-4c96-b075-b98717c5abfe tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 204 len: 0 microversion: 2.1 time: 0.588476 Aug 24 03:39:18.917927 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 903/1825] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:39:18 2022] DELETE /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:39:18.936794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-332af4d0-908a-4654-b3e7-64b11774d145 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102b559700>, body: {"security_group_rule": {"parent_group_id": "f2de8ced-0e99-44b3-a27e-92968f6a1555", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:19.186208 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-332af4d0-908a-4654-b3e7-64b11774d145 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] HTTP exception thrown: This rule already exists in group f2de8ced-0e99-44b3-a27e-92968f6a1555 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-332af4d0-908a-4654-b3e7-64b11774d145 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Request method failure captured: Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 138 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1hFv_oa6L4458yyoix1zN5o7oejxWEjzymesW1bcR_BZ6tdVpf-RTc4PeAJQlwjzw0rmlMiOAFAZMucM12WOtJqepjHrtonVtRKSqqOdxZz29P1V6NHO_hVyBri6Z_9EHY4ovG3tvd5Uw8XkCO0b8eIyP4BykVJ8szLXLkIYRAXmk Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: aaa4ce6a75174a9ab4cee4c59166e9f0 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: {"security_group_rule": {"parent_group_id": "f2de8ced-0e99-44b3-a27e-92968f6a1555", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: exception: This rule already exists in group f2de8ced-0e99-44b3-a27e-92968f6a1555 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f2de8ced-0e99-44b3-a27e-92968f6a1555', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f2de8ced-0e99-44b3-a27e-92968f6a1555 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f2de8ced-0e99-44b3-a27e-92968f6a1555 Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:19.189659 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:19.193017 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:19.193017 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:19.193017 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f2de8ced-0e99-44b3-a27e-92968f6a1555 Aug 24 03:39:19.193017 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:19.198552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-332af4d0-908a-4654-b3e7-64b11774d145 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Returning 400 to user: This rule already exists in group f2de8ced-0e99-44b3-a27e-92968f6a1555 {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:19.200588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-332af4d0-908a-4654-b3e7-64b11774d145 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.277408 Aug 24 03:39:19.201733 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 904/1826] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:39:18 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:39:19.222013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:19.227000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:19.251233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.253201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.255084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.257970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.259091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.261645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.799913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:19.846507 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1fba8e2c-9e05-4ac8-a42d-979dd562f94c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 0.642959 Aug 24 03:39:19.852940 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 905/1827] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:19 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:19.909926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-226c2fbf-7063-47df-9733-c2de679308a1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Calling method '.version_select at 0x7f102b33ad30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:20.597356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-226c2fbf-7063-47df-9733-c2de679308a1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/f7d8b2e2-256b-4d1d-ba34-29f2aa0334be" status: 202 len: 0 microversion: 2.1 time: 0.727305 Aug 24 03:39:20.598287 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 906/1828] 10.222.0.58 () {58 vars in 1287 bytes} [Wed Aug 24 03:39:19 2022] DELETE /compute/v2.1/os-security-group-rules/f7d8b2e2-256b-4d1d-ba34-29f2aa0334be => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:20.608034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2ddf93b-d6e9-429d-ad9c-31a75001744a tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102b111b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-975630693", "description": "tempest-description-1034460763"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:21.142668 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2ddf93b-d6e9-429d-ad9c-31a75001744a tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.538397 Aug 24 03:39:21.153008 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 907/1829] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:39:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:21.165074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:21.168402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:21.193511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:21.193752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:21.201872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:21.203766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:21.205354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:21.206140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:21.674544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:21.694373 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b03da9b0-e2c1-49a7-9716-4019bd07eec1 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1506 microversion: 2.1 time: 0.539490 Aug 24 03:39:21.702288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 908/1830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:21 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:21.728582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef87751e-c035-4601-939f-3b66843b417b tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102b559700>, body: {"security_group_rule": {"parent_group_id": "06f01480-9be1-4a8c-9399-0e8e44a2d9c3", "ip_protocol": "tcp", "from_port": 926366361, "to_port": 22}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:21.838987 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-ef87751e-c035-4601-939f-3b66843b417b tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] HTTP exception thrown: Invalid port range 926366361:22. Former value cannot be greater than the later Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef87751e-c035-4601-939f-3b66843b417b tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Request method failure captured: Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 145 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1hFv_oa6L4458yyoix1zN5o7oejxWEjzymesW1bcR_BZ6tdVpf-RTc4PeAJQlwjzw0rmlMiOAFAZMucM12WOtJqepjHrtonVtRKSqqOdxZz29P1V6NHO_hVyBri6Z_9EHY4ovG3tvd5Uw8XkCO0b8eIyP4BykVJ8szLXLkIYRAXmk Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: aaa4ce6a75174a9ab4cee4c59166e9f0 Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: {"security_group_rule": {"parent_group_id": "06f01480-9be1-4a8c-9399-0e8e44a2d9c3", "ip_protocol": "tcp", "from_port": 926366361, "to_port": 22}} Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid port range 926366361:22. Former value cannot be greater than the later Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'security_group_rule': {'parent_group_id': '06f01480-9be1-4a8c-9399-0e8e44a2d9c3', 'ip_protocol': 'tcp', 'from_port': 926366361, 'to_port': 22}}} Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 926366361:22. Former value cannot be greater than the later Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 926366361:22. Former value cannot be greater than the later Aug 24 03:39:21.842193 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 926366361:22. Former value cannot be greater than the later Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.845266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef87751e-c035-4601-939f-3b66843b417b tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Returning 400 to user: Invalid port range 926366361:22. Former value cannot be greater than the later {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:21.846055 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef87751e-c035-4601-939f-3b66843b417b tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.140591 Aug 24 03:39:21.860543 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 909/1831] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:39:21 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:39:21.899932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3674dd0d-3d91-47e4-93d2-b5c6a12fd9c1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102aec25e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1884912535", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:21.901957 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3674dd0d-3d91-47e4-93d2-b5c6a12fd9c1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] HTTP exception thrown: Security group id should be uuid Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3674dd0d-3d91-47e4-93d2-b5c6a12fd9c1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Request method failure captured: Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 131 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1hFv_oa6L4458yyoix1zN5o7oejxWEjzymesW1bcR_BZ6tdVpf-RTc4PeAJQlwjzw0rmlMiOAFAZMucM12WOtJqepjHrtonVtRKSqqOdxZz29P1V6NHO_hVyBri6Z_9EHY4ovG3tvd5Uw8XkCO0b8eIyP4BykVJ8szLXLkIYRAXmk Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: aaa4ce6a75174a9ab4cee4c59166e9f0 Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1884912535", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: exception: Security group id should be uuid Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1884912535', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:21.924415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:21.927722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 24 03:39:21.927722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:21.927722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3674dd0d-3d91-47e4-93d2-b5c6a12fd9c1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Returning 400 to user: Security group id should be uuid {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:21.927722 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3674dd0d-3d91-47e4-93d2-b5c6a12fd9c1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.061140 Aug 24 03:39:21.927722 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 910/1832] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:39:21 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:21.963416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-715acee6-08bd-445a-9b18-a1e8c00072bb tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102aec25e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1050945396", "description": "tempest-description-567971698"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:22.325121 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-715acee6-08bd-445a-9b18-a1e8c00072bb tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.384556 Aug 24 03:39:22.326945 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 911/1833] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:39:21 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:22.340314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e5b2bbe-3220-42ad-b994-a5cb4d365187 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102afc21f0>, body: {"security_group_rule": {"parent_group_id": "8a77bb17-904c-460d-828a-5bcfcdaaf02d", "ip_protocol": "tempest-999-1103577200", "from_port": 22, "to_port": 22}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:22.482981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7e5b2bbe-3220-42ad-b994-a5cb4d365187 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] HTTP exception thrown: Invalid IP protocol tempest-999-1103577200. Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e5b2bbe-3220-42ad-b994-a5cb4d365187 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Request method failure captured: Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 157 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1hFv_oa6L4458yyoix1zN5o7oejxWEjzymesW1bcR_BZ6tdVpf-RTc4PeAJQlwjzw0rmlMiOAFAZMucM12WOtJqepjHrtonVtRKSqqOdxZz29P1V6NHO_hVyBri6Z_9EHY4ovG3tvd5Uw8XkCO0b8eIyP4BykVJ8szLXLkIYRAXmk Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: aaa4ce6a75174a9ab4cee4c59166e9f0 Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: {"security_group_rule": {"parent_group_id": "8a77bb17-904c-460d-828a-5bcfcdaaf02d", "ip_protocol": "tempest-999-1103577200", "from_port": 22, "to_port": 22}} Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid IP protocol tempest-999-1103577200. Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8a77bb17-904c-460d-828a-5bcfcdaaf02d', 'ip_protocol': 'tempest-999-1103577200', 'from_port': 22, 'to_port': 22}}} Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1103577200. Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1103577200. Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:22.485157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1103577200. Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:22.491208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e5b2bbe-3220-42ad-b994-a5cb4d365187 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Returning 400 to user: Invalid IP protocol tempest-999-1103577200. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:22.493174 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7e5b2bbe-3220-42ad-b994-a5cb4d365187 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.157675 Aug 24 03:39:22.493937 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 912/1834] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:39:22 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:39:22.516893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b728ad3e-ba5a-4a09-bb07-6a24fdda2e7a tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102b0daca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1480802737", "description": "tempest-description-1228687407"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:24.521132 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b728ad3e-ba5a-4a09-bb07-6a24fdda2e7a tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.020681 Aug 24 03:39:24.523225 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 913/1835] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:39:22 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:24.529324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:24.533100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:24.577671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.578267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.582943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.590800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.592424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.594662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.606725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=25 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:25.243549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:25.265388 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-524a4766-aefe-44ba-a2c7-b56b36b03d2a tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 200 len: 1464 microversion: 2.1 time: 0.734351 Aug 24 03:39:25.266968 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 914/1836] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:24 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 1464 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:25.303238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-305bc157-bd51-4eb4-a8fb-c1f9adaf6855 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102acc6790>, body: {"security_group_rule": {"parent_group_id": "82776d33-6728-4011-9186-6e785a408514", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:25.553217 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-305bc157-bd51-4eb4-a8fb-c1f9adaf6855 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-305bc157-bd51-4eb4-a8fb-c1f9adaf6855 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Request method failure captured: Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 138 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1hFv_oa6L4458yyoix1zN5o7oejxWEjzymesW1bcR_BZ6tdVpf-RTc4PeAJQlwjzw0rmlMiOAFAZMucM12WOtJqepjHrtonVtRKSqqOdxZz29P1V6NHO_hVyBri6Z_9EHY4ovG3tvd5Uw8XkCO0b8eIyP4BykVJ8szLXLkIYRAXmk Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: aaa4ce6a75174a9ab4cee4c59166e9f0 Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: {"security_group_rule": {"parent_group_id": "82776d33-6728-4011-9186-6e785a408514", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'security_group_rule': {'parent_group_id': '82776d33-6728-4011-9186-6e785a408514', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 03:39:25.555266 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:25.559122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-305bc157-bd51-4eb4-a8fb-c1f9adaf6855 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:25.561889 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-305bc157-bd51-4eb4-a8fb-c1f9adaf6855 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.287188 Aug 24 03:39:25.563255 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 915/1837] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:39:25 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:39:25.582271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-477052975", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "e82726ef-a025-45c3-aa4d-3c2de00d11c8"}, {"uuid": "6fa1dc19-32db-4dda-a61f-e4b67739e89b"}, {"uuid": "e82726ef-a025-45c3-aa4d-3c2de00d11c8"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:25.737080 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d23e9f5d-2d92-41e7-9597-6ff648608dc5 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.924081 Aug 24 03:39:25.739845 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 923/1838] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:39:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:25.776416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c4de17c3-5c30-4aec-9f5a-cc5dde67f701 req-c948c9bc-1610-47f8-8932-9c8cb5867c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a88c6df-91cd-486d-aae0-9be3bf679962", "name": "network-vif-deleted", "tag": "3839be9d-1381-43cc-a476-105a79d25947"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:25.820511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4de17c3-5c30-4aec-9f5a-cc5dde67f701 req-c948c9bc-1610-47f8-8932-9c8cb5867c9a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.825741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4de17c3-5c30-4aec-9f5a-cc5dde67f701 req-c948c9bc-1610-47f8-8932-9c8cb5867c9a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.827522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4de17c3-5c30-4aec-9f5a-cc5dde67f701 req-c948c9bc-1610-47f8-8932-9c8cb5867c9a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:25.860969 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c4de17c3-5c30-4aec-9f5a-cc5dde67f701 req-c948c9bc-1610-47f8-8932-9c8cb5867c9a service nova] Creating event network-vif-deleted:3839be9d-1381-43cc-a476-105a79d25947 for instance 6a88c6df-91cd-486d-aae0-9be3bf679962 on n-h1-846470-15 Aug 24 03:39:25.870483 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c4de17c3-5c30-4aec-9f5a-cc5dde67f701 req-c948c9bc-1610-47f8-8932-9c8cb5867c9a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128699 Aug 24 03:39:25.871656 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 924/1839] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:25.875129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] validate_networks() for [('e82726ef-a025-45c3-aa4d-3c2de00d11c8', None, None, None, None, None), ('6fa1dc19-32db-4dda-a61f-e4b67739e89b', None, None, None, None, None), ('e82726ef-a025-45c3-aa4d-3c2de00d11c8', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:39:25.880417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a63a8cae-a924-4834-97ef-ee1d2e2dbce6 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f1034241550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-889088930", "description": "tempest-description-1778835623"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:26.348574 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a63a8cae-a924-4834-97ef-ee1d2e2dbce6 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.475255 Aug 24 03:39:26.360622 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 925/1840] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:39:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:26.360622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.184"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:26.360622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:26.374840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:26.376170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:26.378408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:26.379266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:26.381357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:26.381899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:26.447696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:39:26.448236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquired lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:39:28.507078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:39:28.509212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:39:28.510893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:39:28.513495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:39:28.516542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:39:28.549448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.550220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.552302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.553441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.555023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.557352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.606799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Getting quotas for project 79f82857fdf14747a44bc05640804363. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:28.621586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Getting quotas for user fb3951916c5a4aedb1ba04a7cf01ffb3 and project 79f82857fdf14747a44bc05640804363. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:28.655908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:39:28.668388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:39:28.767219 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-22b4f003-e3df-45b0-b655-bfec4ed48b14 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.202435 Aug 24 03:39:28.770535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 916/1841] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:39:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:39:28.783439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:28.785370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 6a88c6df-91cd-486d-aae0-9be3bf679962] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:28.816145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.817894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.818698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.820995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.821833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.822580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.852437 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] HTTP exception thrown: Instance 6a88c6df-91cd-486d-aae0-9be3bf679962 could not be found. Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Request method failure captured: Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 HTTP/1.1 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZzj5M-bw1MsqsWsTktiqfNIxGncFNZRSRC4Ac88-mjq4qZYNJMJuvD2qbT4JCYTfAEDbICsSMpfcjW2pK6e2au_gPK0oU-Ifp-bxprbIsgP45M3DXQKT6r4tgis-1p5TFrVv9M0fiVDuL4TQOjjNxCo8lxGZJWQbTyW4vgi76RnaWw Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 04347edb8512486a8a8cf69229522348 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerRescueTestJSON-1444415653 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_04347edb8512486a8a8cf69229522348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/04347edb8512486a8a8cf69229522348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/04347edb8512486a8a8cf69229522348"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/04347edb8512486a8a8cf69229522348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerRescueTestJSON-1444415653 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 04347edb8512486a8a8cf69229522348 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerRescueTestJSON-1444415653 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerRescueTestJSON-1444415653-project Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 31d9689ec7554610881c5683ca4ca405 Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerRescueTestJSON-1444415653-project Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 6a88c6df-91cd-486d-aae0-9be3bf679962 could not be found. Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '6a88c6df-91cd-486d-aae0-9be3bf679962'} Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a88c6df-91cd-486d-aae0-9be3bf679962 could not be found. Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a88c6df-91cd-486d-aae0-9be3bf679962 could not be found. Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:28.866087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:28.870342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:28.870342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:28.870342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:28.870342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:28.870342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:28.870342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a88c6df-91cd-486d-aae0-9be3bf679962 could not be found. Aug 24 03:39:28.870342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:28.872399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Returning 404 to user: Instance 6a88c6df-91cd-486d-aae0-9be3bf679962 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:28.873495 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f91bcbf-28b2-4e69-afdc-d2156921c50b tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962" status: 404 len: 111 microversion: 2.1 time: 0.101761 Aug 24 03:39:28.876616 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 917/1842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:28 2022] GET /compute/v2.1/servers/6a88c6df-91cd-486d-aae0-9be3bf679962 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:39:28.914002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-97196637-ab44-4940-9be3-83c7de75b0f6 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102afe5160>, body: {"security_group_rule": {"parent_group_id": "4df17cad-5c57-43e8-8ed2-576ad5607e32", "ip_protocol": "tcp", "from_port": 22, "to_port": 1962284511}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:29.216491 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-97196637-ab44-4940-9be3-83c7de75b0f6 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] HTTP exception thrown: Invalid port range 22:1962284511. Valid TCP ports should be between 1-65535 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-97196637-ab44-4940-9be3-83c7de75b0f6 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Request method failure captured: Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 146 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1hFv_oa6L4458yyoix1zN5o7oejxWEjzymesW1bcR_BZ6tdVpf-RTc4PeAJQlwjzw0rmlMiOAFAZMucM12WOtJqepjHrtonVtRKSqqOdxZz29P1V6NHO_hVyBri6Z_9EHY4ovG3tvd5Uw8XkCO0b8eIyP4BykVJ8szLXLkIYRAXmk Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: aaa4ce6a75174a9ab4cee4c59166e9f0 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: {"security_group_rule": {"parent_group_id": "4df17cad-5c57-43e8-8ed2-576ad5607e32", "ip_protocol": "tcp", "from_port": 22, "to_port": 1962284511}} Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid port range 22:1962284511. Valid TCP ports should be between 1-65535 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4df17cad-5c57-43e8-8ed2-576ad5607e32', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1962284511}}} Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1962284511. Valid TCP ports should be between 1-65535 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1962284511. Valid TCP ports should be between 1-65535 Aug 24 03:39:29.219441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1962284511. Valid TCP ports should be between 1-65535 Aug 24 03:39:29.223130 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.225364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-97196637-ab44-4940-9be3-83c7de75b0f6 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Returning 400 to user: Invalid port range 22:1962284511. Valid TCP ports should be between 1-65535 {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:29.226683 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-97196637-ab44-4940-9be3-83c7de75b0f6 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.341483 Aug 24 03:39:29.227756 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 918/1843] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:39:28 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 347 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:39:29.638173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-265179884", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7f7d79fe-5369-4b60-bc8d-97cdf54981c1"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:29.813437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] validate_networks() for [('7f7d79fe-5369-4b60-bc8d-97cdf54981c1', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:39:30.825271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:39:30.917008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:39:30.917477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:39:30.917928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:39:30.918288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:39:30.918696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:39:30.949265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.955639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.956142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.956969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.957507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.957936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.029438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:31.049528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for user 73ddcba828514d1882d2cd02d357bef8 and project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:31.091894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:39:31.115952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:39:31.316413 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eccfc1dd-2007-4fec-b76f-3183119f756b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074836 Aug 24 03:39:31.323559 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 919/1844] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:39:31.329235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:31.330678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:31.347591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.353668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.354291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.355181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.358355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.358979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.559870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.568947 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cfb9e533-d9b6-4e7e-b614-75c1af2dff97 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1272 microversion: 2.1 time: 0.243837 Aug 24 03:39:31.569599 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 920/1845] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:31 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:31.593813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:31.594437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:31.638775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.639370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.639775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.640549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.641038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.641474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.712040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:31.913635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4fcb4285-13bd-45dc-8a25-4a8eabd0e091 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "DELETE /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 204 len: 0 microversion: 2.1 time: 0.323616 Aug 24 03:39:31.918938 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 921/1846] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:39:31 2022] DELETE /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:39:31.936895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57ddd97b-8060-414c-b05a-d033178e85d9 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Action: 'create', calling method: .version_select at 0x7f102b111670>, body: {"security_group_rule": {"parent_group_id": "07350f3a-89e4-4145-a2e2-8a5542b0243c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:32.186886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-57ddd97b-8060-414c-b05a-d033178e85d9 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 07350f3a-89e4-4145-a2e2-8a5542b0243c does not exist", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:39:32.187784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.security_group_api [None req-57ddd97b-8060-414c-b05a-d033178e85d9 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Neutron security group 07350f3a-89e4-4145-a2e2-8a5542b0243c not found {{(pid=122535) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 03:39:32.188562 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-57ddd97b-8060-414c-b05a-d033178e85d9 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] HTTP exception thrown: Security group 07350f3a-89e4-4145-a2e2-8a5542b0243c does not exist Aug 24 03:39:32.188562 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-82effa97-c243-402e-9869-1fdafb346d8d'] Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57ddd97b-8060-414c-b05a-d033178e85d9 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Request method failure captured: Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 138 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1hFv_oa6L4458yyoix1zN5o7oejxWEjzymesW1bcR_BZ6tdVpf-RTc4PeAJQlwjzw0rmlMiOAFAZMucM12WOtJqepjHrtonVtRKSqqOdxZz29P1V6NHO_hVyBri6Z_9EHY4ovG3tvd5Uw8XkCO0b8eIyP4BykVJ8szLXLkIYRAXmk Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: aaa4ce6a75174a9ab4cee4c59166e9f0 Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: {"security_group_rule": {"parent_group_id": "07350f3a-89e4-4145-a2e2-8a5542b0243c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: exception: Security group 07350f3a-89e4-4145-a2e2-8a5542b0243c does not exist Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-82effa97-c243-402e-9869-1fdafb346d8d'] Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'security_group_rule': {'parent_group_id': '07350f3a-89e4-4145-a2e2-8a5542b0243c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:39:32.192235 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 07350f3a-89e4-4145-a2e2-8a5542b0243c does not exist Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82effa97-c243-402e-9869-1fdafb346d8d'] Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 07350f3a-89e4-4145-a2e2-8a5542b0243c does not exist Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82effa97-c243-402e-9869-1fdafb346d8d'] Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 07350f3a-89e4-4145-a2e2-8a5542b0243c does not exist Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82effa97-c243-402e-9869-1fdafb346d8d'] Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 07350f3a-89e4-4145-a2e2-8a5542b0243c does not exist Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82effa97-c243-402e-9869-1fdafb346d8d'] Aug 24 03:39:32.196460 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.200280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57ddd97b-8060-414c-b05a-d033178e85d9 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Returning 404 to user: Security group 07350f3a-89e4-4145-a2e2-8a5542b0243c does not exist Aug 24 03:39:32.200280 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-82effa97-c243-402e-9869-1fdafb346d8d'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:32.201481 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-57ddd97b-8060-414c-b05a-d033178e85d9 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.281512 Aug 24 03:39:32.202644 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 922/1847] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 24 03:39:31 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:39:32.217047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f18483c8-b546-40b9-be8a-ddadf5c23e04 req-fd3d3e71-2e3e-40ad-ab01-25e0ed99b156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b6d358-1b82-4c99-8bab-048d28385fe5", "tag": "3e07d450-4b64-4d9b-b95e-f418dde28d80"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:32.247570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f18483c8-b546-40b9-be8a-ddadf5c23e04 req-fd3d3e71-2e3e-40ad-ab01-25e0ed99b156 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.249598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f18483c8-b546-40b9-be8a-ddadf5c23e04 req-fd3d3e71-2e3e-40ad-ab01-25e0ed99b156 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.251010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f18483c8-b546-40b9-be8a-ddadf5c23e04 req-fd3d3e71-2e3e-40ad-ab01-25e0ed99b156 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.281564 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f18483c8-b546-40b9-be8a-ddadf5c23e04 req-fd3d3e71-2e3e-40ad-ab01-25e0ed99b156 service nova] Creating event network-changed:3e07d450-4b64-4d9b-b95e-f418dde28d80 for instance 04b6d358-1b82-4c99-8bab-048d28385fe5 on n-h1-846470-15 Aug 24 03:39:32.301226 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f18483c8-b546-40b9-be8a-ddadf5c23e04 req-fd3d3e71-2e3e-40ad-ab01-25e0ed99b156 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097007 Aug 24 03:39:32.304239 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 923/1848] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:32.332776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c06ab198-1330-4ec4-93b6-2cc13b736025 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.335282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c06ab198-1330-4ec4-93b6-2cc13b736025 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:32.448756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Updating instance_info_cache with network_info: [{"id": "3e07d450-4b64-4d9b-b95e-f418dde28d80", "address": "fa:16:3e:0f:85:27", "network": {"id": "523345b3-3b31-4398-81f6-32e2319a7503", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-19911293-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8346bc75f4de4e9b9c864d4f7c8b6e75", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3e07d450-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:39:32.472133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Releasing lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:39:32.473100 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b226e66a-79f9-4e94-a007-ed4fc41af62d tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action" status: 202 len: 0 microversion: 2.1 time: 6.122156 Aug 24 03:39:32.479014 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 926/1849] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:39:26 2022] POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action => generated 0 bytes in 6126 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 03:39:32.539203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.548347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:32.557975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.562688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.563325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.565544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.566717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.568793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.592036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c06ab198-1330-4ec4-93b6-2cc13b736025 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:32.599974 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c06ab198-1330-4ec4-93b6-2cc13b736025 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1210 microversion: 2.1 time: 0.294242 Aug 24 03:39:32.604474 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 924/1850] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:32 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1210 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:32.609736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3448e5d6-aec5-468f-845f-864230fbe545 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Calling method '.version_select at 0x7f102b111b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.957018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-3448e5d6-aec5-468f-845f-864230fbe545 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 does not exist", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:39:32.958486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.security_group_api [None req-3448e5d6-aec5-468f-845f-864230fbe545 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Neutron security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 not found {{(pid=122535) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 24 03:39:32.959464 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3448e5d6-aec5-468f-845f-864230fbe545 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] HTTP exception thrown: Security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 does not exist Aug 24 03:39:32.959464 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-6f1ff808-4f3a-4f80-a7e7-8088b46bcdca'] Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3448e5d6-aec5-468f-845f-864230fbe545 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Request method failure captured: Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-security-group-rules/486de962-2129-41c8-8a7a-4f79304a1cf6 HTTP/1.1 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1hFv_oa6L4458yyoix1zN5o7oejxWEjzymesW1bcR_BZ6tdVpf-RTc4PeAJQlwjzw0rmlMiOAFAZMucM12WOtJqepjHrtonVtRKSqqOdxZz29P1V6NHO_hVyBri6Z_9EHY4ovG3tvd5Uw8XkCO0b8eIyP4BykVJ8szLXLkIYRAXmk Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/757dc6eb9b144279b6bf8f5a6adfe9b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 757dc6eb9b144279b6bf8f5a6adfe9b1 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: aaa4ce6a75174a9ab4cee4c59166e9f0 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: exception: Security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 does not exist Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-6f1ff808-4f3a-4f80-a7e7-8088b46bcdca'] Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '486de962-2129-41c8-8a7a-4f79304a1cf6'} Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:39:32.961930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 does not exist Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f1ff808-4f3a-4f80-a7e7-8088b46bcdca'] Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 does not exist Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f1ff808-4f3a-4f80-a7e7-8088b46bcdca'] Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 does not exist Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f1ff808-4f3a-4f80-a7e7-8088b46bcdca'] Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 does not exist Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f1ff808-4f3a-4f80-a7e7-8088b46bcdca'] Aug 24 03:39:32.965666 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.970631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3448e5d6-aec5-468f-845f-864230fbe545 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Returning 404 to user: Security group rule 486de962-2129-41c8-8a7a-4f79304a1cf6 does not exist Aug 24 03:39:32.970631 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-6f1ff808-4f3a-4f80-a7e7-8088b46bcdca'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:32.972953 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3448e5d6-aec5-468f-845f-864230fbe545 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/486de962-2129-41c8-8a7a-4f79304a1cf6" status: 404 len: 199 microversion: 2.1 time: 0.366745 Aug 24 03:39:32.974057 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 925/1851] 10.222.0.58 () {58 vars in 1287 bytes} [Wed Aug 24 03:39:32 2022] DELETE /compute/v2.1/os-security-group-rules/486de962-2129-41c8-8a7a-4f79304a1cf6 => generated 199 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:39:32.998804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-92ab79b7-33e7-42ec-be78-1ff4c1f90fb8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'create', calling method: .version_select at 0x7f102aec2430>, body: {"pool": "675efafd-0e2c-48c3-ab9a-d342ba711621"} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:33.007744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:33.034390 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f2117004-ef16-4662-a5d9-280887e1440c tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1492 microversion: 2.1 time: 0.556636 Aug 24 03:39:33.036163 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 927/1852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:32 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1492 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:33.067726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:33.070759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:33.101830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.107984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.109588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.111471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.112725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.113808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.265476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:33.275481 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d73c707-510c-4c88-a298-09d1717b8452 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1270 microversion: 2.1 time: 0.237414 Aug 24 03:39:33.289423 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 928/1853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:33 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:33.296915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15665df8-99b1-4899-8116-f09c875d1f8b tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Calling method '.version_select at 0x7f10341df820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:33.773240 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15665df8-99b1-4899-8116-f09c875d1f8b tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/4df17cad-5c57-43e8-8ed2-576ad5607e32" status: 202 len: 0 microversion: 2.1 time: 0.482465 Aug 24 03:39:33.774939 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 929/1854] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:39:33 2022] DELETE /compute/v2.1/os-security-groups/4df17cad-5c57-43e8-8ed2-576ad5607e32 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:33.781718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:33.783441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:33.801535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.802118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.802660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.806632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.807132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.807580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.153327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:34.180011 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f14a48c-5920-4865-97b2-ef278b60e65b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1270 microversion: 2.1 time: 0.401491 Aug 24 03:39:34.187537 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 930/1855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:33 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1270 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:34.257461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55cf6121-5dc4-4200-9323-7b258115b3ea tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Calling method '.version_select at 0x7f10341df940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.610202 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55cf6121-5dc4-4200-9323-7b258115b3ea tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/82776d33-6728-4011-9186-6e785a408514" status: 202 len: 0 microversion: 2.1 time: 2.417846 Aug 24 03:39:36.625354 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 931/1856] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:39:34 2022] DELETE /compute/v2.1/os-security-groups/82776d33-6728-4011-9186-6e785a408514 => generated 0 bytes in 2436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:36.641827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.653777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:36.685061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.696531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.697702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.699234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.700414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.701576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.764098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=68,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:36.954917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31d9689ec7554610881c5683ca4ca405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04347edb8512486a8a8cf69229522348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:36.971805 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-41adfb8a-70c5-42ef-90d5-c13f474285ed tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 200 len: 1285 microversion: 2.1 time: 0.341254 Aug 24 03:39:36.993223 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 932/1857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:36 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 1285 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:37.004993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:37.013494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:37.024505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.033309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.034142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:37.035161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.035977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.036791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.023838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:38.041116 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e00b2576-f6e5-4150-aafa-cde358b9a536 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1312 microversion: 2.1 time: 1.046265 Aug 24 03:39:38.041900 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 933/1858] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:36 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1312 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:38.047336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:38.050966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:38.066425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.069273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.070024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.071105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.075733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.076447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.599705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:38.631566 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-43801c1f-671a-479f-a04e-f8d111b51b28 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1310 microversion: 2.1 time: 0.585726 Aug 24 03:39:38.635072 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 934/1859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:38 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1310 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:38.655237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6da00065-b528-4ceb-82aa-fd5f34644bb6 req-41b409ac-677f-45bb-8fae-d5d5ee4847fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ee8347-236a-43a0-ad11-418f9e4d1dcf", "name": "network-vif-deleted", "tag": "24db3f3d-9a35-4ed5-b252-ebb51e44b12a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:38.678999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6da00065-b528-4ceb-82aa-fd5f34644bb6 req-41b409ac-677f-45bb-8fae-d5d5ee4847fa service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.680233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6da00065-b528-4ceb-82aa-fd5f34644bb6 req-41b409ac-677f-45bb-8fae-d5d5ee4847fa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.682054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6da00065-b528-4ceb-82aa-fd5f34644bb6 req-41b409ac-677f-45bb-8fae-d5d5ee4847fa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.711869 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6da00065-b528-4ceb-82aa-fd5f34644bb6 req-41b409ac-677f-45bb-8fae-d5d5ee4847fa service nova] Creating event network-vif-deleted:24db3f3d-9a35-4ed5-b252-ebb51e44b12a for instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf on n-h2-846470-15 Aug 24 03:39:38.725142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6da00065-b528-4ceb-82aa-fd5f34644bb6 req-41b409ac-677f-45bb-8fae-d5d5ee4847fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085919 Aug 24 03:39:38.726555 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 935/1860] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:38.735807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8345257-1cc8-4d9f-bc3b-68ccefeccd1a tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Calling method '.version_select at 0x7f10341dfe50>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:39.304553 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8345257-1cc8-4d9f-bc3b-68ccefeccd1a tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8a77bb17-904c-460d-828a-5bcfcdaaf02d" status: 202 len: 0 microversion: 2.1 time: 0.566772 Aug 24 03:39:39.306837 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 936/1861] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:39:38 2022] DELETE /compute/v2.1/os-security-groups/8a77bb17-904c-460d-828a-5bcfcdaaf02d => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:39.330672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:39.336087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] [instance: 80ee8347-236a-43a0-ad11-418f9e4d1dcf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:39.346524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.347303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.348369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.350928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.351397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.353435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.382659 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] HTTP exception thrown: Instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf could not be found. Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Request method failure captured: Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf HTTP/1.1 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZzj5M-bw1MsqsWsTktiqfNIxGncFNZRSRC4Ac88-mjq4qZYNJMJuvD2qbT4JCYTfAEDbICsSMpfcjW2pK6e2au_gPK0oU-Ifp-bxprbIsgP45M3DXQKT6r4tgis-1p5TFrVv9M0fiVDuL4TQOjjNxCo8lxGZJWQbTyW4vgi76RnaWw Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 04347edb8512486a8a8cf69229522348 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerRescueTestJSON-1444415653 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_04347edb8512486a8a8cf69229522348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/04347edb8512486a8a8cf69229522348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/04347edb8512486a8a8cf69229522348"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/04347edb8512486a8a8cf69229522348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerRescueTestJSON-1444415653 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 04347edb8512486a8a8cf69229522348 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerRescueTestJSON-1444415653 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerRescueTestJSON-1444415653-project Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 31d9689ec7554610881c5683ca4ca405 Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerRescueTestJSON-1444415653-project Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf could not be found. Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '80ee8347-236a-43a0-ad11-418f9e4d1dcf'} Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf could not be found. Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf could not be found. Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:39.394608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:39:39.399076 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:39.399076 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:39.399076 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:39.399076 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:39.399076 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:39.399076 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf could not be found. Aug 24 03:39:39.399076 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:39:39.406157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] Returning 404 to user: Instance 80ee8347-236a-43a0-ad11-418f9e4d1dcf could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:39.410341 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f36af10d-5bb4-42b4-855d-dae349b32378 tempest-ServerRescueTestJSON-1444415653 tempest-ServerRescueTestJSON-1444415653-project] 10.222.0.58 "GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf" status: 404 len: 111 microversion: 2.1 time: 0.091818 Aug 24 03:39:39.410341 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 937/1862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:39 2022] GET /compute/v2.1/servers/80ee8347-236a-43a0-ad11-418f9e4d1dcf => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:39:39.428591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:39.434553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:39.451209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.456690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.457610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.458718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.464827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.465693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.989310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:41.293734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:41.342465 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3cfe90ee-f16e-4d1d-964b-396108b19c17 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1312 microversion: 2.1 time: 1.917638 Aug 24 03:39:41.344954 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 938/1863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:39 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1312 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:41.356038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1dd6dec9-c581-4616-9904-6fe02e45e3f1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Calling method '.version_select at 0x7f1022efdc10>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.278484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:42.371570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:42.439356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-92ab79b7-33e7-42ec-be78-1ff4c1f90fb8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.446805 Aug 24 03:39:42.440505 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 926/1864] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:39:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:42.455102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.456338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:42.487962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.488828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.489595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.498756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.499843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.500725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.601477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=14 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:43.090848 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1dd6dec9-c581-4616-9904-6fe02e45e3f1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/06f01480-9be1-4a8c-9399-0e8e44a2d9c3" status: 202 len: 0 microversion: 2.1 time: 1.743837 Aug 24 03:39:43.098821 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 939/1865] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:39:41 2022] DELETE /compute/v2.1/os-security-groups/06f01480-9be1-4a8c-9399-0e8e44a2d9c3 => generated 0 bytes in 1753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:43.111000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-727dccea-685f-4679-8ec7-5d2a3231ab62 req-c1235e54-72ca-464e-a938-a89c8695e2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6220a504-caa0-4aaf-829e-73fd6a11c887", "tag": "1eda95c9-2580-4337-8578-3cc683db5689"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:43.178796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-727dccea-685f-4679-8ec7-5d2a3231ab62 req-c1235e54-72ca-464e-a938-a89c8695e2ff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.182395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-727dccea-685f-4679-8ec7-5d2a3231ab62 req-c1235e54-72ca-464e-a938-a89c8695e2ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.183304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-727dccea-685f-4679-8ec7-5d2a3231ab62 req-c1235e54-72ca-464e-a938-a89c8695e2ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.220410 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-727dccea-685f-4679-8ec7-5d2a3231ab62 req-c1235e54-72ca-464e-a938-a89c8695e2ff service nova] Creating event network-changed:1eda95c9-2580-4337-8578-3cc683db5689 for instance 6220a504-caa0-4aaf-829e-73fd6a11c887 on n-h1-846470-15 Aug 24 03:39:43.233342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-727dccea-685f-4679-8ec7-5d2a3231ab62 req-c1235e54-72ca-464e-a938-a89c8695e2ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132584 Aug 24 03:39:43.237480 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 940/1866] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:43.255485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:43.257024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:43.277176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.282959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.284130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.285521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.286231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.287411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.564535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:43.588487 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c120f928-4a1b-47d6-b8a3-307326550819 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1310 microversion: 2.1 time: 1.144589 Aug 24 03:39:43.595795 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 927/1867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:42 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1310 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:43.612099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.114"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:43.615781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:43.628057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.628621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.629069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.629820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.630357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.630950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.742321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:39:43.750802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquired lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:39:44.912252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:44.924953 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-269f6b6d-f3b1-4309-a510-1ded72ece3ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 1.685649 Aug 24 03:39:44.949442 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 941/1868] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:43 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:44.955559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e6024da3-d39c-4336-82b6-26f51e0f99c1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] Calling method '.version_select at 0x7f1034226c10>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:45.348242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.114 (491b906b-138c-4fb2-b1de-564e31140c7b) with port 3e07d450-4b64-4d9b-b95e-f418dde28d80 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 675efafd-0e2c-48c3-ab9a-d342ba711621.", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:39:45.348869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Releasing lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:39:45.349577 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.114 (491b906b-138c-4fb2-b1de-564e31140c7b) with port 3e07d450-4b64-4d9b-b95e-f418dde28d80 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 675efafd-0e2c-48c3-ab9a-d342ba711621. Aug 24 03:39:45.349577 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-3600cf89-be7d-45d7-a58d-3dca2d96046f'] Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Request method failure captured: Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action HTTP/1.1 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 46 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ05prB3OZXQOS1c0IkIYTDBQQbwfS-Yzdfq018YoYxO5j5gliudj14WG3fk18dDkhwdpFnQR6-JNgIIB1QY-tSWirn5a96FSaEnuoV3rfkiTD9Pa_yptjI1JoVUgIzs_YrsSXyEDX0X4FBqEpQsQOAGI26dN_KliVGbilnK2_BOoEY Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 3188bf58d3da43ec9859894ebbee70e5 Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: {"addFloatingIp": {"address": "172.25.4.114"}} Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot associate floating IP 172.25.4.114 (491b906b-138c-4fb2-b1de-564e31140c7b) with port 3e07d450-4b64-4d9b-b95e-f418dde28d80 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 675efafd-0e2c-48c3-ab9a-d342ba711621. Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-3600cf89-be7d-45d7-a58d-3dca2d96046f'] Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '04b6d358-1b82-4c99-8bab-048d28385fe5', 'body': {'addFloatingIp': {'address': '172.25.4.114'}}} Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:39:45.352839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.114 (491b906b-138c-4fb2-b1de-564e31140c7b) with port 3e07d450-4b64-4d9b-b95e-f418dde28d80 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 675efafd-0e2c-48c3-ab9a-d342ba711621. Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3600cf89-be7d-45d7-a58d-3dca2d96046f'] Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.114 (491b906b-138c-4fb2-b1de-564e31140c7b) with port 3e07d450-4b64-4d9b-b95e-f418dde28d80 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 675efafd-0e2c-48c3-ab9a-d342ba711621. Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3600cf89-be7d-45d7-a58d-3dca2d96046f'] Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.114 (491b906b-138c-4fb2-b1de-564e31140c7b) with port 3e07d450-4b64-4d9b-b95e-f418dde28d80 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 675efafd-0e2c-48c3-ab9a-d342ba711621. Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3600cf89-be7d-45d7-a58d-3dca2d96046f'] Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.114 (491b906b-138c-4fb2-b1de-564e31140c7b) with port 3e07d450-4b64-4d9b-b95e-f418dde28d80 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 675efafd-0e2c-48c3-ab9a-d342ba711621. Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3600cf89-be7d-45d7-a58d-3dca2d96046f'] Aug 24 03:39:45.358635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:39:45.362046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Returning 400 to user: Cannot associate floating IP 172.25.4.114 (491b906b-138c-4fb2-b1de-564e31140c7b) with port 3e07d450-4b64-4d9b-b95e-f418dde28d80 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 675efafd-0e2c-48c3-ab9a-d342ba711621. Aug 24 03:39:45.362046 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-3600cf89-be7d-45d7-a58d-3dca2d96046f'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:45.362046 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e4dcc375-f576-43f7-a82e-025f5a4ae1fd tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action" status: 400 len: 382 microversion: 2.1 time: 1.757460 Aug 24 03:39:45.362046 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 928/1869] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:39:43 2022] POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action => generated 382 bytes in 1759 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:39:45.366603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:45.367287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:45.393616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:45.394140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:45.394594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:45.395339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:45.396277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:45.397087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.377039 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e6024da3-d39c-4336-82b6-26f51e0f99c1 tempest-SecurityGroupRulesNegativeTestJSON-1007714279 tempest-SecurityGroupRulesNegativeTestJSON-1007714279-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/f2de8ced-0e99-44b3-a27e-92968f6a1555" status: 202 len: 0 microversion: 2.1 time: 1.425703 Aug 24 03:39:46.381610 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 942/1870] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:39:44 2022] DELETE /compute/v2.1/os-security-groups/f2de8ced-0e99-44b3-a27e-92968f6a1555 => generated 0 bytes in 1431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:46.390672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-43db278c-01f6-44b6-9e85-937d931b1c4e tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '.version_select at 0x7f103423ad30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:46.585075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.598163 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-065ca7c7-e0ff-4929-9185-f92475d5f1f3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1310 microversion: 2.1 time: 1.239200 Aug 24 03:39:46.613259 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 929/1871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:45 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1310 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:46.628886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:46.634934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:46.651578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.652158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.652604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.654272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.654745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.655436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.125093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:47.136574 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a49f133-a37d-4e02-95d1-ec9a32fbdf7e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 0.519676 Aug 24 03:39:47.137281 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 930/1872] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:46 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:47.633826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:47.636864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:47.657078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.660481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.661043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.666666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.667805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.669250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.365771 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-43db278c-01f6-44b6-9e85-937d931b1c4e tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/491b906b-138c-4fb2-b1de-564e31140c7b" status: 202 len: 0 microversion: 2.1 time: 2.982853 Aug 24 03:39:49.368463 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 943/1873] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:39:46 2022] DELETE /compute/v2.1/os-floating-ips/491b906b-138c-4fb2-b1de-564e31140c7b => generated 0 bytes in 2986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:49.381799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d8d7024f-1558-4370-9cb8-35ce9ef00e4b req-ebcc8c92-2cae-4c3a-90ea-942b83b5ee66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "tag": "829b9223-e7bf-4f5f-b57b-8942d8d53c99"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:49.403825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:49.404872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d8d7024f-1558-4370-9cb8-35ce9ef00e4b req-ebcc8c92-2cae-4c3a-90ea-942b83b5ee66 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.406241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d8d7024f-1558-4370-9cb8-35ce9ef00e4b req-ebcc8c92-2cae-4c3a-90ea-942b83b5ee66 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.407217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d8d7024f-1558-4370-9cb8-35ce9ef00e4b req-ebcc8c92-2cae-4c3a-90ea-942b83b5ee66 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.419926 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fda43567-db17-4e31-8d64-8bbcb7844596 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1310 microversion: 2.1 time: 1.804877 Aug 24 03:39:49.422913 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 931/1874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:47 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1310 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:49.433295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:49.440717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:49.443446 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d8d7024f-1558-4370-9cb8-35ce9ef00e4b req-ebcc8c92-2cae-4c3a-90ea-942b83b5ee66 service nova] Creating event network-changed:829b9223-e7bf-4f5f-b57b-8942d8d53c99 for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:39:49.459760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d8d7024f-1558-4370-9cb8-35ce9ef00e4b req-ebcc8c92-2cae-4c3a-90ea-942b83b5ee66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086510 Aug 24 03:39:49.462619 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 944/1875] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:49.479164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.481638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.184"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:49.482140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.483027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.484286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.492944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.494221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.268187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:50.275708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.276526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.276976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.277748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.278213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.292368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.715995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:50.732086 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81c746d0-0da1-48d8-91c1-5dbd5dd2f686 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 1.305567 Aug 24 03:39:50.733024 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 932/1876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:49 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:50.738449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:50.739515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:50.750111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.759004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.759810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.760747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.761377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.761970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.170790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:39:51.172846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquired lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:39:51.395761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:51.411569 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3915f1d2-cbb6-41a0-8ae4-c69e35515a5e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1310 microversion: 2.1 time: 0.677067 Aug 24 03:39:51.412370 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 933/1877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:50 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1310 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:51.758994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:51.760431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:51.780803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:51.781298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:51.781750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.782434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:51.782886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:51.783309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.596141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:52.608932 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4c3ef270-a516-4133-bba9-1e379eaaf2a9 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 0.854673 Aug 24 03:39:52.612590 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 934/1878] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:51 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:52.623451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01815885-4fc4-4caa-ae5b-42e3a51e4c6b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Action: 'create', calling method: .version_select at 0x7f102b5590d0>, body: {"keypair": {"name": "tempest-keypair-359630964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKZZ2sOJh9Y1KzfaKYU4+bNJti6AFVma7Duz4fDLUCPqUW8g0WGF0o32CKBs16TB9HbSj3sOVyyznp6AyWvlYDxVS5hkmPF0N06mw7BdV3e/MgORdu6htxYiNVaLsJnrA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:52.672565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-01815885-4fc4-4caa-ae5b-42e3a51e4c6b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Getting quotas for project 7f897cfbb438455f8ff5aabd10ab4135. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:52.688439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-01815885-4fc4-4caa-ae5b-42e3a51e4c6b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Getting quotas for user 632b0aa8a4694c378ba66f9c2ddf453d and project 7f897cfbb438455f8ff5aabd10ab4135. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:52.749690 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01815885-4fc4-4caa-ae5b-42e3a51e4c6b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.135350 Aug 24 03:39:52.758284 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 935/1879] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 03:39:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:39:52.767495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f82698cc-b8dc-4f3e-8288-d11641be8adb req-cab4dc4d-cd15-4c49-b94a-4a5c47a61f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "tag": "a2b8d076-eb38-492b-bf9c-c76c7ad009f8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:52.786833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f82698cc-b8dc-4f3e-8288-d11641be8adb req-cab4dc4d-cd15-4c49-b94a-4a5c47a61f55 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.787779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f82698cc-b8dc-4f3e-8288-d11641be8adb req-cab4dc4d-cd15-4c49-b94a-4a5c47a61f55 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.788369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f82698cc-b8dc-4f3e-8288-d11641be8adb req-cab4dc4d-cd15-4c49-b94a-4a5c47a61f55 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.802902 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f82698cc-b8dc-4f3e-8288-d11641be8adb req-cab4dc4d-cd15-4c49-b94a-4a5c47a61f55 service nova] Creating event network-changed:a2b8d076-eb38-492b-bf9c-c76c7ad009f8 for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:39:52.812285 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f82698cc-b8dc-4f3e-8288-d11641be8adb req-cab4dc4d-cd15-4c49-b94a-4a5c47a61f55 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051770 Aug 24 03:39:52.814074 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 936/1880] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:52.825808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a43e812c-80b2-4abd-98ea-1031fcd3272a req-707543f7-3431-4445-8e28-b50e6864b24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6220a504-caa0-4aaf-829e-73fd6a11c887", "name": "network-vif-plugged", "status": "completed", "tag": "1eda95c9-2580-4337-8578-3cc683db5689"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:52.844466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a43e812c-80b2-4abd-98ea-1031fcd3272a req-707543f7-3431-4445-8e28-b50e6864b24c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.845248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a43e812c-80b2-4abd-98ea-1031fcd3272a req-707543f7-3431-4445-8e28-b50e6864b24c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.846590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a43e812c-80b2-4abd-98ea-1031fcd3272a req-707543f7-3431-4445-8e28-b50e6864b24c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.862308 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a43e812c-80b2-4abd-98ea-1031fcd3272a req-707543f7-3431-4445-8e28-b50e6864b24c service nova] Creating event network-vif-plugged:1eda95c9-2580-4337-8578-3cc683db5689 for instance 6220a504-caa0-4aaf-829e-73fd6a11c887 on n-h1-846470-15 Aug 24 03:39:52.871993 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a43e812c-80b2-4abd-98ea-1031fcd3272a req-707543f7-3431-4445-8e28-b50e6864b24c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054368 Aug 24 03:39:52.873614 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 937/1881] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:52.881363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:52.882492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.890455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.891566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.892863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.894162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.894866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.895555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:53.352771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:53.372445 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-71e4a593-92b7-41b4-9545-b429d8d0a05e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1310 microversion: 2.1 time: 0.496830 Aug 24 03:39:53.374030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 938/1882] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:52 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1310 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:53.643085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:53.659097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:53.677205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:53.678054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:53.686769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:53.690336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:53.693326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:53.694370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:54.713888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:54.724879 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6e45b36-d85b-41bf-9f8d-263783a17af4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 1.089334 Aug 24 03:39:54.740050 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 939/1883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:53 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:54.753720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:54.754651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:54.768305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:54.768779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:54.769233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:54.771089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:54.776535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:54.777324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.101129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:39:55.432849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:55.442754 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d03ebc79-f2be-4db9-81a1-ffa082cb14eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1310 microversion: 2.1 time: 0.701136 Aug 24 03:39:55.475816 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 940/1884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:54 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1310 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:55.487643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cba47682-e3b4-4ba6-8a0f-ac45be96077f req-8bfc858e-437f-4dd7-9eb5-c77e7f83066c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "tag": "0edbb11e-9e6d-4118-829b-c60cd708d99a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:55.518314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cba47682-e3b4-4ba6-8a0f-ac45be96077f req-8bfc858e-437f-4dd7-9eb5-c77e7f83066c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.518979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cba47682-e3b4-4ba6-8a0f-ac45be96077f req-8bfc858e-437f-4dd7-9eb5-c77e7f83066c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.519582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cba47682-e3b4-4ba6-8a0f-ac45be96077f req-8bfc858e-437f-4dd7-9eb5-c77e7f83066c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.546035 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cba47682-e3b4-4ba6-8a0f-ac45be96077f req-8bfc858e-437f-4dd7-9eb5-c77e7f83066c service nova] Creating event network-changed:0edbb11e-9e6d-4118-829b-c60cd708d99a for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:39:55.554235 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cba47682-e3b4-4ba6-8a0f-ac45be96077f req-8bfc858e-437f-4dd7-9eb5-c77e7f83066c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076883 Aug 24 03:39:55.558372 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 941/1885] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:55.574570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-eeb4c9a9-a23a-4972-8eab-0943ec4a5881 req-0e48dd8c-c1f4-4b83-b526-4849055ceba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b6d358-1b82-4c99-8bab-048d28385fe5", "tag": "3e07d450-4b64-4d9b-b95e-f418dde28d80"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:55.591958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-eeb4c9a9-a23a-4972-8eab-0943ec4a5881 req-0e48dd8c-c1f4-4b83-b526-4849055ceba4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.594263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-eeb4c9a9-a23a-4972-8eab-0943ec4a5881 req-0e48dd8c-c1f4-4b83-b526-4849055ceba4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.595959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-eeb4c9a9-a23a-4972-8eab-0943ec4a5881 req-0e48dd8c-c1f4-4b83-b526-4849055ceba4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.620887 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-eeb4c9a9-a23a-4972-8eab-0943ec4a5881 req-0e48dd8c-c1f4-4b83-b526-4849055ceba4 service nova] Creating event network-changed:3e07d450-4b64-4d9b-b95e-f418dde28d80 for instance 04b6d358-1b82-4c99-8bab-048d28385fe5 on n-h1-846470-15 Aug 24 03:39:55.635702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-eeb4c9a9-a23a-4972-8eab-0943ec4a5881 req-0e48dd8c-c1f4-4b83-b526-4849055ceba4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075373 Aug 24 03:39:55.638099 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 942/1886] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:55.746619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:55.748048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:55.764327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.764885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.765335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.766065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.766870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.767531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.396968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:56.411743 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9b994303-55f2-488b-9fb8-0160d27a87ae tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 0.667619 Aug 24 03:39:56.413400 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 943/1887] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:55 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:56.479571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:56.480547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:56.488862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.489888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.490529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.491775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.492404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.493198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.137385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:58.147408 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04857feb-a189-4ba4-933b-80a53df88a43 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1493 microversion: 2.1 time: 1.672723 Aug 24 03:39:58.148090 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 944/1888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:56 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1493 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:58.177574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:58.178310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:58.201550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.206721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.207609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.208774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.212288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.213231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.950587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Updating instance_info_cache with network_info: [{"id": "3e07d450-4b64-4d9b-b95e-f418dde28d80", "address": "fa:16:3e:0f:85:27", "network": {"id": "523345b3-3b31-4398-81f6-32e2319a7503", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-19911293-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8346bc75f4de4e9b9c864d4f7c8b6e75", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3e07d450-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:39:58.969407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Releasing lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:39:58.974624 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92314b4e-92fa-4e56-9501-7dda16fd5e97 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action" status: 202 len: 0 microversion: 2.1 time: 9.507775 Aug 24 03:39:58.976125 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 945/1889] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:39:49 2022] POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action => generated 0 bytes in 9513 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 03:39:59.534582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:59.553781 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b9b96aa0-c6e2-452d-81a6-f8ef921e1842 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 1.393836 Aug 24 03:39:59.554786 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 945/1890] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:58 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:59.560931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69456f99-234c-4be7-9542-0e4f10eee74c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '.version_select at 0x7f102b559700>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:59.653189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:59.654102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:59.666170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=31 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:59.668239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.668770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.669220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:59.669987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.670453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.670921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.314459 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-582f2750-947f-4e38-83da-806998a2e0d5 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1646 microversion: 2.1 time: 1.336377 Aug 24 03:40:00.332184 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 946/1891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:58 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1646 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:00.341039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:00.341616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:00.359120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.360602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.362231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.364955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.373797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.374546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.299749 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9e38253f-a0cc-4c7b-bd38-a1602cbe8337 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1646 microversion: 2.1 time: 0.964082 Aug 24 03:40:01.304527 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 947/1892] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:00 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1646 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:01.309431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:01.310104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:01.328267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.332763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.333515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.334325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.334957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.335391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.589647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:02.602451 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6fa0b879-68ac-4607-b572-8fecf7d267f6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 1.296639 Aug 24 03:40:02.607024 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 948/1893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:01 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:02.637872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-662631458", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c572cdfc-0a9b-44b5-b29d-18dece397186"}, {"port": "8c9f743c-5577-43e9-ac31-13bc671b37b0", "tag": "port-1"}, {"port": "4eddbd7e-3228-4d35-a9ae-041d1df1dfe1", "tag": "port-2"}, {"uuid": "77f0ae4a-d8b3-4028-a779-428c4b4ec723", "tag": "net-1"}, {"uuid": "77f0ae4a-d8b3-4028-a779-428c4b4ec723"}, {"uuid": "15190e4d-a8f4-4fda-9c97-dededa4beec2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "15190e4d-a8f4-4fda-9c97-dededa4beec2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "09919135-bea9-4284-a048-9bf55e0e55ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3b352720-38fa-4e6e-9317-ef08e337814d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c043eabf-6e0e-4387-b991-b741f8c9ae6a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1751023022"}], "key_name": "tempest-keypair-359630964", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:02.709911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:02.756367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69456f99-234c-4be7-9542-0e4f10eee74c tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/a5cf778a-91e3-4cff-980d-7022c56bcdbf" status: 202 len: 0 microversion: 2.1 time: 3.200225 Aug 24 03:40:02.764402 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 946/1894] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:39:59 2022] DELETE /compute/v2.1/os-floating-ips/a5cf778a-91e3-4cff-980d-7022c56bcdbf => generated 0 bytes in 3207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:02.773771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d8af4b42-11f7-4f2b-b030-30d8b06f37ae tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:02.788854 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:40:02.788854 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:40:02.790831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8af4b42-11f7-4f2b-b030-30d8b06f37ae tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.796601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8af4b42-11f7-4f2b-b030-30d8b06f37ae tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.797581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8af4b42-11f7-4f2b-b030-30d8b06f37ae tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.798753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8af4b42-11f7-4f2b-b030-30d8b06f37ae tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.802476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8af4b42-11f7-4f2b-b030-30d8b06f37ae tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.803352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8af4b42-11f7-4f2b-b030-30d8b06f37ae tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.842447 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d8af4b42-11f7-4f2b-b030-30d8b06f37ae tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.077724 Aug 24 03:40:02.843553 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 947/1895] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 03:40:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:02.849237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-137c619d-9317-4ce1-b34e-4a073353b112 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-137c619d-9317-4ce1-b34e-4a073353b112 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Request method failure captured: Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action HTTP/1.1 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 34 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ05prB3OZXQOS1c0IkIYTDBQQbwfS-Yzdfq018YoYxO5j5gliudj14WG3fk18dDkhwdpFnQR6-JNgIIB1QY-tSWirn5a96FSaEnuoV3rfkiTD9Pa_yptjI1JoVUgIzs_YrsSXyEDX0X4FBqEpQsQOAGI26dN_KliVGbilnK2_BOoEY Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 3188bf58d3da43ec9859894ebbee70e5 Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: {"addFloatingIp": {"address": ""}} Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '04b6d358-1b82-4c99-8bab-048d28385fe5', 'body': {'addFloatingIp': {'address': ''}}} Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi '' Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:40:02.854552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-137c619d-9317-4ce1-b34e-4a073353b112 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-137c619d-9317-4ce1-b34e-4a073353b112 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action" status: 400 len: 142 microversion: 2.1 time: 0.011482 Aug 24 03:40:02.859015 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 948/1896] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:40:02 2022] POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action => generated 142 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:40:02.862057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846470-15", "block_migration": true, "disk_over_commit": false}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:02.864998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:02.874489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.875769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.876362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.877139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.877642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.878087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.919394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lazy-loading 'flavor' on Instance uuid 6220a504-caa0-4aaf-829e-73fd6a11c887 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:40:02.941063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Going to try to live migrate instance to n-h2-846470-15 {{(pid=122535) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:40:02.947360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:03.502128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] validate_networks() for [('c572cdfc-0a9b-44b5-b29d-18dece397186', None, None, None, None, None), (None, None, '8c9f743c-5577-43e9-ac31-13bc671b37b0', None, None, None), (None, None, '4eddbd7e-3228-4d35-a9ae-041d1df1dfe1', None, None, None), ('77f0ae4a-d8b3-4028-a779-428c4b4ec723', None, None, None, None, None), ('77f0ae4a-d8b3-4028-a779-428c4b4ec723', None, None, None, None, None), ('15190e4d-a8f4-4fda-9c97-dededa4beec2', '10.2.2.100', None, None, None, None), ('15190e4d-a8f4-4fda-9c97-dededa4beec2', '10.2.2.200', None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:40:06.408560 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c1db67c3-7ac2-42b1-bea9-9f1bfb4a02f1 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887/action" status: 202 len: 0 microversion: 2.1 time: 3.549365 Aug 24 03:40:06.410970 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 949/1897] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:40:02 2022] POST /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887/action => generated 0 bytes in 3553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:06.431910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:06.465140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:06.499171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:06.501374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:06.503749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:06.507325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:06.511241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:06.512653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:06.577062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:40:06.578388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquired lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:40:07.259336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Releasing lock "refresh_cache-04b6d358-1b82-4c99-8bab-048d28385fe5" {{(pid=122535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:40:07.261122 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] HTTP exception thrown: floating IP not found Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Request method failure captured: Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action HTTP/1.1 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 41 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ05prB3OZXQOS1c0IkIYTDBQQbwfS-Yzdfq018YoYxO5j5gliudj14WG3fk18dDkhwdpFnQR6-JNgIIB1QY-tSWirn5a96FSaEnuoV3rfkiTD9Pa_yptjI1JoVUgIzs_YrsSXyEDX0X4FBqEpQsQOAGI26dN_KliVGbilnK2_BOoEY Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 3188bf58d3da43ec9859894ebbee70e5 Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: exception: floating IP not found Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '04b6d358-1b82-4c99-8bab-048d28385fe5', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 24 03:40:07.263854 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 24 03:40:07.269814 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:07.274442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Returning 404 to user: floating IP not found {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:07.276704 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f46eb0d8-1d60-4836-b7af-2fd24355f7d8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action" status: 404 len: 67 microversion: 2.1 time: 0.862501 Aug 24 03:40:07.278626 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 950/1898] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:40:06 2022] POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action => generated 67 bytes in 866 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:40:07.292526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:07.294079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:07.303619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.304741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.305539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.306917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.307874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.308550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.911558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:07.934820 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a9a66e9b-42a8-472d-a8f0-d69d201fb8d3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 0.654649 Aug 24 03:40:07.935435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 951/1899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:07 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:07.940834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f03984f2-6614-4f40-b2f7-1b16a7db521f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Action: 'create', calling method: .version_select at 0x7f102b1119d0>, body: {"keypair": {"name": "tempest-keypair-1231689129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiqnpLd9E8ermsj7uvbY19DMFqbFQOeEIbgjjpYckpzpa6whtZliVwdoxxZY8NCrL6rDDMfSiMm9syJxUdt1uiX9Ozw61y3BL51glzOQYLHU+6sDmlsa/Ps/7yPmUofSg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:07.996130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f03984f2-6614-4f40-b2f7-1b16a7db521f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Getting quotas for project 7a9ef66358704edf814e8a1f0012e0c3. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:08.007563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f03984f2-6614-4f40-b2f7-1b16a7db521f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Getting quotas for user 27a98cafcc0e4f899bbed446fc4f0432 and project 7a9ef66358704edf814e8a1f0012e0c3. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:08.047286 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f03984f2-6614-4f40-b2f7-1b16a7db521f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.109841 Aug 24 03:40:08.056784 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 952/1900] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 03:40:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:40:08.080061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:08.080894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:08.091421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.092486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.093087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.093977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.094614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.095208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.984208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:08.995305 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bec64f89-c9fc-49c4-90ee-10990be96681 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 0.936522 Aug 24 03:40:09.000047 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 953/1901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:08 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:09.024546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0c173a0-618d-4505-b41a-d0073821f350 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:09.180527 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-a0c173a0-618d-4505-b41a-d0073821f350 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0c173a0-618d-4505-b41a-d0073821f350 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Request method failure captured: Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action HTTP/1.1 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 44 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ05prB3OZXQOS1c0IkIYTDBQQbwfS-Yzdfq018YoYxO5j5gliudj14WG3fk18dDkhwdpFnQR6-JNgIIB1QY-tSWirn5a96FSaEnuoV3rfkiTD9Pa_yptjI1JoVUgIzs_YrsSXyEDX0X4FBqEpQsQOAGI26dN_KliVGbilnK2_BOoEY Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 3188bf58d3da43ec9859894ebbee70e5 Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: exception: Floating IP not found for address 0.0.0.0. Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '04b6d358-1b82-4c99-8bab-048d28385fe5', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 24 03:40:09.183907 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 24 03:40:09.188764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:09.190441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:40:09.191914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:40:09.193893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0c173a0-618d-4505-b41a-d0073821f350 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:09.194587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:40:09.196253 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0c173a0-618d-4505-b41a-d0073821f350 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action" status: 404 len: 88 microversion: 2.1 time: 0.195067 Aug 24 03:40:09.197231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:40:09.198725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:40:09.201427 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 954/1902] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:40:09 2022] POST /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5/action => generated 88 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:40:09.218684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:09.221988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:09.232858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.235002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.236526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.241351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.241874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.242375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.253408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.253926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.254207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=64,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:09.254425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.257225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.259811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.262262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.309732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Getting quotas for project 7f897cfbb438455f8ff5aabd10ab4135. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:09.332226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Getting quotas for user 632b0aa8a4694c378ba66f9c2ddf453d and project 7f897cfbb438455f8ff5aabd10ab4135. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:09.623287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:40:09.628901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='09919135-bea9-4284-a048-9bf55e0e55ee',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3b352720-38fa-4e6e-9317-ef08e337814d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c043eabf-6e0e-4387-b991-b741f8c9ae6a',volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:40:10.368099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:10.382102 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dab30f37-6e40-418c-94de-30d4ecaaafde tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 1.178079 Aug 24 03:40:10.394308 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 955/1903] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:09 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:10.394308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:10.394501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:10.419151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:10.425018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:10.425706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:10.426582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:10.427080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:10.427513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:10.503014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:40:10.523838 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e79d515e-ad24-44d6-8eb2-12429f1caeaf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.899884 Aug 24 03:40:10.525894 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 949/1904] 10.222.0.58 () {62 vars in 1189 bytes} [Wed Aug 24 03:40:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 7905 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:40:10.542367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:10.543154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:10.576780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:10.579999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:10.580821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:10.585281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:10.588570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:10.589105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:10.754026 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58bf925a-1cb9-48b4-aa9b-6c4f5c4c92a8 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 204 len: 0 microversion: 2.1 time: 0.363358 Aug 24 03:40:10.756722 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 956/1905] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:40:10 2022] DELETE /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:40:10.767921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e01df001-174f-42bb-9fbd-6377d6a83a43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:10.769518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e01df001-174f-42bb-9fbd-6377d6a83a43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:11.059803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:11.069060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c0c3c70-f68e-4fa0-9f84-feabf7832389 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 0.540131 Aug 24 03:40:11.080059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 950/1906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:10 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:11.093205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:11.095395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:11.114855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.116183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.116869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.120039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.126449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.127264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.317086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e01df001-174f-42bb-9fbd-6377d6a83a43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:11.338570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e01df001-174f-42bb-9fbd-6377d6a83a43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:11.343109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e01df001-174f-42bb-9fbd-6377d6a83a43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:11.353579 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e01df001-174f-42bb-9fbd-6377d6a83a43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1284 microversion: 2.32 time: 0.594038 Aug 24 03:40:11.356035 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 957/1907] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:10 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1284 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:11.409221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:11.410803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:11.431173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.432727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.436198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.437745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.440080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.440581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.897503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:11.916610 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e78fdae3-5e4b-4ead-bfe3-99ac5f43f9e2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1541 microversion: 2.1 time: 0.832037 Aug 24 03:40:11.933840 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 951/1908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:11 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1541 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:11.948549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-aa18123d-ad6c-4e46-be4e-380690d13a47 req-2455a409-353c-44da-8433-1e22112564d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "name": "network-vif-plugged", "status": "completed", "tag": "829b9223-e7bf-4f5f-b57b-8942d8d53c99"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:11.979658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aa18123d-ad6c-4e46-be4e-380690d13a47 req-2455a409-353c-44da-8433-1e22112564d0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.980615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aa18123d-ad6c-4e46-be4e-380690d13a47 req-2455a409-353c-44da-8433-1e22112564d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.981298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aa18123d-ad6c-4e46-be4e-380690d13a47 req-2455a409-353c-44da-8433-1e22112564d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:12.033718 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-aa18123d-ad6c-4e46-be4e-380690d13a47 req-2455a409-353c-44da-8433-1e22112564d0 service nova] Creating event network-vif-plugged:829b9223-e7bf-4f5f-b57b-8942d8d53c99 for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:40:12.053880 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-aa18123d-ad6c-4e46-be4e-380690d13a47 req-2455a409-353c-44da-8433-1e22112564d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117091 Aug 24 03:40:12.057575 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 952/1909] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:12.107115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:12.108738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:12.122304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:12.126995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:12.128103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:12.131647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:12.132500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:12.134294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:12.596985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:12.636622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6525670-0571-4fd8-acd5-b2ee5183049f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 1.232653 Aug 24 03:40:12.644645 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 958/1910] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:11 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:12.661773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-365ae04c-43bc-47b2-a156-12ac9bea7f0f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:12.669813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-365ae04c-43bc-47b2-a156-12ac9bea7f0f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:12.680584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:12.816931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:12.842131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:12.861233 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed6be960-850a-47e8-a898-0cb270ad837e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 0.756917 Aug 24 03:40:12.863056 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 953/1911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:12 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:12.986843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9a0ec568-7bce-4ab7-bd0a-7715a11cf74b req-8d7d62fe-be88-4b2e-955b-ac83c0ba1fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6220a504-caa0-4aaf-829e-73fd6a11c887", "name": "network-vif-unplugged", "status": "completed", "tag": "1eda95c9-2580-4337-8578-3cc683db5689"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:13.018152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9a0ec568-7bce-4ab7-bd0a-7715a11cf74b req-8d7d62fe-be88-4b2e-955b-ac83c0ba1fe6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.019126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9a0ec568-7bce-4ab7-bd0a-7715a11cf74b req-8d7d62fe-be88-4b2e-955b-ac83c0ba1fe6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.019922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9a0ec568-7bce-4ab7-bd0a-7715a11cf74b req-8d7d62fe-be88-4b2e-955b-ac83c0ba1fe6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.045949 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9a0ec568-7bce-4ab7-bd0a-7715a11cf74b req-8d7d62fe-be88-4b2e-955b-ac83c0ba1fe6 service nova] Creating event network-vif-unplugged:1eda95c9-2580-4337-8578-3cc683db5689 for instance 6220a504-caa0-4aaf-829e-73fd6a11c887 on n-h1-846470-15 Aug 24 03:40:13.061121 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9a0ec568-7bce-4ab7-bd0a-7715a11cf74b req-8d7d62fe-be88-4b2e-955b-ac83c0ba1fe6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.191393 Aug 24 03:40:13.064146 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 954/1912] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:13.077578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:13.078546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:13.094262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.095427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.100352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.101381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.102355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.102970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.127908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-365ae04c-43bc-47b2-a156-12ac9bea7f0f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:13.144306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-365ae04c-43bc-47b2-a156-12ac9bea7f0f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:13.148536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-365ae04c-43bc-47b2-a156-12ac9bea7f0f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:13.149744 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-365ae04c-43bc-47b2-a156-12ac9bea7f0f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1284 microversion: 2.32 time: 0.501113 Aug 24 03:40:13.162261 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 959/1913] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:12 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1284 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:13.666008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:13.666974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:13.683590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.684118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.684559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.685430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.685891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.687648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.863535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:13.885092 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c34695c2-3d95-4b02-8923-1e3bdfe1b2b2 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1541 microversion: 2.1 time: 0.818665 Aug 24 03:40:13.901826 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 955/1914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:13 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1541 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:13.907101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:13.908115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:13.915189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.916146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.916783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.917704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.918365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.919207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:14.828030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:14.844334 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52db2140-582a-4888-8097-9c3e7e2a2d62 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 1.179390 Aug 24 03:40:14.849075 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 960/1915] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:13 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:14.864892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:14.865549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:14.882983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:14.883407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:14.888371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:14.889173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:14.889914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:14.891791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.149541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:15.165213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:15.167227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:15.174209 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-243c5579-9365-4502-a3a9-372648c68711 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1592 microversion: 2.32 time: 0.323866 Aug 24 03:40:15.174840 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 961/1916] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:14 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1592 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:15.186923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3bb5189d-c4c2-4e39-939d-bbe5c1141708 req-1b413ecb-3d6e-423d-af97-4e8b8564297f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "name": "network-vif-plugged", "status": "completed", "tag": "0edbb11e-9e6d-4118-829b-c60cd708d99a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:15.215801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3bb5189d-c4c2-4e39-939d-bbe5c1141708 req-1b413ecb-3d6e-423d-af97-4e8b8564297f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.216295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3bb5189d-c4c2-4e39-939d-bbe5c1141708 req-1b413ecb-3d6e-423d-af97-4e8b8564297f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.222689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3bb5189d-c4c2-4e39-939d-bbe5c1141708 req-1b413ecb-3d6e-423d-af97-4e8b8564297f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.247703 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3bb5189d-c4c2-4e39-939d-bbe5c1141708 req-1b413ecb-3d6e-423d-af97-4e8b8564297f service nova] Creating event network-vif-plugged:0edbb11e-9e6d-4118-829b-c60cd708d99a for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:40:15.266193 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3bb5189d-c4c2-4e39-939d-bbe5c1141708 req-1b413ecb-3d6e-423d-af97-4e8b8564297f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088649 Aug 24 03:40:15.273367 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 962/1917] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:15.280932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:15.281888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:15.291442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.292132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.292732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.293548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.294007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.294469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.437169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:15.447954 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a68bbcb1-2f0b-4add-ab1a-43217a2fa1a3 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1499 microversion: 2.1 time: 0.172537 Aug 24 03:40:15.461571 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 963/1918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:15 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1499 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:15.467442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bd6f8905-978d-412d-b4f4-545641cc07c2 req-e708e635-eea7-4689-baf9-0d7e91b6a767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6220a504-caa0-4aaf-829e-73fd6a11c887", "tag": "1eda95c9-2580-4337-8578-3cc683db5689"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:15.491440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bd6f8905-978d-412d-b4f4-545641cc07c2 req-e708e635-eea7-4689-baf9-0d7e91b6a767 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.492847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bd6f8905-978d-412d-b4f4-545641cc07c2 req-e708e635-eea7-4689-baf9-0d7e91b6a767 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.494382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bd6f8905-978d-412d-b4f4-545641cc07c2 req-e708e635-eea7-4689-baf9-0d7e91b6a767 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.523898 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bd6f8905-978d-412d-b4f4-545641cc07c2 req-e708e635-eea7-4689-baf9-0d7e91b6a767 service nova] Creating event network-changed:1eda95c9-2580-4337-8578-3cc683db5689 for instance 6220a504-caa0-4aaf-829e-73fd6a11c887 on n-h1-846470-15 Aug 24 03:40:15.534114 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bd6f8905-978d-412d-b4f4-545641cc07c2 req-e708e635-eea7-4689-baf9-0d7e91b6a767 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078412 Aug 24 03:40:15.537297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 964/1919] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:15.874970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:15.877851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:15.910433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.913249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.917122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.918288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.919238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.920140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.998735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:16.012951 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f82df66-bc84-4573-8288-594868a1730c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 2.109518 Aug 24 03:40:16.014002 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 956/1920] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:13 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:16.051191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ac2e9b97-d729-4738-8966-e6afd52eb503 req-ac565bbc-4735-46b7-a771-8025af100631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b6d358-1b82-4c99-8bab-048d28385fe5", "name": "network-vif-deleted", "tag": "3e07d450-4b64-4d9b-b95e-f418dde28d80"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:16.071091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ac2e9b97-d729-4738-8966-e6afd52eb503 req-ac565bbc-4735-46b7-a771-8025af100631 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.072972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ac2e9b97-d729-4738-8966-e6afd52eb503 req-ac565bbc-4735-46b7-a771-8025af100631 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.074888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ac2e9b97-d729-4738-8966-e6afd52eb503 req-ac565bbc-4735-46b7-a771-8025af100631 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.110195 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ac2e9b97-d729-4738-8966-e6afd52eb503 req-ac565bbc-4735-46b7-a771-8025af100631 service nova] Creating event network-vif-deleted:3e07d450-4b64-4d9b-b95e-f418dde28d80 for instance 04b6d358-1b82-4c99-8bab-048d28385fe5 on n-h1-846470-15 Aug 24 03:40:16.128616 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ac2e9b97-d729-4738-8966-e6afd52eb503 req-ac565bbc-4735-46b7-a771-8025af100631 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107557 Aug 24 03:40:16.129443 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 957/1921] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:16.202920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:16.205294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:16.238787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.239427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.239917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.240663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.241122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.241546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.586360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:16.596672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:16.618181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:16.620276 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-40185e93-f76b-49d7-8ce1-83e14ba85fc0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1592 microversion: 2.32 time: 0.424001 Aug 24 03:40:16.634141 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 958/1922] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:16 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1592 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:16.656530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:16.659222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:16.687229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.692702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.705499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.708298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.708888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.718856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.762749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:16.774428 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bcc05684-c52a-4635-b120-407fcd468ca2 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 0.908215 Aug 24 03:40:16.788092 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 965/1923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:15 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:16.804650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-641339971", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "fcac6d92-ccb7-4ff8-b598-d80d53b81552"}, {"port": "5c7ebbdb-390b-4d78-b6a2-425bd3132adc", "tag": "port-1"}, {"port": "323a0297-cdc4-4ea9-82c5-f9a48df89f13", "tag": "port-2"}, {"uuid": "8ec0f723-ba2f-49dd-8c35-90ed555d1db9", "tag": "net-1"}, {"uuid": "8ec0f723-ba2f-49dd-8c35-90ed555d1db9"}, {"uuid": "2270c87d-8616-4423-9655-f0af6d67840b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2270c87d-8616-4423-9655-f0af6d67840b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e4d10c4b-0ea7-4058-b26e-3c318bf1afe3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "dbc3e16b-49b6-42d4-80b5-524fc66c102d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "15f10e49-d495-4c90-a032-39e0d6e12ccb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1481582901"}], "key_name": "tempest-keypair-1231689129", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:16.842830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.844491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.845535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.846553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lazy-loading 'fault' on Instance uuid 04b6d358-1b82-4c99-8bab-048d28385fe5 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:40:16.980720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188bf58d3da43ec9859894ebbee70e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8346bc75f4de4e9b9c864d4f7c8b6e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:16.989530 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d98b458-6f94-4699-bb37-e40cc79e7bca tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 200 len: 1322 microversion: 2.1 time: 0.352650 Aug 24 03:40:16.990139 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 959/1924] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:16 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:17.035405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:17.036459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:17.048792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.049436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.050575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.051466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.052985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.057214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.441147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:17.451583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0e8ec22-ba2c-4588-bfb3-ee616a3b3185 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 0.420527 Aug 24 03:40:17.470952 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 960/1925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:17 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:17.476441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-17522710-b7e7-4345-a1d4-08e4ee906d68 req-85122707-c868-46b5-85f9-17f53609b3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "name": "network-vif-plugged", "status": "completed", "tag": "a2b8d076-eb38-492b-bf9c-c76c7ad009f8"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:17.509351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17522710-b7e7-4345-a1d4-08e4ee906d68 req-85122707-c868-46b5-85f9-17f53609b3a5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.512736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17522710-b7e7-4345-a1d4-08e4ee906d68 req-85122707-c868-46b5-85f9-17f53609b3a5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.513521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17522710-b7e7-4345-a1d4-08e4ee906d68 req-85122707-c868-46b5-85f9-17f53609b3a5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.536404 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-17522710-b7e7-4345-a1d4-08e4ee906d68 req-85122707-c868-46b5-85f9-17f53609b3a5 service nova] Creating event network-vif-plugged:a2b8d076-eb38-492b-bf9c-c76c7ad009f8 for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:40:17.548736 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-17522710-b7e7-4345-a1d4-08e4ee906d68 req-85122707-c868-46b5-85f9-17f53609b3a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076197 Aug 24 03:40:17.549987 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 961/1926] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:17.648060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] validate_networks() for [('fcac6d92-ccb7-4ff8-b598-d80d53b81552', None, None, None, None, None), (None, None, '5c7ebbdb-390b-4d78-b6a2-425bd3132adc', None, None, None), (None, None, '323a0297-cdc4-4ea9-82c5-f9a48df89f13', None, None, None), ('8ec0f723-ba2f-49dd-8c35-90ed555d1db9', None, None, None, None, None), ('8ec0f723-ba2f-49dd-8c35-90ed555d1db9', None, None, None, None, None), ('2270c87d-8616-4423-9655-f0af6d67840b', '10.2.2.100', None, None, None, None), ('2270c87d-8616-4423-9655-f0af6d67840b', '10.2.2.200', None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:40:17.658780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:17.659558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:17.683499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.694194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.695398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.696407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.697009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.697672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.843280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:17.865799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:17.867631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:17.871418 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f2214fed-f0cd-4231-aef2-5a4f745e1a01 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1592 microversion: 2.32 time: 0.217846 Aug 24 03:40:17.873766 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 962/1927] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:17 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1592 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:17.889842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:17.891397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:17.898439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.899211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.904204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.905171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.905790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.906358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:18.214833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:18.226566 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f47b6ee4-64ba-4371-9d51-dfdc18e0d9b6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 0.352790 Aug 24 03:40:18.228450 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 963/1928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:17 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:18.234776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:18.235569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] [instance: 04b6d358-1b82-4c99-8bab-048d28385fe5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:18.245505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:18.246421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:18.246421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:18.247130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:18.247582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:18.259721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:18.281208 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] HTTP exception thrown: Instance 04b6d358-1b82-4c99-8bab-048d28385fe5 could not be found. Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Request method failure captured: Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 HTTP/1.1 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ05prB3OZXQOS1c0IkIYTDBQQbwfS-Yzdfq018YoYxO5j5gliudj14WG3fk18dDkhwdpFnQR6-JNgIIB1QY-tSWirn5a96FSaEnuoV3rfkiTD9Pa_yptjI1JoVUgIzs_YrsSXyEDX0X4FBqEpQsQOAGI26dN_KliVGbilnK2_BOoEY Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8346bc75f4de4e9b9c864d4f7c8b6e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 8346bc75f4de4e9b9c864d4f7c8b6e75 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 3188bf58d3da43ec9859894ebbee70e5 Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 04b6d358-1b82-4c99-8bab-048d28385fe5 could not be found. Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '04b6d358-1b82-4c99-8bab-048d28385fe5'} Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b6d358-1b82-4c99-8bab-048d28385fe5 could not be found. Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b6d358-1b82-4c99-8bab-048d28385fe5 could not be found. Aug 24 03:40:18.283165 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b6d358-1b82-4c99-8bab-048d28385fe5 could not be found. Aug 24 03:40:18.288356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:40:18.289714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] Returning 404 to user: Instance 04b6d358-1b82-4c99-8bab-048d28385fe5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:18.290767 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-36de2e6e-0bd2-4976-8e73-90d032316316 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132 tempest-FloatingIPsAssociationNegativeTestJSON-1500009132-project] 10.222.0.58 "GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5" status: 404 len: 111 microversion: 2.1 time: 0.060759 Aug 24 03:40:18.291827 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 964/1929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:18 2022] GET /compute/v2.1/servers/04b6d358-1b82-4c99-8bab-048d28385fe5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:18.478436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:18.479359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:18.491241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:18.492426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:18.494038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:18.495880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:18.497922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:18.498367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.005881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:19.038283 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec6953e0-d7f2-4dc9-aec2-a192aa84145e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 0.564412 Aug 24 03:40:19.042156 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 965/1930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:18 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:19.052937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:19.061372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:19.110969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.111920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.112700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.114471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.115540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.116460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.255299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:19.342243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:20.289963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:20.304653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:20.306758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:20.308160 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3cff8f9-708f-4b0e-b16d-d33daa4ccf60 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1660 microversion: 2.32 time: 1.264463 Aug 24 03:40:20.308933 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 966/1931] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:19 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1660 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:20.320428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:20.321343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:20.352850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.353653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.354249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:20.358295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.360285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.371227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.085930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:21.101920 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc630178-eb86-462f-b722-4906a299d62e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1354 microversion: 2.1 time: 0.791308 Aug 24 03:40:21.105771 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 967/1932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:20 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1354 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:21.124804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:21.127449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:21.141893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.144725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.147130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.150227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.155587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.156542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.667034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:21.689329 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e5ff313c-f542-4616-8a41-daa30d96cc93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 0.581992 Aug 24 03:40:21.690588 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 968/1933] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:21 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:21.726581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:21.727293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:21.746472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.746970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.747405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.752559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.753060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.753501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.844139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:22.538586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:22.551806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:22.553566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:22.555636 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99f83ad4-3b50-4515-b524-c2eaf39be78d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1707 microversion: 2.32 time: 0.863738 Aug 24 03:40:22.556904 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 969/1934] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:21 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1707 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:22.568031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:22.569415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:22.587869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:22.594457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:22.595133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:22.596797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:22.597405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:22.598327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:23.046794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:23.114286 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4491d3d5-a559-49b2-99ba-518b9c0a59aa tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1803 microversion: 2.1 time: 0.534509 Aug 24 03:40:23.134133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:23.134815 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 970/1935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:22 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1803 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:23.155652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:23.158101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:23.199094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:23.199963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:23.202344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:23.208844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:23.209690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:23.210418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.479164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:24.497249 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9a7835cb-0a75-4cd7-bf54-c0e25d4db2bb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 1.359215 Aug 24 03:40:24.498312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 971/1936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:23 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:24.516775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:24.532566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:24.562075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.563222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.564022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.565610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.566144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.574338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.649786 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b59d1461-3d43-472c-82fa-032a8fc1f513 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83/ips" status: 200 len: 217 microversion: 2.1 time: 0.141355 Aug 24 03:40:24.650679 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 972/1937] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:40:24 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83/ips => generated 217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:24.662334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:24.662968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:24.677441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.677955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.678404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.679951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.679951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.680209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.089376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:25.107213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:25.117643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:25.122784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8f01883a-c618-49cb-9172-009b34a7fb99 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1754 microversion: 2.32 time: 0.467641 Aug 24 03:40:25.123928 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 973/1938] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:24 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1754 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:25.227973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c5398cd-fefd-411f-9e85-e805e3a7e350 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'create', calling method: .version_select at 0x7f103438ad30>, body: {"keypair": {"name": "tempest-keypair-904152849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkGcyhh8naKG4ojyzd8iaKP2lr3tjZUx3hKKvGI++Z9n58Juv59sBXvVJr8Xva/mH0EQDR6uQoonDZqdFLIEKZW+weXe1PY/aiONvvEZdN9OX8EIdF+1xcD6oXt09mfsw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:25.254605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-8c5398cd-fefd-411f-9e85-e805e3a7e350 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Getting quotas for project de5a2a3c9cdc428d81a1ade5f5102e6d. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:25.263357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-8c5398cd-fefd-411f-9e85-e805e3a7e350 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Getting quotas for user ca968a4777ea4164be5ff3174d4291d5 and project de5a2a3c9cdc428d81a1ade5f5102e6d. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:25.309648 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c5398cd-fefd-411f-9e85-e805e3a7e350 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182994 Aug 24 03:40:25.310487 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 974/1939] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:40:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:25.320578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:25.321874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:25.337630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.341602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.342291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.343769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.345643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.354119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.410745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:40:25.577530 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ab7bb2c-ff77-4a91-8828-432d5a4006db tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 204 len: 0 microversion: 2.1 time: 0.262883 Aug 24 03:40:25.582374 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 975/1940] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:40:25 2022] DELETE /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:40:25.603294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:25.607767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:25.636997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.637687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.638268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.639006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.639898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.640388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:26.240606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:26.268795 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97e4c550-692d-4157-96c8-58207ec11ca8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 0.683373 Aug 24 03:40:26.288107 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 976/1941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:25 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:26.316317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:26.318131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:26.336421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:26.337461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:26.338992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:26.340172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:26.340893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:26.341580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:26.767859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:27.102985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:27.132852 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e1b11cb8-16c9-4021-b3e5-6ad4c5ea29fb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1809 microversion: 2.1 time: 0.842893 Aug 24 03:40:27.134780 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 977/1942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:26 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1809 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:27.147655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:27.149087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:27.169673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.171910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.174012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.174186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.174942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.175798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.805174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:29.818273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:29.837259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:29.838544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e54810f-cbfc-4bf7-910f-fce258df6b52 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1754 microversion: 2.32 time: 2.702074 Aug 24 03:40:29.842566 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 978/1943] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:27 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1754 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:29.858582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:29.861221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:29.876774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:29.883552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:29.884269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:29.884714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.885448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:29.886016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:29.886451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.296325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=19 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:30.524271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:40:30.525545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:40:30.539455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:40:30.541666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:40:30.552783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:40:30.604701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.606255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.613237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.614430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.615463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.616206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.673634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:30.677240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Getting quotas for project 7a9ef66358704edf814e8a1f0012e0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:30.686522 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42fd3a7f-0c45-446f-a801-a5741ebb9bec tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1503 microversion: 2.1 time: 0.842768 Aug 24 03:40:30.687210 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 979/1944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:29 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1503 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:30.702439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Getting quotas for user 27a98cafcc0e4f899bbed446fc4f0432 and project 7a9ef66358704edf814e8a1f0012e0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:30.705416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:30.705932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:30.729387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.729878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.730314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.741754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.742246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.742770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:31.041217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:40:31.044605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e4d10c4b-0ea7-4058-b26e-3c318bf1afe3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='dbc3e16b-49b6-42d4-80b5-524fc66c102d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15f10e49-d495-4c90-a032-39e0d6e12ccb',volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:40:31.283995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:31.304405 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-40d850ae-eb6d-4311-b440-25c827631ebd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1788 microversion: 2.1 time: 0.596338 Aug 24 03:40:31.305568 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 980/1945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:30 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1788 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:31.521144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-319467592", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:31.675190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] validate_networks() for [('46900878-c94a-4405-9873-2bf4b2cdc479', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:40:32.082199 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bfb3c8a2-2abb-46a4-9b4f-5154bb9eb637 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 15.272854 Aug 24 03:40:32.088904 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 966/1946] 10.222.0.58 () {62 vars in 1189 bytes} [Wed Aug 24 03:40:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 15300 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:40:32.095774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:32.098691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:32.118467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.119454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.121014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.122483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.123087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.125162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.271829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:33.307287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:33.312618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:33.314318 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a30ff662-920f-4405-96e5-72fe3cf0ef53 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1801 microversion: 2.32 time: 1.223377 Aug 24 03:40:33.323802 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 967/1947] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:32 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1801 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:33.554058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-552fcc02-d42a-4ab2-9e8e-136e073ed08b req-e6b0e03d-a751-42c1-9c6b-51c2ab400c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "name": "network-vif-unplugged", "status": "completed", "tag": "0edbb11e-9e6d-4118-829b-c60cd708d99a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:33.573481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-552fcc02-d42a-4ab2-9e8e-136e073ed08b req-e6b0e03d-a751-42c1-9c6b-51c2ab400c55 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.574318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-552fcc02-d42a-4ab2-9e8e-136e073ed08b req-e6b0e03d-a751-42c1-9c6b-51c2ab400c55 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.575089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-552fcc02-d42a-4ab2-9e8e-136e073ed08b req-e6b0e03d-a751-42c1-9c6b-51c2ab400c55 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.626530 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-552fcc02-d42a-4ab2-9e8e-136e073ed08b req-e6b0e03d-a751-42c1-9c6b-51c2ab400c55 service nova] Creating event network-vif-unplugged:0edbb11e-9e6d-4118-829b-c60cd708d99a for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:40:33.648807 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-552fcc02-d42a-4ab2-9e8e-136e073ed08b req-e6b0e03d-a751-42c1-9c6b-51c2ab400c55 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.331203 Aug 24 03:40:33.660042 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 968/1948] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:33.674835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a99a49a3-7993-42f0-b1f3-d57dfbadaec2 req-d3b230dd-ef46-4451-b7d9-45ff85a4884e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "name": "network-vif-deleted", "tag": "a2b8d076-eb38-492b-bf9c-c76c7ad009f8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:33.700172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a99a49a3-7993-42f0-b1f3-d57dfbadaec2 req-d3b230dd-ef46-4451-b7d9-45ff85a4884e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.700864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a99a49a3-7993-42f0-b1f3-d57dfbadaec2 req-d3b230dd-ef46-4451-b7d9-45ff85a4884e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.701476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a99a49a3-7993-42f0-b1f3-d57dfbadaec2 req-d3b230dd-ef46-4451-b7d9-45ff85a4884e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.731495 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a99a49a3-7993-42f0-b1f3-d57dfbadaec2 req-d3b230dd-ef46-4451-b7d9-45ff85a4884e service nova] Creating event network-vif-deleted:a2b8d076-eb38-492b-bf9c-c76c7ad009f8 for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:40:33.737495 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a99a49a3-7993-42f0-b1f3-d57dfbadaec2 req-d3b230dd-ef46-4451-b7d9-45ff85a4884e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075687 Aug 24 03:40:33.738495 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 969/1949] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:33.746199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:33.746966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:33.759178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.760153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.761001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.767348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.770170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.771017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:34.406932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:34.436234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5c43546-c247-4a9d-ab42-d2368e22e9a2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1493 microversion: 2.1 time: 0.695919 Aug 24 03:40:34.437647 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 970/1950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:33 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1493 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:34.447343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bd9c3afd-f08f-4040-a2eb-7cbdb5c198c6 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:34.455092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bd9c3afd-f08f-4040-a2eb-7cbdb5c198c6 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:34.846017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bd9c3afd-f08f-4040-a2eb-7cbdb5c198c6 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:34.901554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bd9c3afd-f08f-4040-a2eb-7cbdb5c198c6 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:34.904975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bd9c3afd-f08f-4040-a2eb-7cbdb5c198c6 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:34.907215 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bd9c3afd-f08f-4040-a2eb-7cbdb5c198c6 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1285 microversion: 2.42 time: 0.467637 Aug 24 03:40:34.934591 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 971/1951] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:34 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1285 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:34.940053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:34.940676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:34.964589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:34.965528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:34.966175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:34.967044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:34.967650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:34.968249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.276968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:35.345360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:40:35.346545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:40:35.353253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:40:35.354416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:40:35.356770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:40:35.442236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.443049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.444856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.446918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.447948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.449509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.616449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Getting quotas for project fc7f546446954b6eb687ef4bdfe7af5d. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:35.669239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Getting quotas for user 995c0e38b0a84f548268024dfc2fd0bc and project fc7f546446954b6eb687ef4bdfe7af5d. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:35.707144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:35.722472 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-095b2ca8-cebd-4aa4-806d-a437f42c1afb tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 200 len: 1609 microversion: 2.1 time: 0.786493 Aug 24 03:40:35.749564 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 972/1952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:34 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 1609 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:35.770991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:35.775400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:35.779197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:40:35.798239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:40:35.811751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.812255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.812693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.813414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.814052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.814426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.010467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-78fe472e-eab0-4311-af8f-08ebda6e450f tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.701211 Aug 24 03:40:36.023760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 981/1953] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:40:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 4717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:40:36.030744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fa69c13-48bc-4be5-b722-719fc5923c57 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '.version_select at 0x7f1022838670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:36.054952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69c13-48bc-4be5-b722-719fc5923c57 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.058014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69c13-48bc-4be5-b722-719fc5923c57 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.065041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69c13-48bc-4be5-b722-719fc5923c57 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.098593 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fa69c13-48bc-4be5-b722-719fc5923c57 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 404 microversion: 2.1 time: 0.069351 Aug 24 03:40:36.110265 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 982/1954] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1/os-migrations => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:36.118225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a005b976-54a3-4e46-8a24-8fc43683e800 req-22e3c1be-178d-418f-8975-89eeb936eb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "name": "network-vif-unplugged", "status": "completed", "tag": "829b9223-e7bf-4f5f-b57b-8942d8d53c99"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:36.175247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a005b976-54a3-4e46-8a24-8fc43683e800 req-22e3c1be-178d-418f-8975-89eeb936eb1e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.186633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a005b976-54a3-4e46-8a24-8fc43683e800 req-22e3c1be-178d-418f-8975-89eeb936eb1e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.188943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a005b976-54a3-4e46-8a24-8fc43683e800 req-22e3c1be-178d-418f-8975-89eeb936eb1e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.258191 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a005b976-54a3-4e46-8a24-8fc43683e800 req-22e3c1be-178d-418f-8975-89eeb936eb1e service nova] Creating event network-vif-unplugged:829b9223-e7bf-4f5f-b57b-8942d8d53c99 for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:40:36.282362 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a005b976-54a3-4e46-8a24-8fc43683e800 req-22e3c1be-178d-418f-8975-89eeb936eb1e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167844 Aug 24 03:40:36.292146 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 983/1955] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:36.308805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-473fa78d-53fa-4d62-b9f7-f3e7c10feec2 req-50bde9d9-9466-4eb9-a685-3900d920f35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "name": "network-vif-deleted", "tag": "829b9223-e7bf-4f5f-b57b-8942d8d53c99"}, {"server_uuid": "e672b6aa-e8b3-43bd-bdce-c2cf96d93c83", "name": "network-vif-deleted", "tag": "0edbb11e-9e6d-4118-829b-c60cd708d99a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:36.338956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-473fa78d-53fa-4d62-b9f7-f3e7c10feec2 req-50bde9d9-9466-4eb9-a685-3900d920f35c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.339581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-473fa78d-53fa-4d62-b9f7-f3e7c10feec2 req-50bde9d9-9466-4eb9-a685-3900d920f35c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.339877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-473fa78d-53fa-4d62-b9f7-f3e7c10feec2 req-50bde9d9-9466-4eb9-a685-3900d920f35c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.409058 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-473fa78d-53fa-4d62-b9f7-f3e7c10feec2 req-50bde9d9-9466-4eb9-a685-3900d920f35c service nova] Creating event network-vif-deleted:829b9223-e7bf-4f5f-b57b-8942d8d53c99 for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:40:36.415583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-473fa78d-53fa-4d62-b9f7-f3e7c10feec2 req-50bde9d9-9466-4eb9-a685-3900d920f35c service nova] Creating event network-vif-deleted:0edbb11e-9e6d-4118-829b-c60cd708d99a for instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 on n-h2-846470-15 Aug 24 03:40:36.436921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-473fa78d-53fa-4d62-b9f7-f3e7c10feec2 req-50bde9d9-9466-4eb9-a685-3900d920f35c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.141940 Aug 24 03:40:36.438978 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 984/1956] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:36.440216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:36.463764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:36.465387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:36.465727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:36.467351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:36.468604 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52d7af18-e893-4572-ad9a-beab12114e10 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1801 microversion: 2.32 time: 0.717935 Aug 24 03:40:36.485178 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 973/1957] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:35 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1801 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:36.485716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.487283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.490604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.496321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9eee4718-82f6-496d-bc22-5c69127b266d tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:36.496942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9eee4718-82f6-496d-bc22-5c69127b266d tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:36.497289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.498433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.499485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.650409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9eee4718-82f6-496d-bc22-5c69127b266d tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:36.673358 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9eee4718-82f6-496d-bc22-5c69127b266d tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1222 microversion: 2.1 time: 0.183291 Aug 24 03:40:36.693126 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 974/1958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:36.705554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:36.709054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:36.725840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.729457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.730153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.732411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.733288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.735000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:37.309264 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2e9973f-d99f-49fc-9993-e3ca1a66b266 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1646 microversion: 2.1 time: 0.614879 Aug 24 03:40:37.309867 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 975/1959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1646 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:37.356627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:37.357245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:37.392375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:37.392868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:37.393303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:37.394099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:37.394654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:37.395104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:37.439055 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] HTTP exception thrown: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Request method failure captured: Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 HTTP/1.1 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1lflhQ213UQ63Gd_erRf2VrUuZDmcnOcKg_dLkAFXkub8hIUt-6sCW7ps3uIY25zX36cCBt6-PIF6WVky-ZOe0iIxg7jtW38oVdyNZ9sD1waWZBtHggBZTjoXiErU64F_zVDV9CwDZzfSZBEBMEuigjjYAYZElWugsmhXOG-5i-EI Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f82857fdf14747a44bc05640804363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f82857fdf14747a44bc05640804363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestMultiNic-701637212 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestMultiNic-701637212-project Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: fb3951916c5a4aedb1ba04a7cf01ffb3 Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestMultiNic-701637212-project Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e672b6aa-e8b3-43bd-bdce-c2cf96d93c83'} Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:37.462033 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Returning 404 to user: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3d522fbc-6efc-4754-b37f-0e39f7d5ce8e tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 404 len: 111 microversion: 2.1 time: 0.114183 Aug 24 03:40:37.470544 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 976/1960] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:37 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:37.497321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:37.498166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:37.513747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:37.520018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:37.520480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:37.521271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:37.521870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:37.528259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.121379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.139140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.143391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.146882 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f344ca14-4fb4-4819-b28b-7a7eb9219bfd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1848 microversion: 2.32 time: 0.654575 Aug 24 03:40:38.149933 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 977/1961] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:37 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1848 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:40:38.158304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-314904310", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7f7d79fe-5369-4b60-bc8d-97cdf54981c1"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:38.221414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.233606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.235505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.237341 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2cbfe9b9-9a62-466b-901b-3695df7cc31b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1575 microversion: 2.42 time: 1.793458 Aug 24 03:40:38.256848 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 985/1962] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1575 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:38.268778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:38.271237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:38.288454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] validate_networks() for [('7f7d79fe-5369-4b60-bc8d-97cdf54981c1', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:40:38.298517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.300577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.306696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.308087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.309018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.309750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.647440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.668321 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dda8c640-8425-4b56-a1d1-dd3b457b8890 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1274 microversion: 2.1 time: 0.409725 Aug 24 03:40:38.674039 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 986/1963] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:38 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1274 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:39.183626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:39.187494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:39.228655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:39.229776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:39.232993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:39.234026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:39.235505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:39.238787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.252802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.286626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.291433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.293442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d34e58ea-f9e1-44b4-8a53-69bfb41948e0 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1848 microversion: 2.32 time: 1.119939 Aug 24 03:40:40.295283 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 987/1964] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:39 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1848 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:40:40.312895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:40.314509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:40.326932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.328630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.330990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.334251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.335300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.336212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.438611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:40.645477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:40.676978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.693425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.695467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.705841 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd09cdc8-47c5-4683-9dfa-a454741f1945 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1593 microversion: 2.42 time: 0.407836 Aug 24 03:40:40.707051 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 988/1965] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:40 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1593 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:40.737975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:40.739457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:40.755197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.756184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.756963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.757814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.758466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.759087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.030749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:41.050176 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f192d9f-2b2d-4231-86bc-840a8f4b61d7 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1280 microversion: 2.1 time: 0.341521 Aug 24 03:40:41.050997 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 989/1966] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:40 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1280 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:41.071576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1420962976", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "649d30e3-a245-45b4-ba70-7650bdd4e741"}], "security_groups": [{"name": "tempest-securitygroup--1370117131"}], "key_name": "tempest-keypair-904152849", "user_data": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:41.495843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] validate_networks() for [('649d30e3-a245-45b4-ba70-7650bdd4e741', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:40:42.385276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:40:42.388822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:40:42.389780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:40:42.390442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:40:42.391031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:40:42.428899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.431888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.433047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.434832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.435943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.437635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.501509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:42.530858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for user 73ddcba828514d1882d2cd02d357bef8 and project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:42.572289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:40:42.575181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:40:42.811415 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b66211c6-a575-4533-9804-89c2ccb49c16 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.659609 Aug 24 03:40:42.811786 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 978/1967] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:40:42.837108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:42.837883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:42.869455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.869968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.870411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.871278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.871969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.884552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:43.938365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:43.968632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:43.973633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:43.975294 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2da7a1b-835c-40f2-a311-d35059d14e94 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1848 microversion: 2.32 time: 1.157823 Aug 24 03:40:43.976531 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 979/1968] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:42 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1848 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:43.984737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:43.985517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:44.002141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.003971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.005062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.008253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.008888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.009429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.363187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:40:44.364290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:40:44.364987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:40:44.365741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:40:44.366389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:40:44.402431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.404512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.405731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.406915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.420028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.420784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.481064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Getting quotas for project de5a2a3c9cdc428d81a1ade5f5102e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:44.492888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Getting quotas for user ca968a4777ea4164be5ff3174d4291d5 and project de5a2a3c9cdc428d81a1ade5f5102e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:44.545081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:40:44.549490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:40:44.699501 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f29fc17d-41ac-4f93-af52-e005a82f1b58 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.634537 Aug 24 03:40:44.700831 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 990/1969] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:40:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 3637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:40:44.706904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:44.708324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:44.717006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.717798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.718545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.719467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.720139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.720801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.121496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.134425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.141791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.144126 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-704b5b77-db54-4d75-9c59-1c5a2bb6ac02 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1661 microversion: 2.42 time: 1.165951 Aug 24 03:40:45.145121 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 980/1970] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:43 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1661 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:45.177280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8c526a8d-2115-4c84-9c00-dd8057c78765 req-afebc0ed-e719-4095-9d6c-92bd0329d0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "tag": "405cade2-305c-45aa-8315-48c4d3933e72"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:45.194358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8c526a8d-2115-4c84-9c00-dd8057c78765 req-afebc0ed-e719-4095-9d6c-92bd0329d0ff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.195305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8c526a8d-2115-4c84-9c00-dd8057c78765 req-afebc0ed-e719-4095-9d6c-92bd0329d0ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.196414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8c526a8d-2115-4c84-9c00-dd8057c78765 req-afebc0ed-e719-4095-9d6c-92bd0329d0ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.214663 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8c526a8d-2115-4c84-9c00-dd8057c78765 req-afebc0ed-e719-4095-9d6c-92bd0329d0ff service nova] Creating event network-changed:405cade2-305c-45aa-8315-48c4d3933e72 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:40:45.222792 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8c526a8d-2115-4c84-9c00-dd8057c78765 req-afebc0ed-e719-4095-9d6c-92bd0329d0ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057415 Aug 24 03:40:45.224321 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 981/1971] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:45.233602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:45.234740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:45.246630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.247787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.248969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.250286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.251595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.252424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.285044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.299995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8557d34-1385-4731-9bbb-614f2cf3d880 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1322 microversion: 2.1 time: 0.596243 Aug 24 03:40:45.302113 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 991/1972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:44 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1322 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:45.315216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-71da0d1a-f8bb-4def-8cd5-bd46f7dc636f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:45.317624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-71da0d1a-f8bb-4def-8cd5-bd46f7dc636f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:45.802684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-71da0d1a-f8bb-4def-8cd5-bd46f7dc636f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.814411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.817280 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-71da0d1a-f8bb-4def-8cd5-bd46f7dc636f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1237 microversion: 2.1 time: 0.513713 Aug 24 03:40:45.818455 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 992/1973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:45 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1237 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:45.833764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:45.834659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:45.844005 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-926ffaee-4ba2-4cc9-a805-42bc45ef8fef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1262 microversion: 2.1 time: 0.616739 Aug 24 03:40:45.845219 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 982/1974] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:45 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1262 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:45.852778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.856639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.863607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.865594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.867256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.869916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:46.169017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:46.170367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:46.182943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:46.184189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:46.185020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:46.186169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:46.186990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:46.187722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:46.442882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:46.458283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:46.460182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:46.462198 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44189287-93d6-4975-bdfb-b42d863260a8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1869 microversion: 2.32 time: 0.642336 Aug 24 03:40:46.464443 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 993/1975] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:45 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1869 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:46.482753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:46.484300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:46.492579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:46.493615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:46.495055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:46.496879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:46.497661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:46.498331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.308731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:47.332710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:47.335416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:47.337891 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0413ba4a-a391-4fbb-ae62-9a70038cc7be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1708 microversion: 2.42 time: 1.173380 Aug 24 03:40:47.343993 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 983/1976] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:46 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1708 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:47.361675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:47.362716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:47.374584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.375344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.376033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.376960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.381591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.382263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.714176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:47.735104 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eb17778b-dd0c-4eff-bd89-f4d4b50e409e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1307 microversion: 2.1 time: 0.389379 Aug 24 03:40:47.736833 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 984/1977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:47 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1307 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:47.744725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:47.746162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:47.773339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.776686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.777380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.778647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.779595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.780727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.900280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:47.931411 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc7ae18f-047b-499a-87ed-adef8ecc4600 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1322 microversion: 2.1 time: 1.461475 Aug 24 03:40:47.942092 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 994/1978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:46 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1322 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:47.971262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ac0bf885-f432-4336-853c-5a8560a1b669 req-a30bae1f-e03b-48a8-98f6-78af4b2801d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "tag": "8c9f743c-5577-43e9-ac31-13bc671b37b0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:48.009259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ac0bf885-f432-4336-853c-5a8560a1b669 req-a30bae1f-e03b-48a8-98f6-78af4b2801d5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.010694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ac0bf885-f432-4336-853c-5a8560a1b669 req-a30bae1f-e03b-48a8-98f6-78af4b2801d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.012325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ac0bf885-f432-4336-853c-5a8560a1b669 req-a30bae1f-e03b-48a8-98f6-78af4b2801d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.042864 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ac0bf885-f432-4336-853c-5a8560a1b669 req-a30bae1f-e03b-48a8-98f6-78af4b2801d5 service nova] Creating event network-changed:8c9f743c-5577-43e9-ac31-13bc671b37b0 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:40:48.056059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:48.102618 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ac0bf885-f432-4336-853c-5a8560a1b669 req-a30bae1f-e03b-48a8-98f6-78af4b2801d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154991 Aug 24 03:40:48.107492 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-442d2b3d-3dd0-4be5-b04f-e321ebf5d577 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1268 microversion: 2.1 time: 0.367587 Aug 24 03:40:48.107973 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 995/1979] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:48.123693 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 985/1980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:47 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1268 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:48.128950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-47364f47-b4c5-4248-927d-395144cd32e3 req-96c6d846-9699-4450-baa2-cd53f09e0a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795254e1-5a01-4e35-b63b-e134c3ff4d25", "tag": "ee55608b-015b-4eba-beff-03ed67b44adc"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:48.133148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:48.134754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:48.161736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.162650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.164629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.167285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.171473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.172735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.175145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-47364f47-b4c5-4248-927d-395144cd32e3 req-96c6d846-9699-4450-baa2-cd53f09e0a35 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.176066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-47364f47-b4c5-4248-927d-395144cd32e3 req-96c6d846-9699-4450-baa2-cd53f09e0a35 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.180847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-47364f47-b4c5-4248-927d-395144cd32e3 req-96c6d846-9699-4450-baa2-cd53f09e0a35 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.232999 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-47364f47-b4c5-4248-927d-395144cd32e3 req-96c6d846-9699-4450-baa2-cd53f09e0a35 service nova] Creating event network-changed:ee55608b-015b-4eba-beff-03ed67b44adc for instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 on n-h2-846470-15 Aug 24 03:40:48.258226 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-47364f47-b4c5-4248-927d-395144cd32e3 req-96c6d846-9699-4450-baa2-cd53f09e0a35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137165 Aug 24 03:40:48.262998 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 986/1981] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:48.402009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:48.404940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:48.434604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.435484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.436170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.437148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.437826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.438485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.404542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.421792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.428073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.430630 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-089dbaed-8b38-4b12-adc4-b139074325bc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1869 microversion: 2.32 time: 1.320806 Aug 24 03:40:49.437409 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 996/1982] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:48 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1869 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:49.450505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:49.452289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:49.477103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.478841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.480063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.482537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.484125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.486869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.587225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.640606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.660737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.664339 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90e51b61-3552-46a6-ae8f-37a1ba39837b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1708 microversion: 2.42 time: 1.274317 Aug 24 03:40:49.683131 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 987/1983] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:48 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1708 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:40:49.703739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:49.704367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:49.718972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.719815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.720506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.721666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.722300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.722985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.853075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.873867 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4db5203-aa3a-4a8f-9266-760b9c5e9990 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1295 microversion: 2.1 time: 0.434093 Aug 24 03:40:49.880671 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 997/1984] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:49 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1295 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:49.886556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:49.888565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:49.903749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.905639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.906326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.907321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.908373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.909031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.102889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:50.143847 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0b4e0008-187f-45ce-95ed-a9718f08317d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1268 microversion: 2.1 time: 0.259753 Aug 24 03:40:50.177795 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 998/1985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:49 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1268 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:50.365525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:50.383821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a519d1c-0efa-485e-8575-19f543274cf4 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1322 microversion: 2.1 time: 0.698716 Aug 24 03:40:50.386778 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 988/1986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:49 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:50.470370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:50.472455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:50.515382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.516553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.517490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.518585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.519584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.520382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.716985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:50.725631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:50.747055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.748316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.749467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.751257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.755004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.756095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.777868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:51.799191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.834588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.845136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.854921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4368fe7f-80a6-438f-8826-34d2b9647067 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1890 microversion: 2.32 time: 1.386048 Aug 24 03:40:51.860906 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 999/1987] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:50 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1890 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:51.887977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:51.889236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:51.921502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.926968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.929427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.930553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.937190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.939055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:52.467279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:52.556088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=16 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:53.729071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:53.788749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:53.810095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:53.813359 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e85926a1-f9a3-4572-9463-567e6c554ce4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1755 microversion: 2.42 time: 3.107649 Aug 24 03:40:53.830411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 989/1988] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:50 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1755 bytes in 3125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:54.270388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-aae94345-8efe-4670-b114-189433231a2f req-91a9d0fa-cf35-4575-ab5b-071dc8aaaa13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "tag": "4eddbd7e-3228-4d35-a9ae-041d1df1dfe1"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:54.338614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-aae94345-8efe-4670-b114-189433231a2f req-91a9d0fa-cf35-4575-ab5b-071dc8aaaa13 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.339229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-aae94345-8efe-4670-b114-189433231a2f req-91a9d0fa-cf35-4575-ab5b-071dc8aaaa13 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.342266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-aae94345-8efe-4670-b114-189433231a2f req-91a9d0fa-cf35-4575-ab5b-071dc8aaaa13 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.381055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:54.385877 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-aae94345-8efe-4670-b114-189433231a2f req-91a9d0fa-cf35-4575-ab5b-071dc8aaaa13 service nova] Creating event network-changed:4eddbd7e-3228-4d35-a9ae-041d1df1dfe1 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:40:54.411486 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-aae94345-8efe-4670-b114-189433231a2f req-91a9d0fa-cf35-4575-ab5b-071dc8aaaa13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.577332 Aug 24 03:40:54.421424 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bc94392-5df1-42ad-9eeb-17f588d889ac tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 2.555440 Aug 24 03:40:54.422846 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 990/1989] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:54.432703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1000/1990] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:51 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 2571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:54.437858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:54.446244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:54.460545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:54.464137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:54.471124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.473196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.474162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.475569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.476343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.477061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.489642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:54.493527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.494746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.496569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.498321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.499402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.500495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.952950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:54.999796 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c56d3a33-8d0d-4c38-b11a-223513292a35 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1322 microversion: 2.1 time: 0.560203 Aug 24 03:40:55.002893 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1001/1991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:54 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:55.039652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:55.041949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:55.073266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:55.078286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:55.082436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:55.083506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:55.083745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:55.084257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:55.808463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=14 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:56.030121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:56.071129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:56.087597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:56.092003 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-87b6eddd-1e7c-43ca-8103-5b5530e3cba8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 1.084873 Aug 24 03:40:56.093295 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1002/1992] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:55 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:56.115045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:56.117758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:56.131208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.131208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.137893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.137893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.137893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.137893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.779713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:56.816579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:56.819711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:56.821897 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f6568c4-47d3-42f7-9c36-7aa8d5cebb7c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1755 microversion: 2.42 time: 0.725908 Aug 24 03:40:56.832622 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1003/1993] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:56 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1755 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:56.851506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:56.857234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:56.874398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.875567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.876670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.878074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.879051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.880194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.282049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:57.305629 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ad64a22b-bafb-4871-a7b2-ac581b07dcde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 0.471015 Aug 24 03:40:57.308106 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1004/1994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:56 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:57.331695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:57.333239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:57.345549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.346657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.347429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.348779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.349593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.350426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.590611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:57.610303 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-433b628b-72c9-4bf2-a92c-c25c265a8c88 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1322 microversion: 2.1 time: 0.297526 Aug 24 03:40:57.624843 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1005/1995] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:57 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:57.630085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-eae8ed86-ce7c-4046-ac4e-24aff56d20c4 req-8ea02a51-ea6b-4954-9a4f-f00221cd846f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2931983-47d8-44fe-a4e0-023ee36a6791", "tag": "55e49a5b-9646-4067-99d0-2e062d0d64f7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:57.645323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eae8ed86-ce7c-4046-ac4e-24aff56d20c4 req-8ea02a51-ea6b-4954-9a4f-f00221cd846f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.645650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eae8ed86-ce7c-4046-ac4e-24aff56d20c4 req-8ea02a51-ea6b-4954-9a4f-f00221cd846f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.646099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eae8ed86-ce7c-4046-ac4e-24aff56d20c4 req-8ea02a51-ea6b-4954-9a4f-f00221cd846f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.662127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-eae8ed86-ce7c-4046-ac4e-24aff56d20c4 req-8ea02a51-ea6b-4954-9a4f-f00221cd846f service nova] Creating event network-changed:55e49a5b-9646-4067-99d0-2e062d0d64f7 for instance e2931983-47d8-44fe-a4e0-023ee36a6791 on n-h1-846470-15 Aug 24 03:40:57.669109 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-eae8ed86-ce7c-4046-ac4e-24aff56d20c4 req-8ea02a51-ea6b-4954-9a4f-f00221cd846f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042399 Aug 24 03:40:57.673176 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1006/1996] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:57.691986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:57.691986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:57.706946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.707577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.708568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.709584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.710296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.712341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.103270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.120951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.123450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.125129 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0c180b8-5fd2-4b95-ac04-f3b8d5d0bb22 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.450608 Aug 24 03:40:58.126043 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1007/1997] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:57 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:58.132111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:58.133061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:58.140174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.141059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.141714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.142815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.143893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.144528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.183440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:58.514841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.553290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.557275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.560334 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab9aaa10-1a6c-4a8b-b2fa-ce7c88593ed4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1802 microversion: 2.42 time: 0.432498 Aug 24 03:40:58.568170 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1008/1998] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:58 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1802 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:58.588355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:58.592080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:58.610242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.611396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.613393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.615129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.616158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.617073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.854668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.879885 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4ce20962-4479-4f20-8b88-7987a2bff011 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1310 microversion: 2.1 time: 4.453529 Aug 24 03:40:58.890452 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 991/1999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:54 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1310 bytes in 4467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:58.901000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:58.902341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:58.904876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.914524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.916157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.917076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.918321 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-007735bf-8b97-40c1-9ab7-f2f11e0c5573 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 0.348034 Aug 24 03:40:58.918659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.919380 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1009/2000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:58 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:58.919982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.921800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:59.168588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:59.169434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:59.186067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:59.186589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:59.187051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:59.187890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:59.188305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:59.188741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:59.549908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:59.570448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:59.575201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:59.576544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd6da2fa-1bdb-4930-af22-0e32cd55e6ab tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.412191 Aug 24 03:40:59.580387 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1010/2001] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:59 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:59.602987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:59.603908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:59.617960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:59.618748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:59.619689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:59.620897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:59.624966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:59.625727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.056104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:00.078439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:00.086577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:00.094981 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d1e72f4-ee59-45a7-b73b-8f04e83c0f54 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1802 microversion: 2.42 time: 0.496191 Aug 24 03:41:00.131980 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1011/2002] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:40:59 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1802 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:00.150489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-8dc2a2d6-c6d8-4ce3-88b4-eb6302fd8df4 req-795ed538-6ac4-4bee-8572-4cf6ea01ec01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795254e1-5a01-4e35-b63b-e134c3ff4d25", "name": "network-vif-plugged", "status": "completed", "tag": "ee55608b-015b-4eba-beff-03ed67b44adc"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:00.185379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:00.190426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8dc2a2d6-c6d8-4ce3-88b4-eb6302fd8df4 req-795ed538-6ac4-4bee-8572-4cf6ea01ec01 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.191374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8dc2a2d6-c6d8-4ce3-88b4-eb6302fd8df4 req-795ed538-6ac4-4bee-8572-4cf6ea01ec01 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.192268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8dc2a2d6-c6d8-4ce3-88b4-eb6302fd8df4 req-795ed538-6ac4-4bee-8572-4cf6ea01ec01 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.224403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-8dc2a2d6-c6d8-4ce3-88b4-eb6302fd8df4 req-795ed538-6ac4-4bee-8572-4cf6ea01ec01 service nova] Creating event network-vif-plugged:ee55608b-015b-4eba-beff-03ed67b44adc for instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 on n-h2-846470-15 Aug 24 03:41:00.245967 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-8dc2a2d6-c6d8-4ce3-88b4-eb6302fd8df4 req-795ed538-6ac4-4bee-8572-4cf6ea01ec01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107068 Aug 24 03:41:00.247040 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1012/2003] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:00.269402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:00.270618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:00.295769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.296684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.297474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.298980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.299593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.305845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.547785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:00.558702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4f85d98f-3604-422c-a58c-920fd8455ed5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1322 microversion: 2.1 time: 1.666437 Aug 24 03:41:00.572090 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 992/2004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:58 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1322 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:00.577692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:00.578764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:00.581783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:00.589386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.590193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.590978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.592215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.592938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.593611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.739278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:00.761321 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-34fc5cbe-2aae-41be-922a-7ec00a151697 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1310 microversion: 2.1 time: 0.510557 Aug 24 03:41:00.764790 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1013/2005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:00 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1310 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:00.775290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:00.777097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:00.803093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.803602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.807698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.807698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.807698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.807698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:01.232910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:01.249421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:01.251111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:01.253400 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bbe581b7-82ab-429d-874c-bcb3dcf3070b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.486460 Aug 24 03:41:01.254298 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1014/2006] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:00 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:01.260522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:01.261489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:01.271278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:01.272477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:01.273352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:01.274454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:01.275178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:01.276009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:01.693954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:01.716961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:01.721137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:01.723782 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c0f4ecc1-866d-48da-a1e6-cdbb15ce6cd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1802 microversion: 2.42 time: 0.467831 Aug 24 03:41:01.725793 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1015/2007] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:01 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1802 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:01.735456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:01.737667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:01.749979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:01.751380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:01.752297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:01.753870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:01.755155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:01.756258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:02.200618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:02.224720 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1338d7e-83d5-4eb0-872d-35641e6ccf6e tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1322 microversion: 2.1 time: 0.496669 Aug 24 03:41:02.231465 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1016/2008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:01 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:02.240526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:02.242770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:02.262516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:02.263649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:02.264618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:02.266292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:02.268960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:02.280746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:02.288374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:02.316037 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f3f5f6cf-dfec-4cf1-b14a-3703c1212be6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 1.741966 Aug 24 03:41:02.318923 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 993/2009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:00 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:02.331462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:02.337393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:02.371091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:02.371908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:02.372581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:02.373769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:02.374443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:02.375112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:02.802251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:02.823175 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d69a1722-14be-4079-81b7-943f2f951ce8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1310 microversion: 2.1 time: 0.589242 Aug 24 03:41:02.825370 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1017/2010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:02 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1310 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:02.838387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:02.841022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:02.856610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:02.858107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:02.859290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:02.861346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:02.862655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:02.863838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:03.402581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:03.431770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:03.438370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:03.442604 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4fc62f0-5957-4c69-bdde-2d597d1ce386 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1802 microversion: 2.42 time: 0.615164 Aug 24 03:41:03.445411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1018/2011] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:02 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1802 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:03.462608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-916409129", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "701346a4-1066-45e4-a460-90fc38e2d921"}, {"uuid": "8fc7f21e-66d2-4187-98d7-844547fce3dc"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:03.496811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:03.573489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:03.577369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:03.584963 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee3a4be7-1ae0-484e-8a33-c1838134748e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 1.263765 Aug 24 03:41:03.590531 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 994/2012] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:02 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:03.631174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-282b32e3-8ecd-4e7b-a8ac-703bce91d73e req-aa34f3ef-54dd-468b-859c-d5a0c54cf34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "tag": "840eae0a-52d3-4413-af17-8df0521ff34a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:03.679603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] validate_networks() for [('701346a4-1066-45e4-a460-90fc38e2d921', None, None, None, None, None), ('8fc7f21e-66d2-4187-98d7-844547fce3dc', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:41:03.709317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-282b32e3-8ecd-4e7b-a8ac-703bce91d73e req-aa34f3ef-54dd-468b-859c-d5a0c54cf34b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:03.710141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-282b32e3-8ecd-4e7b-a8ac-703bce91d73e req-aa34f3ef-54dd-468b-859c-d5a0c54cf34b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:03.710931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-282b32e3-8ecd-4e7b-a8ac-703bce91d73e req-aa34f3ef-54dd-468b-859c-d5a0c54cf34b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:03.807097 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-282b32e3-8ecd-4e7b-a8ac-703bce91d73e req-aa34f3ef-54dd-468b-859c-d5a0c54cf34b service nova] Creating event network-changed:840eae0a-52d3-4413-af17-8df0521ff34a for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:41:03.828281 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-282b32e3-8ecd-4e7b-a8ac-703bce91d73e req-aa34f3ef-54dd-468b-859c-d5a0c54cf34b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235490 Aug 24 03:41:03.830112 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 995/2013] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:03.845334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:03.849405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:03.871548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:03.876789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:03.878587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:03.880635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:03.881375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:03.882055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:04.631372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:04.645069 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-385e59c0-1d71-43af-80ab-e5810910f039 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1517 microversion: 2.1 time: 0.811492 Aug 24 03:41:04.664289 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 996/2014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:03 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1517 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:04.670891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:04.672278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:04.679197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:04.680118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:04.681147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:04.682439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:04.683059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:04.683865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.162432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:41:06.162998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:41:06.163426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:41:06.163914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:41:06.164614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:41:06.193115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.193640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.194091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.194853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.195351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.195814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.232071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Getting quotas for project 79f82857fdf14747a44bc05640804363. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:06.239312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Getting quotas for user fb3951916c5a4aedb1ba04a7cf01ffb3 and project 79f82857fdf14747a44bc05640804363. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:06.256379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:41:06.259443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:41:06.338928 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-35c37f45-0d0f-4468-9e10-57ec65600eff tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.892137 Aug 24 03:41:06.340486 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1019/2015] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:41:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:41:06.360631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:06.373262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:06.387225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.387763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.388256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.388997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.389520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.389947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.805822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:06.827306 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2753f14c-e1f7-410e-a1a8-f45886a78617 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1310 microversion: 2.1 time: 0.485188 Aug 24 03:41:06.829546 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1020/2016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:06 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1310 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:06.841171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:06.842674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:06.871257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.872739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.874524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.876515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.879740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.881433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.973841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:07.004494 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a1c1db6-3a7d-41e2-903f-e13351f77616 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 2.338148 Aug 24 03:41:07.006358 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 997/2017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:04 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:07.027793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:07.029296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:07.058105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.059010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.095936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.097711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.098538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.099256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.318160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:07.348791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:07.352060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:07.355279 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8c50835-f955-41d1-b104-e335f13bc9e7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1802 microversion: 2.42 time: 0.522415 Aug 24 03:41:07.357167 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1021/2018] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:06 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1802 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:07.375827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:07.385597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:07.438665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.438665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.439405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.440754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.441568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.442485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.516238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lazy-loading 'flavor' on Instance uuid 795254e1-5a01-4e35-b63b-e134c3ff4d25 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:07.778169 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3e89655a-0ebe-48f2-a0bd-26562d411fe1 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action" status: 200 len: 32 microversion: 2.1 time: 0.418404 Aug 24 03:41:07.778895 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1022/2019] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:07 2022] POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:41:07.801491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a5d6ac59-e1be-4336-b2d6-4d6dbfef7630 req-2ff58e44-5d2a-41fd-aab6-064699f95842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2931983-47d8-44fe-a4e0-023ee36a6791", "name": "network-vif-plugged", "status": "completed", "tag": "55e49a5b-9646-4067-99d0-2e062d0d64f7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:07.840684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5d6ac59-e1be-4336-b2d6-4d6dbfef7630 req-2ff58e44-5d2a-41fd-aab6-064699f95842 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.841406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5d6ac59-e1be-4336-b2d6-4d6dbfef7630 req-2ff58e44-5d2a-41fd-aab6-064699f95842 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.842087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5d6ac59-e1be-4336-b2d6-4d6dbfef7630 req-2ff58e44-5d2a-41fd-aab6-064699f95842 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.891639 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a5d6ac59-e1be-4336-b2d6-4d6dbfef7630 req-2ff58e44-5d2a-41fd-aab6-064699f95842 service nova] Creating event network-vif-plugged:55e49a5b-9646-4067-99d0-2e062d0d64f7 for instance e2931983-47d8-44fe-a4e0-023ee36a6791 on n-h1-846470-15 Aug 24 03:41:07.907800 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a5d6ac59-e1be-4336-b2d6-4d6dbfef7630 req-2ff58e44-5d2a-41fd-aab6-064699f95842 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112500 Aug 24 03:41:07.908470 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1023/2020] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:07.926472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:07.927268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:07.934674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.935502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.936151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.937143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.939249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.940258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.324814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:08.327173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:08.345119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6009af08-ed30-41e8-8daf-2d993a16ced5 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1264 microversion: 2.1 time: 0.424257 Aug 24 03:41:08.345761 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1024/2021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:07 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1264 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:08.351515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c4f4762e-20aa-4c77-a657-c76da60406da req-739b0da2-56d0-44ca-a989-8777442e5e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5650d75d-2bd5-425e-8265-de0c96bb9d09", "tag": "dcd1ebcd-1f5d-48ff-b959-70cda70c0d18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:08.376461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4f4762e-20aa-4c77-a657-c76da60406da req-739b0da2-56d0-44ca-a989-8777442e5e49 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.377197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4f4762e-20aa-4c77-a657-c76da60406da req-739b0da2-56d0-44ca-a989-8777442e5e49 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.378027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4f4762e-20aa-4c77-a657-c76da60406da req-739b0da2-56d0-44ca-a989-8777442e5e49 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.401065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c4f4762e-20aa-4c77-a657-c76da60406da req-739b0da2-56d0-44ca-a989-8777442e5e49 service nova] Creating event network-changed:dcd1ebcd-1f5d-48ff-b959-70cda70c0d18 for instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 on n-h1-846470-15 Aug 24 03:41:08.411760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c4f4762e-20aa-4c77-a657-c76da60406da req-739b0da2-56d0-44ca-a989-8777442e5e49 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064271 Aug 24 03:41:08.412908 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1025/2022] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:08.418166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:08.418869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:08.441792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.442275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.448100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.449046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.449670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.450258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.548967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:08.579303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:08.598919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:08.601009 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58ccabb4-82b4-4605-a582-708c4dac428f tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 1.592742 Aug 24 03:41:08.602028 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 998/2023] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:07 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:08.644229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:08.645551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:08.662653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.663865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.664883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.666365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.668613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.676847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:09.001322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:09.030892 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1f02ef6e-e92b-4e8b-a087-77574dc73796 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1523 microversion: 2.1 time: 0.605170 Aug 24 03:41:09.032155 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1026/2024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:08 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1523 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:09.089730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:09.090890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:09.121032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:09.122097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:09.124359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:09.125474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:09.127032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:09.127960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.019536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:10.041907 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e71353a6-4a34-4058-b08c-4a5a77b20324 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 0.980808 Aug 24 03:41:10.044199 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1027/2025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:09 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:10.054994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:10.056999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:10.070278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.076377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.077728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.079291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.080982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.082148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.246760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:10.292046 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67273db1-0d3e-4acb-84ee-3dec52a0f4b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1310 microversion: 2.1 time: 1.680340 Aug 24 03:41:10.296481 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 999/2026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:08 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1310 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:10.305834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:10.307006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:10.333518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.334427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.335248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.336987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.337977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.338644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.647578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:10.681588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae9e96d8-e13d-4774-92a2-ee149ae7b0bc tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1270 microversion: 2.1 time: 0.383034 Aug 24 03:41:10.682733 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1000/2027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:10 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1270 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:10.703088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:10.704372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:10.729612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.730511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.731290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.732678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:10.733537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:10.734346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.993372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:11.017993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:11.021451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:11.030691 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d41fca8-020f-4f50-8610-f001f1a5fc47 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1849 microversion: 2.42 time: 0.981078 Aug 24 03:41:11.031878 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1028/2028] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:10 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1849 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:11.044063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:11.059495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:11.074216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.082132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.083461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.085083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.087550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.089365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.588592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:11.606249 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-faca7793-2863-4d68-ba34-4d548d8f8f30 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1523 microversion: 2.1 time: 0.573005 Aug 24 03:41:11.609571 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1029/2029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:11 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:11.620286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d85e7629-28a9-4282-8579-bb42e4728730 req-24d88e47-049d-49fb-9f0a-d0a5138e9b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "tag": "5af2697c-af94-46c8-909d-23f7f66e37c1"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:11.671235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d85e7629-28a9-4282-8579-bb42e4728730 req-24d88e47-049d-49fb-9f0a-d0a5138e9b50 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.671974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d85e7629-28a9-4282-8579-bb42e4728730 req-24d88e47-049d-49fb-9f0a-d0a5138e9b50 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.672620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d85e7629-28a9-4282-8579-bb42e4728730 req-24d88e47-049d-49fb-9f0a-d0a5138e9b50 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.714999 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d85e7629-28a9-4282-8579-bb42e4728730 req-24d88e47-049d-49fb-9f0a-d0a5138e9b50 service nova] Creating event network-changed:5af2697c-af94-46c8-909d-23f7f66e37c1 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:41:11.724424 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d85e7629-28a9-4282-8579-bb42e4728730 req-24d88e47-049d-49fb-9f0a-d0a5138e9b50 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112488 Aug 24 03:41:11.725791 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1030/2030] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:11.734343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:11.735796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:11.748163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.749157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.750053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.751455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.752849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.753837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:12.078384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:12.117706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:12.130187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:12.132601 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-48633f9a-93cd-46c7-a53e-9251041393bb tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 1.447809 Aug 24 03:41:12.144462 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1001/2031] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:10 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:12.162348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:12.163901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:12.186837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:12.188250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:12.189270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:12.191129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:12.195870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:12.197335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:12.724225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:12.747419 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59483506-5fb0-4064-91c0-2034898b3f40 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 1.019935 Aug 24 03:41:12.761588 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1031/2032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:11 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:12.773081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:12.773720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:12.788298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:12.788798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:12.789231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:12.789947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:12.790395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:12.795155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.008393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:13.038123 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-34236b8d-c773-4bf7-ab93-c4594ad642ab tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1270 microversion: 2.1 time: 0.274750 Aug 24 03:41:13.040105 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1032/2033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:12 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1270 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:13.056628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:13.057574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:13.082583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.083086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.083526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.084288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.092370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.092904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.603601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:13.623194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0b37218e-6171-427c-8887-12e03aac8db7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1494 microversion: 2.1 time: 1.476533 Aug 24 03:41:13.636727 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1002/2034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:12 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1494 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:13.656639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:13.666023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:13.716647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.723616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.740139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.743058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.744436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.750158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.141295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:14.162318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:14.164643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:14.166864 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-56329e51-e0dc-41e7-9afa-3f33d05d5954 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1849 microversion: 2.42 time: 1.125360 Aug 24 03:41:14.190552 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1033/2035] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:13 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1849 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:14.202058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:14.205892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:14.222606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.228598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.230235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.231033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.231534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.232036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.708353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:14.726605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:14.730205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:14.732902 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d53d734-8e93-4a63-a39d-ab6267a0d2b8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.540110 Aug 24 03:41:14.753367 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1034/2036] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:14 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:14.765397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:14.767012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:14.788035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.788932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.789875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.792087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.792918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.793690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.976098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:15.022922 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4470bfd8-755b-4169-b090-1ec9374c55d8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1523 microversion: 2.1 time: 1.383974 Aug 24 03:41:15.029159 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1003/2037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:13 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1523 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:15.034947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:15.042680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:15.063653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.064341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.065042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.066363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.066985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.067519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.301438 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15635a38-8be2-41b2-98c5-5045eaf54602 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1647 microversion: 2.1 time: 0.543626 Aug 24 03:41:15.312491 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1035/2038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:14 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1647 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:15.323495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:15.325895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:15.341478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.346080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.347053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.350150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.350965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.352807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.651872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:15.668402 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fcd025cb-ed22-4826-b6e4-9316dd2fe18f tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1312 microversion: 2.1 time: 0.353200 Aug 24 03:41:15.670816 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1036/2039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:15 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1312 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:15.681022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-8cceeced-c030-410d-b989-37ba5316f1ed req-ec441128-3ed3-4c98-b46c-472d9e542b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "tag": "1aa3e47c-9374-4288-97b6-28044e86d865"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:15.717954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cceeced-c030-410d-b989-37ba5316f1ed req-ec441128-3ed3-4c98-b46c-472d9e542b1c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.718545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cceeced-c030-410d-b989-37ba5316f1ed req-ec441128-3ed3-4c98-b46c-472d9e542b1c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.719096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cceeced-c030-410d-b989-37ba5316f1ed req-ec441128-3ed3-4c98-b46c-472d9e542b1c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.748593 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-8cceeced-c030-410d-b989-37ba5316f1ed req-ec441128-3ed3-4c98-b46c-472d9e542b1c service nova] Creating event network-changed:1aa3e47c-9374-4288-97b6-28044e86d865 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:41:15.763588 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-8cceeced-c030-410d-b989-37ba5316f1ed req-ec441128-3ed3-4c98-b46c-472d9e542b1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091241 Aug 24 03:41:15.764923 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1037/2040] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:15.772108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:15.773732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:15.784559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.785352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.786224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:15.787372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:15.788367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:15.788999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.219172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:16.248291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:16.418055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:16.432223 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27970aab-f385-4b67-9b81-b5f49f9c85fd tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 1.400731 Aug 24 03:41:16.434961 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1004/2041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:15 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:16.444430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:16.445937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:16.454152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.454663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.455132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.456796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.458068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.458518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.697359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:16.714763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:16.716523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:16.718079 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81b3a43c-437b-4e88-bbc1-c4a1c32f231a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1849 microversion: 2.42 time: 0.951473 Aug 24 03:41:16.741651 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1038/2042] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:15 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1849 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:16.749984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:16.750923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:16.768281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.769506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.772263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:16.773113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:16.773662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:16.777318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.130904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:17.142770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:17.144837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:17.146066 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-87afaa9e-51ac-43e4-925a-649afbdaaf9a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.403250 Aug 24 03:41:17.146651 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1039/2043] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:16 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:17.151616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:17.152714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:17.159624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.160414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.160859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.161590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.162046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.162832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.363886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:17.369701 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-75d05939-88dc-4915-9496-ce9df9b00b31 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1647 microversion: 2.1 time: 0.932920 Aug 24 03:41:17.370662 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1005/2044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:16 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1647 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:17.374663 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-354a33bc-dab7-4490-b273-f70bdb989907 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1523 microversion: 2.1 time: 0.226767 Aug 24 03:41:17.375343 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1040/2045] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:17 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:17.386849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:17.387847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:17.392095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2c1f0dcb-1c1f-4cc6-8989-c68920ba9ae1 req-de80c7e9-1f53-4288-8f3f-f3472b2eb5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5650d75d-2bd5-425e-8265-de0c96bb9d09", "name": "network-vif-plugged", "status": "completed", "tag": "dcd1ebcd-1f5d-48ff-b959-70cda70c0d18"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:17.395495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.396043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.396522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.397240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.397696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.398713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.406264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2c1f0dcb-1c1f-4cc6-8989-c68920ba9ae1 req-de80c7e9-1f53-4288-8f3f-f3472b2eb5e9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.407067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2c1f0dcb-1c1f-4cc6-8989-c68920ba9ae1 req-de80c7e9-1f53-4288-8f3f-f3472b2eb5e9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.407765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2c1f0dcb-1c1f-4cc6-8989-c68920ba9ae1 req-de80c7e9-1f53-4288-8f3f-f3472b2eb5e9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.420414 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2c1f0dcb-1c1f-4cc6-8989-c68920ba9ae1 req-de80c7e9-1f53-4288-8f3f-f3472b2eb5e9 service nova] Creating event network-vif-plugged:dcd1ebcd-1f5d-48ff-b959-70cda70c0d18 for instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 on n-h1-846470-15 Aug 24 03:41:17.427111 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2c1f0dcb-1c1f-4cc6-8989-c68920ba9ae1 req-de80c7e9-1f53-4288-8f3f-f3472b2eb5e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055217 Aug 24 03:41:17.428443 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1006/2046] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:17.605233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:17.617727 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1fb34e80-743b-41f1-ae85-17003a299326 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1312 microversion: 2.1 time: 0.240798 Aug 24 03:41:17.619386 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1041/2047] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:17 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:17.638736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b3f76184-0ca6-432e-ac8c-2748794c69d9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:17.645010 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:41:17.645010 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:41:17.645796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1517e17a-37dd-4e17-96fb-2fd51837fb93 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Action: 'create', calling method: .version_select at 0x7f10343ee4c0>, body: {"pool": null} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:17.647070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3f76184-0ca6-432e-ac8c-2748794c69d9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.647828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3f76184-0ca6-432e-ac8c-2748794c69d9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.648421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3f76184-0ca6-432e-ac8c-2748794c69d9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.649218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3f76184-0ca6-432e-ac8c-2748794c69d9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.649673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3f76184-0ca6-432e-ac8c-2748794c69d9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.650099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3f76184-0ca6-432e-ac8c-2748794c69d9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.679327 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b3f76184-0ca6-432e-ac8c-2748794c69d9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.058344 Aug 24 03:41:17.680339 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1042/2048] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 03:41:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:17.685070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:17.685670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:17.692644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.693388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.694002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.694909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.695528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.696019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.917546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:17.928849 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c11e79b7-038f-495b-b7b1-0a2ac93666bf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1363 microversion: 2.1 time: 0.247309 Aug 24 03:41:17.929446 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1043/2049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:17 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:17.938662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:17.939943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:17.947898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.948587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.949129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.950048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.950611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.951139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.955820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:18.039749 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc8268c0-1e9e-4b20-a89c-8726a2ba4695 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791/action" status: 202 len: 0 microversion: 2.1 time: 0.107545 Aug 24 03:41:18.040856 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1044/2050] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:17 2022] POST /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:18.053571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:18.054197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:18.074897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:18.075707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:18.076812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:18.077827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:18.078394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:18.078925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:18.326813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:18.343324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:18.347554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:18.349125 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b1cc08d-984d-4dda-843d-a46ea1451670 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1837 microversion: 2.42 time: 0.305950 Aug 24 03:41:18.365742 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1045/2051] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:18 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1837 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:18.374244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:18.374890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:18.383534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:18.384082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:18.384580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:18.385330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:18.385842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:18.386303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:18.606466 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d8f6e6d3-3135-440d-a684-5f4aec0f4469 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1632 microversion: 2.1 time: 0.239511 Aug 24 03:41:18.607868 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1046/2052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:18 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1632 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:18.627947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:18.629057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:18.691455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:18.692304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:18.692938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:18.693805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:18.695435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:18.699024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:19.217170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:19.245052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:19.256128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:19.258949 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-98cb3925-ea6f-4f6b-b0f7-7b7db946aa75 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.649586 Aug 24 03:41:19.265378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1047/2053] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:18 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:19.276207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:19.277872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:19.306527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:19.310873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:19.311364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:19.312182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:19.312667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:19.313104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:19.696328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:19.728112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bcb52c28-5f2b-492c-a4d2-3e84212c9d41 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1523 microversion: 2.1 time: 0.460974 Aug 24 03:41:19.728987 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1048/2054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:19 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1523 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:19.741903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d01ee826-28be-4658-9321-3f918df2add7 req-fa9efef6-d752-4afa-bcbc-696f5944226a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "tag": "efcdcdd4-3cc4-4b59-9e73-b000f5f70269"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:19.766357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d01ee826-28be-4658-9321-3f918df2add7 req-fa9efef6-d752-4afa-bcbc-696f5944226a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:19.770484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d01ee826-28be-4658-9321-3f918df2add7 req-fa9efef6-d752-4afa-bcbc-696f5944226a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:19.770967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d01ee826-28be-4658-9321-3f918df2add7 req-fa9efef6-d752-4afa-bcbc-696f5944226a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:19.807799 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d01ee826-28be-4658-9321-3f918df2add7 req-fa9efef6-d752-4afa-bcbc-696f5944226a service nova] Creating event network-changed:efcdcdd4-3cc4-4b59-9e73-b000f5f70269 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:41:19.825051 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d01ee826-28be-4658-9321-3f918df2add7 req-fa9efef6-d752-4afa-bcbc-696f5944226a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092792 Aug 24 03:41:19.827397 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1049/2055] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:19.842153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846470-15", "block_migration": true, "disk_over_commit": false}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:19.853053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:19.868102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:19.869490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:19.870619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:19.872673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:19.873738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:19.874703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:20.032402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lazy-loading 'flavor' on Instance uuid e2931983-47d8-44fe-a4e0-023ee36a6791 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:20.049913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Going to try to live migrate instance to n-h2-846470-15 {{(pid=122536) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:41:23.354145 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd28e6d5-f6a7-4bbb-9abd-5fabbfa0ad2c tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791/action" status: 202 len: 0 microversion: 2.1 time: 3.524645 Aug 24 03:41:23.359607 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1050/2056] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:19 2022] POST /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791/action => generated 0 bytes in 3531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:23.367035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:23.369295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:23.382717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:23.383961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:23.384908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:23.386112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:23.386878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:23.387874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:23.749225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:23.759021 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-12d3204c-c553-4a32-9952-072c66816388 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.397730 Aug 24 03:41:23.763490 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1051/2057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:23 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:23.778055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:23.778055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:23.801212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:23.801212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:23.801212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:23.801212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:23.801212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:23.801212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:24.139981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:24.151113 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55595270-23e2-400e-b73f-12de9e1274f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1548 microversion: 2.1 time: 0.386388 Aug 24 03:41:24.152042 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1052/2058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:23 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1548 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:24.161912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:24.163199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:24.170999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:24.173604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:24.174842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:24.176637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:24.177708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:24.178861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:24.180143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:24.539054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:24.567219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:24.582117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:24.586249 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3fc377d4-9841-4743-95d3-179b0da1e3a2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1858 microversion: 2.42 time: 0.429799 Aug 24 03:41:24.588822 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1053/2059] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:24 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1858 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:24.605774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:24.606884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:24.616732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:24.618827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:24.619791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:24.620910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:24.621391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:24.621992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:24.990598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:25.003560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:25.006365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:25.008302 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ebfbda3-d10d-45fa-ba43-2446f5c77e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.410593 Aug 24 03:41:25.032170 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1054/2060] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:24 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:25.039993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:25.040997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:25.049179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.049895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.050501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.051419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.052063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.052647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.088095 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1517e17a-37dd-4e17-96fb-2fd51837fb93 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.657948 Aug 24 03:41:25.089245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1007/2061] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:41:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:25.095702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8faf39fc-de1b-41db-a80c-37ad9aa3563f req-bef75665-e090-4fca-9552-a45e85696982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "tag": "dbf9362f-58e3-48e5-ac2d-5aaac595a8a8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:25.120889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8faf39fc-de1b-41db-a80c-37ad9aa3563f req-bef75665-e090-4fca-9552-a45e85696982 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.121450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8faf39fc-de1b-41db-a80c-37ad9aa3563f req-bef75665-e090-4fca-9552-a45e85696982 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.121956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8faf39fc-de1b-41db-a80c-37ad9aa3563f req-bef75665-e090-4fca-9552-a45e85696982 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.136726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:25.138907 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8faf39fc-de1b-41db-a80c-37ad9aa3563f req-bef75665-e090-4fca-9552-a45e85696982 service nova] Creating event network-changed:dbf9362f-58e3-48e5-ac2d-5aaac595a8a8 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:41:25.144884 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8faf39fc-de1b-41db-a80c-37ad9aa3563f req-bef75665-e090-4fca-9552-a45e85696982 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054197 Aug 24 03:41:25.145996 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1008/2062] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:25.157576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:25.158518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:25.167270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.168380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.168902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.169808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.170479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.183730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.369778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:25.385543 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31d26fef-862e-4eb1-955a-46541c2e7cec tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1523 microversion: 2.1 time: 0.349549 Aug 24 03:41:25.386780 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1055/2063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:25 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:25.394196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:25.394995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:25.416420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.416938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.417405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.418322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.419082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.420418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.585325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d6506ed0-4be8-403e-82ea-fd9cf007f546 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195714 Aug 24 03:41:25.587434 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1056/2064] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:41:25 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:25.592851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:25.593562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:25.602751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.603252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.603718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.604481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.605123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.605577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:26.108739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:26.120493 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f89b44e-868d-490e-9c37-71bc13c5e9c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.531787 Aug 24 03:41:26.128760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1057/2065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:25 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:26.138462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6acf25c0-3e53-41f7-abb5-3d71f2bf278c tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Action: 'create', calling method: .version_select at 0x7f102274d550>, body: {"pool": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:26.307826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:26.346454 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45f63c47-62da-4d36-9663-17ac231a1faf tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1504 microversion: 2.1 time: 1.198511 Aug 24 03:41:26.349563 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1009/2066] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:25 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1504 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:26.360499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-45b8bd0a-1375-4cfd-8d09-30218fb238ff req-a24b1b37-6f6d-49f4-9874-db27a739e570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2931983-47d8-44fe-a4e0-023ee36a6791", "name": "network-vif-unplugged", "status": "completed", "tag": "55e49a5b-9646-4067-99d0-2e062d0d64f7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:26.385121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-45b8bd0a-1375-4cfd-8d09-30218fb238ff req-a24b1b37-6f6d-49f4-9874-db27a739e570 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:26.386168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-45b8bd0a-1375-4cfd-8d09-30218fb238ff req-a24b1b37-6f6d-49f4-9874-db27a739e570 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:26.387062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-45b8bd0a-1375-4cfd-8d09-30218fb238ff req-a24b1b37-6f6d-49f4-9874-db27a739e570 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:26.409419 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-45b8bd0a-1375-4cfd-8d09-30218fb238ff req-a24b1b37-6f6d-49f4-9874-db27a739e570 service nova] Creating event network-vif-unplugged:55e49a5b-9646-4067-99d0-2e062d0d64f7 for instance e2931983-47d8-44fe-a4e0-023ee36a6791 on n-h1-846470-15 Aug 24 03:41:26.419158 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-45b8bd0a-1375-4cfd-8d09-30218fb238ff req-a24b1b37-6f6d-49f4-9874-db27a739e570 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067031 Aug 24 03:41:26.420771 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1010/2067] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:26.433166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:26.435547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:26.450096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:26.451373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:26.452452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:26.454106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:26.455232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:26.456097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:27.323482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:27.351319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:27.355360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:27.358806 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d4dbf789-619c-4b0f-adb7-4290dfc63bfc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.935802 Aug 24 03:41:27.361572 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1011/2068] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:26 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:27.388356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:27.389994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:27.409392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:27.410051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:27.410546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:27.411371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:27.412821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:27.416294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:27.659649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:28.197605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:28.232832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:28.236693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:28.239392 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a409c4b5-65aa-4111-b383-c3083651f2f3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.876016 Aug 24 03:41:28.253989 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1012/2069] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:27 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:28.266933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:28.267944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:28.276378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:28.277107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:28.277904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:28.278812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:28.281810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:28.282360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.253031 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6acf25c0-3e53-41f7-abb5-3d71f2bf278c tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.122543 Aug 24 03:41:29.254458 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1058/2070] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:41:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:29.263233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:29.264311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:29.272740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.273239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.273676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.274411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.274871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.275460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.337305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:29.347315 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fac65689-88fd-4f5f-b374-a49107233f84 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1523 microversion: 2.1 time: 1.090790 Aug 24 03:41:29.360476 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1013/2071] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:28 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1523 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:29.369876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b065f21d-1a70-4ca4-9606-014c673afaef req-b11267e4-ea2d-452b-9979-db8c5aa8b860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "tag": "5c7ebbdb-390b-4d78-b6a2-425bd3132adc"}, {"name": "network-changed", "server_uuid": "73e6d382-2a98-466a-9f39-e360c84b5d1d", "tag": "39ab6c40-4d46-41c5-8630-ad298cf1e574"}, {"name": "network-changed", "server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "tag": "323a0297-cdc4-4ea9-82c5-f9a48df89f13"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:29.390007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b065f21d-1a70-4ca4-9606-014c673afaef req-b11267e4-ea2d-452b-9979-db8c5aa8b860 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.390802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b065f21d-1a70-4ca4-9606-014c673afaef req-b11267e4-ea2d-452b-9979-db8c5aa8b860 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.392050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b065f21d-1a70-4ca4-9606-014c673afaef req-b11267e4-ea2d-452b-9979-db8c5aa8b860 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.420629 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b065f21d-1a70-4ca4-9606-014c673afaef req-b11267e4-ea2d-452b-9979-db8c5aa8b860 service nova] Creating event network-changed:5c7ebbdb-390b-4d78-b6a2-425bd3132adc for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:41:29.421173 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b065f21d-1a70-4ca4-9606-014c673afaef req-b11267e4-ea2d-452b-9979-db8c5aa8b860 service nova] Creating event network-changed:39ab6c40-4d46-41c5-8630-ad298cf1e574 for instance 73e6d382-2a98-466a-9f39-e360c84b5d1d on n-h2-846470-15 Aug 24 03:41:29.421691 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b065f21d-1a70-4ca4-9606-014c673afaef req-b11267e4-ea2d-452b-9979-db8c5aa8b860 service nova] Creating event network-changed:323a0297-cdc4-4ea9-82c5-f9a48df89f13 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:41:29.449213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b065f21d-1a70-4ca4-9606-014c673afaef req-b11267e4-ea2d-452b-9979-db8c5aa8b860 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.086292 Aug 24 03:41:29.452540 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1014/2072] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:29.464871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:29.465899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:29.475274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.481218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.482536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.483900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.484739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.485415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.547142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:29.550656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:29.560227 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dd1704b4-6905-42ca-9b18-f44f44c25a70 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.303167 Aug 24 03:41:29.561055 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1059/2073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:29 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:29.567483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:29.568693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:29.576079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.576921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.577639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.578773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.579440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.580568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.813550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:29.828736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:29.831010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:29.832159 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7fbdc48d-c89c-4303-a063-52b24e1bbfe9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.269866 Aug 24 03:41:29.832739 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1060/2074] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:29 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:29.838139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9834bc13-33c3-4777-b3f4-0db302a7a11d req-eef6dd7a-0b21-431d-988d-dd65b55b1381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2931983-47d8-44fe-a4e0-023ee36a6791", "tag": "55e49a5b-9646-4067-99d0-2e062d0d64f7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:29.849315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9834bc13-33c3-4777-b3f4-0db302a7a11d req-eef6dd7a-0b21-431d-988d-dd65b55b1381 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:29.850275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9834bc13-33c3-4777-b3f4-0db302a7a11d req-eef6dd7a-0b21-431d-988d-dd65b55b1381 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:29.850908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9834bc13-33c3-4777-b3f4-0db302a7a11d req-eef6dd7a-0b21-431d-988d-dd65b55b1381 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:29.864896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9834bc13-33c3-4777-b3f4-0db302a7a11d req-eef6dd7a-0b21-431d-988d-dd65b55b1381 service nova] Creating event network-changed:55e49a5b-9646-4067-99d0-2e062d0d64f7 for instance e2931983-47d8-44fe-a4e0-023ee36a6791 on n-h1-846470-15 Aug 24 03:41:29.871260 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9834bc13-33c3-4777-b3f4-0db302a7a11d req-eef6dd7a-0b21-431d-988d-dd65b55b1381 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036973 Aug 24 03:41:29.872341 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1061/2075] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:29.880277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7fc5a6ff-3701-445f-98ad-521897640e1f tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Action: 'create', calling method: .version_select at 0x7f102279cd30>, body: {"pool": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:30.220641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:30.230232 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd45a3a1-802a-4c7f-b1f9-7e68140e3e39 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1504 microversion: 2.1 time: 0.773664 Aug 24 03:41:30.242938 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1015/2076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:29 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1504 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:30.253487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:30.254381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:30.261266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:30.262055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:30.262661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:30.263586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:30.264221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:30.264801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:31.112957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:31.128885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:31.130817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:31.132735 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-56add712-6d4c-4731-9ed7-eebc939bf7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.884172 Aug 24 03:41:31.133925 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1016/2077] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:30 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:31.138900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:31.139556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:31.142818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=46 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:31.150676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:31.151176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:31.151602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:31.152381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:31.152833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:31.153251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:31.885811 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7fc5a6ff-3701-445f-98ad-521897640e1f tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.011717 Aug 24 03:41:31.892345 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1062/2078] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:41:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:31.899267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:31.900308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:31.910618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:31.911768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:31.911768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:31.912314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:31.912776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:31.913208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.098833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:32.109756 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48baebe8-f073-44d8-91f6-1c85ddd83d6b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.215532 Aug 24 03:41:32.110423 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1063/2079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:31 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:32.117090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:32.118138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:32.125723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.126571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.127451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.127955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.128434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.128952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.220622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:32.236583 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf6f5857-847f-4870-8ecd-b72c5e07c467 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1503 microversion: 2.1 time: 1.101171 Aug 24 03:41:32.237500 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1017/2080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:31 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1503 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:32.242919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:32.243557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:32.262085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.262613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.263058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.263880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.264372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.264818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.414842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:32.439541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:32.446233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:32.452951 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df94c692-30e4-4b9d-99eb-3e0832b74ce7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.341256 Aug 24 03:41:32.453586 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1064/2081] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:32 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:32.459850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5a7bfdb8-b4ca-46eb-b5be-a7894cce862f req-d70bca80-2a25-47a1-bffa-b66dcaa0a545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e6d382-2a98-466a-9f39-e360c84b5d1d", "tag": "e013e20f-753b-4f98-afd6-362eaa5854bf"}, {"name": "network-changed", "server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "tag": "20094682-916d-47c5-bd07-b6fb29d41cb9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:32.473765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5a7bfdb8-b4ca-46eb-b5be-a7894cce862f req-d70bca80-2a25-47a1-bffa-b66dcaa0a545 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.474526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5a7bfdb8-b4ca-46eb-b5be-a7894cce862f req-d70bca80-2a25-47a1-bffa-b66dcaa0a545 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.475150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5a7bfdb8-b4ca-46eb-b5be-a7894cce862f req-d70bca80-2a25-47a1-bffa-b66dcaa0a545 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.492424 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5a7bfdb8-b4ca-46eb-b5be-a7894cce862f req-d70bca80-2a25-47a1-bffa-b66dcaa0a545 service nova] Creating event network-changed:e013e20f-753b-4f98-afd6-362eaa5854bf for instance 73e6d382-2a98-466a-9f39-e360c84b5d1d on n-h2-846470-15 Aug 24 03:41:32.493317 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5a7bfdb8-b4ca-46eb-b5be-a7894cce862f req-d70bca80-2a25-47a1-bffa-b66dcaa0a545 service nova] Creating event network-changed:20094682-916d-47c5-bd07-b6fb29d41cb9 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:41:32.505146 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5a7bfdb8-b4ca-46eb-b5be-a7894cce862f req-d70bca80-2a25-47a1-bffa-b66dcaa0a545 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050062 Aug 24 03:41:32.506266 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1065/2082] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:32.513269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b1a23b63-efed-4bd4-ae88-2cf44fcb4340 req-561bbba4-55db-4cfa-99c9-4126f5fe3796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5650d75d-2bd5-425e-8265-de0c96bb9d09", "tag": "dcd1ebcd-1f5d-48ff-b959-70cda70c0d18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:32.533774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b1a23b63-efed-4bd4-ae88-2cf44fcb4340 req-561bbba4-55db-4cfa-99c9-4126f5fe3796 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.534166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b1a23b63-efed-4bd4-ae88-2cf44fcb4340 req-561bbba4-55db-4cfa-99c9-4126f5fe3796 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.534831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b1a23b63-efed-4bd4-ae88-2cf44fcb4340 req-561bbba4-55db-4cfa-99c9-4126f5fe3796 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.550998 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b1a23b63-efed-4bd4-ae88-2cf44fcb4340 req-561bbba4-55db-4cfa-99c9-4126f5fe3796 service nova] Creating event network-changed:dcd1ebcd-1f5d-48ff-b959-70cda70c0d18 for instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 on n-h1-846470-15 Aug 24 03:41:32.558766 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b1a23b63-efed-4bd4-ae88-2cf44fcb4340 req-561bbba4-55db-4cfa-99c9-4126f5fe3796 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050208 Aug 24 03:41:32.559569 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1066/2083] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:32.566328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24858700-51f6-4db0-92df-a928f1637533 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Action: 'create', calling method: .version_select at 0x7f10227a9820>, body: {"pool": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:33.231206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:33.257000 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a38f223e-d998-4368-9d83-644d7a214121 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1504 microversion: 2.1 time: 1.017953 Aug 24 03:41:33.265571 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1018/2084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:32 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1504 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:33.282856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:33.284543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:33.297203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:33.297721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:33.299419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:33.300619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:33.301305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:33.302621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:34.634063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:34.657241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:34.667836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:34.669253 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e25143c-bda5-4d85-9b93-549fe45926a9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 1.401955 Aug 24 03:41:34.674520 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1019/2085] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:33 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:34.682656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bdde7258-b0be-4c45-9d71-0e015e55acc8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Action: 'create', calling method: .version_select at 0x7f10344474c0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1063448049", "description": "tempest-description-1951486551"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:35.373602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bdde7258-b0be-4c45-9d71-0e015e55acc8 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.696667 Aug 24 03:41:35.384538 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1020/2086] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 03:41:34 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:35.401077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:35.402267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:35.422384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:35.423037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:35.423810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:35.425058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:35.426308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:35.427792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:35.629248 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24858700-51f6-4db0-92df-a928f1637533 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.068059 Aug 24 03:41:35.639463 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1067/2087] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:41:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:35.648451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:35.649810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:35.662424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:35.664243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:35.665617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:35.666653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:35.667533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:35.670082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.038474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.052980 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-73328900-bb96-44ab-b7bb-31d2243a6035 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.666678 Aug 24 03:41:36.056151 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1021/2088] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:35 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:36.065524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:36.068341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:36.086986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:36.087617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:36.088221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.093244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:36.093830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:36.094348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.120527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.143774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.146318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.149849 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5dc0913-00df-4e6b-929a-400ff5de9a1c tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.507861 Aug 24 03:41:36.155473 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1068/2089] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:35 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:36.238403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e7d6cd8-a43b-4d75-8dfb-a2f9afd4fd75 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] Calling method '.version_select at 0x7f10227a98b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:36.417221 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e7d6cd8-a43b-4d75-8dfb-a2f9afd4fd75 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.260228 Aug 24 03:41:36.418308 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1069/2090] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:41:36 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:41:36.423479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1063448049"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:36.424484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:36.443257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:36.444038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:36.444641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.446756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:36.447513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:36.447989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.781249 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.network.security_group_api [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Adding security group 51041189-f354-46fb-b345-9d20e17b8078 to port ee55608b-015b-4eba-beff-03ed67b44adc Aug 24 03:41:36.979725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.995598 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ad51060-52fe-4025-8487-e7a6ba638e93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1504 microversion: 2.1 time: 0.937676 Aug 24 03:41:36.998151 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1022/2091] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:36 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1504 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:37.016271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-357f15a9-de72-44ee-a96c-750167745288 req-1cc7046a-83dd-4371-b8b4-2e3033d46d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "tag": "ded6684b-2e32-4bbb-be0f-f0be069a1304"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:37.032075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-357f15a9-de72-44ee-a96c-750167745288 req-1cc7046a-83dd-4371-b8b4-2e3033d46d53 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.033238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-357f15a9-de72-44ee-a96c-750167745288 req-1cc7046a-83dd-4371-b8b4-2e3033d46d53 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.035349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-357f15a9-de72-44ee-a96c-750167745288 req-1cc7046a-83dd-4371-b8b4-2e3033d46d53 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.071566 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-357f15a9-de72-44ee-a96c-750167745288 req-1cc7046a-83dd-4371-b8b4-2e3033d46d53 service nova] Creating event network-changed:ded6684b-2e32-4bbb-be0f-f0be069a1304 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:41:37.082997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-357f15a9-de72-44ee-a96c-750167745288 req-1cc7046a-83dd-4371-b8b4-2e3033d46d53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081378 Aug 24 03:41:37.084959 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1023/2092] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:37.099528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3b83c7d3-6303-4239-afe7-b17f1b3476b2 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Calling method '.version_select at 0x7f1034416280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:37.586998 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-19a98a9a-168d-451d-93af-68c3d8b7ce06 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action" status: 202 len: 0 microversion: 2.1 time: 1.167227 Aug 24 03:41:37.592548 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1070/2093] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:36 2022] POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:37.597451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:37.601609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:37.636917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.637822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.638327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.640295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.641079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.641825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.953284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.984917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.986289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.989190 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-314a93bb-49c8-43e9-85b1-460c58f0fcb8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.398514 Aug 24 03:41:37.990182 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1071/2094] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:37 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:37.997627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0fcdf85-9f64-4f35-83b6-77ba3df55dc9 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] Action: 'create', calling method: .version_select at 0x7f1022740b80>, body: {"pool": "non_exist_pool"} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:38.025936 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3b83c7d3-6303-4239-afe7-b17f1b3476b2 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/e564f148-2a23-47db-b3e3-35f77cba5b64" status: 200 len: 141 microversion: 2.1 time: 0.934731 Aug 24 03:41:38.029390 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1024/2095] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 24 03:41:37 2022] GET /compute/v2.1/os-floating-ips/e564f148-2a23-47db-b3e3-35f77cba5b64 => generated 141 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:38.040900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:38.042663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:38.050184 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d0fcdf85-9f64-4f35-83b6-77ba3df55dc9 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] HTTP exception thrown: Floating IP pool not found. Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0fcdf85-9f64-4f35-83b6-77ba3df55dc9 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] Request method failure captured: Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 26 Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ3uLKC9gtKr4N-kqodsVtzGnaIScuaVI3zS2YOVTtga6mD9fihMeO_lJnCjmArq-ShgNya5IfaRPWWlvNqaG16kCBrlCTAYQokn7HwER66RvPGPxg-zE8yiC9xM_cybpdn7P1BJ9BwF5TufYEt_-CwceWMlhh_UieWL6xNf-AiDYgw Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f562fb58be6b440ab1488fd70f1d16aa Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1447580146 Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f562fb58be6b440ab1488fd70f1d16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f562fb58be6b440ab1488fd70f1d16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f562fb58be6b440ab1488fd70f1d16aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f562fb58be6b440ab1488fd70f1d16aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1447580146 Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f562fb58be6b440ab1488fd70f1d16aa Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1447580146 Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FloatingIPsNegativeTestJSON-1447580146-project Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6aff68ebc3fd4880bc35ac90265f8959 Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1447580146-project Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: {"pool": "non_exist_pool"} Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: exception: Floating IP pool not found. Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:38.055002 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:38.063058 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 24 03:41:38.063058 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.074065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0fcdf85-9f64-4f35-83b6-77ba3df55dc9 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] Returning 404 to user: Floating IP pool not found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:38.074065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0fcdf85-9f64-4f35-83b6-77ba3df55dc9 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.076593 Aug 24 03:41:38.074065 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1072/2096] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:41:37 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:41:38.080969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.080969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.081614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.086171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.087084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:38.089370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:38.089607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.089827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.108417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.109722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.112936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.113135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.114221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.114221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.458662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:38.473997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:38.476975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:38.478434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-067081fe-dce5-4ed5-bb6f-c5b8e6ad2237 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.401957 Aug 24 03:41:38.479068 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1073/2097] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:38 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:38.486072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-34fa7596-2bf3-4347-86ca-47cffea8c605 req-48c3617c-8307-42fd-8ca6-45796403241a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795254e1-5a01-4e35-b63b-e134c3ff4d25", "tag": "ee55608b-015b-4eba-beff-03ed67b44adc"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:38.499527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-34fa7596-2bf3-4347-86ca-47cffea8c605 req-48c3617c-8307-42fd-8ca6-45796403241a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.500402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-34fa7596-2bf3-4347-86ca-47cffea8c605 req-48c3617c-8307-42fd-8ca6-45796403241a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.501462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-34fa7596-2bf3-4347-86ca-47cffea8c605 req-48c3617c-8307-42fd-8ca6-45796403241a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.522295 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-34fa7596-2bf3-4347-86ca-47cffea8c605 req-48c3617c-8307-42fd-8ca6-45796403241a service nova] Creating event network-changed:ee55608b-015b-4eba-beff-03ed67b44adc for instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 on n-h2-846470-15 Aug 24 03:41:38.530624 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-34fa7596-2bf3-4347-86ca-47cffea8c605 req-48c3617c-8307-42fd-8ca6-45796403241a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049986 Aug 24 03:41:38.539995 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1074/2098] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:38.549606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:38.555683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1063448049"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:38.558397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:38.567658 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a69100f2-8f9e-4696-b370-e893d850b6e1 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.533756 Aug 24 03:41:38.568643 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1025/2099] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:38 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:38.591109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:38.592252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:38.600113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.601652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.602266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.603460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.604042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.604692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.607955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.608789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.609764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.611138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.612370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.612971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.829774 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.network.security_group_api [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Removing security group 51041189-f354-46fb-b345-9d20e17b8078 from port ee55608b-015b-4eba-beff-03ed67b44adc Aug 24 03:41:38.893929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:38.910628 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cff19d99-b9ce-4bfb-a2ef-64a185ddc721 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1479 microversion: 2.1 time: 0.339809 Aug 24 03:41:38.912821 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1026/2100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:38 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1479 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:38.916587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9e4d0fce-0c61-4ff2-b8f7-189838d1c4b8 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Calling method '.version_select at 0x7f1034416940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:39.535689 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-396a94d3-5a90-4e7c-b947-1d2d9959a602 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action" status: 202 len: 0 microversion: 2.1 time: 0.993819 Aug 24 03:41:39.542012 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1075/2101] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:38 2022] POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:39.542193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ccf1b20f-2495-463f-bfc8-f6bb6ea45355 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] Calling method '.version_select at 0x7f1034241a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:39.657277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-ccf1b20f-2495-463f-bfc8-f6bb6ea45355 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 97b61f3f-914f-49f6-8b76-c5863597fd9d could not be found", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 03:41:39.667073 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ccf1b20f-2495-463f-bfc8-f6bb6ea45355 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] HTTP exception thrown: Floating IP not found for ID 97b61f3f-914f-49f6-8b76-c5863597fd9d Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ccf1b20f-2495-463f-bfc8-f6bb6ea45355 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] Request method failure captured: Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-floating-ips/97b61f3f-914f-49f6-8b76-c5863597fd9d HTTP/1.1 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ3uLKC9gtKr4N-kqodsVtzGnaIScuaVI3zS2YOVTtga6mD9fihMeO_lJnCjmArq-ShgNya5IfaRPWWlvNqaG16kCBrlCTAYQokn7HwER66RvPGPxg-zE8yiC9xM_cybpdn7P1BJ9BwF5TufYEt_-CwceWMlhh_UieWL6xNf-AiDYgw Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f562fb58be6b440ab1488fd70f1d16aa Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1447580146 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f562fb58be6b440ab1488fd70f1d16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f562fb58be6b440ab1488fd70f1d16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f562fb58be6b440ab1488fd70f1d16aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f562fb58be6b440ab1488fd70f1d16aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1447580146 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f562fb58be6b440ab1488fd70f1d16aa Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1447580146 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-FloatingIPsNegativeTestJSON-1447580146-project Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6aff68ebc3fd4880bc35ac90265f8959 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1447580146-project Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: exception: Floating IP not found for ID 97b61f3f-914f-49f6-8b76-c5863597fd9d Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '97b61f3f-914f-49f6-8b76-c5863597fd9d'} Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 97b61f3f-914f-49f6-8b76-c5863597fd9d could not be found Aug 24 03:41:39.672444 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f38e578b-49ed-4500-8498-84c160aa8cc2'] Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 97b61f3f-914f-49f6-8b76-c5863597fd9d. Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 97b61f3f-914f-49f6-8b76-c5863597fd9d Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 97b61f3f-914f-49f6-8b76-c5863597fd9d Aug 24 03:41:39.680525 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:41:39.700935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ccf1b20f-2495-463f-bfc8-f6bb6ea45355 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] Returning 404 to user: Floating IP not found for ID 97b61f3f-914f-49f6-8b76-c5863597fd9d {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:39.700935 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ccf1b20f-2495-463f-bfc8-f6bb6ea45355 tempest-FloatingIPsNegativeTestJSON-1447580146 tempest-FloatingIPsNegativeTestJSON-1447580146-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/97b61f3f-914f-49f6-8b76-c5863597fd9d" status: 404 len: 111 microversion: 2.1 time: 0.148218 Aug 24 03:41:39.712431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1076/2102] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:41:39 2022] DELETE /compute/v2.1/os-floating-ips/97b61f3f-914f-49f6-8b76-c5863597fd9d => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:39.723658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6de050ec-7649-4597-8f7e-10ea55ade399 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '.version_select at 0x7f1022740ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:39.729255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de050ec-7649-4597-8f7e-10ea55ade399 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:39.732899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de050ec-7649-4597-8f7e-10ea55ade399 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:39.734535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6de050ec-7649-4597-8f7e-10ea55ade399 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:39.749733 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6de050ec-7649-4597-8f7e-10ea55ade399 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 792 microversion: 2.1 time: 0.033628 Aug 24 03:41:39.751184 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1077/2103] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:41:39 2022] GET /compute/v2.1/os-migrations => generated 792 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:39.764113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:39.765454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:39.775868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:39.776893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:39.777578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:39.778564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:39.779792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:39.780482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.261968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:40.272667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:40.274694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:40.276446 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0075ada8-6158-4775-9329-ca249810850d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.519867 Aug 24 03:41:40.277323 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1078/2104] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:39 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:40.282170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7518e81a-d506-401a-a527-fc611d2e90e2 req-eab3269b-1331-470b-931b-d7d7b7bce4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "tag": "20cb989b-08a0-48e3-8702-22885f1f572e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:40.296869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7518e81a-d506-401a-a527-fc611d2e90e2 req-eab3269b-1331-470b-931b-d7d7b7bce4f0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.297744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7518e81a-d506-401a-a527-fc611d2e90e2 req-eab3269b-1331-470b-931b-d7d7b7bce4f0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.298588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7518e81a-d506-401a-a527-fc611d2e90e2 req-eab3269b-1331-470b-931b-d7d7b7bce4f0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.313309 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7518e81a-d506-401a-a527-fc611d2e90e2 req-eab3269b-1331-470b-931b-d7d7b7bce4f0 service nova] Creating event network-changed:20cb989b-08a0-48e3-8702-22885f1f572e for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:41:40.321309 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7518e81a-d506-401a-a527-fc611d2e90e2 req-eab3269b-1331-470b-931b-d7d7b7bce4f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042109 Aug 24 03:41:40.322866 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1079/2105] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:40.330955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:40.332282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:40.340238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.341157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.341862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.342726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.343304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.343888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:41.093182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.106856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.110785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.112578 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f35fd2ef-f277-41ae-911c-85cd69bc2364 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.788105 Aug 24 03:41:41.113706 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1080/2106] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:40 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:41.122332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-961aa5fa-da12-4cc9-a97a-67a1ca8b180d tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Action: 'create', calling method: .version_select at 0x7f102279c700>, body: {"pool": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:42.216938 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9e4d0fce-0c61-4ff2-b8f7-189838d1c4b8 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/e564f148-2a23-47db-b3e3-35f77cba5b64" status: 202 len: 0 microversion: 2.1 time: 3.304014 Aug 24 03:41:42.217504 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1027/2107] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:41:38 2022] DELETE /compute/v2.1/os-floating-ips/e564f148-2a23-47db-b3e3-35f77cba5b64 => generated 0 bytes in 3305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:42.225707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:42.226797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:42.238454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:42.239475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:42.240256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:42.241549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:42.242372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:42.243167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:42.669334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:42.692765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c65d7aea-3254-4f8b-a290-039082d74b4d tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.474110 Aug 24 03:41:42.694191 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1028/2108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:42 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:42.703972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:42.705651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:42.721305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:42.722662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:42.723439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:42.729383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:42.733077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:42.737414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.026642 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0285a331-5255-434d-8541-1c3035845eee tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1632 microversion: 2.1 time: 0.331114 Aug 24 03:41:43.028744 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1029/2109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:42 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1632 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:43.035214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f8bb40e2-d854-4270-809e-e81800751f36 req-1a20f733-e9de-4c29-8ce5-a67c1fde42e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795254e1-5a01-4e35-b63b-e134c3ff4d25", "tag": "ee55608b-015b-4eba-beff-03ed67b44adc"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:43.093368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f8bb40e2-d854-4270-809e-e81800751f36 req-1a20f733-e9de-4c29-8ce5-a67c1fde42e1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.094440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f8bb40e2-d854-4270-809e-e81800751f36 req-1a20f733-e9de-4c29-8ce5-a67c1fde42e1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.095369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f8bb40e2-d854-4270-809e-e81800751f36 req-1a20f733-e9de-4c29-8ce5-a67c1fde42e1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.139772 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f8bb40e2-d854-4270-809e-e81800751f36 req-1a20f733-e9de-4c29-8ce5-a67c1fde42e1 service nova] Creating event network-changed:ee55608b-015b-4eba-beff-03ed67b44adc for instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 on n-h2-846470-15 Aug 24 03:41:43.157278 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f8bb40e2-d854-4270-809e-e81800751f36 req-1a20f733-e9de-4c29-8ce5-a67c1fde42e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125659 Aug 24 03:41:43.159091 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1030/2110] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:43.170848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.172836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:43.185245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.186540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.187615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.189631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.190402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.191027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.227161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:43.832279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.853711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.859022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.859022 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0677e1a8-7eb2-41bb-abed-a9723d362c04 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.696371 Aug 24 03:41:43.859022 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1031/2111] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:43 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:43.864376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c92303a0-b5b9-4cb1-b481-efd120bdb741 req-680f0f44-f22b-4775-b3c3-4462af2eff98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e6d382-2a98-466a-9f39-e360c84b5d1d", "name": "network-vif-plugged", "status": "completed", "tag": "39ab6c40-4d46-41c5-8630-ad298cf1e574"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:43.875913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c92303a0-b5b9-4cb1-b481-efd120bdb741 req-680f0f44-f22b-4775-b3c3-4462af2eff98 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.876713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c92303a0-b5b9-4cb1-b481-efd120bdb741 req-680f0f44-f22b-4775-b3c3-4462af2eff98 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.877558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c92303a0-b5b9-4cb1-b481-efd120bdb741 req-680f0f44-f22b-4775-b3c3-4462af2eff98 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.890955 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c92303a0-b5b9-4cb1-b481-efd120bdb741 req-680f0f44-f22b-4775-b3c3-4462af2eff98 service nova] Creating event network-vif-plugged:39ab6c40-4d46-41c5-8630-ad298cf1e574 for instance 73e6d382-2a98-466a-9f39-e360c84b5d1d on n-h2-846470-15 Aug 24 03:41:43.897323 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c92303a0-b5b9-4cb1-b481-efd120bdb741 req-680f0f44-f22b-4775-b3c3-4462af2eff98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037961 Aug 24 03:41:43.898169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1032/2112] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:43.905339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.906493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:43.913947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.914455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.914907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.915646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.916296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.916729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.234574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.247517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.249456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.252008 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e344d150-4c93-485c-a7be-cdf596d1f328 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.351209 Aug 24 03:41:44.252823 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1033/2113] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:43 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:44.257850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-326b842b-89bd-4efb-ae14-a11e4c6be598 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Calling method '.version_select at 0x7f10344474c0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:44.483189 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-961aa5fa-da12-4cc9-a97a-67a1ca8b180d tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.368120 Aug 24 03:41:44.490782 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1081/2114] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 24 03:41:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:44.498373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-35aa84d7-bf65-4c88-bc96-f5d1c58cc5b0 req-ee2bc509-0e61-4d8a-8313-da858ac4dcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "tag": "ada7addd-bf30-4193-8194-ddce03d8df90"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:44.510101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-35aa84d7-bf65-4c88-bc96-f5d1c58cc5b0 req-ee2bc509-0e61-4d8a-8313-da858ac4dcc9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.510582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-35aa84d7-bf65-4c88-bc96-f5d1c58cc5b0 req-ee2bc509-0e61-4d8a-8313-da858ac4dcc9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.511029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-35aa84d7-bf65-4c88-bc96-f5d1c58cc5b0 req-ee2bc509-0e61-4d8a-8313-da858ac4dcc9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.526359 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-35aa84d7-bf65-4c88-bc96-f5d1c58cc5b0 req-ee2bc509-0e61-4d8a-8313-da858ac4dcc9 service nova] Creating event network-changed:ada7addd-bf30-4193-8194-ddce03d8df90 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:41:44.535058 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-35aa84d7-bf65-4c88-bc96-f5d1c58cc5b0 req-ee2bc509-0e61-4d8a-8313-da858ac4dcc9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046342 Aug 24 03:41:44.536858 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1082/2115] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:44.545654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c26102bb-3458-47b8-b161-539348985a3d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Action: 'create', calling method: .version_select at 0x7f103423a4c0>, body: {"keypair": {"name": "tempest-keypair-858906865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOheCiC2ib3AtTTZV743i3EDVv7ytIhO9mFkVOPPmKtio12EmgMpADW2wxXTUFwRKiwIQ0jFri63/MCKelyqlkiPRFYiwP0XbnZAjoqomjdtp9S1w3ua/W5hqvuYFpUuA=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:44.574821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-c26102bb-3458-47b8-b161-539348985a3d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:44.583913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-c26102bb-3458-47b8-b161-539348985a3d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for user 73ddcba828514d1882d2cd02d357bef8 and project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:44.596366 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-326b842b-89bd-4efb-ae14-a11e4c6be598 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.341583 Aug 24 03:41:44.597486 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1034/2116] 10.222.0.58 () {58 vars in 1164 bytes} [Wed Aug 24 03:41:44 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:41:44.607343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:44.608088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:44.624972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c26102bb-3458-47b8-b161-539348985a3d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083803 Aug 24 03:41:44.626014 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1083/2117] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:41:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:44.630747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.632471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.633730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.638812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.639545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.641350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.645749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.59"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:44.653764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:44.662670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.663501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.664221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.665170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.665888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.667191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.701204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "refresh_cache-795254e1-5a01-4e35-b63b-e134c3ff4d25" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:41:44.702058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquired lock "refresh_cache-795254e1-5a01-4e35-b63b-e134c3ff4d25" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:41:44.996332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:45.005377 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-224ee570-8dca-45c0-9f0f-d0c9d45bc83c tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.406430 Aug 24 03:41:45.019463 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1035/2118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:44 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:45.024820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19b3980a-1466-47e0-93cc-6adbe3eed764 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Calling method '.version_select at 0x7f1034416b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:45.439630 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19b3980a-1466-47e0-93cc-6adbe3eed764 tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.418015 Aug 24 03:41:45.448342 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1036/2119] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:41:45 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:45.456232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:45.457220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:45.466949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:45.467728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:45.468747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:45.469917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:45.470874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:45.471472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:45.818365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:45.836075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:45.841021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:45.843248 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c68ad779-3586-40fe-bf20-407255abecfc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.392986 Aug 24 03:41:45.845264 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1037/2120] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:45 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:45.856729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:45.858519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:45.896862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:45.898085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:45.900211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:45.917103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:45.918100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:45.918802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.254864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.275096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.279566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.281786 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f35e320-6856-4631-b84d-c330bc697306 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.435039 Aug 24 03:41:46.284142 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1038/2121] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:45 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:46.299280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d7a5a541-69e1-47a4-bd9b-89e7ab5a49de tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Calling method '.version_select at 0x7f10343e0670>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:47.583283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:41:48.938118 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d7a5a541-69e1-47a4-bd9b-89e7ab5a49de tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/200cf193-7edb-4f59-987f-51a3868c2ed8" status: 202 len: 0 microversion: 2.1 time: 2.649991 Aug 24 03:41:48.945953 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1039/2122] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:41:46 2022] DELETE /compute/v2.1/os-floating-ips/200cf193-7edb-4f59-987f-51a3868c2ed8 => generated 0 bytes in 2659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:48.965519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-72a4722b-473d-4676-801b-5c10d29429e2 req-d111cdd2-4629-4b37-a361-d98f7b841c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e6d382-2a98-466a-9f39-e360c84b5d1d", "name": "network-vif-plugged", "status": "completed", "tag": "e013e20f-753b-4f98-afd6-362eaa5854bf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:48.982027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-72a4722b-473d-4676-801b-5c10d29429e2 req-d111cdd2-4629-4b37-a361-d98f7b841c45 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:48.983135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-72a4722b-473d-4676-801b-5c10d29429e2 req-d111cdd2-4629-4b37-a361-d98f7b841c45 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:48.983982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-72a4722b-473d-4676-801b-5c10d29429e2 req-d111cdd2-4629-4b37-a361-d98f7b841c45 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.004575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Updating instance_info_cache with network_info: [{"id": "ee55608b-015b-4eba-beff-03ed67b44adc", "address": "fa:16:3e:bc:c2:e1", "network": {"id": "46900878-c94a-4405-9873-2bf4b2cdc479", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-607641192-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fc7f546446954b6eb687ef4bdfe7af5d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee55608b-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:41:49.029014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Releasing lock "refresh_cache-795254e1-5a01-4e35-b63b-e134c3ff4d25" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:41:49.030372 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76c91a91-1259-45bf-903d-d843808728a2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action" status: 202 len: 0 microversion: 2.1 time: 4.400672 Aug 24 03:41:49.032723 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1084/2123] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:44 2022] POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action => generated 0 bytes in 4405 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 03:41:49.034830 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-72a4722b-473d-4676-801b-5c10d29429e2 req-d111cdd2-4629-4b37-a361-d98f7b841c45 service nova] Creating event network-vif-plugged:e013e20f-753b-4f98-afd6-362eaa5854bf for instance 73e6d382-2a98-466a-9f39-e360c84b5d1d on n-h2-846470-15 Aug 24 03:41:49.047175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:49.049806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:49.050254 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-72a4722b-473d-4676-801b-5c10d29429e2 req-d111cdd2-4629-4b37-a361-d98f7b841c45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097012 Aug 24 03:41:49.053252 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1040/2124] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:49.107385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:49.107648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:49.112686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.113314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.113770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.114542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.115010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.115448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.132091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.132387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.135688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.138420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.139122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.148403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.547721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.560318 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a34a6b1-ca2a-44f1-a884-946a54d1d140 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1333 microversion: 2.1 time: 0.525596 Aug 24 03:41:49.575295 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1085/2125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:49 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1333 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:49.580127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:49.581076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:49.594691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.595912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.597298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.601533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.602555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.603419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.729567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.742565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.744505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.747130 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8dace42f-ed5d-490a-9571-13d83875f00c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.687465 Aug 24 03:41:49.749120 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1041/2126] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:49 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:49.756775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e32549e5-7e79-4531-9a7c-fd5ade887b09 req-ce2422e0-2602-416c-8fe1-48ff59f62ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795254e1-5a01-4e35-b63b-e134c3ff4d25", "tag": "ee55608b-015b-4eba-beff-03ed67b44adc"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:49.774303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e32549e5-7e79-4531-9a7c-fd5ade887b09 req-ce2422e0-2602-416c-8fe1-48ff59f62ae5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.775503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e32549e5-7e79-4531-9a7c-fd5ade887b09 req-ce2422e0-2602-416c-8fe1-48ff59f62ae5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.777249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e32549e5-7e79-4531-9a7c-fd5ade887b09 req-ce2422e0-2602-416c-8fe1-48ff59f62ae5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.810407 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e32549e5-7e79-4531-9a7c-fd5ade887b09 req-ce2422e0-2602-416c-8fe1-48ff59f62ae5 service nova] Creating event network-changed:ee55608b-015b-4eba-beff-03ed67b44adc for instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 on n-h2-846470-15 Aug 24 03:41:49.824962 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e32549e5-7e79-4531-9a7c-fd5ade887b09 req-ce2422e0-2602-416c-8fe1-48ff59f62ae5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073616 Aug 24 03:41:49.825952 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1042/2127] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:49.832584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a7b01a3b-5c46-49ae-b7d4-a6daf5854c3e tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Calling method '.version_select at 0x7f102b1119d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:50.002763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:50.016019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:50.020479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:50.022676 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-69d88995-c0ef-4d88-b6f2-a49c80bab7ed tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.451017 Aug 24 03:41:50.024312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1086/2128] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:49 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:50.031573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.59"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:50.216549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:50.224086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:50.225892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:50.226561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:50.227543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:50.228230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:50.229124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:50.516274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "refresh_cache-795254e1-5a01-4e35-b63b-e134c3ff4d25" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:41:50.517105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquired lock "refresh_cache-795254e1-5a01-4e35-b63b-e134c3ff4d25" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:41:51.047266 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a7b01a3b-5c46-49ae-b7d4-a6daf5854c3e tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/251f6cbe-4aab-4504-8690-9c7282ec76e0" status: 202 len: 0 microversion: 2.1 time: 1.219653 Aug 24 03:41:51.054417 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1043/2129] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:41:49 2022] DELETE /compute/v2.1/os-floating-ips/251f6cbe-4aab-4504-8690-9c7282ec76e0 => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:51.064020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1752322125", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7f7d79fe-5369-4b60-bc8d-97cdf54981c1"}], "security_groups": [{"name": "tempest-securitygroup--1861464609"}], "key_name": "tempest-keypair-858906865", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:51.311279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] validate_networks() for [('7f7d79fe-5369-4b60-bc8d-97cdf54981c1', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:41:51.758125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Building network info cache for instance {{(pid=122536) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 03:41:51.769295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:52.302032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:41:52.302840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:41:52.303041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:41:52.303460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:41:52.303919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:41:52.314605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.315431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.316116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.316889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.317340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.317935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.341135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:52.350008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for user 73ddcba828514d1882d2cd02d357bef8 and project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:52.370370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:41:52.373024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:41:52.436883 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1e680ac0-5abb-46d9-85a9-621307e879be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.380481 Aug 24 03:41:52.449712 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1044/2130] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:41:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:41:52.455150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:52.456050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:52.463802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.464553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.465149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.466020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.466634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.467215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.529957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Updating instance_info_cache with network_info: [{"id": "ee55608b-015b-4eba-beff-03ed67b44adc", "address": "fa:16:3e:bc:c2:e1", "network": {"id": "46900878-c94a-4405-9873-2bf4b2cdc479", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-607641192-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fc7f546446954b6eb687ef4bdfe7af5d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee55608b-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122536) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:41:52.538773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Releasing lock "refresh_cache-795254e1-5a01-4e35-b63b-e134c3ff4d25" {{(pid=122536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:41:52.539936 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c3d1227-b350-425d-a24c-bf7da28fe471 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action" status: 202 len: 0 microversion: 2.1 time: 2.514182 Aug 24 03:41:52.543802 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1087/2131] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:50 2022] POST /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25/action => generated 0 bytes in 2516 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 03:41:52.546415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:52.547273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:52.553947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.554687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.555424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.556384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.557002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.557593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.691472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.710242 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37dd2ff7-9a6e-4c8e-8921-922d29ffa86b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1668 microversion: 2.1 time: 0.259236 Aug 24 03:41:52.711234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1045/2132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:52 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1668 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:52.740330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:52.742189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:52.758331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.759007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.759998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.761018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.761756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.762385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.932122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.954193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.956993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.958360 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-83497dea-b999-4370-968e-02a4e61a9550 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.416374 Aug 24 03:41:52.959292 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1088/2133] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:52 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:52.976607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29092a54-15a3-4823-8ea9-390230af36be tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] Calling method '.version_select at 0x7f103423a670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:53.044258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.069426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.074672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.076319 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-80e1ac55-2962-4511-b5c8-df88bcd12b6a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.363881 Aug 24 03:41:53.078029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1046/2134] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:52 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:53.359599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-3970581", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:53.432192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:41:53.803654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:41:53.804091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:41:53.804590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:41:53.804996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:41:53.805371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:41:53.820568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.821961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.822486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.823257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.823773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.824203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.845178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Getting quotas for project 2b5d14e6320f4a2587cb3ee64e7e98c9. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:53.853225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Getting quotas for user ae771f274012411391a0563ca2eb8cbc and project 2b5d14e6320f4a2587cb3ee64e7e98c9. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:53.869456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:41:53.871770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:41:53.932217 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4c974002-f10f-4c25-889f-4188654756d3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850497 Aug 24 03:41:53.932873 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1047/2135] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:41:53.940066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1d576ce6-8316-448c-879c-6efe40a867ae req-b082d8bb-37f2-4434-95ad-8443d310fb62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795254e1-5a01-4e35-b63b-e134c3ff4d25", "tag": "ee55608b-015b-4eba-beff-03ed67b44adc"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:53.955265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d576ce6-8316-448c-879c-6efe40a867ae req-b082d8bb-37f2-4434-95ad-8443d310fb62 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.956474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d576ce6-8316-448c-879c-6efe40a867ae req-b082d8bb-37f2-4434-95ad-8443d310fb62 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.957106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d576ce6-8316-448c-879c-6efe40a867ae req-b082d8bb-37f2-4434-95ad-8443d310fb62 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.973168 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1d576ce6-8316-448c-879c-6efe40a867ae req-b082d8bb-37f2-4434-95ad-8443d310fb62 service nova] Creating event network-changed:ee55608b-015b-4eba-beff-03ed67b44adc for instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 on n-h2-846470-15 Aug 24 03:41:53.983369 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1d576ce6-8316-448c-879c-6efe40a867ae req-b082d8bb-37f2-4434-95ad-8443d310fb62 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048480 Aug 24 03:41:53.984799 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1048/2136] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:53.991245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:53.992693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:54.002567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.003333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.004153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.005120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.005757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.006378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.214838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:54.233336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b1d0d31-bc35-4a92-b4fb-fedfa6dfd9e2 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1294 microversion: 2.1 time: 0.246532 Aug 24 03:41:54.235142 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1049/2137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:53 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1294 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:54.255648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2d85eae2-fd63-428d-92ee-cd2ced61ecba tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '.version_select at 0x7f102afd5550>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:54.593282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:55.100989 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29092a54-15a3-4823-8ea9-390230af36be tempest-FloatingIPDetailsTestJSON-744079543 tempest-FloatingIPDetailsTestJSON-744079543-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/3f5c50c9-2f7b-442c-9b82-bdec4fa03c5d" status: 202 len: 0 microversion: 2.1 time: 2.139567 Aug 24 03:41:55.119853 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1089/2138] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:41:52 2022] DELETE /compute/v2.1/os-floating-ips/3f5c50c9-2f7b-442c-9b82-bdec4fa03c5d => generated 0 bytes in 2160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:55.131636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:55.132771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:55.136561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:55.148936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.149507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.150126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.151895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.152799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.153144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.190473 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-83639edf-36fd-43f4-8ec4-f8f4d255c794 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d/ips" status: 200 len: 179 microversion: 2.1 time: 0.067538 Aug 24 03:41:55.191481 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1090/2139] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:41:55 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d/ips => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:55.196693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:55.198192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:55.206873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.207986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.209193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.210219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.212301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.213087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.351220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.369068 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b86bd971-dfd3-4369-a0f3-1038a2f00ca1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1266 microversion: 2.1 time: 0.175809 Aug 24 03:41:55.369772 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1091/2140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:55 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:55.384756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:55.385385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:55.395836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.396650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.397106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.397822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.398280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.398705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.817424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.828672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.830885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.832901 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6ff0903-2717-48b1-8e43-6b0e92224fc5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.459217 Aug 24 03:41:55.833642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1092/2141] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:55 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:55.839065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:55.840154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:55.847491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.848462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.849198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.850191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.850888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.851541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.159925 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2d85eae2-fd63-428d-92ee-cd2ced61ecba tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/7f61af09-1f3e-4c0e-acb5-10699cd345e2" status: 202 len: 0 microversion: 2.1 time: 1.922883 Aug 24 03:41:56.161362 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1050/2142] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:41:54 2022] DELETE /compute/v2.1/os-floating-ips/7f61af09-1f3e-4c0e-acb5-10699cd345e2 => generated 0 bytes in 1926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:56.169488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:56.171322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:56.180937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.181445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.181914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.182622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.183083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.183513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.218498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:41:56.282887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:56.310729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:56.314861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:56.319791 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8dd3b074-c1e1-4943-926f-083c2f44a9a7 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.484449 Aug 24 03:41:56.321219 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1093/2143] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:55 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:56.325316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ec528ac3-00fb-4dbd-9362-bde2809fcde3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "DELETE /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 204 len: 0 microversion: 2.1 time: 0.162136 Aug 24 03:41:56.326013 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1051/2144] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:41:56 2022] DELETE /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:41:56.339531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8768f2b0-8e9e-4bf9-be7c-13e5a4f0eec6 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '.version_select at 0x7f102afd5b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:56.345727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:56.346547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:56.354757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.355514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.356161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.356927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.357648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.358383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.688187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:56.708659 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0244c83a-df51-4117-a0d9-048ced04554a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.384949 Aug 24 03:41:56.710942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1094/2145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:56 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:56.723905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:56.725921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:56.752755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.753755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.754848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.757158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.758671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.759769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.035643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.048382 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-644838d2-80d8-4dde-9507-4cec7df5b1c4 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1674 microversion: 2.1 time: 0.333084 Aug 24 03:41:57.066150 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1095/2146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:56 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1674 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:57.097457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:57.099242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:57.116019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.116947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.117780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.119077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.119950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.120718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.262983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.286392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb4cff94-ffde-4d67-b023-55f73553a848 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1272 microversion: 2.1 time: 0.208964 Aug 24 03:41:57.300489 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1096/2147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:57 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:57.306910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:57.307798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:57.316197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.317535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.318537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.320286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.321506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.322161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.467445 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8768f2b0-8e9e-4bf9-be7c-13e5a4f0eec6 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/51041189-f354-46fb-b345-9d20e17b8078" status: 202 len: 0 microversion: 2.1 time: 1.133573 Aug 24 03:41:57.469089 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1052/2148] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:41:56 2022] DELETE /compute/v2.1/os-security-groups/51041189-f354-46fb-b345-9d20e17b8078 => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:57.481759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:57.483372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:57.505964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.506737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.507402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.508429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.509744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.510740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.802112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.842882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.847619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.853789 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-27b81fda-e4aa-4f8b-866e-6f93c8827798 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.548259 Aug 24 03:41:57.855207 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1097/2149] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:57 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:57.864845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:57.866200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:57.880802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.882104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.883124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.884904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.886001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.887397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.924831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:41:58.059632 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c480c024-27db-43a9-8398-e65e493f6f57 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "DELETE /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 204 len: 0 microversion: 2.1 time: 0.202276 Aug 24 03:41:58.061029 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1098/2150] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:41:57 2022] DELETE /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:41:58.073644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:58.080060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:58.097680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.098565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.099407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.100518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.101242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.101917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.369209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.391153 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4e4cd1a-871a-4570-a153-ed1b421ed712 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.328207 Aug 24 03:41:58.393392 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1099/2151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:58 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:58.407615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:58.409199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:58.433599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.435117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.436188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.438085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.439565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.440882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.626068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.665334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.673991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.678230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b2528dc3-1b7a-45b6-a453-fe065bf9a5da tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 1.204374 Aug 24 03:41:58.683866 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1053/2152] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:57 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:58.699735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:58.702210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:58.723136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.724865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.726574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.730055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.731646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.734168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.796299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.811565 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bb8ea7ad-8bb9-4f50-aa56-09623bc1b918 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1509 microversion: 2.1 time: 0.413524 Aug 24 03:41:58.812264 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1100/2153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:58 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:58.833527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:58.834846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:58.842268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.843200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.843871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.845571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.846370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.847039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.986530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.001782 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20fe5dd4-69a3-4fce-87c8-492f7545e239 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1272 microversion: 2.1 time: 0.175947 Aug 24 03:41:59.003321 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1101/2154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:58 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:59.009951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:59.011106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:59.017769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.018415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.019126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.020186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.020940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.021733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.453421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.479071 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d063da59-e669-4e82-91f7-19eb53b5fed3 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1674 microversion: 2.1 time: 0.789539 Aug 24 03:41:59.480084 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1054/2155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:58 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1674 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:59.485298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.491264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:59.491905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:59.511531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.512119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.512567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.513307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.513778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.514199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.517414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.532794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.537202 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd25686d-a946-4b7e-8241-091b87ed1496 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.531072 Aug 24 03:41:59.538524 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1102/2156] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:59 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:59.738720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:59.740052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:59.748090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.750294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.751400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.752578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.753330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.754147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.778384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:00.032136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.049405 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-80be294f-3e74-4c76-acbb-b8696ea332fc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.564748 Aug 24 03:42:00.050841 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1055/2157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:59 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:00.056054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:00.059596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:00.082369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.083520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.087411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.091501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.093175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.093688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.117839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:00.674235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.694750 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef5c0ff2-fea2-4754-88a0-c577d7e3426c tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1509 microversion: 2.1 time: 0.642168 Aug 24 03:42:00.708212 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1056/2158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:00 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1509 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:00.732004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6ea23e9a-efeb-4517-ac68-b07b0775ea75 req-cd840c22-fbf2-4814-8bd2-7f6fedaed9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79baa30-fa4f-47de-8d26-6d070734bccd", "tag": "8eb13453-5453-4ce2-a0f9-64aba47b275b"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:00.764013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.770119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ea23e9a-efeb-4517-ac68-b07b0775ea75 req-cd840c22-fbf2-4814-8bd2-7f6fedaed9a9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.781304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ea23e9a-efeb-4517-ac68-b07b0775ea75 req-cd840c22-fbf2-4814-8bd2-7f6fedaed9a9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.782386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ea23e9a-efeb-4517-ac68-b07b0775ea75 req-cd840c22-fbf2-4814-8bd2-7f6fedaed9a9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.800684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.810416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.815879 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6967da59-362c-4b17-b59f-a1038b47aad1 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 1.084040 Aug 24 03:42:00.819099 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1103/2159] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:59 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:00.833753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:00.835980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:00.846766 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6ea23e9a-efeb-4517-ac68-b07b0775ea75 req-cd840c22-fbf2-4814-8bd2-7f6fedaed9a9 service nova] Creating event network-changed:8eb13453-5453-4ce2-a0f9-64aba47b275b for instance a79baa30-fa4f-47de-8d26-6d070734bccd on n-h1-846470-15 Aug 24 03:42:00.862509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.863390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.864217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.865400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.871193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.871193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.872056 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6ea23e9a-efeb-4517-ac68-b07b0775ea75 req-cd840c22-fbf2-4814-8bd2-7f6fedaed9a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155870 Aug 24 03:42:00.877059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1057/2160] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:00.900533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:00.908708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:00.912693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:00.946315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.954064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.954987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.956216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.957031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.967562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.353893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:01.379235 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce4a92a4-1f47-4d20-ab5d-517307f70dbf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.556658 Aug 24 03:42:01.382135 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1104/2161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:00 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:01.398505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:01.402489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:01.435384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.441122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.442603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.444794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.446028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.447080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.014909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.038258 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-014ac4c4-bf03-4fa7-901c-44e109e3be81 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1674 microversion: 2.1 time: 1.156984 Aug 24 03:42:02.041003 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1058/2162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:00 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1674 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:02.051149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.052109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.061948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.064212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.065313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.066868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.068270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.069106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.625921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.646880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.659629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.662052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.662221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0a71b0b-3b5d-4168-9bde-6cc5198d39f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.618921 Aug 24 03:42:02.663588 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6d9e1bcd-550f-46c4-9b77-0f203b80fb47 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 1.279568 Aug 24 03:42:02.665624 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1105/2164] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:01 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:02.671155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.672162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.675780 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1059/2164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:02 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:02.683070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.695491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.696726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.698464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.700070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.707621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.712200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.718298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.719867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.723847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.724625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.727178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.729409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.730724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.103283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.120807 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d3c1b4f4-aede-40c9-932c-a80d26416957 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1509 microversion: 2.1 time: 0.453359 Aug 24 03:42:03.136906 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1106/2165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:02 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:03.143627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:03.152491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:03.191080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.192912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.193490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.195976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.196472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.199919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.275371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.315361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.324523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.326703 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1e81673a-7618-4db6-859a-afcbee4b8d56 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.649215 Aug 24 03:42:03.348112 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1060/2166] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:02 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:03.383007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:03.394369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:03.411576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.413679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.421617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.423543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.424729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.425934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.678449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.698510 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0cc4a88f-6c1a-429c-b379-20ae282cb022 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.559395 Aug 24 03:42:03.715714 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1107/2167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:03 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:03.731537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-4d47cb27-101c-4dd4-a58b-30fa8fb56ae0 req-aede1c13-07af-452d-8b04-ea0a89392706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795254e1-5a01-4e35-b63b-e134c3ff4d25", "name": "network-vif-deleted", "tag": "ee55608b-015b-4eba-beff-03ed67b44adc"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:03.756820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4d47cb27-101c-4dd4-a58b-30fa8fb56ae0 req-aede1c13-07af-452d-8b04-ea0a89392706 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.757637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4d47cb27-101c-4dd4-a58b-30fa8fb56ae0 req-aede1c13-07af-452d-8b04-ea0a89392706 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.758398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4d47cb27-101c-4dd4-a58b-30fa8fb56ae0 req-aede1c13-07af-452d-8b04-ea0a89392706 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.773779 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-4d47cb27-101c-4dd4-a58b-30fa8fb56ae0 req-aede1c13-07af-452d-8b04-ea0a89392706 service nova] Creating event network-vif-deleted:ee55608b-015b-4eba-beff-03ed67b44adc for instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 on n-h2-846470-15 Aug 24 03:42:03.785961 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-4d47cb27-101c-4dd4-a58b-30fa8fb56ae0 req-aede1c13-07af-452d-8b04-ea0a89392706 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069163 Aug 24 03:42:03.787829 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1108/2168] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:03.796363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:03.798051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:03.806571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.807113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.807557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.808673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.809510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.810098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.833317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:03.861937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=12 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:04.049748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.063922 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e5eed78-b3db-401c-a0f2-f485c0e9a23f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.273845 Aug 24 03:42:04.065842 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1109/2169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:03 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:04.089867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:04.090383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:04.097016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.097516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.098161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.099350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.099947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.100421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.184203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.195364 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eff492f3-f24e-42d9-9496-c069eaf4cac6 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1653 microversion: 2.1 time: 0.841342 Aug 24 03:42:04.196025 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1061/2170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:03 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1653 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:04.203510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b49d70f8-5b9a-43c7-a909-59cb9a7ee66d req-a2e495e0-e61a-4dc3-b79b-c39046a2fb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e6d382-2a98-466a-9f39-e360c84b5d1d", "name": "network-vif-deleted", "tag": "e013e20f-753b-4f98-afd6-362eaa5854bf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:04.215019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b49d70f8-5b9a-43c7-a909-59cb9a7ee66d req-a2e495e0-e61a-4dc3-b79b-c39046a2fb04 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.215523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b49d70f8-5b9a-43c7-a909-59cb9a7ee66d req-a2e495e0-e61a-4dc3-b79b-c39046a2fb04 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.216080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b49d70f8-5b9a-43c7-a909-59cb9a7ee66d req-a2e495e0-e61a-4dc3-b79b-c39046a2fb04 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.229662 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b49d70f8-5b9a-43c7-a909-59cb9a7ee66d req-a2e495e0-e61a-4dc3-b79b-c39046a2fb04 service nova] Creating event network-vif-deleted:e013e20f-753b-4f98-afd6-362eaa5854bf for instance 73e6d382-2a98-466a-9f39-e360c84b5d1d on n-h2-846470-15 Aug 24 03:42:04.235509 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b49d70f8-5b9a-43c7-a909-59cb9a7ee66d req-a2e495e0-e61a-4dc3-b79b-c39046a2fb04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037173 Aug 24 03:42:04.236719 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1062/2171] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:04.242591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:04.243320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:04.252341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.252851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.253408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.254232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.254732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.255173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.298477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.299935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.300551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.302573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lazy-loading 'fault' on Instance uuid 795254e1-5a01-4e35-b63b-e134c3ff4d25 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:42:04.403802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.420329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.422596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.424919 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-69b3f5a5-6b45-47aa-882e-c10cc91bdde9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.357359 Aug 24 03:42:04.425765 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1110/2172] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:04 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:04.433871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:04.434861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:04.444174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.444174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.444174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.444802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.447079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.447079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.736192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.748755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.750301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.752105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ed15dea-7474-428b-b852-a67916295e26 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.324809 Aug 24 03:42:04.752697 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1111/2173] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:04 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:04.757541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:04.758458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:04.766743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.767913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.768381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.769485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.770941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.771421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.794761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995c0e38b0a84f548268024dfc2fd0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f546446954b6eb687ef4bdfe7af5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.811782 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04fe8db0-adeb-478a-9761-901cc0c616c5 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 200 len: 1312 microversion: 2.1 time: 0.572330 Aug 24 03:42:04.812506 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1063/2174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:04 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 1312 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:04.976755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.991852 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-481fabad-2732-412a-a876-bc012c977ca8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.237911 Aug 24 03:42:04.994447 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1112/2175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:04 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:05.091645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:05.098033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:05.141531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.143238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.145680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.147124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.154956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.155926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.222957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:05.236650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:05.274945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.277275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.280171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.283700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.285897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.286679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.541948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.559829 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7fc557c7-a12f-4b8a-a4ea-80c22b3dc6fd tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1495 microversion: 2.1 time: 0.343811 Aug 24 03:42:05.560949 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1113/2176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:05 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1495 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:05.567133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:05.568069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:05.577922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.578795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.579423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.580743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.581548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.582365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.836898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.866107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.869663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.873367 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-afceda13-4532-4d8c-9d25-8ecce95813b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.309454 Aug 24 03:42:05.876292 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1114/2177] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:05 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:05.888532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:05.890169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:05.907352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.908157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.908927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.909837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.910467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.911051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.028006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.044658 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1fbc6d27-7a0e-4f92-81cb-3a865eb3311b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.961404 Aug 24 03:42:06.050479 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1064/2178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:05 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:06.067339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:06.069092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] [instance: 795254e1-5a01-4e35-b63b-e134c3ff4d25] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:06.093745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.097089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.098523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.101541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.102748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.103785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.147743 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] HTTP exception thrown: Instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 could not be found. Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Request method failure captured: Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 HTTP/1.1 Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ2sGvZZwVS0FI5U90KNLTBaFEeOHsLXlVyisCGKmS7FZUlQ6OgNXd5vIkMDXXvB0yqimcYe_X6Iq-_e-wlU6fXjCL0iP3xEto943JZkcDf3h4PEqjnk1l-UIl9qXh_kci6TZGpVd3XUvbUbtiDogUjm51gTiB2ydFLzm9N2WO8UTY8 Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: fc7f546446954b6eb687ef4bdfe7af5d Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2032866412 Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc7f546446954b6eb687ef4bdfe7af5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc7f546446954b6eb687ef4bdfe7af5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc7f546446954b6eb687ef4bdfe7af5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc7f546446954b6eb687ef4bdfe7af5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2032866412 Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: fc7f546446954b6eb687ef4bdfe7af5d Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2032866412 Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerRescueTestJSONUnderV235-2032866412-project Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 995c0e38b0a84f548268024dfc2fd0bc Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2032866412-project Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 could not be found. Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '795254e1-5a01-4e35-b63b-e134c3ff4d25'} Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 could not be found. Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 could not be found. Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:06.153507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 could not be found. Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:06.161645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] Returning 404 to user: Instance 795254e1-5a01-4e35-b63b-e134c3ff4d25 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:06.164753 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-25607249-c965-46b6-8284-65e11ad591f2 tempest-ServerRescueTestJSONUnderV235-2032866412 tempest-ServerRescueTestJSONUnderV235-2032866412-project] 10.222.0.58 "GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25" status: 404 len: 111 microversion: 2.1 time: 0.109719 Aug 24 03:42:06.171002 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1065/2179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:06 2022] GET /compute/v2.1/servers/795254e1-5a01-4e35-b63b-e134c3ff4d25 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:06.211272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:06.216503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:06.241674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.242573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.243853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.247441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.247968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.248532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.298852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.338571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.340381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.345708 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-85981eb9-32e6-4cee-b2d6-274398f84b4a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.467205 Aug 24 03:42:06.347866 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1115/2180] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:05 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:06.378793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-49783684-a086-43f1-8b3d-a3feaeba71c4 req-13cbe7b9-ea42-45d1-9fb4-fd3830084cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b81154-9101-4ed9-96ce-4134bbf5484b", "tag": "ba6c3530-c382-4b6e-89e9-580698731037"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:06.410234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49783684-a086-43f1-8b3d-a3feaeba71c4 req-13cbe7b9-ea42-45d1-9fb4-fd3830084cd0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.410747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49783684-a086-43f1-8b3d-a3feaeba71c4 req-13cbe7b9-ea42-45d1-9fb4-fd3830084cd0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.411308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49783684-a086-43f1-8b3d-a3feaeba71c4 req-13cbe7b9-ea42-45d1-9fb4-fd3830084cd0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.447935 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-49783684-a086-43f1-8b3d-a3feaeba71c4 req-13cbe7b9-ea42-45d1-9fb4-fd3830084cd0 service nova] Creating event network-changed:ba6c3530-c382-4b6e-89e9-580698731037 for instance 93b81154-9101-4ed9-96ce-4134bbf5484b on n-h1-846470-15 Aug 24 03:42:06.458297 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-49783684-a086-43f1-8b3d-a3feaeba71c4 req-13cbe7b9-ea42-45d1-9fb4-fd3830084cd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084363 Aug 24 03:42:06.461788 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1116/2181] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:06.617189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:06.623253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:06.682572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.686183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.688777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.692667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.693778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.695653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.976934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3951916c5a4aedb1ba04a7cf01ffb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f82857fdf14747a44bc05640804363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.990778 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d905a6ff-bb63-4785-91cf-ccfeab57d4c0 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 200 len: 1297 microversion: 2.1 time: 0.392933 Aug 24 03:42:06.993146 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1117/2182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:06 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 1297 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:07.005995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:07.006910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:07.023718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.029165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.030130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.031444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.032779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.032779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.162743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.176110 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab42b705-a61e-4b71-be8b-4e52496c85ba tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 1.005646 Aug 24 03:42:07.178546 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1066/2183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:06 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:07.184362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:07.185655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:07.214829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.218097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.220577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.222343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.224393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.229150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.471879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.489644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.494499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.496153 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1ba81a6e-d8dd-4672-b5bc-f2955b4bae9b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.501669 Aug 24 03:42:07.497880 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1118/2184] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:06 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:07.511452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:07.514306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:07.532567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.535805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.537735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.541961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.542458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.543072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.668465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.679387 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-30afcda2-1a81-4354-bf4c-7a63a995362c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.499389 Aug 24 03:42:07.694778 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1067/2185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:07 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:07.937342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.947783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.949355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.950572 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b5c528db-d2c0-49a4-8279-9ff013de27cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.451339 Aug 24 03:42:07.951175 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1119/2186] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:07 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:08.028878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:08.029523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:08.036609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.037386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.037975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.038862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.039506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.040833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.065784 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] HTTP exception thrown: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Request method failure captured: Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d HTTP/1.1 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1lflhQ213UQ63Gd_erRf2VrUuZDmcnOcKg_dLkAFXkub8hIUt-6sCW7ps3uIY25zX36cCBt6-PIF6WVky-ZOe0iIxg7jtW38oVdyNZ9sD1waWZBtHggBZTjoXiErU64F_zVDV9CwDZzfSZBEBMEuigjjYAYZElWugsmhXOG-5i-EI Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f82857fdf14747a44bc05640804363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f82857fdf14747a44bc05640804363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: fb3951916c5a4aedb1ba04a7cf01ffb3 Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '73e6d382-2a98-466a-9f39-e360c84b5d1d'} Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:08.068290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:08.073665 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:08.073665 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:08.073665 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:08.073665 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:08.073665 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:08.073665 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:08.073665 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:08.078210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Returning 404 to user: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:08.082169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f1d62c1-4d5c-4d6e-a726-951bf023c29b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 404 len: 111 microversion: 2.1 time: 0.055730 Aug 24 03:42:08.083552 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1068/2187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:08 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:08.203286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:08.205162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:08.212291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.213196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.213855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.215078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.215832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.216496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.525354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:08.526297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:08.539419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.540130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.541079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.542279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.543252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.543948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.626023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:08.634760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d52ad65-7ae3-4fbc-bd76-ad790ca2d3cf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.435433 Aug 24 03:42:08.635736 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1120/2188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:08 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:08.641580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1d5b802a-d70f-4f94-974c-3e8a0c11b256 req-a078c5ab-54d7-49da-b1b0-3b8172dd8830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e6d382-2a98-466a-9f39-e360c84b5d1d", "name": "network-vif-deleted", "tag": "39ab6c40-4d46-41c5-8630-ad298cf1e574"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:08.654512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d5b802a-d70f-4f94-974c-3e8a0c11b256 req-a078c5ab-54d7-49da-b1b0-3b8172dd8830 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.655083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d5b802a-d70f-4f94-974c-3e8a0c11b256 req-a078c5ab-54d7-49da-b1b0-3b8172dd8830 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.655580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d5b802a-d70f-4f94-974c-3e8a0c11b256 req-a078c5ab-54d7-49da-b1b0-3b8172dd8830 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.668242 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1d5b802a-d70f-4f94-974c-3e8a0c11b256 req-a078c5ab-54d7-49da-b1b0-3b8172dd8830 service nova] Creating event network-vif-deleted:39ab6c40-4d46-41c5-8630-ad298cf1e574 for instance 73e6d382-2a98-466a-9f39-e360c84b5d1d on n-h2-846470-15 Aug 24 03:42:08.674425 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1d5b802a-d70f-4f94-974c-3e8a0c11b256 req-a078c5ab-54d7-49da-b1b0-3b8172dd8830 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037006 Aug 24 03:42:08.675418 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1121/2189] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:08.710978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:08.712620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:08.724189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.725085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.726030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.727400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.728459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.729117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.736172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:09.021024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.043363 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-214c2a13-c9c7-4102-a302-b53fd285367f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.335293 Aug 24 03:42:09.047872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.059790 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1122/2190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:08 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:09.067270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.068901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.070136 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-377714fe-a642-493b-8d3b-840a652af68b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.549862 Aug 24 03:42:09.070706 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1069/2191] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:08 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:09.087842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:09.088687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:09.095859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:09.096363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:09.097010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:09.097904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:09.098521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:09.099103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:09.613338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.634746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.638509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.645177 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c3df9f0-52d8-4b84-bac9-decc521ab6ff tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.583770 Aug 24 03:42:09.649476 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1123/2192] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:09 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:09.692215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:09.696793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:09.719612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:09.721300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:09.722828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:09.724079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:09.727131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:09.727609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.070108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:10.070637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:10.087969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.088459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.094264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.096119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.096649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.097065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.315303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.333198 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aa39d191-8f40-4279-9d57-e767a0efe73e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.656112 Aug 24 03:42:10.348129 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1070/2193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:09 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:10.354628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:10.358710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:10.373769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.374576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.375187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.378342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.379131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.380295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.593626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.608997 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15cc5352-db0a-4f4f-8ed6-9a3073404da3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.543378 Aug 24 03:42:10.616000 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1124/2194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:10 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:10.622603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-3110852f-2351-400a-955d-243bb74a5092 req-73dd8854-4637-49b8-822d-2c74e74cd9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79baa30-fa4f-47de-8d26-6d070734bccd", "name": "network-vif-plugged", "status": "completed", "tag": "8eb13453-5453-4ce2-a0f9-64aba47b275b"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:10.651240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3110852f-2351-400a-955d-243bb74a5092 req-73dd8854-4637-49b8-822d-2c74e74cd9e9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.652246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3110852f-2351-400a-955d-243bb74a5092 req-73dd8854-4637-49b8-822d-2c74e74cd9e9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.655495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3110852f-2351-400a-955d-243bb74a5092 req-73dd8854-4637-49b8-822d-2c74e74cd9e9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.687097 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-3110852f-2351-400a-955d-243bb74a5092 req-73dd8854-4637-49b8-822d-2c74e74cd9e9 service nova] Creating event network-vif-plugged:8eb13453-5453-4ce2-a0f9-64aba47b275b for instance a79baa30-fa4f-47de-8d26-6d070734bccd on n-h1-846470-15 Aug 24 03:42:10.697404 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-3110852f-2351-400a-955d-243bb74a5092 req-73dd8854-4637-49b8-822d-2c74e74cd9e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079916 Aug 24 03:42:10.701547 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1125/2195] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:10.712949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:10.721667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:10.743049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.743969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.744632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.745775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.748582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.749452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.390566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.419551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.424911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.428221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-558515f3-46d4-490a-8850-ded321317d43 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 1.078718 Aug 24 03:42:11.430045 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1071/2196] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:10 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:11.455065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:11.456057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:11.477896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.478106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.478560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.479407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.479965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.480412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.715110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.737689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.741026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.743872 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb243ac4-2b3e-41c3-b070-6ae8ed74a4bc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 1.039798 Aug 24 03:42:11.751246 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1126/2197] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:10 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:11.763543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:11.767697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:11.785373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.786446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.791203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.797924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.798582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.799122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.865407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.881079 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b65f0add-8e30-4754-9670-d8f35490ba57 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.447171 Aug 24 03:42:11.883042 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1072/2198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:11 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:12.254791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:12.273557 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f2a9480-4688-4ccd-8e82-8ca380ce3f52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.517798 Aug 24 03:42:12.274128 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1127/2199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:11 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:12.463852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:12.468947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:12.484163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:12.487875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:12.490068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:12.496733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:12.497667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:12.498424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:12.775749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:12.776720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:12.784852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:12.785863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:12.787209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:12.788424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:12.789592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:12.790353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.194482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.214171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.219098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.229184 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ab8b75a-0fd8-4c27-b30e-df04f45d3e57 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.774023 Aug 24 03:42:13.229828 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1073/2200] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:12 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:13.248555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-885e6385-1fc2-4a56-8be2-c4db32e8d301 req-6882a867-acec-4d44-bcdb-50a599f85ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-plugged", "status": "completed", "tag": "8c9f743c-5577-43e9-ac31-13bc671b37b0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:13.272785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-885e6385-1fc2-4a56-8be2-c4db32e8d301 req-6882a867-acec-4d44-bcdb-50a599f85ed4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.273458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-885e6385-1fc2-4a56-8be2-c4db32e8d301 req-6882a867-acec-4d44-bcdb-50a599f85ed4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.273976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-885e6385-1fc2-4a56-8be2-c4db32e8d301 req-6882a867-acec-4d44-bcdb-50a599f85ed4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.308999 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-885e6385-1fc2-4a56-8be2-c4db32e8d301 req-6882a867-acec-4d44-bcdb-50a599f85ed4 service nova] Creating event network-vif-plugged:8c9f743c-5577-43e9-ac31-13bc671b37b0 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:42:13.323361 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-885e6385-1fc2-4a56-8be2-c4db32e8d301 req-6882a867-acec-4d44-bcdb-50a599f85ed4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091493 Aug 24 03:42:13.324493 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1074/2201] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:13.334470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:13.335233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:13.343460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.344155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.344905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.346750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.347494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.348324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.579900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.596924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.601896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.603882 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2c0a6c6-5d56-4be7-807d-e249f646a91f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.832252 Aug 24 03:42:13.604745 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1128/2202] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:12 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:13.638643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:13.639625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:13.654544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.655238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.675882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.679839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.681182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.682775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.764751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.774905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:13.782290 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2862ecbc-097c-4d7c-a2f4-aff333aa7145 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.456356 Aug 24 03:42:13.783831 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1075/2203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:13 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:14.118291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.136969 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a781c5d-10c9-43bc-9b91-17ff59a6c59a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1360 microversion: 2.1 time: 0.528746 Aug 24 03:42:14.137523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1129/2204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:13 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1360 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:14.262947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:14.263623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:14.274536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.275040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.275478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.276471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.276769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.277669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.634213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:14.634826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:14.646022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.646785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.648656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.650859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.652037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.652841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.804952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.818520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.822560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.824533 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-51f43d05-638e-4738-80db-c2b1ecf30382 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.566131 Aug 24 03:42:14.825634 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1076/2205] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:14 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:14.840360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:14.841885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:14.892410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.897328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.901471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.902776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.904967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.907604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.240932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:15.259331 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d1b0a5f-f629-455c-a96c-9fdef4fb1b47 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.431325 Aug 24 03:42:15.264298 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1077/2206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:14 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:15.276424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:15.277545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.290808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.292510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.296149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.298786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.300400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.302367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.325564 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] HTTP exception thrown: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Request method failure captured: Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d HTTP/1.1 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1lflhQ213UQ63Gd_erRf2VrUuZDmcnOcKg_dLkAFXkub8hIUt-6sCW7ps3uIY25zX36cCBt6-PIF6WVky-ZOe0iIxg7jtW38oVdyNZ9sD1waWZBtHggBZTjoXiErU64F_zVDV9CwDZzfSZBEBMEuigjjYAYZElWugsmhXOG-5i-EI Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f82857fdf14747a44bc05640804363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f82857fdf14747a44bc05640804363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: fb3951916c5a4aedb1ba04a7cf01ffb3 Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '73e6d382-2a98-466a-9f39-e360c84b5d1d'} Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:15.329195 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.332865 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.338344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Returning 404 to user: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:15.340611 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f555b374-a69d-4a03-8004-07fda8e2bc38 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "DELETE /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 404 len: 111 microversion: 2.1 time: 0.071385 Aug 24 03:42:15.342131 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1078/2207] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:15 2022] DELETE /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:15.361570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:15.364474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.381040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.382125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.384023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.388625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.391626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.393096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.541261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:15.573853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:15.579309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:15.582782 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-147b72e0-7900-4eac-b403-633243f838cc tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.952518 Aug 24 03:42:15.601093 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1130/2208] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:14 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:15.612776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:15.613848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: 73e6d382-2a98-466a-9f39-e360c84b5d1d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.621508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.622454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.623110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.624186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.625543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.626226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.678365 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] HTTP exception thrown: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Request method failure captured: Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d HTTP/1.1 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ1lflhQ213UQ63Gd_erRf2VrUuZDmcnOcKg_dLkAFXkub8hIUt-6sCW7ps3uIY25zX36cCBt6-PIF6WVky-ZOe0iIxg7jtW38oVdyNZ9sD1waWZBtHggBZTjoXiErU64F_zVDV9CwDZzfSZBEBMEuigjjYAYZElWugsmhXOG-5i-EI Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f82857fdf14747a44bc05640804363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f82857fdf14747a44bc05640804363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: fb3951916c5a4aedb1ba04a7cf01ffb3 Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '73e6d382-2a98-466a-9f39-e360c84b5d1d'} Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:15.682245 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.696483 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.696483 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:15.696483 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:15.696483 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:15.696483 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:15.696483 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. Aug 24 03:42:15.696483 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.701426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Returning 404 to user: Instance 73e6d382-2a98-466a-9f39-e360c84b5d1d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:15.703793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e9728eb1-5b99-4718-8dd7-220a9e95fa58 tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d" status: 404 len: 111 microversion: 2.1 time: 0.100148 Aug 24 03:42:15.706210 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1131/2209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:15 2022] GET /compute/v2.1/servers/73e6d382-2a98-466a-9f39-e360c84b5d1d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:15.717653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-49c481ea-e028-414f-b657-8c2dfdd05aab req-bd7e29ec-1128-4bc6-942b-11edc7f71669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-plugged", "status": "completed", "tag": "405cade2-305c-45aa-8315-48c4d3933e72"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:15.742352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49c481ea-e028-414f-b657-8c2dfdd05aab req-bd7e29ec-1128-4bc6-942b-11edc7f71669 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.743741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49c481ea-e028-414f-b657-8c2dfdd05aab req-bd7e29ec-1128-4bc6-942b-11edc7f71669 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.745569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-49c481ea-e028-414f-b657-8c2dfdd05aab req-bd7e29ec-1128-4bc6-942b-11edc7f71669 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.765367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:15.777882 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-49c481ea-e028-414f-b657-8c2dfdd05aab req-bd7e29ec-1128-4bc6-942b-11edc7f71669 service nova] Creating event network-vif-plugged:405cade2-305c-45aa-8315-48c4d3933e72 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:42:15.784433 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-49c481ea-e028-414f-b657-8c2dfdd05aab req-bd7e29ec-1128-4bc6-942b-11edc7f71669 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076129 Aug 24 03:42:15.788877 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1132/2210] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:15.797589 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53316d51-9844-43c5-8fb5-7149147cd306 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1543 microversion: 2.1 time: 0.448062 Aug 24 03:42:15.798943 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1079/2211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:15 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1543 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:15.803793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:15.821295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.824079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:15.824645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.834543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.836678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.836975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.837189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.837642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.838224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.843523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.844779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.845395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.845899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.846804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.847439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.870921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] HTTP exception thrown: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Request method failure captured: Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 HTTP/1.1 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ1lflhQ213UQ63Gd_erRf2VrUuZDmcnOcKg_dLkAFXkub8hIUt-6sCW7ps3uIY25zX36cCBt6-PIF6WVky-ZOe0iIxg7jtW38oVdyNZ9sD1waWZBtHggBZTjoXiErU64F_zVDV9CwDZzfSZBEBMEuigjjYAYZElWugsmhXOG-5i-EI Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f82857fdf14747a44bc05640804363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f82857fdf14747a44bc05640804363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: fb3951916c5a4aedb1ba04a7cf01ffb3 Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'e672b6aa-e8b3-43bd-bdce-c2cf96d93c83'} Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:15.894032 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:15.898040 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:15.899990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Returning 404 to user: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:15.901161 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-172ffbad-0d13-48d3-a12e-2f42b0ce553b tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 404 len: 111 microversion: 2.1 time: 0.110668 Aug 24 03:42:15.905328 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1133/2212] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:15 2022] DELETE /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:15.912505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:15.913480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.922485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.924537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.925163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.926325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.926954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.927558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.060343 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16dec37f-b657-4816-b590-341f02cedce9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.240930 Aug 24 03:42:16.061734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1080/2213] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:42:15 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:16.091467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:16.095234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] [instance: e672b6aa-e8b3-43bd-bdce-c2cf96d93c83] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:16.111629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.112593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.113211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.115438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.116457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.117411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.167150 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] HTTP exception thrown: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Request method failure captured: Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 HTTP/1.1 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1lflhQ213UQ63Gd_erRf2VrUuZDmcnOcKg_dLkAFXkub8hIUt-6sCW7ps3uIY25zX36cCBt6-PIF6WVky-ZOe0iIxg7jtW38oVdyNZ9sD1waWZBtHggBZTjoXiErU64F_zVDV9CwDZzfSZBEBMEuigjjYAYZElWugsmhXOG-5i-EI Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f82857fdf14747a44bc05640804363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f82857fdf14747a44bc05640804363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f82857fdf14747a44bc05640804363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 79f82857fdf14747a44bc05640804363 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestMultiNic-701637212 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: fb3951916c5a4aedb1ba04a7cf01ffb3 Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestMultiNic-701637212-project Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e672b6aa-e8b3-43bd-bdce-c2cf96d93c83'} Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:16.171157 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:16.174793 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:16.174793 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:16.174793 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:16.174793 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:16.174793 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:16.174793 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. Aug 24 03:42:16.174793 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:16.174793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] Returning 404 to user: Instance e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:16.183532 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1b22b31c-d78f-41f2-86c4-3c1e8ab05a8a tempest-ServersTestMultiNic-701637212 tempest-ServersTestMultiNic-701637212-project] 10.222.0.58 "GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83" status: 404 len: 111 microversion: 2.1 time: 0.119788 Aug 24 03:42:16.184173 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1081/2214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:16 2022] GET /compute/v2.1/servers/e672b6aa-e8b3-43bd-bdce-c2cf96d93c83 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:16.294019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:16.295039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:16.317740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.318998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.320113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.321729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.323017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.324220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.445906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.464982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.470856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.472329 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-88298f20-5687-4248-beac-5cedc6fc2767 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.565677 Aug 24 03:42:16.484362 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1134/2215] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:15 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:16.636152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:16.637501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:16.658955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.659512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.660075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.660852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.673052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.673052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.463474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.475945 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a0ed412-9cf8-4ada-bece-bc358b84b0e3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 1.184877 Aug 24 03:42:17.479273 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1082/2216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:16 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:17.549273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.584228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.587006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.588830 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91622487-51fc-47bf-8da2-abd234f2b956 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.957947 Aug 24 03:42:17.590055 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1135/2217] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:16 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:17.598074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:17.600036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:17.611084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:17.611963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:17.613225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.615248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:17.616776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:17.617557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.746829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-479104882", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": "none"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:17.831953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:42:17.836077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:42:17.836969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:42:17.847912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:42:17.848646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:42:17.861117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:17.861889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:17.862488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.863432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:17.864073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:17.864652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.886774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Getting quotas for project a91a44062a0e4189999fef8341606f67. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:42:17.894801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Getting quotas for user bd02198499fd40209412a89e65861f55 and project a91a44062a0e4189999fef8341606f67. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:42:17.912223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:42:17.915536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: 03447a2d-3e50-4b01-bb60-6d5b26772676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:42:17.988055 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f760fd2e-bbc6-4b49-8a6e-d1e173d1f7eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.506351 Aug 24 03:42:17.997020 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1083/2218] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:42:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:42:18.009943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5561756d-1f93-4879-8449-ed1fc41ba509 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:18.010324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5561756d-1f93-4879-8449-ed1fc41ba509 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: 03447a2d-3e50-4b01-bb60-6d5b26772676] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:18.139710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5561756d-1f93-4879-8449-ed1fc41ba509 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.159379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5561756d-1f93-4879-8449-ed1fc41ba509 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.161981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5561756d-1f93-4879-8449-ed1fc41ba509 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.163548 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5561756d-1f93-4879-8449-ed1fc41ba509 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676" status: 200 len: 1277 microversion: 2.47 time: 0.163987 Aug 24 03:42:18.165790 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1084/2219] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:17 2022] GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:18.179508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7013c258-7976-41f7-bc89-4f0a36f7e7b4 req-2a8a8a31-e69c-4fe0-8013-a9cd3d8fa2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-plugged", "status": "completed", "tag": "5af2697c-af94-46c8-909d-23f7f66e37c1"}, {"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-plugged", "status": "completed", "tag": "840eae0a-52d3-4413-af17-8df0521ff34a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:18.208035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7013c258-7976-41f7-bc89-4f0a36f7e7b4 req-2a8a8a31-e69c-4fe0-8013-a9cd3d8fa2a5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.208533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7013c258-7976-41f7-bc89-4f0a36f7e7b4 req-2a8a8a31-e69c-4fe0-8013-a9cd3d8fa2a5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.208973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7013c258-7976-41f7-bc89-4f0a36f7e7b4 req-2a8a8a31-e69c-4fe0-8013-a9cd3d8fa2a5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.224281 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7013c258-7976-41f7-bc89-4f0a36f7e7b4 req-2a8a8a31-e69c-4fe0-8013-a9cd3d8fa2a5 service nova] Creating event network-vif-plugged:5af2697c-af94-46c8-909d-23f7f66e37c1 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:42:18.224703 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7013c258-7976-41f7-bc89-4f0a36f7e7b4 req-2a8a8a31-e69c-4fe0-8013-a9cd3d8fa2a5 service nova] Creating event network-vif-plugged:840eae0a-52d3-4413-af17-8df0521ff34a for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:42:18.249079 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7013c258-7976-41f7-bc89-4f0a36f7e7b4 req-2a8a8a31-e69c-4fe0-8013-a9cd3d8fa2a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081477 Aug 24 03:42:18.250225 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1085/2220] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:18.277008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-94947820", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": "none"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:18.285716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.304642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.310725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.314631 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f42b363d-00a4-4f63-a183-c92b8d3e5a7a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.721901 Aug 24 03:42:18.316050 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1136/2221] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:17 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:18.402843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:42:18.405871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:42:18.407360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:42:18.409015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:42:18.410305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:42:18.431200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.432216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.433153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.435059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.435860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.436874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.509090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Getting quotas for project a91a44062a0e4189999fef8341606f67. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:42:18.510698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:18.512397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:18.526617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:18.541284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Getting quotas for user bd02198499fd40209412a89e65861f55 and project a91a44062a0e4189999fef8341606f67. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:42:18.565147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.567102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.568828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.569912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.571221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.572209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.582387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:42:18.585199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:42:18.757445 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a9a62084-9cb1-48d1-a6b7-2c0b354131d3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.489206 Aug 24 03:42:18.759730 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1086/2222] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:42:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 03:42:18.777706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:18.778345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:18.818540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.819054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.819501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.820263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.826500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.830361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:19.139654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:19.173746 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc03abd5-2feb-490f-9025-cf7f9103b0df tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.672618 Aug 24 03:42:19.193831 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1137/2223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:18 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:19.200068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ee636e6-8fb9-4df6-9379-9466e86fcf6d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:19.205593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ee636e6-8fb9-4df6-9379-9466e86fcf6d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:19.268854 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ee636e6-8fb9-4df6-9379-9466e86fcf6d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "PUT /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 990 microversion: 2.47 time: 0.069352 Aug 24 03:42:19.269808 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1138/2224] 10.222.0.58 () {62 vars in 1297 bytes} [Wed Aug 24 03:42:19 2022] PUT /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 990 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:42:19.300975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d186575d-b24e-42fa-abf4-94e4c70b7288 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:19.301662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d186575d-b24e-42fa-abf4-94e4c70b7288 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:19.573079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:19.605165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:19.606869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:19.620156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d32d0da1-db09-4e4f-b9ad-96716e67e948 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.858882 Aug 24 03:42:19.620808 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1087/2225] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:18 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:19.633521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:19.634191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:19.683025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.684093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.684882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:19.685859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.686492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.687098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:19.865490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d186575d-b24e-42fa-abf4-94e4c70b7288 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:19.885704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d186575d-b24e-42fa-abf4-94e4c70b7288 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:19.904229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d186575d-b24e-42fa-abf4-94e4c70b7288 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:19.908317 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d186575d-b24e-42fa-abf4-94e4c70b7288 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1276 microversion: 2.47 time: 0.615538 Aug 24 03:42:19.930743 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1139/2226] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:19 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1276 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:19.954723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-65dc4527-9a1f-4ffd-8d9a-7c4ab95f6ee4 req-53e3a0eb-d897-4dd4-9406-3d31e873d643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79baa30-fa4f-47de-8d26-6d070734bccd", "tag": "8eb13453-5453-4ce2-a0f9-64aba47b275b"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:19.989636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-65dc4527-9a1f-4ffd-8d9a-7c4ab95f6ee4 req-53e3a0eb-d897-4dd4-9406-3d31e873d643 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.992915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-65dc4527-9a1f-4ffd-8d9a-7c4ab95f6ee4 req-53e3a0eb-d897-4dd4-9406-3d31e873d643 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.993481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-65dc4527-9a1f-4ffd-8d9a-7c4ab95f6ee4 req-53e3a0eb-d897-4dd4-9406-3d31e873d643 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.035625 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-65dc4527-9a1f-4ffd-8d9a-7c4ab95f6ee4 req-53e3a0eb-d897-4dd4-9406-3d31e873d643 service nova] Creating event network-changed:8eb13453-5453-4ce2-a0f9-64aba47b275b for instance a79baa30-fa4f-47de-8d26-6d070734bccd on n-h1-846470-15 Aug 24 03:42:20.053053 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-65dc4527-9a1f-4ffd-8d9a-7c4ab95f6ee4 req-53e3a0eb-d897-4dd4-9406-3d31e873d643 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120664 Aug 24 03:42:20.055817 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1140/2227] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:20.207532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:20.208615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:20.225485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:20.228310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:20.229292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.234999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:20.235982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:20.236647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.718532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.740169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.756456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.758372 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-507c9fe6-3e2d-43e0-bce5-64cc08c8b22e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 1.136430 Aug 24 03:42:20.788831 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1088/2228] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:19 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:20.798127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cfb41175-ad40-49e5-bc6c-88d7c7554db2 req-6b0f2c06-d05f-4fdc-aa61-88a939dbd797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-plugged", "status": "completed", "tag": "1aa3e47c-9374-4288-97b6-28044e86d865"}, {"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-plugged", "status": "completed", "tag": "4eddbd7e-3228-4d35-a9ae-041d1df1dfe1"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:20.839982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfb41175-ad40-49e5-bc6c-88d7c7554db2 req-6b0f2c06-d05f-4fdc-aa61-88a939dbd797 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:20.840488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfb41175-ad40-49e5-bc6c-88d7c7554db2 req-6b0f2c06-d05f-4fdc-aa61-88a939dbd797 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:20.840937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfb41175-ad40-49e5-bc6c-88d7c7554db2 req-6b0f2c06-d05f-4fdc-aa61-88a939dbd797 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.881710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.904216 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cfb41175-ad40-49e5-bc6c-88d7c7554db2 req-6b0f2c06-d05f-4fdc-aa61-88a939dbd797 service nova] Creating event network-vif-plugged:1aa3e47c-9374-4288-97b6-28044e86d865 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:42:20.904903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cfb41175-ad40-49e5-bc6c-88d7c7554db2 req-6b0f2c06-d05f-4fdc-aa61-88a939dbd797 service nova] Creating event network-vif-plugged:4eddbd7e-3228-4d35-a9ae-041d1df1dfe1 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:42:20.909818 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e63948d5-2de1-48ef-aa1e-a1c864684c10 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.711685 Aug 24 03:42:20.911293 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1141/2229] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:20 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:20.940951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cfb41175-ad40-49e5-bc6c-88d7c7554db2 req-6b0f2c06-d05f-4fdc-aa61-88a939dbd797 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.150491 Aug 24 03:42:20.941693 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1089/2230] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:20.959535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:20.977984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:20.992244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:20.995471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:20.996170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.003118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.003889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.004823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.172392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1715016849", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "24e0c1ee-6927-4db3-966c-30a482465365"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:21.291399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] validate_networks() for [('24e0c1ee-6927-4db3-966c-30a482465365', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:42:21.428459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.453785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.459159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.470519 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f473e189-32ee-459e-a620-35035293713a tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.514967 Aug 24 03:42:21.476055 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1090/2231] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:20 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:21.489523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:21.501362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:21.512441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.517302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.518512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.521317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.521898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.524634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.772320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.808207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.815610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.817455 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bb3f9b6a-4d93-4a96-80f6-13374e1a7de9 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1328 microversion: 2.47 time: 0.339244 Aug 24 03:42:21.821952 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1091/2232] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:21 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1328 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:21.835100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:21.836953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:21.841465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:21.847756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.849471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.850548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.851734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.852763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.853797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.298699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.333247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.334995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.341273 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b94abb7-cff8-4958-9586-c064bc027969 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.511808 Aug 24 03:42:22.342097 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1092/2233] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:21 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:22.364567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:22.365554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:22.375607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.376645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.377795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.378738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.379516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.380115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.470971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:42:22.471505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:42:22.472031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:42:22.472477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:42:22.472970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:42:22.496649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.501667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.502258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.503587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.506437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.506961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.575339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Getting quotas for project 9955856c503245a085710a153078db6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:42:22.599339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Getting quotas for user d3e90b070dc24281923ae98f436e8e2f and project 9955856c503245a085710a153078db6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:42:22.649885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:42:22.656063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:42:22.700605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.712783 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05ecd6bc-bb76-426e-b0ca-558a1c8ac895 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.354894 Aug 24 03:42:22.728210 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1093/2234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:22 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:22.740340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:22.741950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:22.753388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.754321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.755045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.756110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.756779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.757490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.823251 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8df4d722-0281-4e7e-ad21-f50eb9beb5b7 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.908287 Aug 24 03:42:22.824170 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1142/2235] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:42:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:42:22.836632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-26b52af4-6e39-4ce3-a29a-772d93065fbe tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:22.840465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-26b52af4-6e39-4ce3-a29a-772d93065fbe tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:23.155244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-26b52af4-6e39-4ce3-a29a-772d93065fbe tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.175448 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-26b52af4-6e39-4ce3-a29a-772d93065fbe tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1216 microversion: 2.1 time: 0.343062 Aug 24 03:42:23.192235 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1143/2236] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:22 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1216 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:23.204862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:23.205897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:23.215252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.216216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.216872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.221697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.227214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.230901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.232197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.242144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.245638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.251641 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad5b2e92-7ff7-45f1-a167-44fb4cbe4409 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.515435 Aug 24 03:42:23.253153 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1094/2237] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:22 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:23.259169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-535eef7c-bf52-46fc-a5ce-aeb43e911bf6 req-bec879b9-a1b8-4251-9b14-853b6e0d70bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-plugged", "status": "completed", "tag": "dbf9362f-58e3-48e5-ac2d-5aaac595a8a8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:23.281115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-535eef7c-bf52-46fc-a5ce-aeb43e911bf6 req-bec879b9-a1b8-4251-9b14-853b6e0d70bd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.285217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-535eef7c-bf52-46fc-a5ce-aeb43e911bf6 req-bec879b9-a1b8-4251-9b14-853b6e0d70bd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.286867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-535eef7c-bf52-46fc-a5ce-aeb43e911bf6 req-bec879b9-a1b8-4251-9b14-853b6e0d70bd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.339951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-535eef7c-bf52-46fc-a5ce-aeb43e911bf6 req-bec879b9-a1b8-4251-9b14-853b6e0d70bd service nova] Creating event network-vif-plugged:dbf9362f-58e3-48e5-ac2d-5aaac595a8a8 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:42:23.385160 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-535eef7c-bf52-46fc-a5ce-aeb43e911bf6 req-bec879b9-a1b8-4251-9b14-853b6e0d70bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128667 Aug 24 03:42:23.400285 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1095/2238] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:23.416129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:23.417086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:23.432136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.433016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.433923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.436645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.437678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.439707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.466838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.487734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.489406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.490725 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9a3cfb38-30e0-41d0-9494-d9cb27e98f99 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1328 microversion: 2.47 time: 0.297032 Aug 24 03:42:23.491316 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1144/2239] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:23 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1328 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:23.735122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:23.735909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:23.749544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.750146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.750601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.751455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.754740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.756484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.821417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.848586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.852794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.857476 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c677fa8-e36c-403f-bce0-c439fa88b62d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.455262 Aug 24 03:42:23.860111 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1096/2240] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:23 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:24.114386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.136177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:24.139335 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-09068513-bd3f-4a9f-884a-74bd884fa7a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.408423 Aug 24 03:42:24.140301 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1145/2241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:23 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:24.207748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:24.208470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:24.218519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.219634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.220668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.221952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.223382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.224153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.277537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:24.278160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:24.290940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.291744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.292377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.293300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.293924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.294525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.361628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.371989 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-da6c9ffb-d1fc-463a-b04a-f7d6e0c93e75 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1212 microversion: 2.1 time: 0.169907 Aug 24 03:42:24.378708 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1097/2242] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:24 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1212 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:24.519279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:24.520086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:24.534331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.534660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.535095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.535876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.536428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.537725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.610120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:24.685525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.695987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.697523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.698802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0cb5c8d8-32cf-4744-8715-d7f8dec1b84f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.425555 Aug 24 03:42:24.699383 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1146/2243] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:24 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:24.753034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.778922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.783830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:24.789316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1cfd6904-2218-4331-bed6-8be90e31bbbb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1336 microversion: 2.47 time: 0.276041 Aug 24 03:42:24.809890 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1098/2244] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:24 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1336 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:24.885934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:24.886799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:24.907612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.908349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.909042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.909854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.910526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.911218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.175886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:25.180724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:25.254827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.260026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.264746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.268201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.270613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.274727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.463512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.491573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.500250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.502177 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0d3ab98-5fc9-4de9-99e5-f23d9b74e13c tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.621167 Aug 24 03:42:25.504024 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1147/2245] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:24 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:25.512275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:25.529726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:25.539726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.540251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.540703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.541473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.548506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.550732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.691173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.708966 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37a30248-70d8-4686-89a2-6ad1dfef5db5 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1286 microversion: 2.1 time: 0.202845 Aug 24 03:42:25.711651 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1148/2246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:25 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1286 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:25.737629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:25.739257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:25.766923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.768061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.769153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.770905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:25.771875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:25.772758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.126585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.140320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.146782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.153321 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-95842215-6cb4-4256-bc48-8b152a1cca33 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.426105 Aug 24 03:42:26.155394 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1149/2247] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:25 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:26.162512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:26.163411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:26.170579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.171323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.172057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.173809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.174276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.174887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.255136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.259192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.266177 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2f795ace-069a-486d-8bac-0544a53533a4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 1.104822 Aug 24 03:42:26.269839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.271475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.273060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f2293a7a-da80-4ff4-92bd-df5ef110ef6f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1334 microversion: 2.47 time: 0.115334 Aug 24 03:42:26.276964 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1099/2248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:25 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:26.284329 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1150/2249] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:26 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1334 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:26.529198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:26.530100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:26.539450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.540046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.540768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.542075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.542906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.543582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.738962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:26.740115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:26.753482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.754380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.755448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.757021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.758087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.759123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.870048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.882623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-77097839-d8b4-49be-a5d0-13a91a7b6590 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1274 microversion: 2.1 time: 0.152216 Aug 24 03:42:26.888626 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1151/2250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:26 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:27.065565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.087428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.089441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.091025 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2fabde81-feca-4adb-aa3e-432569ca8658 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.566548 Aug 24 03:42:27.091888 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1100/2251] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:26 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:27.183195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:27.185393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:27.194587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.195352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.196170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.197050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.197884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.198500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.310002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:27.310918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:27.362059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.363613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.364801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.366236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.367653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.369153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.997286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.025572 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3bf1cef3-590c-48ae-91bc-27b4ec67b33d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.723658 Aug 24 03:42:28.031297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1101/2252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:27 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:28.043174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:28.043849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:28.052121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.052954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.053507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.054283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.054763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.055199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.159685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.179977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.183066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.185752 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-89c01e9f-938f-41f4-b893-6bb3ce88f9c4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 1.007407 Aug 24 03:42:28.186655 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1152/2253] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:27 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:28.194160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:28.195129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:28.204515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.205334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.207358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.211717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.212897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.213428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.213884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.222497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.225948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.231912 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-38b6bb75-8f28-4898-b475-31b4598d30a8 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1334 microversion: 2.47 time: 0.198267 Aug 24 03:42:28.235037 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1102/2254] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:28 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1334 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:28.244500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:28.245535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:28.265635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.268339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.269468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.270529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.270953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.271460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.470923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:28.482488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.492284 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f2ed727-c213-4ada-8eb5-d3d3663963df tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.302549 Aug 24 03:42:28.492758 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1153/2255] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:28 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:28.564554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=14 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:28.831618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.850771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.854390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.859741 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9f537213-2633-41ef-9edc-528c51adc03b tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1878 microversion: 2.32 time: 0.618113 Aug 24 03:42:28.859741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1103/2256] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:28 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1878 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:29.059409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:29.061167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:29.083279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.083828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.084500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.089322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.090451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.090451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.215331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:29.216248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:29.226316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.227115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.228067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.229881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.230591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.231232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.274133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.285012 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-34244eb4-10b2-40f4-858e-be25bce3a2e7 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.235019 Aug 24 03:42:29.298550 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1154/2257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:29 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:29.298550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:29.298550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:29.301060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.302131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.302606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.303347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.303844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.304275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.444317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.464060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.466503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.468806 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5acc4f7e-9167-48de-94e8-c0e96042fa77 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1334 microversion: 2.47 time: 0.181628 Aug 24 03:42:29.469623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1155/2258] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:29 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1334 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:29.483706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-13a42f00-04c2-4de2-b705-23fa9bfc2f0c req-e7528260-cad6-4fb4-8358-86f72bcc7ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc630f6-5a01-40c3-b70d-493c201f39ed", "tag": "44017fe9-496a-4017-b16a-3323fd108f1f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:29.517118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-13a42f00-04c2-4de2-b705-23fa9bfc2f0c req-e7528260-cad6-4fb4-8358-86f72bcc7ec2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.517942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-13a42f00-04c2-4de2-b705-23fa9bfc2f0c req-e7528260-cad6-4fb4-8358-86f72bcc7ec2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.518813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-13a42f00-04c2-4de2-b705-23fa9bfc2f0c req-e7528260-cad6-4fb4-8358-86f72bcc7ec2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.540808 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-13a42f00-04c2-4de2-b705-23fa9bfc2f0c req-e7528260-cad6-4fb4-8358-86f72bcc7ec2 service nova] Creating event network-changed:44017fe9-496a-4017-b16a-3323fd108f1f for instance 3fc630f6-5a01-40c3-b70d-493c201f39ed on n-h1-846470-15 Aug 24 03:42:29.553405 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-13a42f00-04c2-4de2-b705-23fa9bfc2f0c req-e7528260-cad6-4fb4-8358-86f72bcc7ec2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076183 Aug 24 03:42:29.557207 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1156/2259] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:29.570152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:29.570894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:29.577803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.579060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.579561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.580326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.580795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.581279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.595523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.621910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.624957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.626568 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-971a1cea-8ad2-4ea3-b044-20623d099867 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.416861 Aug 24 03:42:29.628799 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1104/2260] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:29 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:29.784309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.796147 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31cd3208-6940-4853-a3c0-fb9dc63a8c82 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.231088 Aug 24 03:42:29.811114 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1157/2261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:29 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:29.888035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:29.888797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:29.901893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.901893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.901893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.901893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.901893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.901893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.252270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.270692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.272358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.273797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc3792b9-72a8-440a-bcfe-c853dd45a716 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2831 microversion: 2.32 time: 0.391473 Aug 24 03:42:30.274471 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1105/2262] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:29 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2831 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:30.303202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:30.304487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:30.308721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:30.309350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:30.312069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.312868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.313334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.314103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.314773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.315213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.317571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.318096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.318537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.319277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.319822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.320809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.479218 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1ef60507-f705-4585-a143-55a9ea5f3d31 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.182588 Aug 24 03:42:30.488092 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1158/2263] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 03:42:30 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82/os-interface => generated 1831 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:30.505542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:30.512795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.520098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:30.530793 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c2e253e3-9c5c-4a5e-bd0c-afe35c782ddf tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.226610 Aug 24 03:42:30.541679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.542593 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1106/2264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:30 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:30.549344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.551204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.553479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.554289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.555018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.671207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:30.673303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:30.681881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.682885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.683542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.685232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.686025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.687184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.692799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.711207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.714251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:30.717400 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3a3b8aec-4ebe-44cb-9725-d56f568f28e7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1355 microversion: 2.47 time: 0.221817 Aug 24 03:42:30.737052 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1159/2265] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:30 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1355 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:30.761546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:30.767030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:30.787555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.788942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.792589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.794303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.795481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.797191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.930720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:42:30.931434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:42:30.932132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:42:30.932724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:42:30.933310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:42:30.984299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.004347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.007497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.010179 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d2e4259-d6a9-418f-8e18-33a35a73d881 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.344341 Aug 24 03:42:31.011192 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1107/2266] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:30 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:31.039648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:31.040779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:31.045005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:31.048968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.049827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.050493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.051511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.052293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.052915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.061965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.062874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.063612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.065186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.066627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.067327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.114722 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-98bab578-ea23-4e7a-9e84-29f6cb9d42c1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "POST /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533/action" status: 202 len: 1077 microversion: 2.47 time: 0.361897 Aug 24 03:42:31.120265 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1160/2267] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:42:30 2022] POST /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533/action => generated 1077 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 03:42:31.144280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:31.145052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:31.152379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.152892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.153800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.154167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.154649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.155097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.180017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:31.342968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.367486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.370247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.372038 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1f5e3947-a764-4936-9e01-8cb23e6abc05 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.233907 Aug 24 03:42:31.373399 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1161/2268] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:31 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:31.435920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.450854 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79737bfe-747e-44bb-a5fb-8626ee3eb185 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.420648 Aug 24 03:42:31.452959 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1108/2269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:31 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:31.566023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:31.566872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:31.577354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.577954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.578416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.579367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:31.579885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:31.580328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.913576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.925559 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bbfa4ebe-ba4c-4af1-9f84-81ea84257115 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.365477 Aug 24 03:42:31.926193 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1162/2270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:31 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:32.048832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:32.051009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:32.081475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.082301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.082982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.084036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.084752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.085767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.398678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:32.399510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:32.429831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.432853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.433953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.442210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.442980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.443602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.543224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:32.572151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.583996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.586145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.587423 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3701e815-0d4b-438c-9eb9-e3cfb9c662cd tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.193991 Aug 24 03:42:32.611399 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1163/2271] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:32 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:32.619425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:32.620100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:32.631379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.632560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.633006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.633739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.634193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.634617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.697504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.722030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.724288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.727070 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-30f45523-baa5-47be-b7b6-868805f19704 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.685562 Aug 24 03:42:32.732399 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1109/2272] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:32 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:32.755821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b93a3ec2-1d8f-4fc3-9d91-c97a5cd74c4b req-88aa0ca4-293a-40ba-b0e5-2f9294a33968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "tag": "405cade2-305c-45aa-8315-48c4d3933e72"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:32.799206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b93a3ec2-1d8f-4fc3-9d91-c97a5cd74c4b req-88aa0ca4-293a-40ba-b0e5-2f9294a33968 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.800433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b93a3ec2-1d8f-4fc3-9d91-c97a5cd74c4b req-88aa0ca4-293a-40ba-b0e5-2f9294a33968 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.801134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b93a3ec2-1d8f-4fc3-9d91-c97a5cd74c4b req-88aa0ca4-293a-40ba-b0e5-2f9294a33968 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.833980 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b93a3ec2-1d8f-4fc3-9d91-c97a5cd74c4b req-88aa0ca4-293a-40ba-b0e5-2f9294a33968 service nova] Creating event network-changed:405cade2-305c-45aa-8315-48c4d3933e72 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:42:32.852810 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b93a3ec2-1d8f-4fc3-9d91-c97a5cd74c4b req-88aa0ca4-293a-40ba-b0e5-2f9294a33968 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118308 Aug 24 03:42:32.854429 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1110/2273] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:32.958970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:32.961756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:32.977852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.979083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.980083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.982849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.984038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.986360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.001653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.028843 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9829b147-d8c0-4e41-920e-119d4c3ed6dd tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.415765 Aug 24 03:42:33.030496 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1164/2274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:32 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:33.358083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-19d82c97-7098-4289-94ec-0a4fb70efb1b req-bf657d68-e655-45c9-81c3-217c1df38e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-plugged", "status": "completed", "tag": "5c7ebbdb-390b-4d78-b6a2-425bd3132adc"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:33.365804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=10 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:33.400947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-19d82c97-7098-4289-94ec-0a4fb70efb1b req-bf657d68-e655-45c9-81c3-217c1df38e6c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.400947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-19d82c97-7098-4289-94ec-0a4fb70efb1b req-bf657d68-e655-45c9-81c3-217c1df38e6c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.402166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-19d82c97-7098-4289-94ec-0a4fb70efb1b req-bf657d68-e655-45c9-81c3-217c1df38e6c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.433092 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-19d82c97-7098-4289-94ec-0a4fb70efb1b req-bf657d68-e655-45c9-81c3-217c1df38e6c service nova] Creating event network-vif-plugged:5c7ebbdb-390b-4d78-b6a2-425bd3132adc for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:42:33.452340 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-19d82c97-7098-4289-94ec-0a4fb70efb1b req-bf657d68-e655-45c9-81c3-217c1df38e6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098871 Aug 24 03:42:33.457078 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1165/2275] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:33.616003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:33.617219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:33.633930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.639265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.640239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.641676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.647279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.647889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.648655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.661677 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e9e1491a-510a-4514-ae26-5b68cb405121 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.714957 Aug 24 03:42:33.662304 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1111/2276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:32 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:33.778522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:33.779188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:33.793733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.796609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.799813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.800920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.802579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.806654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.825102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.849621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.853453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.856801 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a251662f-2ed9-4cef-a43b-e0407d6cf08b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.248220 Aug 24 03:42:33.858786 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1166/2277] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:33 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:34.061751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:34.064159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:34.075820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.077052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.077837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:34.078871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.079591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.080306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:34.271951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:34.287775 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f76e2904-1f58-47fe-af9b-1ab91bccb7ee tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.230613 Aug 24 03:42:34.288959 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1167/2278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:34 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:34.708212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:34.710558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:34.726394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.741263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.742670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:34.744405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.745598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.747355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:35.027840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.045806 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e41f37e6-7e80-4913-8245-b45fe40152c9 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.350191 Aug 24 03:42:35.048491 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1168/2279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:34 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:35.060313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:35.061776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:35.073929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:35.075197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:35.076289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:35.078150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:35.079402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:35.080517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:35.155101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.171309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.175309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.178411 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45edfd33-0be9-408f-97fe-789c3454e989 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 1.407525 Aug 24 03:42:35.180315 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1112/2280] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:33 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:35.215971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.230650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.236190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:35.239450 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5374394f-68b9-46d4-ba87-8f2926fd85eb tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.188464 Aug 24 03:42:35.244267 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1169/2281] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:35 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:35.314377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:35.316522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:35.328495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:35.331522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:35.332296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:35.333383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:35.334203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:35.334917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:35.576803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-cb47f918-8e96-43e4-ac18-0267b7ef1101 req-37134e13-6582-47c9-85a9-4136ceed3d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-plugged", "status": "completed", "tag": "ada7addd-bf30-4193-8194-ddce03d8df90"}, {"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-plugged", "status": "completed", "tag": "20094682-916d-47c5-bd07-b6fb29d41cb9"}, {"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-plugged", "status": "completed", "tag": "323a0297-cdc4-4ea9-82c5-f9a48df89f13"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:35.598418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cb47f918-8e96-43e4-ac18-0267b7ef1101 req-37134e13-6582-47c9-85a9-4136ceed3d52 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:35.599597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cb47f918-8e96-43e4-ac18-0267b7ef1101 req-37134e13-6582-47c9-85a9-4136ceed3d52 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:35.600629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cb47f918-8e96-43e4-ac18-0267b7ef1101 req-37134e13-6582-47c9-85a9-4136ceed3d52 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:35.622570 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-cb47f918-8e96-43e4-ac18-0267b7ef1101 req-37134e13-6582-47c9-85a9-4136ceed3d52 service nova] Creating event network-vif-plugged:ada7addd-bf30-4193-8194-ddce03d8df90 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:42:35.624327 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-cb47f918-8e96-43e4-ac18-0267b7ef1101 req-37134e13-6582-47c9-85a9-4136ceed3d52 service nova] Creating event network-vif-plugged:20094682-916d-47c5-bd07-b6fb29d41cb9 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:42:35.626223 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-cb47f918-8e96-43e4-ac18-0267b7ef1101 req-37134e13-6582-47c9-85a9-4136ceed3d52 service nova] Creating event network-vif-plugged:323a0297-cdc4-4ea9-82c5-f9a48df89f13 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:42:35.638797 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-cb47f918-8e96-43e4-ac18-0267b7ef1101 req-37134e13-6582-47c9-85a9-4136ceed3d52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.068694 Aug 24 03:42:35.640823 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1170/2282] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:36.071768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.092997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:36.094247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:36.104856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.106076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.107390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.108818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.109817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.112384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.122403 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-97d2fad2-af9d-4153-acee-682c199ea965 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.815422 Aug 24 03:42:36.126085 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1113/2283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:35 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:36.216538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:36.218269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:36.235934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.237522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.238651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.241695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.243589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.244888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.386355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.403622 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd096ebf-a7dc-4e39-9b78-7647d31d4f06 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.321228 Aug 24 03:42:36.414947 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1171/2284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:36 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:36.432868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:36.435077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:36.447100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.448255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.448997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.450153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:36.450981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:36.451713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.603962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.633368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.668361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.677904 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d947d7ac-14e5-4613-aeaf-01b141c442b2 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.258705 Aug 24 03:42:36.684478 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1172/2285] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:36 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:36.838313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.871454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.874169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.880726 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d86cd559-7897-4221-91fe-860b93830f6f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.670126 Aug 24 03:42:36.881640 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1114/2286] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:36 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:37.151157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:37.153523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:37.164014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:37.166710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.167868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.168943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.170458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.171517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.172570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.438839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:37.453480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.454689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:37.483600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.488133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.490127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c506b94-490a-4aeb-aac3-e55fff798cdb tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.346422 Aug 24 03:42:37.492117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.494704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.495918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.497175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.506884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1173/2287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:37 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:37.666673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-21585e80-f063-4bf4-9296-0d8e5ccf7efc req-4ce6f30c-4f35-4245-b9a5-82eff27e9615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-plugged", "status": "completed", "tag": "ded6684b-2e32-4bbb-be0f-f0be069a1304"}, {"server_uuid": "93b81154-9101-4ed9-96ce-4134bbf5484b", "name": "network-vif-plugged", "status": "completed", "tag": "ba6c3530-c382-4b6e-89e9-580698731037"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:37.692046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-21585e80-f063-4bf4-9296-0d8e5ccf7efc req-4ce6f30c-4f35-4245-b9a5-82eff27e9615 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.693588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-21585e80-f063-4bf4-9296-0d8e5ccf7efc req-4ce6f30c-4f35-4245-b9a5-82eff27e9615 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.694742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-21585e80-f063-4bf4-9296-0d8e5ccf7efc req-4ce6f30c-4f35-4245-b9a5-82eff27e9615 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.753487 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-21585e80-f063-4bf4-9296-0d8e5ccf7efc req-4ce6f30c-4f35-4245-b9a5-82eff27e9615 service nova] Creating event network-vif-plugged:ded6684b-2e32-4bbb-be0f-f0be069a1304 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:42:37.755132 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-21585e80-f063-4bf4-9296-0d8e5ccf7efc req-4ce6f30c-4f35-4245-b9a5-82eff27e9615 service nova] Creating event network-vif-plugged:ba6c3530-c382-4b6e-89e9-580698731037 for instance 93b81154-9101-4ed9-96ce-4134bbf5484b on n-h1-846470-15 Aug 24 03:42:37.770177 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-21585e80-f063-4bf4-9296-0d8e5ccf7efc req-4ce6f30c-4f35-4245-b9a5-82eff27e9615 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110517 Aug 24 03:42:37.772190 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1174/2288] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:37.794331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:37.800307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:37.819825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.823189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.823942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.824969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.826053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.829063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.881391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.889431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:37.913100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3d918376-b042-41c1-8e37-8a6c869df288 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.481040 Aug 24 03:42:37.915099 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1115/2289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:37 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:37.927712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:37.929829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:37.943348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.944765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.945883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.947947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.949161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.950245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:38.261472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.308481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.327133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.335106 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6cdebc98-d5a5-4d92-9d02-9eb3d940edfc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.555205 Aug 24 03:42:38.337042 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1175/2290] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:37 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:38.525002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:38.526847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:38.576879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.579556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:38.580763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:38.589899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:38.596282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:38.599429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.602600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.604315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:38.605047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:38.612486 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-263ff783-b38c-4a19-b2bb-1fcb11fa945f tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.694862 Aug 24 03:42:38.613776 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1116/2291] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:37 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:38.971842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:38.975363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:38.995058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:38.995931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:38.996554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:38.998001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:38.998872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.001819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.060347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.078627 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-41e6f5b7-624c-4cdd-9529-35be92e153c4 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.566818 Aug 24 03:42:39.080264 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1176/2292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:38 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:39.290289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.300998 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e363c8bc-6a84-489d-8db0-ede85a5fb349 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1314 microversion: 2.1 time: 0.345483 Aug 24 03:42:39.301747 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1117/2293] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:38 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:39.386718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:39.388028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:39.403879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.404643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.405335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.406581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.407405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.408475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.526029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.534972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.536534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.538082 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ccce68f3-0861-4934-a9d5-43c67fd8a711 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.159482 Aug 24 03:42:39.542293 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1177/2294] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:39 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:39.666594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:39.667345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:39.683857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.698207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.701702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.704504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.706791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.708730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.803772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-bfca8026-5f9f-4fec-832b-a88f2e13f4ea req-404093b7-c0bc-4fee-b0cf-55dacf91aa4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-plugged", "status": "completed", "tag": "efcdcdd4-3cc4-4b59-9e73-b000f5f70269"}, {"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-plugged", "status": "completed", "tag": "20cb989b-08a0-48e3-8702-22885f1f572e"}, {"server_uuid": "3fc630f6-5a01-40c3-b70d-493c201f39ed", "name": "network-vif-plugged", "status": "completed", "tag": "44017fe9-496a-4017-b16a-3323fd108f1f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:39.826379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bfca8026-5f9f-4fec-832b-a88f2e13f4ea req-404093b7-c0bc-4fee-b0cf-55dacf91aa4a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.827331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bfca8026-5f9f-4fec-832b-a88f2e13f4ea req-404093b7-c0bc-4fee-b0cf-55dacf91aa4a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.828033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bfca8026-5f9f-4fec-832b-a88f2e13f4ea req-404093b7-c0bc-4fee-b0cf-55dacf91aa4a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.868587 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bfca8026-5f9f-4fec-832b-a88f2e13f4ea req-404093b7-c0bc-4fee-b0cf-55dacf91aa4a service nova] Creating event network-vif-plugged:efcdcdd4-3cc4-4b59-9e73-b000f5f70269 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:42:39.869772 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bfca8026-5f9f-4fec-832b-a88f2e13f4ea req-404093b7-c0bc-4fee-b0cf-55dacf91aa4a service nova] Creating event network-vif-plugged:20cb989b-08a0-48e3-8702-22885f1f572e for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:42:39.870207 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bfca8026-5f9f-4fec-832b-a88f2e13f4ea req-404093b7-c0bc-4fee-b0cf-55dacf91aa4a service nova] Creating event network-vif-plugged:44017fe9-496a-4017-b16a-3323fd108f1f for instance 3fc630f6-5a01-40c3-b70d-493c201f39ed on n-h1-846470-15 Aug 24 03:42:39.895063 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-bfca8026-5f9f-4fec-832b-a88f2e13f4ea req-404093b7-c0bc-4fee-b0cf-55dacf91aa4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.102343 Aug 24 03:42:39.900597 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1178/2295] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:40.057529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.075421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.081176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.083023 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3e7beed4-3e95-4eee-b9ca-5ade0169441d tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.421089 Aug 24 03:42:40.083555 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1118/2296] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:39 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:40.114858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:40.115562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:40.130766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.131257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.135457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.136363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.138613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.143038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.323818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:40.324487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:40.335914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.336638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.337298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.338808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.339567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.340476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.694839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.713070 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e491b53-f42b-435b-a6de-63f634c5df21 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.602662 Aug 24 03:42:40.717024 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1179/2297] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:40 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:40.738033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:40.739401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:40.747730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.748849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.749864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.750982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.752295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.753008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.840566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.853163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.858512 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7dd79ab2-4815-475c-a4db-9465a7c961d8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1464 microversion: 2.1 time: 0.539319 Aug 24 03:42:40.866527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:40.869947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.876885 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1119/2298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:40 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1464 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:40.878159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.886758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-960c3cdd-19b9-41db-9c8a-78a5d4597940 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.153099 Aug 24 03:42:40.902818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-537100154", "metadata": {"image_type": "test"}}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:40.903437 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1180/2299] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:40 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:40.913318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:40.917809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.918324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.919906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.919906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.920138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.920606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.964743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Getting quotas for project 2b5d14e6320f4a2587cb3ee64e7e98c9. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:42:40.971591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Getting quotas for user ae771f274012411391a0563ca2eb8cbc and project 2b5d14e6320f4a2587cb3ee64e7e98c9. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:42:41.125041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1434631924", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7e985d05-8052-49f4-894f-069701c9a6ec"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:41.186531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] validate_networks() for [('7e985d05-8052-49f4-894f-069701c9a6ec', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:42:41.214520 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb4dbb7e-821d-448f-a640-b64dd3c597c8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "POST /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b/action" status: 202 len: 0 microversion: 2.1 time: 0.330133 Aug 24 03:42:41.215349 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1120/2300] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:42:40 2022] POST /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 03:42:41.220996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.221818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:41.228663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.229284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.230155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.230608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.231157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.231703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.513398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:41.529362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:41.533334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:41.536260 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a1eff155-5f10-4c48-a027-5e9526d49561 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.318599 Aug 24 03:42:41.537288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1121/2301] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:41.545392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83e1b33a-05b6-4325-b517-b31b8d71b55e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034397d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.619204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-83e1b33a-05b6-4325-b517-b31b8d71b55e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.080124 Aug 24 03:42:41.620173 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1122/2302] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:41.751799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:42:41.752553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:42:41.753187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:42:41.753836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:42:41.754470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:42:41.755645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.756939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:41.769764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.777029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.778113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.778302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.778463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.778639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.778805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.778805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.779085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.779243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.779406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.779406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.807024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Getting quotas for project d9017741914745fb8e346195e1077dae. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:42:41.815170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Getting quotas for user 85d63578576d4fc7b6efabde5276b860 and project d9017741914745fb8e346195e1077dae. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:42:41.834580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:42:41.839208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:42:41.934516 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-199aa688-f355-46b1-b158-c995cf77dc1c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980841 Aug 24 03:42:41.935190 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1181/2303] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:42:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:42:41.953357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.954363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:41.962590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.963442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.964233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.965243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.966104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.966828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:42.025332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.038156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6f0fcb5-a6a6-47d2-9d5f-0a4d44cf84ba tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.289907 Aug 24 03:42:42.052313 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1123/2304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:42.062654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81bc9468-bb60-48fd-a7b9-c31f41e1e8d5 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:42.064500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81bc9468-bb60-48fd-a7b9-c31f41e1e8d5 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:42.092588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.115579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.117290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.120006 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65bec297-bd06-4146-b941-dc8c5131229b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.183476 Aug 24 03:42:42.121201 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1182/2305] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:42.143234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81bc9468-bb60-48fd-a7b9-c31f41e1e8d5 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.156717 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81bc9468-bb60-48fd-a7b9-c31f41e1e8d5 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1218 microversion: 2.1 time: 0.102515 Aug 24 03:42:42.157484 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1124/2306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:42 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:42.581511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:42.583449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:42.607709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:42.607709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:42.607709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:42.607709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:42.607709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:42.607709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:42.608510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:42.608510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:42.617649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:42.619795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:42.620534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:42.622416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:42.623196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:42.624454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:42.664091 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e62d7f8a-76ab-47ba-9e81-511e1cd008db tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/ips" status: 200 len: 144 microversion: 2.1 time: 0.061486 Aug 24 03:42:42.665692 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1125/2307] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:42:42 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/ips => generated 144 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:42.672016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1508d6d3-3571-4491-b2ca-973c4662a815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034382940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:42.788532 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1508d6d3-3571-4491-b2ca-973c4662a815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.120816 Aug 24 03:42:42.804155 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1126/2308] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:42 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:43.069258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:43.070298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:43.088102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.096320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.099898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.100465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.101239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.101721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.105517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.116325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.120456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.127522 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d2edfe69-4164-4c68-8e17-9238d46aaa10 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1879 microversion: 2.42 time: 0.555372 Aug 24 03:42:43.131534 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1183/2309] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:42 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1879 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:43.178609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:43.179707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:43.214214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.217000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.218846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.221063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.224186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.224893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.425046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.446241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.457660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.460565 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7cdae6a4-8b52-4592-ba6d-eb67eadbb48a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.315399 Aug 24 03:42:43.487617 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1184/2310] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:43 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:43.499722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:43.500729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:43.510090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.510530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.511534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.512513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.513203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.513644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.593667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.616835 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-57e75387-7c39-451f-b9c2-4743516f82c8 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1316 microversion: 2.1 time: 0.554729 Aug 24 03:42:43.619734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1127/2311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:43 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:43.639755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.654958 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b76b14b-90ba-492d-b675-1173c4a52553 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1270 microversion: 2.1 time: 0.164129 Aug 24 03:42:43.659875 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1185/2312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:43 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:43.814323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bca23021-2703-4f35-8b9d-fcfb0b8f0c1b tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f102afe5790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:43.964607 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bca23021-2703-4f35-8b9d-fcfb0b8f0c1b tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.157119 Aug 24 03:42:43.978196 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1128/2313] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:43 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:44.177732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:44.180930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:44.223037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.228581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.229801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.233410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.235996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.240419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.519242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:44.522893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:44.565939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.566664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.567467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.590202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.593965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.599228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.784879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.796591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.798732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.800583 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5aad1c01-011a-4e2c-9156-300f963ada98 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.309441 Aug 24 03:42:44.801783 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1129/2314] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:44 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:44.808966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:44.809969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:44.819150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.819931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.820446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.821432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.822452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.822452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.211733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.244719 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c5fbde4-90c0-469b-931f-02daaf9b6e2f tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1504 microversion: 2.1 time: 0.440849 Aug 24 03:42:45.281348 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1130/2315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:44 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:45.302930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:45.304543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:45.325004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.329785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.330987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.331829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.333175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.335659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.336395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.362415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.372800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.375012 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9d38257-3780-4d94-a9c4-fec9f1a5bd38 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2837 microversion: 2.42 time: 1.213176 Aug 24 03:42:45.376029 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1186/2316] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:44 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2837 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:45.397683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14feb1da-ef8f-4a45-94bf-f1a717d2f18a tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10341e6ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:45.477130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.490764 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14feb1da-ef8f-4a45-94bf-f1a717d2f18a tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.102114 Aug 24 03:42:45.492280 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1187/2317] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:45 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:45.492728 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-93258fe4-ed58-4163-82bb-d593247555af tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1276 microversion: 2.1 time: 0.208853 Aug 24 03:42:45.506331 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1131/2318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:45 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:45.510147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:45.510701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:45.514109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:45.515918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:45.525677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.527903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.529016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.530189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.532310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.533341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.533901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.534988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.535908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.537509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.538782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.541017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.597048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:42:45.794588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4060ff95-faad-4b1c-916d-921529b3e305 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.286616 Aug 24 03:42:45.796490 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1132/2319] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 03:42:45 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584/os-interface => generated 1831 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:45.850889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:45.855793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:45.862988 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac909db0-f628-4bba-9022-972cb6d58836 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 204 len: 0 microversion: 2.1 time: 0.367203 Aug 24 03:42:45.870244 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1188/2320] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:45 2022] DELETE /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:42:45.886934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:45.887720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:45.888950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.892164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.895746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.896603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.897657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.898902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.899622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.900528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.907883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.913682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.921800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.922616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.226047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:46.247742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:46.251227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:46.253820 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b07c7029-8d38-4458-bff8-d73777b90e1f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.412470 Aug 24 03:42:46.256418 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1133/2321] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:45 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:46.320515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:46.364349 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc4d715f-ff8d-4f13-a596-f8521668d70c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1510 microversion: 2.1 time: 0.489309 Aug 24 03:42:46.393338 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1189/2322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:45 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:46.516429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-581e3dfb-81ac-4d91-88ed-36b68183c474 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034382940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:46.526642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:46.527546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:46.583436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.583991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.608682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.610203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.611096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.613965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.812507 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-581e3dfb-81ac-4d91-88ed-36b68183c474 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.302878 Aug 24 03:42:46.813627 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1134/2323] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:46 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:46.935337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3af96c0-f517-4e21-a967-0dda3aa0136f"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:46.940620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:46.968691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.969720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.970545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.979133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.980689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.986118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:47.505730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.536211 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3806852-3f5a-423e-aecb-a51c95498897 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1318 microversion: 2.1 time: 1.016109 Aug 24 03:42:47.544405 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1190/2324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:46 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1318 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:47.552435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:47.553431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:47.584694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:47.585792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:47.586470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:47.589371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:47.590273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:47.591066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:47.698392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:47.787186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.804230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.807056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.809251 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-52ec957a-a917-43c2-9e6d-03868dc41be0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.263370 Aug 24 03:42:47.810030 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1191/2325] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:47 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:47.817477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:47.818651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:47.829647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:47.831084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:47.832016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:47.834535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:47.836161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:47.837103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.047600 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eee9a983-67f6-4426-b534-81fb64ee3140 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.125748 Aug 24 03:42:48.070074 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1135/2326] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:42:46 2022] POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/os-volume_attachments => generated 194 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:48.117241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af02e1b9-3461-47fe-8888-2cd302c2b4ff tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034397ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:48.294571 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af02e1b9-3461-47fe-8888-2cd302c2b4ff tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.220636 Aug 24 03:42:48.295441 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1136/2327] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:48 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:48.585433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:48.593963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:48.609171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.613283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.614435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.616392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.617504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.618611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.677467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:48.713548 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-630fbeb3-c28a-436c-ad07-ecb05e1bfe08 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1510 microversion: 2.1 time: 0.899971 Aug 24 03:42:48.722244 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1192/2328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:47 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1510 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:48.845785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:48.860429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:48.883617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.884796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.885803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.889539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.891081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.892107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.103364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.123476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.128342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.130899 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0701e07a-cd40-43f5-8bbb-206f7c0bade0 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.292691 Aug 24 03:42:49.132479 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1193/2329] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:48 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:49.149492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-aabd07e9-c144-421c-87b9-9b93325c837d req-42e69b7d-9602-4bb5-80ac-d53e2f4098a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b75085c-e1de-4465-9ddb-1dba6c2519d9", "tag": "d7168410-b5e0-40ba-9272-6acda36b915d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:49.184124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aabd07e9-c144-421c-87b9-9b93325c837d req-42e69b7d-9602-4bb5-80ac-d53e2f4098a1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.185004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aabd07e9-c144-421c-87b9-9b93325c837d req-42e69b7d-9602-4bb5-80ac-d53e2f4098a1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.185682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aabd07e9-c144-421c-87b9-9b93325c837d req-42e69b7d-9602-4bb5-80ac-d53e2f4098a1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.195274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.213245 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d8330be0-f95c-4489-8212-e448d311e845 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1318 microversion: 2.1 time: 0.638610 Aug 24 03:42:49.216138 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1137/2330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:48 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:49.225931 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-aabd07e9-c144-421c-87b9-9b93325c837d req-42e69b7d-9602-4bb5-80ac-d53e2f4098a1 service nova] Creating event network-changed:d7168410-b5e0-40ba-9272-6acda36b915d for instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 on n-h2-846470-15 Aug 24 03:42:49.238267 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-aabd07e9-c144-421c-87b9-9b93325c837d req-42e69b7d-9602-4bb5-80ac-d53e2f4098a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102293 Aug 24 03:42:49.240458 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1194/2331] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:49.319358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0b18a1d4-4d27-4a4f-aa91-cae6566da12f tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f103437c160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:49.417000 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0b18a1d4-4d27-4a4f-aa91-cae6566da12f tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.105298 Aug 24 03:42:49.418628 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1138/2332] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:49 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:49.532922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ee8ab1a4-ec82-4f48-9512-4324a6a1bca2 req-16975ab5-14e7-483f-9819-a9debd1f1109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b81154-9101-4ed9-96ce-4134bbf5484b", "name": "network-vif-plugged", "status": "completed", "tag": "ba6c3530-c382-4b6e-89e9-580698731037"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:49.553931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ee8ab1a4-ec82-4f48-9512-4324a6a1bca2 req-16975ab5-14e7-483f-9819-a9debd1f1109 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.555102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ee8ab1a4-ec82-4f48-9512-4324a6a1bca2 req-16975ab5-14e7-483f-9819-a9debd1f1109 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.556078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ee8ab1a4-ec82-4f48-9512-4324a6a1bca2 req-16975ab5-14e7-483f-9819-a9debd1f1109 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.581518 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ee8ab1a4-ec82-4f48-9512-4324a6a1bca2 req-16975ab5-14e7-483f-9819-a9debd1f1109 service nova] Creating event network-vif-plugged:ba6c3530-c382-4b6e-89e9-580698731037 for instance 93b81154-9101-4ed9-96ce-4134bbf5484b on n-h1-846470-15 Aug 24 03:42:49.591740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ee8ab1a4-ec82-4f48-9512-4324a6a1bca2 req-16975ab5-14e7-483f-9819-a9debd1f1109 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067468 Aug 24 03:42:49.593692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1195/2333] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:49.763116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:49.764105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:49.780726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7348c1a6-24d1-421b-ae9a-5e9ad70484c3 req-8304810b-300a-40ff-a415-ae20a9b89e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "tag": "efcdcdd4-3cc4-4b59-9e73-b000f5f70269"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:49.803095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.803910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.804567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.805576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.806304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.806993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.846646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7348c1a6-24d1-421b-ae9a-5e9ad70484c3 req-8304810b-300a-40ff-a415-ae20a9b89e3e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:49.847690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7348c1a6-24d1-421b-ae9a-5e9ad70484c3 req-8304810b-300a-40ff-a415-ae20a9b89e3e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:49.848684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7348c1a6-24d1-421b-ae9a-5e9ad70484c3 req-8304810b-300a-40ff-a415-ae20a9b89e3e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.911723 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7348c1a6-24d1-421b-ae9a-5e9ad70484c3 req-8304810b-300a-40ff-a415-ae20a9b89e3e service nova] Creating event network-changed:efcdcdd4-3cc4-4b59-9e73-b000f5f70269 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:42:49.935427 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7348c1a6-24d1-421b-ae9a-5e9ad70484c3 req-8304810b-300a-40ff-a415-ae20a9b89e3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164925 Aug 24 03:42:49.936408 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1196/2334] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:49.957389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e90b070dc24281923ae98f436e8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9955856c503245a085710a153078db6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.969562 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fc981d54-2bd2-40a2-b0ec-37dfffe83a53 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 200 len: 1468 microversion: 2.1 time: 0.214694 Aug 24 03:42:49.971152 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1139/2335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:49 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 1468 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:50.173328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:50.174420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:50.191979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:50.193079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:50.193734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:50.194667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:50.195748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:50.196812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:50.267711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:50.271438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:50.288311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:50.290930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:50.291786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:50.293617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:50.296343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:50.297012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:50.325247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:50.337212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:50.342378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:50.345348 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-800ee993-8d49-4076-86fe-0743d94ca167 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.177443 Aug 24 03:42:50.346178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1197/2336] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:50 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:50.433479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-34299b4a-e746-459b-b233-85a4f1c1313e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10343c01f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:50.506121 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-34299b4a-e746-459b-b233-85a4f1c1313e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.077250 Aug 24 03:42:50.509214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1198/2337] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:50 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:50.534333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:50.542982 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be866d0d-b7c9-4888-9934-2d886746dca9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1318 microversion: 2.1 time: 0.304290 Aug 24 03:42:50.543583 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1140/2338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:50 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:50.999978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:51.001539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:51.010141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.010720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.011244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.012155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.012685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.013176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.037012 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] HTTP exception thrown: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Request method failure captured: Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed HTTP/1.1 Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ4cpbq7-FZe5tlM-wZzbVbAOVZUBoDALN-jDR3oTjYmbecruxF26gBgf7H-7apPGlLsjS8syGvTAh16E3MNTp2aRmsER5jHN970SdowY-6KC9Eh6nPbottbkAHcSZegVPyn9W7shwQvD_4fP7HPeyLuoJeu5VjAh5fZBjEmdTtl8kc Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9955856c503245a085710a153078db6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9955856c503245a085710a153078db6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d3e90b070dc24281923ae98f436e8e2f Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '3fc630f6-5a01-40c3-b70d-493c201f39ed'} Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.038899 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Returning 404 to user: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6a5183e8-1db1-4bf1-bd13-8f2a293e865c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 404 len: 111 microversion: 2.1 time: 0.049085 Aug 24 03:42:51.043274 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1199/2339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:50 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:51.057561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-236218528", "metadata": {"image_type": "test"}}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:51.060727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:51.069799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.070543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.071847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.072946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.073565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.074145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.099360 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] HTTP exception thrown: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Request method failure captured: Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed/action HTTP/1.1 Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 111 Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ4cpbq7-FZe5tlM-wZzbVbAOVZUBoDALN-jDR3oTjYmbecruxF26gBgf7H-7apPGlLsjS8syGvTAh16E3MNTp2aRmsER5jHN970SdowY-6KC9Eh6nPbottbkAHcSZegVPyn9W7shwQvD_4fP7HPeyLuoJeu5VjAh5fZBjEmdTtl8kc Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9955856c503245a085710a153078db6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9955856c503245a085710a153078db6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d3e90b070dc24281923ae98f436e8e2f Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-236218528", "metadata": {"image_type": "test"}}} Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '3fc630f6-5a01-40c3-b70d-493c201f39ed', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-236218528', 'metadata': {'image_type': 'test'}}}} Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 03:42:51.101566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.105884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.107453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Returning 404 to user: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:51.108301 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4ad66c75-285b-4098-9e84-c71869e7773b tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "POST /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed/action" status: 404 len: 111 microversion: 2.1 time: 0.060442 Aug 24 03:42:51.115175 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1141/2340] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 24 03:42:51 2022] POST /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:51.121270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75518a7b-aeec-4580-ba24-b0672165dd10 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-963656492", "metadata": {"image_type": "test"}}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:51.123762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75518a7b-aeec-4580-ba24-b0672165dd10 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Failed to fetch instance by id tempest-invalid-1332213810 {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 03:42:51.124730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-75518a7b-aeec-4580-ba24-b0672165dd10 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] HTTP exception thrown: Instance tempest-invalid-1332213810 could not be found. Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75518a7b-aeec-4580-ba24-b0672165dd10 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Request method failure captured: Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/tempest-invalid-1332213810/action HTTP/1.1 Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 111 Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ4cpbq7-FZe5tlM-wZzbVbAOVZUBoDALN-jDR3oTjYmbecruxF26gBgf7H-7apPGlLsjS8syGvTAh16E3MNTp2aRmsER5jHN970SdowY-6KC9Eh6nPbottbkAHcSZegVPyn9W7shwQvD_4fP7HPeyLuoJeu5VjAh5fZBjEmdTtl8kc Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9955856c503245a085710a153078db6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9955856c503245a085710a153078db6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d3e90b070dc24281923ae98f436e8e2f Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-963656492", "metadata": {"image_type": "test"}}} Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance tempest-invalid-1332213810 could not be found. Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'tempest-invalid-1332213810', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-963656492', 'metadata': {'image_type': 'test'}}}} Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1332213810 could not be found. Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:51.126411 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1332213810 could not be found. Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1332213810 could not be found. Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75518a7b-aeec-4580-ba24-b0672165dd10 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Returning 404 to user: Instance tempest-invalid-1332213810 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75518a7b-aeec-4580-ba24-b0672165dd10 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "POST /compute/v2.1/servers/tempest-invalid-1332213810/action" status: 404 len: 101 microversion: 2.1 time: 0.010971 Aug 24 03:42:51.134053 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1200/2341] 10.222.0.58 () {60 vars in 1249 bytes} [Wed Aug 24 03:42:51 2022] POST /compute/v2.1/servers/tempest-invalid-1332213810/action => generated 101 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:51.139781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a6b91cb4-fb50-4813-8abc-0d150902d857 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-964913162"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:51.142563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a6b91cb4-fb50-4813-8abc-0d150902d857 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 03:42:51.143196 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-a6b91cb4-fb50-4813-8abc-0d150902d857 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a6b91cb4-fb50-4813-8abc-0d150902d857 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Request method failure captured: Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 56 Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ4cpbq7-FZe5tlM-wZzbVbAOVZUBoDALN-jDR3oTjYmbecruxF26gBgf7H-7apPGlLsjS8syGvTAh16E3MNTp2aRmsER5jHN970SdowY-6KC9Eh6nPbottbkAHcSZegVPyn9W7shwQvD_4fP7HPeyLuoJeu5VjAh5fZBjEmdTtl8kc Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9955856c503245a085710a153078db6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9955856c503245a085710a153078db6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d3e90b070dc24281923ae98f436e8e2f Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: {"createImage": {"name": "tempest-test-snap-964913162"}} Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-964913162'}}} Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.145288 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.150087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a6b91cb4-fb50-4813-8abc-0d150902d857 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:51.152676 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a6b91cb4-fb50-4813-8abc-0d150902d857 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.018839 Aug 24 03:42:51.153868 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1142/2342] 10.222.0.58 () {60 vars in 1275 bytes} [Wed Aug 24 03:42:51 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:42:51.166065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f38bb5f0-7c52-4ba6-b290-d7ccf1ad9d8c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-99890497"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:51.169618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f38bb5f0-7c52-4ba6-b290-d7ccf1ad9d8c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 03:42:51.170137 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f38bb5f0-7c52-4ba6-b290-d7ccf1ad9d8c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f38bb5f0-7c52-4ba6-b290-d7ccf1ad9d8c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Request method failure captured: Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 55 Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ4cpbq7-FZe5tlM-wZzbVbAOVZUBoDALN-jDR3oTjYmbecruxF26gBgf7H-7apPGlLsjS8syGvTAh16E3MNTp2aRmsER5jHN970SdowY-6KC9Eh6nPbottbkAHcSZegVPyn9W7shwQvD_4fP7HPeyLuoJeu5VjAh5fZBjEmdTtl8kc Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9955856c503245a085710a153078db6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9955856c503245a085710a153078db6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d3e90b070dc24281923ae98f436e8e2f Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: {"createImage": {"name": "tempest-test-snap-99890497"}} Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-99890497'}}} Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.171989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f38bb5f0-7c52-4ba6-b290-d7ccf1ad9d8c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:51.177751 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f38bb5f0-7c52-4ba6-b290-d7ccf1ad9d8c tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011516 Aug 24 03:42:51.183847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:51.184503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:51.188091 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1201/2343] 10.222.0.58 () {60 vars in 1281 bytes} [Wed Aug 24 03:42:51 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:51.193912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.194415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.194857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.195630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.196123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.196513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.217533 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] HTTP exception thrown: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Request method failure captured: Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed HTTP/1.1 Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ4cpbq7-FZe5tlM-wZzbVbAOVZUBoDALN-jDR3oTjYmbecruxF26gBgf7H-7apPGlLsjS8syGvTAh16E3MNTp2aRmsER5jHN970SdowY-6KC9Eh6nPbottbkAHcSZegVPyn9W7shwQvD_4fP7HPeyLuoJeu5VjAh5fZBjEmdTtl8kc Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9955856c503245a085710a153078db6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9955856c503245a085710a153078db6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d3e90b070dc24281923ae98f436e8e2f Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '3fc630f6-5a01-40c3-b70d-493c201f39ed'} Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:51.220615 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Returning 404 to user: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:51.224406 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f62f2cc4-5922-437b-b069-23eb6dcbbbd1 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 404 len: 111 microversion: 2.1 time: 0.043662 Aug 24 03:42:51.225272 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1143/2344] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:51 2022] DELETE /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:42:51.237230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:51.238206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] [instance: 3fc630f6-5a01-40c3-b70d-493c201f39ed] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:51.264064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.265029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.265374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.266219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.266779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.267620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.298462 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] HTTP exception thrown: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Request method failure captured: Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed HTTP/1.1 Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ4cpbq7-FZe5tlM-wZzbVbAOVZUBoDALN-jDR3oTjYmbecruxF26gBgf7H-7apPGlLsjS8syGvTAh16E3MNTp2aRmsER5jHN970SdowY-6KC9Eh6nPbottbkAHcSZegVPyn9W7shwQvD_4fP7HPeyLuoJeu5VjAh5fZBjEmdTtl8kc Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9955856c503245a085710a153078db6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9955856c503245a085710a153078db6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9955856c503245a085710a153078db6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9955856c503245a085710a153078db6c Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269651632 Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d3e90b070dc24281923ae98f436e8e2f Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesNegativeTestJSON-1269651632-project Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '3fc630f6-5a01-40c3-b70d-493c201f39ed'} Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:51.302804 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.309778 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:51.309778 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:51.309778 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:51.309778 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:51.309778 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:51.309778 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. Aug 24 03:42:51.309778 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:42:51.309778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] Returning 404 to user: Instance 3fc630f6-5a01-40c3-b70d-493c201f39ed could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:51.315389 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-523d0afc-0cd4-4c91-aefe-3f83ca34d790 tempest-ImagesNegativeTestJSON-1269651632 tempest-ImagesNegativeTestJSON-1269651632-project] 10.222.0.58 "GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed" status: 404 len: 111 microversion: 2.1 time: 0.079672 Aug 24 03:42:51.317610 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1202/2345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:51 2022] GET /compute/v2.1/servers/3fc630f6-5a01-40c3-b70d-493c201f39ed => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:51.380752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:51.381639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:51.396324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:51.399194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.400087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.400922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.402132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.402952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.403803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.529395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f43c2ace-2186-47b9-a636-5c5e08c19880 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1022d8eee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:51.558722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:51.607003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:51.610957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:51.614293 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ed55e287-dff5-4690-89a2-a7d757f54241 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.239724 Aug 24 03:42:51.615307 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1144/2346] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:51 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:51.624885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:51.626362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:51.642886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.643682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.644487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.647933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.648679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.649271 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f43c2ace-2186-47b9-a636-5c5e08c19880 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.126856 Aug 24 03:42:51.649402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.652759 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1203/2347] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:51 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:52.004400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:52.005382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:52.011512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7d500993-3cc4-4223-a732-23c091a25426 req-c1afe6d8-f887-405d-ac23-1131382cf53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc630f6-5a01-40c3-b70d-493c201f39ed", "name": "network-vif-deleted", "tag": "44017fe9-496a-4017-b16a-3323fd108f1f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:52.024724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d500993-3cc4-4223-a732-23c091a25426 req-c1afe6d8-f887-405d-ac23-1131382cf53c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.025205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d500993-3cc4-4223-a732-23c091a25426 req-c1afe6d8-f887-405d-ac23-1131382cf53c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.025879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d500993-3cc4-4223-a732-23c091a25426 req-c1afe6d8-f887-405d-ac23-1131382cf53c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.040212 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7d500993-3cc4-4223-a732-23c091a25426 req-c1afe6d8-f887-405d-ac23-1131382cf53c service nova] Creating event network-vif-deleted:44017fe9-496a-4017-b16a-3323fd108f1f for instance 3fc630f6-5a01-40c3-b70d-493c201f39ed on n-h1-846470-15 Aug 24 03:42:52.045673 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7d500993-3cc4-4223-a732-23c091a25426 req-c1afe6d8-f887-405d-ac23-1131382cf53c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041943 Aug 24 03:42:52.046840 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1204/2348] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:52.090514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:52.101210 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-78825325-ba92-42d5-9504-69e3068cd0bd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1318 microversion: 2.1 time: 0.483918 Aug 24 03:42:52.124930 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1145/2349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:51 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:52.649470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:52.650569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:52.675934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-962c38d2-d1be-4133-9705-26b28fc7883d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f102b4c0ca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:52.676657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.676830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.679142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.691277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.692197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.692874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.703326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:52.800562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:52.848115 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-962c38d2-d1be-4133-9705-26b28fc7883d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.178748 Aug 24 03:42:52.850691 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1146/2350] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:52 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:52.929893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:52.939293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:52.940855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:52.942067 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8c8dda9-a8ee-4600-9e5e-cb41bc010185 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.300031 Aug 24 03:42:52.942643 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1205/2351] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:52 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:53.134101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:53.135074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:53.145092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.146399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.147278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.149918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.151196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.153152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.558522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:53.569764 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72564df0-361a-4fe6-9d22-6ccd96507218 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1318 microversion: 2.1 time: 0.440895 Aug 24 03:42:53.570508 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1147/2352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:53 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:53.870985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c386f94-f184-4451-8471-b5231f3af96e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10227974c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:53.968546 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c386f94-f184-4451-8471-b5231f3af96e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.101413 Aug 24 03:42:53.969666 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1206/2353] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:53 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:53.975899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:53.976533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:53.988336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.992306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.994252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.997515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.998281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.998798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:54.344041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:54.380857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:54.385747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:54.391602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ec09c8a-1a0e-42de-ab2d-f4e9c73c3d0e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.420251 Aug 24 03:42:54.407760 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1148/2354] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:53 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:54.605094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:54.607210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:54.636860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:54.639312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:54.641431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:54.649406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:54.651364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:54.652376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:54.993044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ec05a76-ba9c-4b79-9dc4-e0fe63256ff1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10343e01f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:55.199183 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ec05a76-ba9c-4b79-9dc4-e0fe63256ff1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.212740 Aug 24 03:42:55.200682 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1149/2355] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:54 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:55.434555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:55.435696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:55.447419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:55.448387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:55.449060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:55.452055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:55.452885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:55.455245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:55.500616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:55.518521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f4b84d1-7b67-4633-ab8f-6068f22d9198 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1318 microversion: 2.1 time: 0.928813 Aug 24 03:42:55.520803 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1207/2356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:54 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1318 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:55.581130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:55.594879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:55.597427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:55.599592 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0c87ddf-f0fa-4bb2-9741-b0bf0ad7380e tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.169677 Aug 24 03:42:55.601285 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1150/2357] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:55 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:56.215922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-04cab68e-7e81-4bb6-8cff-cbf75cc68508 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10230a4700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:56.360848 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-04cab68e-7e81-4bb6-8cff-cbf75cc68508 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.149547 Aug 24 03:42:56.370446 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1208/2358] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:56 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:56.545554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:56.547914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:56.561616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:56.564447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:56.566719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:56.568039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:56.569712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:56.570383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:56.635104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:56.636186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:56.662997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:56.665555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:56.666983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:56.672331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:56.679849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:56.680969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:56.888036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:56.905769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:56.925313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:56.930186 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-759656f9-309b-4952-a4c4-be9800095460 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.304171 Aug 24 03:42:56.937407 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1209/2359] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:56 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:57.045884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-16983492-594b-4641-a928-ffbfdcb4d68f req-e2c07f80-ea17-42d9-b410-be0f4dbec4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b75085c-e1de-4465-9ddb-1dba6c2519d9", "name": "network-vif-plugged", "status": "completed", "tag": "d7168410-b5e0-40ba-9272-6acda36b915d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:57.106805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-16983492-594b-4641-a928-ffbfdcb4d68f req-e2c07f80-ea17-42d9-b410-be0f4dbec4cf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:57.111289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-16983492-594b-4641-a928-ffbfdcb4d68f req-e2c07f80-ea17-42d9-b410-be0f4dbec4cf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:57.113724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-16983492-594b-4641-a928-ffbfdcb4d68f req-e2c07f80-ea17-42d9-b410-be0f4dbec4cf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:57.175286 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-16983492-594b-4641-a928-ffbfdcb4d68f req-e2c07f80-ea17-42d9-b410-be0f4dbec4cf service nova] Creating event network-vif-plugged:d7168410-b5e0-40ba-9272-6acda36b915d for instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 on n-h2-846470-15 Aug 24 03:42:57.191235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:57.238623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-16983492-594b-4641-a928-ffbfdcb4d68f req-e2c07f80-ea17-42d9-b410-be0f4dbec4cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187129 Aug 24 03:42:57.244673 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1210/2360] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:57.249937 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b572d4c2-581c-4525-84ed-960a9382042d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1318 microversion: 2.1 time: 0.708317 Aug 24 03:42:57.261523 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1151/2361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:56 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1318 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:57.397464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07c2cb7a-d71f-4e1e-9447-ccbccb5fb325 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1023697a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:57.540921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07c2cb7a-d71f-4e1e-9447-ccbccb5fb325 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.164471 Aug 24 03:42:57.546243 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1211/2362] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:57 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:57.970977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:57.972362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:57.992201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:57.993095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:57.994814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:57.996707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:57.998076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:58.000143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:58.160237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:58.182032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:58.188442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:58.192080 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0edade2d-6454-4ad0-8864-1f127d5607d6 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.227743 Aug 24 03:42:58.207240 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1152/2363] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:57 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:58.289436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:58.290393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:58.307420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:58.311058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:58.312023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:58.315856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:58.320473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:58.322782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:58.564916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a59c0862-671c-41a7-a9eb-4ee7b09a88a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f103433a8b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:58.707003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:58.724893 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a59c0862-671c-41a7-a9eb-4ee7b09a88a1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.166650 Aug 24 03:42:58.742200 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15924339-64b7-4719-a226-afac6e924999 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1318 microversion: 2.1 time: 0.455066 Aug 24 03:42:58.751591 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1153/2364] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:58 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:58.759414 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1212/2365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:58 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:59.235560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:59.245213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:59.266976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:59.268191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:59.269020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:59.270231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:59.271148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:59.271949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:59.476123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:59.491002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:59.494392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:59.496250 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8e8b467e-0042-46eb-bb47-fed25a72d6e3 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.273217 Aug 24 03:42:59.498593 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1154/2366] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:59 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:59.744795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e7a08f7-509f-4d72-b28e-a32e80152fd2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342c91f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:59.778160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:59.779039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:59.803468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:59.804076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:59.804567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:59.805340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:59.805812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:59.806243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:59.859269 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e7a08f7-509f-4d72-b28e-a32e80152fd2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.118764 Aug 24 03:42:59.866108 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1213/2367] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:59 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:00.179453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:00.199375 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cdee5b78-76fe-44a0-baae-d8227c89c2dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1509 microversion: 2.1 time: 0.426030 Aug 24 03:43:00.216331 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1155/2368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:59 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:00.262956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:00.266774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:00.289363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:00.289868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:00.290308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:00.291038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:00.296611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:00.297616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:00.524398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:00.526019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:00.539356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:00.542383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:00.543161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:00.544338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:00.544685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:00.545111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:00.609096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:00.616505 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fb48c821-ad8b-4b42-8d17-6f30164477aa tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1509 microversion: 2.1 time: 0.381510 Aug 24 03:43:00.617683 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1214/2369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:00 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:00.654321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:00.658327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:00.669991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:00.671000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:00.671628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:00.672879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:00.673756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:00.674411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:00.765560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:00.793166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:00.801184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:00.801184 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9229e790-50f0-4321-92c6-b5a65fd9e041 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.275229 Aug 24 03:43:00.801184 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1156/2370] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:00 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:43:00.860915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:43:00.861370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:43:00.862172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:43:00.862890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:43:00.863683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:43:00.893777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d3fab0d2-8c99-42ce-8742-8b3bf60e5a13 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342eca60>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:00.993211 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d3fab0d2-8c99-42ce-8742-8b3bf60e5a13 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.105326 Aug 24 03:43:00.994605 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1157/2371] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:00 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:00.995106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:01.021781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.022850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.024616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.028920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.030328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.031203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.139189 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f7a68f5c-247a-4f85-a766-ab4dafb0b93b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "POST /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9/action" status: 202 len: 1111 microversion: 2.1 time: 0.488513 Aug 24 03:43:01.154359 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1215/2372] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:43:00 2022] POST /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9/action => generated 1111 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 03:43:01.161981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:01.162873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:01.183615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.184944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.185573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.188261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.189661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.190357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.699446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:01.714711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-56c45d77-00a4-4243-92f3-2fe5739c594b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.553376 Aug 24 03:43:01.715508 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1158/2373] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:01 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:01.829767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:01.833970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:01.844108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.844645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.845358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.846631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:01.847198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:01.847854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:01.956765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:01.971442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:01.973046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:01.974489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0132b33-a182-4bdb-9b71-3da6c9cc4264 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.153013 Aug 24 03:43:01.974985 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1216/2374] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:01 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:02.022960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-904981c1-5b3d-410b-9bc2-1f9adf44a5c2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342ec1f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:02.117774 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-904981c1-5b3d-410b-9bc2-1f9adf44a5c2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.103096 Aug 24 03:43:02.120031 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1159/2375] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:02 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:02.739399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:02.740107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:02.759883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:02.767173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:02.768090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:02.769344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:02.770004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:02.770640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.001339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:03.002796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:03.012737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.014437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.015608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.017280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.018484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.019549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.234443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:03.245545 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-36380333-6d3b-4655-8115-efd8c8ec20be tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.511143 Aug 24 03:43:03.246848 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1217/2376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:02 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:03.253924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-193b2ba2-8e69-4c01-aa99-a8b3416d3331 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10230a4ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:03.302523 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-193b2ba2-8e69-4c01-aa99-a8b3416d3331 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.054192 Aug 24 03:43:03.303429 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1218/2377] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:03 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:03.372967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:03.402656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:03.423276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:03.428111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c510cec-6800-4fed-a4f2-fa85b348ddad tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:03.437225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c510cec-6800-4fed-a4f2-fa85b348ddad tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.438202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c510cec-6800-4fed-a4f2-fa85b348ddad tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.438916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c510cec-6800-4fed-a4f2-fa85b348ddad tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.452306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:03.470066 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3e61f409-868a-4936-8828-b5d8d4165d96 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1364 microversion: 2.47 time: 0.466958 Aug 24 03:43:03.477412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1160/2378] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:02 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1364 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:03.554377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1c510cec-6800-4fed-a4f2-fa85b348ddad tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Going to try to stop instance {{(pid=122536) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:43:03.640020 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c510cec-6800-4fed-a4f2-fa85b348ddad tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/action" status: 202 len: 0 microversion: 2.1 time: 0.216055 Aug 24 03:43:03.641772 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1219/2379] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:43:03 2022] POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:43:03.662779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:03.666313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:03.679067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.679565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.680302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.681242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:03.681909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:03.682536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:03.901323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:03.918106 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-56c7ef15-0370-4860-b2b4-3546fac773a4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.271196 Aug 24 03:43:03.927355 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1161/2380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:03 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:04.285189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:04.286039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:04.301865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.302372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.302802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.305701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.309781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.310505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.332480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-13608635-4b65-47c4-b055-31c09b22e236 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f103432c0d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:04.435820 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-13608635-4b65-47c4-b055-31c09b22e236 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.111387 Aug 24 03:43:04.436869 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1162/2381] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:04 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:04.501781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:04.502512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:04.519889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.520768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.521425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.522402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.524923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.525678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.630219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:04.644124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:04.647449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:04.649252 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c1f57f78-61cc-47ec-b142-7f2820f41318 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1370 microversion: 2.47 time: 0.154132 Aug 24 03:43:04.651264 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1163/2382] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:04 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:04.786276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:04.824147 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-136e694d-0354-472f-8e5f-3b69a9164360 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.544836 Aug 24 03:43:04.846105 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1220/2383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:04 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:04.960294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:04.966643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:04.992611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.993581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.994323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:04.995282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:04.996272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:04.998616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:05.367551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:05.382767 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-560935a6-cdf1-454d-b88b-b48f8ad723cf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.435157 Aug 24 03:43:05.383590 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1164/2384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:04 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:05.472431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d197f890-a3fb-45a9-9e78-ebf782b5b91f tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1022d8e040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:05.574868 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d197f890-a3fb-45a9-9e78-ebf782b5b91f tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.106804 Aug 24 03:43:05.575965 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1221/2385] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:05 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:05.675420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:05.677250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:05.684650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:05.685613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:05.686495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:05.687709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:05.688455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:05.689094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:05.823529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:05.839658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:05.842524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:05.843967 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-22f49609-a9c5-45ec-a2f4-2bda9663a00a tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1370 microversion: 2.47 time: 0.173180 Aug 24 03:43:05.857104 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1165/2386] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:05 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:05.865385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:05.865385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:05.867512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:05.880598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:05.883069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:05.883733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:05.885568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:05.886097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:05.887808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:06.278741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:06.295571 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bef76f0b-f0d6-406c-a248-411afadc0db1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.436533 Aug 24 03:43:06.296456 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1222/2387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:05 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:06.407530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:06.408304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:06.436765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:06.437594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:06.438242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:06.439294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:06.440290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:06.440614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:06.600143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f367180-9a6c-4a91-b197-60ddfe8029b4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10233131f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:06.732734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:06.746496 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-679536c3-a6a3-49de-8ebc-64096538b892 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.343513 Aug 24 03:43:06.748151 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1166/2388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:06 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:06.770257 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f367180-9a6c-4a91-b197-60ddfe8029b4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.182808 Aug 24 03:43:06.771126 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1223/2389] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:06 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:06.875092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:06.876239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:06.893181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:06.896590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:06.897512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:06.903187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:06.904207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:06.905830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:07.000147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:07.025947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:07.029701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:07.032535 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0ecee0b4-bcb9-4c2d-8f9a-d5ef8b1687ee tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1370 microversion: 2.47 time: 0.162735 Aug 24 03:43:07.044446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1167/2390] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:06 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:07.323762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:07.328706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:07.399518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:07.402998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:07.406508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:07.410446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:07.411432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:07.414289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:07.792539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:07.794150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:07.800215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:07.811393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c016e450-45b1-4be7-bff1-7c9ac26100f4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.495917 Aug 24 03:43:07.814763 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1224/2391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:07 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:07.827990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-234797c2-0ea3-41fc-b141-1a5898d2b2ca tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10227b5700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:07.829029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:07.841164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:07.842519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:07.866552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:07.868063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:07.869429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:08.081362 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-234797c2-0ea3-41fc-b141-1a5898d2b2ca tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.258986 Aug 24 03:43:08.088576 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1225/2392] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:07 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:08.108757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:08.112193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:08.131411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:08.133286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:08.135319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:08.137774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:08.140362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:08.143491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:08.350280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:08.368019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:08.371601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:08.373285 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9c2d04cd-156f-47db-ad2c-1f84d156c57b tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1370 microversion: 2.47 time: 0.278656 Aug 24 03:43:08.374413 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1226/2393] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:08 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:08.493083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:08.503681 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1770ecfb-2c3d-47d5-b0a2-b81051a02e80 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.720840 Aug 24 03:43:08.506932 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1168/2394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:07 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:08.840971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:08.841768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:08.874245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:08.877012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:08.881295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:08.885429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:08.886388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:08.890851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.105423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45852752-0b53-46cf-820a-8f4c81520c66 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034416160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:09.192446 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45852752-0b53-46cf-820a-8f4c81520c66 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.092686 Aug 24 03:43:09.204828 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1169/2395] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:09 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:09.286777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:09.296198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:09.311972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7f8f9af6-d519-468f-9e74-f318415c3786 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.474572 Aug 24 03:43:09.313880 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1227/2396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:08 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:09.410107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:09.411015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:09.428152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.428946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.429676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.433939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.434895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.435613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.541635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:09.549513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:09.556197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:09.565629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:09.570609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:09.576094 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dadc1d5b-5eb7-4dfe-8a25-96034f07dbc7 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1355 microversion: 2.47 time: 0.171184 Aug 24 03:43:09.578731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.580434 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1170/2397] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:09 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1355 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:09.587025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.588175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.589759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.590878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.591995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.608250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:09.623301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:09.625444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Searching by: {'deleted': False, 'project_id': 'a91a44062a0e4189999fef8341606f67'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:43:09.635050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.635940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.637641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.639010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.641722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.642629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.833717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:43:09.949044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:09.967817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.968586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.969211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.987268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:09.989574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:10.027842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:10.046410 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b7476ad-8aa3-46bc-9442-1d489507f531 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.506083 Aug 24 03:43:10.047363 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1228/2398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:09 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:10.071605 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e922a079-dfb6-4808-a769-89d34b795a80 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.467907 Aug 24 03:43:10.080613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1171/2399] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 24 03:43:09 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:10.126126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:10.127283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:10.136376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:10.137623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:10.138424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:10.139440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:10.140129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:10.140756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:10.186498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:43:10.224198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de625c40-7ffa-471b-a07d-72022a16373a tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f103432c940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:10.333733 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de625c40-7ffa-471b-a07d-72022a16373a tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.115655 Aug 24 03:43:10.334835 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1172/2400] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:10 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:10.362292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:10.362884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:10.380370 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0fb0ce0b-9ea7-41e8-9a50-27bd50d79774 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 204 len: 0 microversion: 2.47 time: 0.257926 Aug 24 03:43:10.383764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1229/2401] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:43:10 2022] DELETE /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:43:10.388759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:10.389406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:10.389951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:10.390764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:10.391228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:10.391688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:10.404783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:10.410421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:10.434119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:10.434970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:10.435633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:10.436700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:10.437408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:10.438048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:10.619028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:10.633947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:10.641543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:10.643120 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-45448b26-95be-42d9-b4c3-a67ecff67470 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1361 microversion: 2.47 time: 0.256033 Aug 24 03:43:10.644087 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1230/2402] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:10 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:11.056978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:11.088707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:11.090703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:11.122324 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0148c247-d697-493f-a135-800d57945a1f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.765479 Aug 24 03:43:11.132182 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1173/2403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:10 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:11.145961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.147952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.151359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.159457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.160797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.163970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.369626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-df57dd8d-88e3-42ad-abd0-38e409f5cae1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f103432cd30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:11.463462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-df57dd8d-88e3-42ad-abd0-38e409f5cae1 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.109276 Aug 24 03:43:11.475262 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1174/2404] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:11 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:11.506625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:11.529457 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fa561f6f-c4d9-4119-8cd3-91b59b1bf937 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.449505 Aug 24 03:43:11.534260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1231/2405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:11 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:11.668836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:11.669410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:11.676530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.685833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.686645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.687884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.688594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.689273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.696369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1658837405", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "6b7c20d5-6e0c-43b0-8505-bb28069b1895"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:11.790329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:11.801009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:11.802602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:11.803919 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9b13f6e-b3b7-49ee-b219-8a3df10d46cc tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1361 microversion: 2.47 time: 0.139377 Aug 24 03:43:11.808674 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1232/2406] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:11 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:43:11.808969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] validate_networks() for [('6b7c20d5-6e0c-43b0-8505-bb28069b1895', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:43:12.156441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:12.157508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:12.181934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:12.182589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:12.186511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:12.187907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:12.189017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:12.190085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:12.531406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:12.543844 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-872183a0-aae5-4e1b-bfe1-65d825ad2d86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.392562 Aug 24 03:43:12.573323 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1233/2407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:12 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:12.574342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:43:12.575476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:43:12.576163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:43:12.577023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:43:12.578405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:43:12.590532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a8967d6-454a-4915-a574-1c5a5d13f834 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1023313280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:12.617628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:12.619390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:12.620938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:12.627404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:12.630668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:12.631432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:12.662876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:43:12.684372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for user 69a1414940b14e459202a86bd8e9027b and project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:43:12.721042 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a8967d6-454a-4915-a574-1c5a5d13f834 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1421 microversion: 2.1 time: 0.140417 Aug 24 03:43:12.724502 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1234/2408] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:12 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1421 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:12.750962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:12.756209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:12.769982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:43:12.792598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:43:12.797741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:12.801822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:12.804309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:12.808106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:12.812618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:12.816936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:12.985955 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c417bb79-9fa6-4dbc-b407-75ba1ae91605 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501848 Aug 24 03:43:12.992235 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1175/2409] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:43:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:43:13.017480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:13.019112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:13.035492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:13.037786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:13.037786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:13.039077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:13.039478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:13.040541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:13.158498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:13.159361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:13.160908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:13.161695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lazy-loading 'fault' on Instance uuid e0b80bc2-ba46-4426-9298-7d2b82346533 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:43:13.239982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:13.261065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f756e18-5507-426e-a066-754c37f46b04 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.532925 Aug 24 03:43:13.264679 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1235/2410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:12 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:13.272190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58c58352-d1d9-41c8-98ea-a43e73d8bb39 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:13.281441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-58c58352-d1d9-41c8-98ea-a43e73d8bb39 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:13.396803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:13.431325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:13.436674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:13.439464 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3919568c-6b4f-4b21-9879-473caf75e532 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 200 len: 1366 microversion: 2.47 time: 0.444720 Aug 24 03:43:13.440100 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1176/2411] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:12 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:13.455224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-58c58352-d1d9-41c8-98ea-a43e73d8bb39 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:13.468190 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58c58352-d1d9-41c8-98ea-a43e73d8bb39 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1215 microversion: 2.1 time: 0.200432 Aug 24 03:43:13.469290 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1236/2412] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:13 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:13.576051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:13.576873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:13.585679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:13.586512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:13.587132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:13.587936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:13.588398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:13.588851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:13.739378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d33ab149-d073-4ef2-9826-6f9d9c35af24 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1022d8edc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:13.858288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:13.869226 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d33ab149-d073-4ef2-9826-6f9d9c35af24 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1430 microversion: 2.1 time: 0.132343 Aug 24 03:43:13.870590 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1237/2413] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:13 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1430 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:13.874003 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee1a9dcc-2e89-4e02-93d1-41cbda3df948 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.303098 Aug 24 03:43:13.885663 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1177/2414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:13 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:13.899603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03217a96-49fe-444e-8e20-7147c86bd746 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10230a43a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:13.975751 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03217a96-49fe-444e-8e20-7147c86bd746 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 200 len: 1430 microversion: 2.1 time: 0.087881 Aug 24 03:43:13.977845 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1238/2415] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:13 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 1430 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:13.994611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:13.995473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:14.004005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.004852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.005425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.006281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.006921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.007861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.240524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:14.250675 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-77943a47-7d4e-4584-ab0f-01e2705da4fa tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1477 microversion: 2.1 time: 0.261615 Aug 24 03:43:14.251771 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1178/2416] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:13 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:14.290156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:14.290893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:14.298133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.299113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.299836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.300798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.301349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.301886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.475065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:14.487640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:14.488531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: e0b80bc2-ba46-4426-9298-7d2b82346533] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:14.490598 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f953a03c-eabf-4f38-bf74-596bd80570bb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.206592 Aug 24 03:43:14.493358 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1239/2417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:14 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:14.496767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.497577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.498677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.499469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:14.500080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:14.500617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.501255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.501867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.507249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.509251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.509797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.510584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.511070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.511516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.521632 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] HTTP exception thrown: Instance e0b80bc2-ba46-4426-9298-7d2b82346533 could not be found. Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Request method failure captured: Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 HTTP/1.1 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ4ZXkvQRzU_FeBogl_F_La68mTOFORUrr8bkYlBV85lFgtDYO9iMR30QZV0H1bqn4DliguzS1QPvLjMmieeDGs2Cr5QzfROhmpImo7hUrseDx-01DvuR96JuCjeb0zptcX80JJme_LEOFc__SbfK0nCrNtRxdlombs4ZN6FEv6BScs Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a91a44062a0e4189999fef8341606f67 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerShowV247Test-1749780869 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a91a44062a0e4189999fef8341606f67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a91a44062a0e4189999fef8341606f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a91a44062a0e4189999fef8341606f67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a91a44062a0e4189999fef8341606f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerShowV247Test-1749780869 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a91a44062a0e4189999fef8341606f67 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerShowV247Test-1749780869 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerShowV247Test-1749780869-project Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: bd02198499fd40209412a89e65861f55 Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerShowV247Test-1749780869-project Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e0b80bc2-ba46-4426-9298-7d2b82346533 could not be found. Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e0b80bc2-ba46-4426-9298-7d2b82346533'} Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b80bc2-ba46-4426-9298-7d2b82346533 could not be found. Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b80bc2-ba46-4426-9298-7d2b82346533 could not be found. Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:14.523343 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:14.530060 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:14.530060 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:14.530060 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:14.530060 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:14.530060 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:14.530060 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b80bc2-ba46-4426-9298-7d2b82346533 could not be found. Aug 24 03:43:14.530060 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:14.530060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Returning 404 to user: Instance e0b80bc2-ba46-4426-9298-7d2b82346533 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:14.535792 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-32656aab-0777-4ffe-80c8-595981a62540 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533" status: 404 len: 111 microversion: 2.47 time: 0.045906 Aug 24 03:43:14.535792 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1179/2418] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:14 2022] GET /compute/v2.1/servers/e0b80bc2-ba46-4426-9298-7d2b82346533 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:43:14.542138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:14.543321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: 03447a2d-3e50-4b01-bb60-6d5b26772676] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:14.551886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.552681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.553193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.554321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.554896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.555347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.590609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: 03447a2d-3e50-4b01-bb60-6d5b26772676] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:43:14.607275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:14.642434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dd69e7e2-34dc-4a97-9f62-1ecbdb8a373d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1211 microversion: 2.1 time: 0.149599 Aug 24 03:43:14.653366 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1240/2419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:14 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:14.657773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:14.742194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5cb8620-f692-4bfe-8369-ae763bb6a451 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676" status: 204 len: 0 microversion: 2.47 time: 0.205172 Aug 24 03:43:14.743050 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1180/2420] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:43:14 2022] DELETE /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:43:14.764176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:14.766316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: 03447a2d-3e50-4b01-bb60-6d5b26772676] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:14.773666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.774175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.774614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.777004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.777509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.778417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.893053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:14.905448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:14.906149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:14.907136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:14.911423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:14.915275 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7bc570e-24dc-4e11-9645-db48bb51faf1 tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676" status: 200 len: 1362 microversion: 2.47 time: 0.161614 Aug 24 03:43:14.919805 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1241/2421] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:14 2022] GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:14.920545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.921139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.922019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.923552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.924455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.925204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:15.200951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:15.215365 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c8bf1ff1-1377-4f86-a4df-2e5abf70cbec tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.318480 Aug 24 03:43:15.228809 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1181/2422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:14 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:15.278842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:15.280896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:15.293118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:15.296831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:15.298004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:15.299685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:15.300824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:15.302020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:15.529367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:15.532796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:15.551495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:15.563757 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4af14437-d93b-46d0-b434-889a39e8c728 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1464 microversion: 2.1 time: 0.293111 Aug 24 03:43:15.566502 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1242/2423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:15 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:15.571620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:15.572815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:15.573675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:15.575355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:15.576655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:15.579250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:15.603111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dccdd8b0-29c4-4036-a29a-008eda90822e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f102367e550>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:15.709203 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dccdd8b0-29c4-4036-a29a-008eda90822e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/940ed0d3-700a-4ac5-a26b-97e9311e8ce3" status: 200 len: 784 microversion: 2.1 time: 0.114339 Aug 24 03:43:15.710529 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1243/2424] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:15 2022] GET /compute/v2.1/images/940ed0d3-700a-4ac5-a26b-97e9311e8ce3 => generated 784 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:43:15.720619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:15.721286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:15.754149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:15.755155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:15.756831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:15.758100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:15.758938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:15.759697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:15.867643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:15.878793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f90873e1-0488-4d33-9e9b-4400685b5d95 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1273 microversion: 2.1 time: 0.165272 Aug 24 03:43:15.879920 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1244/2425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:15 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:15.885510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-538d5e12-0a81-4f1d-86ce-481a87db99b6 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:15.896225 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-538d5e12-0a81-4f1d-86ce-481a87db99b6 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014691 Aug 24 03:43:15.897265 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1245/2426] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:43:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:15.912170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e40f83c-2589-45cd-98eb-c6d2adbf5ce3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342c91f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:16.248449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:16.260811 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-63049a29-aade-4303-8968-90c3719271f2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.746112 Aug 24 03:43:16.262080 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1182/2427] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:15 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:16.269858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:16.271280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: 03447a2d-3e50-4b01-bb60-6d5b26772676] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:16.280863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.281332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.281863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.282804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.283345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.283930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.391137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:16.404046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:16.406881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:16.409340 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c7f86ae0-fdb2-4c99-9983-a419d53d6c0f tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676" status: 200 len: 1362 microversion: 2.47 time: 0.145761 Aug 24 03:43:16.410745 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1183/2428] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:16 2022] GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:16.431784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:16.433513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:16.445453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.446146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.446900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.448039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.449535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.449535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.816575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:16.836755 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87c81595-2140-4755-ad39-dc24152677fd tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.424595 Aug 24 03:43:16.838277 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1184/2429] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:16 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:16.929677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:16.932947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:16.953301 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e40f83c-2589-45cd-98eb-c6d2adbf5ce3 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "DELETE /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 204 len: 0 microversion: 2.1 time: 1.045151 Aug 24 03:43:16.955763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.956902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.957175 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1246/2430] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:15 2022] DELETE /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:43:16.957462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.958535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.959050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.960422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.991319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9de8c53-b9f8-490f-9df4-db3eb1a88ae2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10227b5820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:17.046553 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d9de8c53-b9f8-490f-9df4-db3eb1a88ae2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] HTTP exception thrown: Image not found. Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9de8c53-b9f8-490f-9df4-db3eb1a88ae2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Request method failure captured: Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 HTTP/1.1 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ3_1DjdzhXQoHhqw7qX1MQqsTWsMMr55Hqh3791enzbEdLlbir3oPy27a6Y75u3lNqFxIpmqbvpQcIu3ycTKYdVtGvgI1iWIAqsPj_OrxJ9I-Rc8pQInu92Wdywj8Rt1r3yC3_ePVZdtMUVV7Q3XYidVUb4zsecIFWMk7uWCytBziY Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2b5d14e6320f4a2587cb3ee64e7e98c9 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2b5d14e6320f4a2587cb3ee64e7e98c9 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerTestJSON-102057375-project Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: ae771f274012411391a0563ca2eb8cbc Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerTestJSON-102057375-project Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: exception: Image not found. Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '66825000-eaf4-402f-a951-83a21017ce03'} Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 66825000-eaf4-402f-a951-83a21017ce03 Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 03:43:17.050619 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66825000-eaf4-402f-a951-83a21017ce03 could not be found. Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:17.057329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9de8c53-b9f8-490f-9df4-db3eb1a88ae2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Returning 404 to user: Image not found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:17.060612 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d9de8c53-b9f8-490f-9df4-db3eb1a88ae2 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 404 len: 62 microversion: 2.1 time: 0.079517 Aug 24 03:43:17.065889 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1247/2431] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:16 2022] GET /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:43:17.076398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1311300116"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:17.090391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:17.102142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.102712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.103158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.104298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.105013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.105629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.199460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:17.222635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e314449e-9893-473d-9548-7693f8735b1c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1273 microversion: 2.1 time: 0.302178 Aug 24 03:43:17.228635 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1185/2432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:16 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:17.321503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:17.331892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:17.358688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.361485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.362976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.366574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.371283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.373610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.472826 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-921a932c-8c1b-4d2e-9391-1d0104b7ab20 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "POST /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b/action" status: 202 len: 0 microversion: 2.1 time: 0.401442 Aug 24 03:43:17.486640 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1248/2433] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:43:17 2022] POST /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 24 03:43:17.510105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:17.511208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: 03447a2d-3e50-4b01-bb60-6d5b26772676] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:17.528215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.528800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.529399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.530968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.531629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.532434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.569641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:17.614045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.614995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.615997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.616947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lazy-loading 'fault' on Instance uuid 03447a2d-3e50-4b01-bb60-6d5b26772676 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:43:17.767051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:17.791229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:17.797885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd02198499fd40209412a89e65861f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91a44062a0e4189999fef8341606f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:17.806158 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f7bcf3a-a0de-450c-9fbe-9e5a76d7966d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676" status: 200 len: 1367 microversion: 2.47 time: 0.314307 Aug 24 03:43:17.811000 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1249/2434] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:17 2022] GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:17.837426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef4e857c-5879-4017-9ec9-6ab3adce9467 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10227974c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:17.844421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:17.859985 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-453d2692-cafe-4d81-a554-3a27dfd01073 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.550024 Aug 24 03:43:17.861765 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1186/2435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:17 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:17.869295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:17.889895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:17.905870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.906664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.907317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.913404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.921941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.922989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.001171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef4e857c-5879-4017-9ec9-6ab3adce9467 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.187416 Aug 24 03:43:18.005531 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1250/2436] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:17 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:18.010673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-881c13bc-b7c8-493b-adff-5722856f10d7 req-73964fd0-7d35-41da-91e3-e422158ac461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b81154-9101-4ed9-96ce-4134bbf5484b", "name": "network-vif-unplugged", "status": "completed", "tag": "ba6c3530-c382-4b6e-89e9-580698731037"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:18.060019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-881c13bc-b7c8-493b-adff-5722856f10d7 req-73964fd0-7d35-41da-91e3-e422158ac461 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.065017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-881c13bc-b7c8-493b-adff-5722856f10d7 req-73964fd0-7d35-41da-91e3-e422158ac461 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.080530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-881c13bc-b7c8-493b-adff-5722856f10d7 req-73964fd0-7d35-41da-91e3-e422158ac461 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.119434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-881c13bc-b7c8-493b-adff-5722856f10d7 req-73964fd0-7d35-41da-91e3-e422158ac461 service nova] Creating event network-vif-unplugged:ba6c3530-c382-4b6e-89e9-580698731037 for instance 93b81154-9101-4ed9-96ce-4134bbf5484b on n-h1-846470-15 Aug 24 03:43:18.146423 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-881c13bc-b7c8-493b-adff-5722856f10d7 req-73964fd0-7d35-41da-91e3-e422158ac461 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138923 Aug 24 03:43:18.147472 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1251/2437] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:18.279764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:18.284724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:18.302890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.303972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.304986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.306369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.307277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.308595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.512200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:18.554655 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0ab61ddf-0b9f-4da7-b52f-aa69fe577e5e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.691055 Aug 24 03:43:18.565183 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1187/2438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:17 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:18.677458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:18.695198 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a19ae3cb-0756-4d46-b10e-67ef41fcfdc6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.434880 Aug 24 03:43:18.708560 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1252/2439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:18 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:18.846985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:18.848017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] [instance: 03447a2d-3e50-4b01-bb60-6d5b26772676] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:18.857879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.858813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.859643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.860966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.861767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.862488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.894233 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] HTTP exception thrown: Instance 03447a2d-3e50-4b01-bb60-6d5b26772676 could not be found. Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Request method failure captured: Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676 HTTP/1.1 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ4ZXkvQRzU_FeBogl_F_La68mTOFORUrr8bkYlBV85lFgtDYO9iMR30QZV0H1bqn4DliguzS1QPvLjMmieeDGs2Cr5QzfROhmpImo7hUrseDx-01DvuR96JuCjeb0zptcX80JJme_LEOFc__SbfK0nCrNtRxdlombs4ZN6FEv6BScs Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a91a44062a0e4189999fef8341606f67 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerShowV247Test-1749780869 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a91a44062a0e4189999fef8341606f67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a91a44062a0e4189999fef8341606f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a91a44062a0e4189999fef8341606f67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a91a44062a0e4189999fef8341606f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerShowV247Test-1749780869 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a91a44062a0e4189999fef8341606f67 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerShowV247Test-1749780869 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerShowV247Test-1749780869-project Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: bd02198499fd40209412a89e65861f55 Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerShowV247Test-1749780869-project Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 03447a2d-3e50-4b01-bb60-6d5b26772676 could not be found. Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '03447a2d-3e50-4b01-bb60-6d5b26772676'} Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03447a2d-3e50-4b01-bb60-6d5b26772676 could not be found. Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03447a2d-3e50-4b01-bb60-6d5b26772676 could not be found. Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:18.896785 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03447a2d-3e50-4b01-bb60-6d5b26772676 could not be found. Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] Returning 404 to user: Instance 03447a2d-3e50-4b01-bb60-6d5b26772676 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f9cb967-1342-46e3-9880-280c21aa7e0d tempest-ServerShowV247Test-1749780869 tempest-ServerShowV247Test-1749780869-project] 10.222.0.58 "GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676" status: 404 len: 111 microversion: 2.47 time: 0.060454 Aug 24 03:43:18.905378 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1188/2440] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:18 2022] GET /compute/v2.1/servers/03447a2d-3e50-4b01-bb60-6d5b26772676 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:43:18.909159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:18.909867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:18.924709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.929564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.930395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.931393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.932062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.932710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:19.020683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-330aa4b3-42eb-4bab-a6e7-62c9e3c6f1e8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10341fd4c0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:19.116814 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-330aa4b3-42eb-4bab-a6e7-62c9e3c6f1e8 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.101000 Aug 24 03:43:19.118913 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1189/2441] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:19 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:19.185622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:19.198243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb4ff117-cc4b-4b2f-9afe-932d7c03874f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1722 microversion: 2.1 time: 0.301788 Aug 24 03:43:19.199877 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1253/2442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:18 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:19.433022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2e2a78a9-9e6d-4574-bb53-9e7e9751448f req-24f51f40-dad8-4abc-9592-5d1d82252edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0caddd-5b22-458c-9054-70aaf23a5d10", "tag": "8abdb660-ff98-47aa-abce-eb7aa4782de5"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:19.480398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2e2a78a9-9e6d-4574-bb53-9e7e9751448f req-24f51f40-dad8-4abc-9592-5d1d82252edf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:19.486242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2e2a78a9-9e6d-4574-bb53-9e7e9751448f req-24f51f40-dad8-4abc-9592-5d1d82252edf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:19.486699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2e2a78a9-9e6d-4574-bb53-9e7e9751448f req-24f51f40-dad8-4abc-9592-5d1d82252edf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:19.522937 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2e2a78a9-9e6d-4574-bb53-9e7e9751448f req-24f51f40-dad8-4abc-9592-5d1d82252edf service nova] Creating event network-changed:8abdb660-ff98-47aa-abce-eb7aa4782de5 for instance da0caddd-5b22-458c-9054-70aaf23a5d10 on n-h1-846470-15 Aug 24 03:43:19.541210 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2e2a78a9-9e6d-4574-bb53-9e7e9751448f req-24f51f40-dad8-4abc-9592-5d1d82252edf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123247 Aug 24 03:43:19.542434 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1190/2443] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:19.592803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:19.593913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:19.615425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:19.617559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:19.618308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:19.619659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:19.621598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:19.622937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:19.739758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:19.740754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:19.756019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:19.757060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:19.758486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:19.762334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:19.764264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:19.765518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:19.917522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:19.927239 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da60e8f4-2491-4923-adc6-131fe5546de1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.339884 Aug 24 03:43:19.938644 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1254/2444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:19 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:20.042853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:20.062446 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba2ab5dc-0024-4612-8740-0862b0b3c67d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.331742 Aug 24 03:43:20.064708 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1191/2445] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:19 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:20.136163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89cd2357-2131-4dfe-a95c-9932fa71427d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10235515e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:20.224909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:20.225603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:20.230086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.236142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-89cd2357-2131-4dfe-a95c-9932fa71427d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.103585 Aug 24 03:43:20.237546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.238169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.238638 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1255/2446] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:20 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:20.239131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.239816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.240484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.241540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.426176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:20.443487 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3af5946c-dbcb-4dbb-a631-b5a3568f3151 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1699 microversion: 2.1 time: 0.224257 Aug 24 03:43:20.444566 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1192/2447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:20 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1699 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:20.478168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e8bf37b-2ea4-4fe3-ae41-c9f9b1a0da71 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:20.490277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8bf37b-2ea4-4fe3-ae41-c9f9b1a0da71 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.491315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8bf37b-2ea4-4fe3-ae41-c9f9b1a0da71 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.492135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e8bf37b-2ea4-4fe3-ae41-c9f9b1a0da71 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.521688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e8bf37b-2ea4-4fe3-ae41-c9f9b1a0da71 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Going to try to start instance {{(pid=122536) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:43:20.581380 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e8bf37b-2ea4-4fe3-ae41-c9f9b1a0da71 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/action" status: 202 len: 0 microversion: 2.1 time: 0.111530 Aug 24 03:43:20.582191 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1256/2448] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:43:20 2022] POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:43:20.594071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:20.595054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:20.605566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.606543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.607380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.608959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.609719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.610503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.854857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:20.873610 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a8c1de1-7324-41ec-9779-59441d3f6501 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1708 microversion: 2.1 time: 0.285654 Aug 24 03:43:20.874543 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1193/2449] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:20 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1708 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:20.957476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:20.958279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:20.969085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.970290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.970290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.971040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.971568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.972019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.088281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:21.088975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:21.096135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.096602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.097029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.097977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.098437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.098833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.141383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:21.150050 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0f31beb-e49b-4afc-a390-058a17fdfe0c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.198293 Aug 24 03:43:21.151119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1257/2450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:20 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:21.259983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa810637-9ffe-42c0-b57b-49b707709a8c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10231ffd30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:21.333765 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa810637-9ffe-42c0-b57b-49b707709a8c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.083290 Aug 24 03:43:21.335425 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1258/2451] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:21 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:21.343295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:21.353788 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d77b74f-81dd-44f8-a027-56e41898c6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.271563 Aug 24 03:43:21.354904 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1194/2452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:21 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:21.914372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:21.915215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:21.923792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.924409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.924868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.925819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.926289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.926804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.155306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:22.179540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:22.180725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:22.189132 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c906523-ca5b-4951-b51d-b70b886cb050 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1708 microversion: 2.1 time: 0.282535 Aug 24 03:43:22.190593 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1259/2453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:21 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1708 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:22.202979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.204038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.204671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.205586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.206373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.207124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.364581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74e384c4-2a26-46af-be87-9c1635a1c81e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1023628310>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:22.478522 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74e384c4-2a26-46af-be87-9c1635a1c81e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.124819 Aug 24 03:43:22.480922 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1260/2454] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:22 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:22.490543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:22.491750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:22.510363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.511339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.512802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.514119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.516586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.517429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.543623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:22.554951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-315d6f37-a22c-4722-886a-728232bcc4a8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.385804 Aug 24 03:43:22.555593 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1195/2455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:22 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:22.763284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:22.777835 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a8640cba-5185-4fba-90f2-150cd39d9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.294996 Aug 24 03:43:22.778744 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1261/2456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:22 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:23.235886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:23.236720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:23.243040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:23.253166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:23.273661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.274176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.274620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.277490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.278002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.278527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.516470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93d6dde4-10b3-431f-829c-dc25382298a6 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1023628f70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:23.547750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:23.639391 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93d6dde4-10b3-431f-829c-dc25382298a6 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.144839 Aug 24 03:43:23.648379 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1262/2457] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:23 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:23.655746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:23.656355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:23.664798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.665585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.666061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.666771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.667343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.667688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.932144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:23.946788 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a535745-5343-437a-a582-45e312a96c3a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.300800 Aug 24 03:43:23.948103 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1263/2458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:23 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:23.952890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:23.955009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:23.956059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:23.964640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.965478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.966177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.967885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.968596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.969218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.982227 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4594f333-078a-42b2-9474-e2498266791a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1708 microversion: 2.1 time: 0.763445 Aug 24 03:43:23.996705 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1196/2459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:23 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1708 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:24.207215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:24.219049 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99d1713d-16cc-47a3-bd41-17de0fc06f34 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.268873 Aug 24 03:43:24.236125 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1264/2460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:23 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:24.661870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8db74bfd-558b-41e9-9ebd-8772237c4d12 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034397f70>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:24.773615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8db74bfd-558b-41e9-9ebd-8772237c4d12 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.119971 Aug 24 03:43:24.774246 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1197/2461] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:24 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:24.989805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:24.990489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:24.998418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.998942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.999377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.000206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.000663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.001274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.012463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:25.013101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:25.021251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.021755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.022640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.023521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.023993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.024613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.183787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:25.193593 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5f078f4-c06f-4ec7-9bd6-d7767f55b1db tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.211272 Aug 24 03:43:25.194221 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1265/2462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:24 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:25.248844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:25.249770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:25.257026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.257560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.258088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.258828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.259295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.259790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.444575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:25.458942 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dac1c6d8-a7d4-4665-b6d3-e78d09414aa0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.211687 Aug 24 03:43:25.459781 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1266/2463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:25 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:25.498662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:25.500457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:25.513451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.515036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.516149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.518893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.520123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.521214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.535305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:25.549349 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d051a2d-bef1-4d2f-a187-c02f4a291c7d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1708 microversion: 2.1 time: 0.545743 Aug 24 03:43:25.558932 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1198/2464] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:24 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1708 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:25.792719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c2c17671-a001-4679-8e55-781c23b8f80d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034397b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:25.831124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:25.848450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:25.850075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:25.852303 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b0a7573-8ed5-48da-ac77-24772255d621 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2950 microversion: 2.32 time: 0.360966 Aug 24 03:43:25.857542 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1267/2465] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:25 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2950 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:25.872701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-200dc15a-fa3b-40a7-b53e-a851a801e6ac req-f7701c48-a5bf-4acb-9f35-60334aaa0927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b81154-9101-4ed9-96ce-4134bbf5484b", "name": "network-vif-plugged", "status": "completed", "tag": "ba6c3530-c382-4b6e-89e9-580698731037"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:25.895291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-200dc15a-fa3b-40a7-b53e-a851a801e6ac req-f7701c48-a5bf-4acb-9f35-60334aaa0927 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.896357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-200dc15a-fa3b-40a7-b53e-a851a801e6ac req-f7701c48-a5bf-4acb-9f35-60334aaa0927 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.896357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-200dc15a-fa3b-40a7-b53e-a851a801e6ac req-f7701c48-a5bf-4acb-9f35-60334aaa0927 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.915255 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c2c17671-a001-4679-8e55-781c23b8f80d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.128711 Aug 24 03:43:25.919382 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-200dc15a-fa3b-40a7-b53e-a851a801e6ac req-f7701c48-a5bf-4acb-9f35-60334aaa0927 service nova] Creating event network-vif-plugged:ba6c3530-c382-4b6e-89e9-580698731037 for instance 93b81154-9101-4ed9-96ce-4134bbf5484b on n-h1-846470-15 Aug 24 03:43:25.930158 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1199/2466] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:25 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:25.933889 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-200dc15a-fa3b-40a7-b53e-a851a801e6ac req-f7701c48-a5bf-4acb-9f35-60334aaa0927 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073786 Aug 24 03:43:25.935501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1268/2467] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:25.937359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:25.938138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:25.947688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.948994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.952147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.953590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.954394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.955057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.140581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fe8e15e9-9eb6-40c7-acb3-02dccdafcbc1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.208158 Aug 24 03:43:26.141409 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1200/2468] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 03:43:25 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82/os-interface => generated 1831 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:26.227590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:26.228498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:26.239021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.239706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.240327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.241312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.241902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.242397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.417405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:26.426465 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d90b3adb-7cb8-4cc8-8fe2-4bcceea0a6b4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.204225 Aug 24 03:43:26.427333 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1269/2469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:26 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:26.484690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:26.486023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:26.492693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.493198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.493635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.495926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.497044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.497044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.514730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:26.574072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:26.575148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:26.583076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.583768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.584281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.585806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.586928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.587470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.725593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:26.736854 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bff56016-a88f-47ea-9a39-ebb2b856d560 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.257272 Aug 24 03:43:26.738674 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1201/2470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:26 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:26.778353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:26.791393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-78de99ee-c1b8-4d23-930d-38307d70ad2a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1708 microversion: 2.1 time: 0.221542 Aug 24 03:43:26.792258 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1270/2471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:26 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1708 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:26.939074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05680220-514c-4c30-b54d-16ed45585ab5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342430d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:27.036933 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05680220-514c-4c30-b54d-16ed45585ab5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.101341 Aug 24 03:43:27.038300 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1202/2472] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:26 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:27.471727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:27.479479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:27.502187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.503013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.504600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.505493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.506014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.506465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.516815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:27.756916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:27.762027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:27.762824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:27.771125 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-25f22081-2241-40a1-9289-70abecc6ab82 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1516 microversion: 2.1 time: 0.317087 Aug 24 03:43:27.772588 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1271/2473] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:27 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:27.793106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.798839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.811456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.815845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.816699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.817848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.821811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:27.823598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:27.836823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.840024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.840731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.842165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.843764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.844522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.178185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:28.207829 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0d67c828-31c8-4461-858e-49b50d0a688c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1712 microversion: 2.1 time: 0.391437 Aug 24 03:43:28.210559 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1272/2474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:27 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1712 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:28.229385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7598ef55-cabb-4ed5-b584-c2779efdb918 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1023628310>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:28.322482 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7598ef55-cabb-4ed5-b584-c2779efdb918 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.104732 Aug 24 03:43:28.323785 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1273/2475] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:28 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:28.726181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:28.741356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d739b443-a9b3-4c21-b89c-c782f98ff136 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.984521 Aug 24 03:43:28.742368 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1203/2476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:27 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:28.807841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:28.809281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:28.818155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.818659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.819102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.822145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.822881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.834359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.110562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:29.141998 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1522 microversion: 2.1 time: 0.338975 Aug 24 03:43:29.144235 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1274/2477] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:28 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:29.351538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf954619-568c-42c2-a3e9-d541695f6830 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10343290d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:29.443030 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf954619-568c-42c2-a3e9-d541695f6830 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.105933 Aug 24 03:43:29.446654 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1204/2478] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:29 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:29.482913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:29.485261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8ffe06ce-0bb4-431b-9807-4716f125dc0f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002364 Aug 24 03:43:29.487406 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1275/2479] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 24 03:43:29 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 03:43:29.708151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ba6ec133-4463-4136-9fcd-30358bbd2056 req-e914c8f2-27f8-4c02-b6cf-e1a426357bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da0caddd-5b22-458c-9054-70aaf23a5d10", "name": "network-vif-plugged", "status": "completed", "tag": "8abdb660-ff98-47aa-abce-eb7aa4782de5"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:29.731856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ba6ec133-4463-4136-9fcd-30358bbd2056 req-e914c8f2-27f8-4c02-b6cf-e1a426357bf8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.734613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ba6ec133-4463-4136-9fcd-30358bbd2056 req-e914c8f2-27f8-4c02-b6cf-e1a426357bf8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.735839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ba6ec133-4463-4136-9fcd-30358bbd2056 req-e914c8f2-27f8-4c02-b6cf-e1a426357bf8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.755847 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ba6ec133-4463-4136-9fcd-30358bbd2056 req-e914c8f2-27f8-4c02-b6cf-e1a426357bf8 service nova] Creating event network-vif-plugged:8abdb660-ff98-47aa-abce-eb7aa4782de5 for instance da0caddd-5b22-458c-9054-70aaf23a5d10 on n-h1-846470-15 Aug 24 03:43:29.763900 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ba6ec133-4463-4136-9fcd-30358bbd2056 req-e914c8f2-27f8-4c02-b6cf-e1a426357bf8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060170 Aug 24 03:43:29.765747 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1205/2480] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:29.770095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:29.771202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:29.781942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.782616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.783472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.784551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.785493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.786290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.152968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:30.171519 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4392e22d-df9d-4463-8ce0-78d2433c4dbb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.411098 Aug 24 03:43:30.172286 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1276/2481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:29 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:30.175658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:30.176823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:30.187495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.188410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.189409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.190918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.191497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.192253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.383835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:30.394966 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c426eb2c-1acd-4eeb-a9ba-258cf8b6d937 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1522 microversion: 2.1 time: 0.227089 Aug 24 03:43:30.395741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1206/2482] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:30 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:30.461682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ebf6b9a7-2edd-416f-b299-a2d936dd7a02 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1022edd820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:30.526354 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ebf6b9a7-2edd-416f-b299-a2d936dd7a02 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.070818 Aug 24 03:43:30.527172 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1277/2483] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:30 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:31.211645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:31.213134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:31.227447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.229091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.229962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.231860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.233410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.234296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.433850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:31.435476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:31.447952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.448967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.450448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.453070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.454021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.455308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.522750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:31.554251 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8171ce39-b4b9-49ed-96b3-afa6b47231a9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1315 microversion: 2.1 time: 0.361421 Aug 24 03:43:31.557728 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1207/2484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:31 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:31.571967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-daf9c17c-ced5-4d26-8cfd-91cb0f7ea988 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034416160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:31.744813 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-daf9c17c-ced5-4d26-8cfd-91cb0f7ea988 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.180483 Aug 24 03:43:31.759422 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1208/2485] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:31 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:31.893369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:31.918213 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9aab9fe9-0582-45c0-9e29-3ccb49c586fe tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1522 microversion: 2.1 time: 0.490553 Aug 24 03:43:31.921847 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1278/2486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:31 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:32.601182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:32.604637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:32.618442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.620278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.621571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:32.623514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.624872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.626236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:32.786338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc5fbf81-1069-449a-bf8a-cc6b8b5b6344 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f102311a9d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:32.931349 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc5fbf81-1069-449a-bf8a-cc6b8b5b6344 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.148221 Aug 24 03:43:32.952386 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1279/2487] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:32 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:32.981158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:32.982250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:33.000992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:33.002181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:33.007893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.009479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:33.010433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:33.011318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.207255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:33.220706 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ceda6a69-9354-4bb4-a517-c8665246893b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1501 microversion: 2.1 time: 0.625602 Aug 24 03:43:33.221577 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1209/2488] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:32 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1501 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:33.266487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:33.270100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:33.299492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:33.301195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:33.302082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.304138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:33.305254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:33.306186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.408745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:43:33.531526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:33.588337 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e53738be-f521-40a7-8c39-30d643eb796f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1522 microversion: 2.1 time: 0.626771 Aug 24 03:43:33.589373 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1280/2489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:32 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:33.682124 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37d60e3b-8b1f-4dfd-a399-d3c9c6f6bd07 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 204 len: 0 microversion: 2.1 time: 0.430643 Aug 24 03:43:33.685119 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1210/2490] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:33 2022] DELETE /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:43:33.701727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:33.704573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:33.716926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:33.718245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:33.719332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.721116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:33.722183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:33.723232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.985866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a86f8858-6ff0-4b5c-90c6-a1a582b77d4c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f103424b820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:34.104405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:34.182131 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-947718b7-138a-47d5-827b-aa4c357af407 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1507 microversion: 2.1 time: 0.485592 Aug 24 03:43:34.184490 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a86f8858-6ff0-4b5c-90c6-a1a582b77d4c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.205823 Aug 24 03:43:34.186297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1281/2491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:33 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:34.190920 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1211/2492] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:33 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:34.632481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:34.633469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:34.657232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.658555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.663525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.665554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.666925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.673887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.072594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:35.086273 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d4695c53-f56c-4a7f-a871-26b392b2f655 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1522 microversion: 2.1 time: 0.460973 Aug 24 03:43:35.091868 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1282/2493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:34 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:35.236127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:35.248538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-25b7c1a1-b59d-40da-9141-765b328baf85 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342ec160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:35.250522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:35.285605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.287247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.288433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.291857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.307158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.309124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.404622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-25b7c1a1-b59d-40da-9141-765b328baf85 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.190390 Aug 24 03:43:35.406371 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1212/2494] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:35 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:35.876601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:35.909314 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-268bfb93-df62-4e6e-827a-3eda61bc5b8c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1507 microversion: 2.1 time: 0.681297 Aug 24 03:43:35.912640 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1283/2495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:35 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:36.131521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:36.134231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:36.158498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.159428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.160316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.161950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.162866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.163688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.438720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-217f0fbe-454a-459c-9aec-cf5461dfb1a5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10230d98b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:36.538809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-217f0fbe-454a-459c-9aec-cf5461dfb1a5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.110157 Aug 24 03:43:36.541403 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1284/2496] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:36 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:36.702098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:36.740072 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2e959086-9d20-4f2a-8ab4-b8a795ef1fd9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1522 microversion: 2.1 time: 0.615745 Aug 24 03:43:36.741162 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1213/2497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:36 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:36.952939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:36.956157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:36.981514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:36.986158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.987407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.988369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.989774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.990517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.991205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:37.276015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:37.307157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8830c2dd-24a9-4d6a-840c-21eed7df51c5 req-d7047771-da34-4734-81b0-38b76730c3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da0caddd-5b22-458c-9054-70aaf23a5d10", "name": "network-vif-deleted", "tag": "8abdb660-ff98-47aa-abce-eb7aa4782de5"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:37.346837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8830c2dd-24a9-4d6a-840c-21eed7df51c5 req-d7047771-da34-4734-81b0-38b76730c3f9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.366611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8830c2dd-24a9-4d6a-840c-21eed7df51c5 req-d7047771-da34-4734-81b0-38b76730c3f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.368514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8830c2dd-24a9-4d6a-840c-21eed7df51c5 req-d7047771-da34-4734-81b0-38b76730c3f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:37.409254 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a75e8e8-0708-4176-bb30-b3b245e9114f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1465 microversion: 2.1 time: 0.471056 Aug 24 03:43:37.425849 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1285/2498] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:36 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1465 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:37.461150 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8830c2dd-24a9-4d6a-840c-21eed7df51c5 req-d7047771-da34-4734-81b0-38b76730c3f9 service nova] Creating event network-vif-deleted:8abdb660-ff98-47aa-abce-eb7aa4782de5 for instance da0caddd-5b22-458c-9054-70aaf23a5d10 on n-h1-846470-15 Aug 24 03:43:37.484595 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8830c2dd-24a9-4d6a-840c-21eed7df51c5 req-d7047771-da34-4734-81b0-38b76730c3f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180592 Aug 24 03:43:37.489310 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1214/2499] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:37.570869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c22aceb6-54da-41a4-b09b-90fe47122a8c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f102323b280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:37.798782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:37.808089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:37.834232 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c22aceb6-54da-41a4-b09b-90fe47122a8c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.272197 Aug 24 03:43:37.838258 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1286/2500] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:37 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:37.882296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.883629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.885020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:37.887644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.889742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.890905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.087244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-4b4283fc-b4b9-4c34-ad89-8b9bd82f29e3 req-e729dffb-b10e-4114-a521-68ea0ba2ae65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b75085c-e1de-4465-9ddb-1dba6c2519d9", "name": "network-vif-plugged", "status": "completed", "tag": "d7168410-b5e0-40ba-9272-6acda36b915d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:38.127020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4b4283fc-b4b9-4c34-ad89-8b9bd82f29e3 req-e729dffb-b10e-4114-a521-68ea0ba2ae65 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.128381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4b4283fc-b4b9-4c34-ad89-8b9bd82f29e3 req-e729dffb-b10e-4114-a521-68ea0ba2ae65 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.130042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4b4283fc-b4b9-4c34-ad89-8b9bd82f29e3 req-e729dffb-b10e-4114-a521-68ea0ba2ae65 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.164684 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-4b4283fc-b4b9-4c34-ad89-8b9bd82f29e3 req-e729dffb-b10e-4114-a521-68ea0ba2ae65 service nova] Creating event network-vif-plugged:d7168410-b5e0-40ba-9272-6acda36b915d for instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 on n-h2-846470-15 Aug 24 03:43:38.177901 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-4b4283fc-b4b9-4c34-ad89-8b9bd82f29e3 req-e729dffb-b10e-4114-a521-68ea0ba2ae65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103028 Aug 24 03:43:38.179626 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1287/2501] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:38.355331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:38.366728 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-650264c1-0620-4398-bfb4-5102d30d3503 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1522 microversion: 2.1 time: 0.581011 Aug 24 03:43:38.369864 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1215/2502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:37 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1522 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:38.453970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:38.455497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:38.476233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.477257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.480736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.483933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.487544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.488457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.554334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.555060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.555870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.556472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lazy-loading 'fault' on Instance uuid da0caddd-5b22-458c-9054-70aaf23a5d10 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:43:38.645376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:38.667969 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-98ea2706-29ae-48fb-96f2-0fa1c0f40738 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 200 len: 1305 microversion: 2.1 time: 0.220006 Aug 24 03:43:38.670799 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1288/2503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:38 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:38.865969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a0dd58c-43ae-47d5-a1ba-2276b2254bfd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10343973a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:39.006805 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a0dd58c-43ae-47d5-a1ba-2276b2254bfd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.144584 Aug 24 03:43:39.012612 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1216/2504] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:38 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:39.417634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:39.418665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:39.430204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.431205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.432477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.433686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.434743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.435590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.710624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:39.711249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:39.724203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.724668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.725106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.729317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.730632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.733292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:39.734706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.743116 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96fb79a1-b971-402d-8fcf-362d36b41e16 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1522 microversion: 2.1 time: 0.331546 Aug 24 03:43:39.752018 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1289/2505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:39 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:39.769680 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 HTTP/1.1 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'da0caddd-5b22-458c-9054-70aaf23a5d10'} Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:39.773223 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.779483 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:39.779483 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:39.779483 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:39.779483 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:39.779483 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:39.779483 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:43:39.779483 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:43:39.781590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:39.782976 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee3f4ca2-cd3a-4675-b4fe-b6a213e878ab tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 404 len: 111 microversion: 2.1 time: 0.077400 Aug 24 03:43:39.783750 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1217/2506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:39 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:43:40.011647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-725182422", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "6b7c20d5-6e0c-43b0-8505-bb28069b1895"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:40.024913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a117bc4-32ea-4a47-b96a-53b5b0fe4d17 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10343971f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:40.228598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] validate_networks() for [('6b7c20d5-6e0c-43b0-8505-bb28069b1895', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:43:40.238674 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a117bc4-32ea-4a47-b96a-53b5b0fe4d17 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.209163 Aug 24 03:43:40.243062 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1218/2507] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:40 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:40.775658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:40.790454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:40.826749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:40.828340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:40.830080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:40.839987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:40.842408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:40.844535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:40.861472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:43:40.862058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:43:40.862362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:43:40.862773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:43:40.863198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:43:40.874823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:40.875761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:40.876412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:40.877558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:40.878210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:40.878836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:40.902256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:43:40.910868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for user 69a1414940b14e459202a86bd8e9027b and project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:43:40.931279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:43:40.934478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:43:41.050129 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0ca09cf9-9b5d-4ed2-85ee-caec10e159f0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039723 Aug 24 03:43:41.053703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1290/2508] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:43:41.107729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48926ec1-5028-470d-bdab-e7ab89d8af9b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:41.118243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48926ec1-5028-470d-bdab-e7ab89d8af9b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:41.187901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:41.213687 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89b18a5e-73d3-41e2-95a6-aeda852671e1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1507 microversion: 2.1 time: 0.448622 Aug 24 03:43:41.216204 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1219/2509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:40 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:41.264387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:41.281541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:41.314646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.316169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.316993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.318279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.324138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.329924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.370073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48926ec1-5028-470d-bdab-e7ab89d8af9b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:41.387253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48926ec1-5028-470d-bdab-e7ab89d8af9b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1214 microversion: 2.1 time: 0.324022 Aug 24 03:43:41.391857 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1291/2510] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:41 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1214 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:41.413287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3988e7f-deba-4322-8473-2149adaadb81 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10231ef3a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:41.537995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3988e7f-deba-4322-8473-2149adaadb81 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.141648 Aug 24 03:43:41.539506 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1292/2511] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:41 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:41.699598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:41.721766 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0b38ebc4-721f-4974-b1a9-e8a8e6732ea4 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 200 len: 1507 microversion: 2.1 time: 0.480337 Aug 24 03:43:41.724363 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1220/2512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:41 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 1507 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:41.760239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:41.765571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:41.804868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.805780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.806557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.818932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.824811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.826520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.934004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:43:42.194022 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10ed3edf-4e75-4800-b5dd-6e7ce7bea342 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 204 len: 0 microversion: 2.1 time: 0.447450 Aug 24 03:43:42.197404 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1293/2513] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:41 2022] DELETE /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:43:42.417840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:42.419484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:42.434915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:42.436038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:42.445698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:42.447075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:42.447821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:42.448548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:42.508617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1058435106", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7e985d05-8052-49f4-894f-069701c9a6ec"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:42.558440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:42.569148 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-074cfa9a-b602-48eb-a21e-aa94098e192b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1210 microversion: 2.1 time: 0.155347 Aug 24 03:43:42.570411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1221/2514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:42 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:42.575933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc2ab959-2df9-492e-8c0a-dac914785582 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034218790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:42.652226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] validate_networks() for [('7e985d05-8052-49f4-894f-069701c9a6ec', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:43:42.681405 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc2ab959-2df9-492e-8c0a-dac914785582 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.109103 Aug 24 03:43:42.701575 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1222/2515] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:42 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:43.518987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:43.522324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:43.538982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.540043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.540957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:43.542269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.543070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.544120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:43.598388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:43:43.600577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:43:43.601879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:43:43.602788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:43:43.604205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:43:43.664114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.664948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.665687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:43.667455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.672570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.673730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:43.716042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Getting quotas for project d9017741914745fb8e346195e1077dae. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:43:43.724869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Getting quotas for user 85d63578576d4fc7b6efabde5276b860 and project d9017741914745fb8e346195e1077dae. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:43:43.751220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:43:43.756323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:43:43.875851 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b22430ae-ba6b-4723-8c5f-d0e78c4c53b6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.366624 Aug 24 03:43:43.891710 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1294/2516] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:43:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:43:43.910213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:43.911371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:43.930248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.932356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.933046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:43.933907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.939105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.941427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:44.230686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:44.252023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:44.260055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:44.268200 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-86cb877f-6d9f-472b-9297-473dfa00c0b4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2955 microversion: 2.42 time: 0.751553 Aug 24 03:43:44.275104 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1223/2517] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:43:43 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2955 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:44.298495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f7e7b5c1-57a6-48a8-b507-8be07f73cd8d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034382160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:44.484908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:44.503337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:44.507004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f7e7b5c1-57a6-48a8-b507-8be07f73cd8d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.227937 Aug 24 03:43:44.527385 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1224/2518] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:44 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:44.563025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fcf48a4e-7e15-4bbb-adcf-1f8d85bc4363 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1284 microversion: 2.1 time: 0.669773 Aug 24 03:43:44.563761 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1295/2519] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:43 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1284 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:44.568775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e7923241-f763-4698-b423-c16f81743ec0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:44.572915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e7923241-f763-4698-b423-c16f81743ec0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:44.588044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:44.588599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:44.597155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:44.598038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:44.598716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:44.600158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:44.600810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:44.601442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:44.801996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e7923241-f763-4698-b423-c16f81743ec0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:44.824112 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e7923241-f763-4698-b423-c16f81743ec0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1218 microversion: 2.1 time: 0.285892 Aug 24 03:43:44.828507 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1225/2520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:44 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:44.881581 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59afbefe-11d0-4000-a4fa-a9e0f75fbe0e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.303114 Aug 24 03:43:44.883856 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1296/2521] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 03:43:44 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584/os-interface => generated 1831 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:45.549455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-084d3300-8d16-4b27-9b25-cc6094bfe19b tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1034397430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:45.592727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:45.593459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:45.604713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:45.606269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:45.606269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:45.618116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:45.619015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:45.619785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:45.855325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:45.874393 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-084d3300-8d16-4b27-9b25-cc6094bfe19b tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.331579 Aug 24 03:43:45.876305 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1226/2522] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:45 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:45.877815 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1cb8bfa-62ea-446d-a887-f5c75f1c2fc9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1272 microversion: 2.1 time: 0.291134 Aug 24 03:43:45.888837 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1297/2523] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:45 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:45.896006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8348d5a6-edfe-4892-8486-18416f24f7fb req-dba0a544-c12f-4b6b-8563-1ac86e4cee03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b75085c-e1de-4465-9ddb-1dba6c2519d9", "name": "network-vif-deleted", "tag": "d7168410-b5e0-40ba-9272-6acda36b915d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:45.912110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:45.913589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:45.930705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:45.931613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:45.932789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:45.936931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:45.937792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:45.938634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:45.959280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8348d5a6-edfe-4892-8486-18416f24f7fb req-dba0a544-c12f-4b6b-8563-1ac86e4cee03 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:45.960635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8348d5a6-edfe-4892-8486-18416f24f7fb req-dba0a544-c12f-4b6b-8563-1ac86e4cee03 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:45.963911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8348d5a6-edfe-4892-8486-18416f24f7fb req-dba0a544-c12f-4b6b-8563-1ac86e4cee03 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:46.003844 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8348d5a6-edfe-4892-8486-18416f24f7fb req-dba0a544-c12f-4b6b-8563-1ac86e4cee03 service nova] Creating event network-vif-deleted:d7168410-b5e0-40ba-9272-6acda36b915d for instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 on n-h2-846470-15 Aug 24 03:43:46.034247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8348d5a6-edfe-4892-8486-18416f24f7fb req-dba0a544-c12f-4b6b-8563-1ac86e4cee03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154855 Aug 24 03:43:46.044680 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1227/2524] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:46.112677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:46.133772 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d01768a6-39ae-429f-8196-d119fa58bc49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1270 microversion: 2.1 time: 0.243114 Aug 24 03:43:46.134951 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1298/2525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:45 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:46.916461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:46.917483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:46.918852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bba3908f-08fe-4d3f-8eec-0a3349c8c1f0 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f102a797b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:46.940826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:46.941336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:46.941791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:46.961302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:46.962405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:46.973806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:47.154508 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bba3908f-08fe-4d3f-8eec-0a3349c8c1f0 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.250474 Aug 24 03:43:47.180088 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1228/2526] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:46 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:47.221797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:47.223050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:47.259257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:47.284995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:47.302769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:47.304004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:47.312451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:47.313098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:47.819590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:47.835137 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f70f7c1-ca1a-438c-a8d6-915b3af53d72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.930678 Aug 24 03:43:47.841427 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1299/2527] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:46 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:48.121924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:48.141852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a3c919d-d932-41ac-a4e6-9a2ec16c43d0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1278 microversion: 2.1 time: 0.959591 Aug 24 03:43:48.152161 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1229/2528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:47 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1278 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:48.193807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-143b7ea9-9aac-479a-b8a3-4e2215fcbf7a tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342c9820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:48.345896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-143b7ea9-9aac-479a-b8a3-4e2215fcbf7a tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.160375 Aug 24 03:43:48.347604 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1300/2529] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:48 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:48.816978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b2dbe38f-9cb0-4893-ae03-584c0e6c1118 req-c68308dd-3136-4285-adc4-848bea361402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c514243f-2dde-48fb-868d-a27be663f606", "tag": "fb0caa34-cb45-4bf3-9c7e-5578c04dc4d7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:48.862544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:48.863486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:48.871201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b2dbe38f-9cb0-4893-ae03-584c0e6c1118 req-c68308dd-3136-4285-adc4-848bea361402 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.871886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b2dbe38f-9cb0-4893-ae03-584c0e6c1118 req-c68308dd-3136-4285-adc4-848bea361402 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.872450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b2dbe38f-9cb0-4893-ae03-584c0e6c1118 req-c68308dd-3136-4285-adc4-848bea361402 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.885413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.887367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.892435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.893755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.896068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.896926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.914366 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b2dbe38f-9cb0-4893-ae03-584c0e6c1118 req-c68308dd-3136-4285-adc4-848bea361402 service nova] Creating event network-changed:fb0caa34-cb45-4bf3-9c7e-5578c04dc4d7 for instance c514243f-2dde-48fb-868d-a27be663f606 on n-h1-846470-15 Aug 24 03:43:48.934560 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b2dbe38f-9cb0-4893-ae03-584c0e6c1118 req-c68308dd-3136-4285-adc4-848bea361402 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134842 Aug 24 03:43:48.938926 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1230/2530] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:49.168935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:49.170023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:49.180149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:49.196081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:49.196950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:49.197929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:49.198603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:49.199542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:49.481498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:49.505040 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fbc32642-81d6-4f5a-8d4b-b3c37a65870e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.646581 Aug 24 03:43:49.519523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1301/2531] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:48 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:49.519523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-246608b1-afb0-45ae-b6cd-2bbf950bd810 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10230a18b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:49.562946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:49.566958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:49.581140 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47da4405-ed03-474c-b550-123536946835 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1276 microversion: 2.1 time: 0.417575 Aug 24 03:43:49.584171 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1231/2532] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:49 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1276 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:49.595997 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-246608b1-afb0-45ae-b6cd-2bbf950bd810 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.088936 Aug 24 03:43:49.596858 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1302/2533] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:49 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:50.549321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:50.557779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:50.600269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:50.609725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:50.610316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:50.610931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:50.612074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:50.614212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:50.616444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:50.619011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93b5068c-4daf-46b9-b1f5-51df9124894f tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1022fd7790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:50.746707 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93b5068c-4daf-46b9-b1f5-51df9124894f tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.133378 Aug 24 03:43:50.748624 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1303/2534] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:50 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:50.758916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:50.760437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:50.769595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:50.770580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:50.771272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:50.772294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:50.772947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:50.773560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:50.983454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:51.025232 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67d95cd6-31c2-4342-9855-fb502cef41bf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1318 microversion: 2.1 time: 0.274361 Aug 24 03:43:51.028312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1304/2535] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:50 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:51.267438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:51.276364 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-62fdcbb7-1af4-4c47-89d0-3903054719e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.736054 Aug 24 03:43:51.292848 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1232/2536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:50 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:51.768790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bbe006f5-7912-42b9-88c5-fbf38aef9e7f tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342c95e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:51.891409 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bbe006f5-7912-42b9-88c5-fbf38aef9e7f tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1427 microversion: 2.1 time: 0.129391 Aug 24 03:43:51.893344 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1305/2537] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:51 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:52.052154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6eb4f2c3-2887-4fd3-89ca-50c1e734782b req-b22585c3-7ad6-42a6-b9dd-c8f1926d09d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8ff552d-5e9a-497e-add0-2c14f712c63e", "tag": "615b5a9b-42ab-41a9-b137-40efe16cb240"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:52.072005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6eb4f2c3-2887-4fd3-89ca-50c1e734782b req-b22585c3-7ad6-42a6-b9dd-c8f1926d09d5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:52.074289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6eb4f2c3-2887-4fd3-89ca-50c1e734782b req-b22585c3-7ad6-42a6-b9dd-c8f1926d09d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:52.076173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6eb4f2c3-2887-4fd3-89ca-50c1e734782b req-b22585c3-7ad6-42a6-b9dd-c8f1926d09d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:52.098470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:52.100820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:52.117730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:52.119252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:52.120315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:52.123108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:52.125794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:52.127370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:52.129064 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6eb4f2c3-2887-4fd3-89ca-50c1e734782b req-b22585c3-7ad6-42a6-b9dd-c8f1926d09d5 service nova] Creating event network-changed:615b5a9b-42ab-41a9-b137-40efe16cb240 for instance b8ff552d-5e9a-497e-add0-2c14f712c63e on n-h2-846470-15 Aug 24 03:43:52.141066 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6eb4f2c3-2887-4fd3-89ca-50c1e734782b req-b22585c3-7ad6-42a6-b9dd-c8f1926d09d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099837 Aug 24 03:43:52.145530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1233/2538] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:43:52.305929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:52.306173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:52.317340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:52.317848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:52.318290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:52.326973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:52.329368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:52.330083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:52.447068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:52.462619 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-61008838-7b99-4e6a-bddf-4f61d7087a04 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1318 microversion: 2.1 time: 0.382869 Aug 24 03:43:52.465000 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1306/2539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:52 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:52.705170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:52.719619 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dda273c1-0a86-4ba0-bc21-528d48d8a6bc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.418418 Aug 24 03:43:52.721775 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1234/2540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:52 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:52.907312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ddf9472-3f9d-4d81-9e5f-b4c0326d0e99 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1022f330d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:52.963727 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ddf9472-3f9d-4d81-9e5f-b4c0326d0e99 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1436 microversion: 2.1 time: 0.060741 Aug 24 03:43:52.964860 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1307/2541] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:52 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1436 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:52.986209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a00ab601-41e8-4373-8a3d-7957ab6a8b5a tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f10342f7700>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:53.047084 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a00ab601-41e8-4373-8a3d-7957ab6a8b5a tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 200 len: 1436 microversion: 2.1 time: 0.065013 Aug 24 03:43:53.048418 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1235/2542] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:52 2022] GET /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 1436 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:53.062479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:53.063785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:53.072187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.072770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.073467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.074532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.075322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.076079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.245293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:53.259764 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7d2884a1-9f91-45c0-9ae6-020c35bf1e27 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1477 microversion: 2.1 time: 0.196363 Aug 24 03:43:53.259764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1308/2543] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:53 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1477 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:53.508403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:53.514676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:53.527872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.529051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.530262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.534047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.535980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.536843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.752222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:53.753446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:53.761136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:53.762333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=14 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:53.767799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.768396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.768838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.769568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.770024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.770543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.922641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:53.938083 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d7536c79-2d5e-46f2-8e3f-17ed89f1fbd3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1318 microversion: 2.1 time: 0.442132 Aug 24 03:43:53.938686 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1236/2544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:53 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:53.940081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:53.949430 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c86e39a7-4272-4598-a1bf-c345feab1cb0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.202873 Aug 24 03:43:53.951546 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1309/2545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:53 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:54.276813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:54.277692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:54.285598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:54.286540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:54.287055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:54.288061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:54.288591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:54.289009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:54.545980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:54.559474 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c924af42-d77c-4383-b3b7-cbfa7af9dbe4 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1464 microversion: 2.1 time: 0.286873 Aug 24 03:43:54.561017 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1237/2546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:54 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:54.590263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0371480-8245-45cc-91b0-2d3963cf2df6 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1022ec4430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:54.963495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:54.964916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:54.976859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:54.980264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:54.981466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:54.982552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:54.984366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:54.985536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:54.986696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:55.274117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:55.303872 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94ab29d1-9698-43ca-8856-9a3a5012c47f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1318 microversion: 2.1 time: 0.331265 Aug 24 03:43:55.317555 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1238/2547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:54 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:55.331265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:55.332736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:55.359392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:55.361709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:55.362823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:55.364589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:55.365738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:55.366880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:55.668001 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0371480-8245-45cc-91b0-2d3963cf2df6 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "DELETE /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43" status: 204 len: 0 microversion: 2.1 time: 1.081740 Aug 24 03:43:55.668721 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1310/2548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:54 2022] DELETE /compute/v2.1/images/9411f8e3-40b4-4e95-9c24-22fdbb065b43 => generated 0 bytes in 1084 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:43:55.680695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b5624fbd-1686-490d-8ae0-ccdb4cd903fc tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '.version_select at 0x7f1023438d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:55.692168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:55.701122 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4410398a-dc10-49eb-a12d-1fde96afe4f6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.381835 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b5624fbd-1686-490d-8ae0-ccdb4cd903fc tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] HTTP exception thrown: Image not found. Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b5624fbd-1686-490d-8ae0-ccdb4cd903fc tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Request method failure captured: Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 HTTP/1.1 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ3_1DjdzhXQoHhqw7qX1MQqsTWsMMr55Hqh3791enzbEdLlbir3oPy27a6Y75u3lNqFxIpmqbvpQcIu3ycTKYdVtGvgI1iWIAqsPj_OrxJ9I-Rc8pQInu92Wdywj8Rt1r3yC3_ePVZdtMUVV7Q3XYidVUb4zsecIFWMk7uWCytBziY Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2b5d14e6320f4a2587cb3ee64e7e98c9 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2b5d14e6320f4a2587cb3ee64e7e98c9 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerTestJSON-102057375-project Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: ae771f274012411391a0563ca2eb8cbc Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerTestJSON-102057375-project Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: exception: Image not found. Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '66825000-eaf4-402f-a951-83a21017ce03'} Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 66825000-eaf4-402f-a951-83a21017ce03 to delete Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 03:43:55.714970 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66825000-eaf4-402f-a951-83a21017ce03 could not be found. Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b5624fbd-1686-490d-8ae0-ccdb4cd903fc tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Returning 404 to user: Image not found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b5624fbd-1686-490d-8ae0-ccdb4cd903fc tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "DELETE /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03" status: 404 len: 62 microversion: 2.1 time: 0.038687 Aug 24 03:43:55.720191 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1311/2549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:55 2022] DELETE /compute/v2.1/images/66825000-eaf4-402f-a951-83a21017ce03 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:43:55.722647 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1239/2550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:55 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:55.724590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:55.725204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:55.731723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:55.732220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:55.732857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:55.733751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:55.734648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:55.735098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:55.766260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:43:55.873003 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fa7afe76-9087-4539-ba4b-6b3427df6e3e tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "DELETE /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 204 len: 0 microversion: 2.1 time: 0.153090 Aug 24 03:43:55.873954 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1312/2551] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:55 2022] DELETE /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:43:55.884931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:55.885697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:55.892701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:55.893268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:55.893766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:55.894461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:55.894910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:55.895334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.044169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:56.053843 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc103ca7-f202-4f04-87ff-b1da749c55da tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1470 microversion: 2.1 time: 0.174667 Aug 24 03:43:56.054456 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1240/2552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:55 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:56.331069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:56.332039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:56.339588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.340347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.340783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.341942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.342410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.342825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.506673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:56.518455 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-95823377-b9ba-4c04-990b-73cc36f84ef8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1318 microversion: 2.1 time: 0.191869 Aug 24 03:43:56.520566 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1313/2553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:56 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:56.531622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-08acd3c0-b83c-410b-b130-0eec0bb0872e req-46dceddb-2213-44f4-9d5b-1df0af73410a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c514243f-2dde-48fb-868d-a27be663f606", "name": "network-vif-plugged", "status": "completed", "tag": "fb0caa34-cb45-4bf3-9c7e-5578c04dc4d7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:56.542119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-08acd3c0-b83c-410b-b130-0eec0bb0872e req-46dceddb-2213-44f4-9d5b-1df0af73410a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.542600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-08acd3c0-b83c-410b-b130-0eec0bb0872e req-46dceddb-2213-44f4-9d5b-1df0af73410a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.543214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-08acd3c0-b83c-410b-b130-0eec0bb0872e req-46dceddb-2213-44f4-9d5b-1df0af73410a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.556806 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-08acd3c0-b83c-410b-b130-0eec0bb0872e req-46dceddb-2213-44f4-9d5b-1df0af73410a service nova] Creating event network-vif-plugged:fb0caa34-cb45-4bf3-9c7e-5578c04dc4d7 for instance c514243f-2dde-48fb-868d-a27be663f606 on n-h1-846470-15 Aug 24 03:43:56.562927 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-08acd3c0-b83c-410b-b130-0eec0bb0872e req-46dceddb-2213-44f4-9d5b-1df0af73410a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034869 Aug 24 03:43:56.563878 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1241/2554] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:56.721931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:56.722534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:56.729923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.730324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.730758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.731461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.731968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.732398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.896410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:56.905383 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86a1b7f2-6187-415a-b049-645849d779d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.187354 Aug 24 03:43:56.907198 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1314/2555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:56 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:57.086752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:57.086752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:57.096532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.097149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.097678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.098432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.099072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.099698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.259988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:57.270298 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11d24547-a441-47cf-9452-f3a1d6d31ed5 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1470 microversion: 2.1 time: 0.193353 Aug 24 03:43:57.270841 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1242/2556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:57 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:57.541861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:57.542576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:57.550800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.551559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.552387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.553094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.553567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.553985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.718749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:57.726657 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-61c35e9b-97f6-47d9-85af-c233f0695d50 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1318 microversion: 2.1 time: 0.188893 Aug 24 03:43:57.727268 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1315/2557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:57 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:57.927826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:57.928775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:57.935905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.936393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.936890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.937602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.938228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.938697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.203992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:58.212235 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b22f5980-97e7-4400-b133-2e4044442fd0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.288409 Aug 24 03:43:58.213082 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1243/2558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:57 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:58.293449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:58.294777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:58.302537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:58.303033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:58.303476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.304462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:58.304937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:58.305372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.479024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:58.490623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7482e312-0544-470a-beef-23f644b8bebd tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1470 microversion: 2.1 time: 0.202177 Aug 24 03:43:58.491517 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1316/2559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:58 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:58.748716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:58.749498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:58.757195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:58.757883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:58.758449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.759205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:58.759758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:58.760259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.907994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:58.909383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:58.916909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:58.917552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:58.918266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.919298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:58.920082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:58.921237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.963162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:58.973992 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c7b098d-01f8-4c59-aac0-319ac68720bc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1318 microversion: 2.1 time: 0.229860 Aug 24 03:43:58.975139 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1244/2560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:58 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:59.060031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-17917a76-62bb-4620-bd7f-da686d75cbe9 req-93ade8db-b69f-4a11-994b-b225b5f80fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ff552d-5e9a-497e-add0-2c14f712c63e", "name": "network-vif-plugged", "status": "completed", "tag": "615b5a9b-42ab-41a9-b137-40efe16cb240"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:59.076680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-17917a76-62bb-4620-bd7f-da686d75cbe9 req-93ade8db-b69f-4a11-994b-b225b5f80fb6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.079932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-17917a76-62bb-4620-bd7f-da686d75cbe9 req-93ade8db-b69f-4a11-994b-b225b5f80fb6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.081087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-17917a76-62bb-4620-bd7f-da686d75cbe9 req-93ade8db-b69f-4a11-994b-b225b5f80fb6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.104768 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0f879f7-dec3-4990-8ed3-fe4cce1bd6f9 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1815 microversion: 2.1 time: 0.202038 Aug 24 03:43:59.105766 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1317/2561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:58 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1815 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:59.112589 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-17917a76-62bb-4620-bd7f-da686d75cbe9 req-93ade8db-b69f-4a11-994b-b225b5f80fb6 service nova] Creating event network-vif-plugged:615b5a9b-42ab-41a9-b137-40efe16cb240 for instance b8ff552d-5e9a-497e-add0-2c14f712c63e on n-h2-846470-15 Aug 24 03:43:59.121110 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-17917a76-62bb-4620-bd7f-da686d75cbe9 req-93ade8db-b69f-4a11-994b-b225b5f80fb6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064879 Aug 24 03:43:59.122467 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1245/2562] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:59.131712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0cd46016-35a9-45a1-b551-3856910e017f tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:59.135100 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:43:59.135100 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:43:59.136451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cd46016-35a9-45a1-b551-3856910e017f tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.137014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cd46016-35a9-45a1-b551-3856910e017f tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.137513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cd46016-35a9-45a1-b551-3856910e017f tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.138270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cd46016-35a9-45a1-b551-3856910e017f tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.138898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cd46016-35a9-45a1-b551-3856910e017f tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.139530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cd46016-35a9-45a1-b551-3856910e017f tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.147658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:59.188077 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0cd46016-35a9-45a1-b551-3856910e017f tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.060592 Aug 24 03:43:59.189149 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1318/2563] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 03:43:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:59.236933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:59.238447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:59.252053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.253030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.253789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.254870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.255418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.255988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.515769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:59.517360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:59.528731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.531532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.535028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.536278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.536849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.537360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.583760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:59.598564 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af199e20-a639-46ef-872d-0ed07cf72973 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1314 microversion: 2.1 time: 0.366183 Aug 24 03:43:59.599328 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1246/2564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:59 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:59.819057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:59.829119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-56969649-815c-4c25-b9b9-8fcb77867815 tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1470 microversion: 2.1 time: 0.318427 Aug 24 03:43:59.830054 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1319/2565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:59 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:00.000788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:00.002668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:00.016285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.017542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.018648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.020104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.021237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.022578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.639447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:00.641404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:00.669172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.669925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.671386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.672553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.673839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.674929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:01.014274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:01.038200 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-699821a3-3bf4-4dea-a707-6644ccad0853 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1500 microversion: 2.1 time: 0.406100 Aug 24 03:44:01.039430 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1320/2566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:00 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1500 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:01.051406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:01.052969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:01.056985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:01.073985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:01.075221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:01.076233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:01.078553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:01.079735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:01.080693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:01.214078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:01.222862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:01.229710 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07c01d37-2c07-473e-bc15-dc673d49e35c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1428 microversion: 2.1 time: 0.188465 Aug 24 03:44:01.230519 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1321/2567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:01 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1428 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:01.245416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9c7ac6ed-f060-42be-871d-9874901f8a5a req-8d5cd68c-a151-4c9d-b7e7-a1d9374d621e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b81154-9101-4ed9-96ce-4134bbf5484b", "name": "network-vif-unplugged", "status": "completed", "tag": "ba6c3530-c382-4b6e-89e9-580698731037"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:01.258431 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c1ce5aa4-7f4b-4a92-b36b-4c5f6a71c5e8 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1318 microversion: 2.1 time: 1.265119 Aug 24 03:44:01.261314 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1247/2568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:59 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1318 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:01.273352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9c7ac6ed-f060-42be-871d-9874901f8a5a req-8d5cd68c-a151-4c9d-b7e7-a1d9374d621e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:01.274752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9c7ac6ed-f060-42be-871d-9874901f8a5a req-8d5cd68c-a151-4c9d-b7e7-a1d9374d621e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:01.277091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9c7ac6ed-f060-42be-871d-9874901f8a5a req-8d5cd68c-a151-4c9d-b7e7-a1d9374d621e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:01.301875 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9c7ac6ed-f060-42be-871d-9874901f8a5a req-8d5cd68c-a151-4c9d-b7e7-a1d9374d621e service nova] Creating event network-vif-unplugged:ba6c3530-c382-4b6e-89e9-580698731037 for instance 93b81154-9101-4ed9-96ce-4134bbf5484b on n-h1-846470-15 Aug 24 03:44:01.309511 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9c7ac6ed-f060-42be-871d-9874901f8a5a req-8d5cd68c-a151-4c9d-b7e7-a1d9374d621e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072413 Aug 24 03:44:01.315596 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1322/2569] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:01.498774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f69aef55-a009-42e0-bd2a-a3914c0fef57 req-1a4b9898-160a-41d3-8bb6-2eb38591d352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b81154-9101-4ed9-96ce-4134bbf5484b", "name": "network-vif-deleted", "tag": "ba6c3530-c382-4b6e-89e9-580698731037"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:01.515444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f69aef55-a009-42e0-bd2a-a3914c0fef57 req-1a4b9898-160a-41d3-8bb6-2eb38591d352 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:01.516141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f69aef55-a009-42e0-bd2a-a3914c0fef57 req-1a4b9898-160a-41d3-8bb6-2eb38591d352 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:01.517211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f69aef55-a009-42e0-bd2a-a3914c0fef57 req-1a4b9898-160a-41d3-8bb6-2eb38591d352 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:01.561259 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f69aef55-a009-42e0-bd2a-a3914c0fef57 req-1a4b9898-160a-41d3-8bb6-2eb38591d352 service nova] Creating event network-vif-deleted:ba6c3530-c382-4b6e-89e9-580698731037 for instance 93b81154-9101-4ed9-96ce-4134bbf5484b on n-h1-846470-15 Aug 24 03:44:01.635730 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f69aef55-a009-42e0-bd2a-a3914c0fef57 req-1a4b9898-160a-41d3-8bb6-2eb38591d352 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093617 Aug 24 03:44:01.639413 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1248/2570] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:02.057901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff729b4f-8973-497a-855b-fa7f644b4c22", "device": "/dev/xvdb"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:02.075937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:02.095154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.095992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.096695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.098076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.099182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.100413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.258162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:02.259561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:02.267886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.268917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.269543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.270533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.271058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.271523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.317161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.317796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.318453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.319209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lazy-loading 'fault' on Instance uuid 93b81154-9101-4ed9-96ce-4134bbf5484b {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:02.394048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae771f274012411391a0563ca2eb8cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5d14e6320f4a2587cb3ee64e7e98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:02.410970 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7f758d9a-eb9c-4acd-aade-b01af034e81d tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 200 len: 1304 microversion: 2.1 time: 0.157587 Aug 24 03:44:02.412955 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1249/2571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:02 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:02.425215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:02.427153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:02.438459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.439959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.442231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.443827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.444697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.446517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.668080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:02.679010 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91c5809b-c24a-406b-a031-3e5d207ea3b1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1508 microversion: 2.1 time: 0.261623 Aug 24 03:44:02.679609 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1250/2572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:02 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:02.706953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:02.709069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:02.724136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.725591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.726399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.727637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.728450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.729226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.082884 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-021dc7a8-f7f8-46df-b51a-810e9f49e9ed tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "POST /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033708 Aug 24 03:44:03.091971 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1323/2573] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:44:02 2022] POST /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments => generated 194 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:03.134590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:03.156211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:03.156211 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02f42e76-e4da-451d-8734-54ed5a52dee3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1508 microversion: 2.1 time: 0.452922 Aug 24 03:44:03.156211 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1251/2574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:02 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:03.179892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:03.183581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:03.194425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.195143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.195823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.196601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.197093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.197515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.289225 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b54228ca-8fca-4d1e-9075-dc15bc0940ed tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "PUT /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1080 microversion: 2.1 time: 0.113927 Aug 24 03:44:03.289885 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1324/2575] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:44:03 2022] PUT /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1080 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:03.316576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:03.317073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:03.342951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.343457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.345267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.346027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.346499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.346936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.435040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:03.435847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] [instance: 93b81154-9101-4ed9-96ce-4134bbf5484b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:03.443192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.443981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.444616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.445707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.446215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.446713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.463648 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] HTTP exception thrown: Instance 93b81154-9101-4ed9-96ce-4134bbf5484b could not be found. Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Request method failure captured: Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b HTTP/1.1 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ3_1DjdzhXQoHhqw7qX1MQqsTWsMMr55Hqh3791enzbEdLlbir3oPy27a6Y75u3lNqFxIpmqbvpQcIu3ycTKYdVtGvgI1iWIAqsPj_OrxJ9I-Rc8pQInu92Wdywj8Rt1r3yC3_ePVZdtMUVV7Q3XYidVUb4zsecIFWMk7uWCytBziY Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2b5d14e6320f4a2587cb3ee64e7e98c9 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b5d14e6320f4a2587cb3ee64e7e98c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2b5d14e6320f4a2587cb3ee64e7e98c9 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-102057375 Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesOneServerTestJSON-102057375-project Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: ae771f274012411391a0563ca2eb8cbc Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesOneServerTestJSON-102057375-project Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 93b81154-9101-4ed9-96ce-4134bbf5484b could not be found. Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '93b81154-9101-4ed9-96ce-4134bbf5484b'} Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b81154-9101-4ed9-96ce-4134bbf5484b could not be found. Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b81154-9101-4ed9-96ce-4134bbf5484b could not be found. Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:03.465873 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:03.470947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:03.470947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:03.470947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:03.470947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:03.470947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:03.470947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b81154-9101-4ed9-96ce-4134bbf5484b could not be found. Aug 24 03:44:03.470947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:03.472532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] Returning 404 to user: Instance 93b81154-9101-4ed9-96ce-4134bbf5484b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:03.473634 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92e857f7-b480-43e8-a3a1-3aaf766a957c tempest-ImagesOneServerTestJSON-102057375 tempest-ImagesOneServerTestJSON-102057375-project] 10.222.0.58 "GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b" status: 404 len: 111 microversion: 2.1 time: 0.042936 Aug 24 03:44:03.474694 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1325/2576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:03 2022] GET /compute/v2.1/servers/93b81154-9101-4ed9-96ce-4134bbf5484b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:44:03.557614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:03.569038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-60cd282f-565e-414d-913d-1a18d2af2c33 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1506 microversion: 2.1 time: 0.257905 Aug 24 03:44:03.569594 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1252/2577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:03 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:03.590721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:03.591446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:03.599111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.599968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.600484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.601258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.601919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.602544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.801797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:03.810523 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc4abd5c-0dd4-49ed-97ae-e3a168b194dc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1506 microversion: 2.1 time: 0.223825 Aug 24 03:44:03.812943 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1326/2578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:03 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:03.847418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:03.853129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:03.865915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e8e01d6-8dc9-4dff-8435-48856f4d9e44"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:03.869920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:03.870060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.871876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.873245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.874814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.876488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.879309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.879846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.880108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.880766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.881787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.883014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.883995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.035779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:04.036234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:04.038744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:04.039285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:04.039867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:04.154582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:04.169716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:04.172147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:04.173276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.179879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:04.180482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:04.181241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.245803 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-77a20cb5-f2eb-4748-a904-73b2e5e0f0c6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "POST /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e/action" status: 202 len: 1112 microversion: 2.1 time: 0.414558 Aug 24 03:44:04.248669 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1253/2579] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:44:03 2022] POST /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e/action => generated 1112 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 03:44:04.269431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:04.270131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:04.281318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:04.282038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:04.282651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.283499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:04.284125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:04.284658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.358549 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-33c3b44f-df9b-47f6-b469-a6e6e1d06d8a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500417 Aug 24 03:44:04.359115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1327/2580] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:44:03 2022] POST /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:04.567786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:04.579288 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74efefd0-1bf8-40f8-9e1d-e55617f2c52e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.315091 Aug 24 03:44:04.580565 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1254/2581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:04 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:05.608540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:05.610088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:05.617454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:05.618219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:05.620179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:05.621166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:05.622088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:05.624282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:05.816897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:05.831416 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3cff494f-11e4-4438-883c-96fbcaeb2ced tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.227949 Aug 24 03:44:05.834578 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1328/2582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:05 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:06.856162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:06.856926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:06.866444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:06.867253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:06.867900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:06.868788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:06.869397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:06.870149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:07.040773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:07.051980 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67dfb464-8b1d-4d6d-8d69-86c1c9018782 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.200504 Aug 24 03:44:07.052755 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1255/2583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:06 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:07.550095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c663eecd-16fd-464a-a539-d63c67def8bc tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10227b5d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:07.600780 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c663eecd-16fd-464a-a539-d63c67def8bc tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/f901becb-71ce-482e-8956-e24cfd83e950" status: 200 len: 661 microversion: 2.1 time: 0.055516 Aug 24 03:44:07.601514 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1329/2584] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:07 2022] GET /compute/v2.1/images/f901becb-71ce-482e-8956-e24cfd83e950 => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:07.615301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d11ccbe3-cc9a-46ce-a915-b1be3a99c951 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a780550>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:07.692797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d11ccbe3-cc9a-46ce-a915-b1be3a99c951 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/f901becb-71ce-482e-8956-e24cfd83e950" status: 200 len: 661 microversion: 2.1 time: 0.081885 Aug 24 03:44:07.694325 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1256/2585] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:07 2022] GET /compute/v2.1/images/f901becb-71ce-482e-8956-e24cfd83e950 => generated 661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:08.074881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:08.075499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:08.088577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:08.089078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:08.089524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:08.090254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:08.090727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:08.091159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:08.255862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:08.264813 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65ec91ed-5d0a-4295-9b38-7a998f2fbb49 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.195196 Aug 24 03:44:08.265686 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1330/2586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:08 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:09.287052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:09.289655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:09.301776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:09.302894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:09.303576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:09.304348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:09.304807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:09.305263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:09.408950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-625d5805-bf69-4a5c-8427-3019f0ae3f12 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022e7bf70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:09.421325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:09.480779 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-625d5805-bf69-4a5c-8427-3019f0ae3f12 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/9ea7a2b9-daaa-4445-92c8-500a440e63a5" status: 200 len: 662 microversion: 2.1 time: 0.078055 Aug 24 03:44:09.481458 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1331/2587] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:09 2022] GET /compute/v2.1/images/9ea7a2b9-daaa-4445-92c8-500a440e63a5 => generated 662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:09.496619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20396d4b-53d6-4800-bb0c-707accbfe1e6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022fd71f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:09.497276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:09.506184 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26d2da2e-a236-4eae-9afa-1c4d2c62e93a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.223973 Aug 24 03:44:09.521536 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1257/2588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:09 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:09.555039 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20396d4b-53d6-4800-bb0c-707accbfe1e6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/9ea7a2b9-daaa-4445-92c8-500a440e63a5" status: 200 len: 662 microversion: 2.1 time: 0.063517 Aug 24 03:44:09.555229 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1332/2589] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:09 2022] GET /compute/v2.1/images/9ea7a2b9-daaa-4445-92c8-500a440e63a5 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:10.530769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:10.531512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:10.539389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:10.539908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:10.540362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:10.541043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:10.541692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:10.542119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:10.706394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:10.719450 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-75a51b13-87cd-4e38-8649-e27a09239523 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.192606 Aug 24 03:44:10.720202 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1258/2590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:10 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:11.307562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03b42594-3c5a-4cf2-9170-0bb6c84e70f3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10232df310>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:11.366156 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03b42594-3c5a-4cf2-9170-0bb6c84e70f3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/ca17815b-f3d7-4166-b272-131526ea458a" status: 200 len: 662 microversion: 2.1 time: 0.062858 Aug 24 03:44:11.367469 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1333/2591] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:11 2022] GET /compute/v2.1/images/ca17815b-f3d7-4166-b272-131526ea458a => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:11.381231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74def3bd-ed89-4f7a-9a87-49ba62aad370 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10343e0820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:11.452378 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74def3bd-ed89-4f7a-9a87-49ba62aad370 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/ca17815b-f3d7-4166-b272-131526ea458a" status: 200 len: 662 microversion: 2.1 time: 0.073386 Aug 24 03:44:11.456026 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1259/2592] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:11 2022] GET /compute/v2.1/images/ca17815b-f3d7-4166-b272-131526ea458a => generated 662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:11.611520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-260846085", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:11.683474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:44:11.744519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:11.745421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:11.757799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.758326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.758930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:11.759939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.760919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.761617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:11.970773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:11.974371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:11.975611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:11.975611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:11.976002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:11.976503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:11.982859 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4911c9fa-e39b-4a58-9282-dedb033ced2b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.244115 Aug 24 03:44:11.984240 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1260/2593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:11 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:11.992432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.995418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.996215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.000296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.001126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.001782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.023761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Getting quotas for project ecbbd1614938483089ab1d1efc22dbed. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:12.030256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Getting quotas for user fb1dd0f130454573873a7f5e1542e874 and project ecbbd1614938483089ab1d1efc22dbed. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:12.045533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:44:12.048724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:44:12.125729 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-671b078c-e348-4f11-beb3-1c11c80b5ca3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530477 Aug 24 03:44:12.156349 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1334/2594] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:44:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:44:12.364328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-592992512", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:12.464645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:44:12.720021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:12.721284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:12.722144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:12.723527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:12.725240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:12.736838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.737765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.738194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.739722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.740370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.741075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.776324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Getting quotas for project ecbbd1614938483089ab1d1efc22dbed. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:12.785422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Getting quotas for user fb1dd0f130454573873a7f5e1542e874 and project ecbbd1614938483089ab1d1efc22dbed. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:12.804213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:44:12.807099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:44:12.861623 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-628c872b-f1ba-41c8-b00d-849a7c5e825e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512573 Aug 24 03:44:12.862217 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1261/2595] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:44:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:44:12.876816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b26a9fd-01e1-419f-ad26-c931b013243b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:12.877604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7b26a9fd-01e1-419f-ad26-c931b013243b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:12.946771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7b26a9fd-01e1-419f-ad26-c931b013243b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:12.957740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b26a9fd-01e1-419f-ad26-c931b013243b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1217 microversion: 2.1 time: 0.085063 Aug 24 03:44:12.968244 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1335/2596] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:12 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:13.016517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:13.017328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:13.028330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:13.031021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:13.033057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:13.034255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:13.034984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:13.035824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:13.316171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:13.329529 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5fab708d-15cd-48c2-bec1-3421a07a1bf6 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.326815 Aug 24 03:44:13.331056 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1262/2597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:13 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:13.982249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:13.983205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:14.014003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.020489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.020954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.021724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.022383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.022827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.128549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:14.137555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75a8e645-7993-4a09-adf4-5f2b5b16752e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1213 microversion: 2.1 time: 0.159949 Aug 24 03:44:14.140630 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1336/2598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:13 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:14.360371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:14.360760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:14.386899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.387888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.388916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.390500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.391407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.392225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.657864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:14.675441 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6488eb9c-a1fa-4143-815b-38d2d9412079 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.322391 Aug 24 03:44:14.688914 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1263/2599] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:14 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:15.163144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:15.163819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:15.171837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.172191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.172643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.173372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.173828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.174251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.245054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:15.256269 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b916e29c-53b2-498d-9b42-fdcb46138384 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1277 microversion: 2.1 time: 0.097544 Aug 24 03:44:15.256878 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1337/2600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:15 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:15.703057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:15.704206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:15.714917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.715869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.716501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.717608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.718493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.719085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:16.081739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:16.092601 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9121d56b-0dbd-4e87-b67a-59395737e712 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.397283 Aug 24 03:44:16.093205 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1264/2601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:15 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:16.285946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:16.288407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:16.303733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:16.305061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:16.306179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:16.307510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:16.308691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:16.309407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:16.387409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:16.399956 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1ccf79a7-78f2-42da-a1a1-dee14477d2fb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1275 microversion: 2.1 time: 0.124670 Aug 24 03:44:16.401665 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1338/2602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:16 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:16.866481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9b9a8c92-fef1-4f2c-b71f-205c80d46afe req-851ecb03-d5d9-47aa-9325-0c25706137f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a57fff-dd1c-4da6-a069-721eeb327ba9", "tag": "7b45f896-efbb-49d1-885b-f24770cf2671"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:16.881834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9b9a8c92-fef1-4f2c-b71f-205c80d46afe req-851ecb03-d5d9-47aa-9325-0c25706137f7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:16.882667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9b9a8c92-fef1-4f2c-b71f-205c80d46afe req-851ecb03-d5d9-47aa-9325-0c25706137f7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:16.883327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9b9a8c92-fef1-4f2c-b71f-205c80d46afe req-851ecb03-d5d9-47aa-9325-0c25706137f7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:16.906011 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9b9a8c92-fef1-4f2c-b71f-205c80d46afe req-851ecb03-d5d9-47aa-9325-0c25706137f7 service nova] Creating event network-changed:7b45f896-efbb-49d1-885b-f24770cf2671 for instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 on n-h1-846470-15 Aug 24 03:44:16.914283 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9b9a8c92-fef1-4f2c-b71f-205c80d46afe req-851ecb03-d5d9-47aa-9325-0c25706137f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051109 Aug 24 03:44:16.915315 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1265/2603] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:17.115968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:17.117168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:17.127427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:17.128242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:17.128697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.129467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:17.129940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:17.130559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.135786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:17.398424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:17.422715 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f5c7ed44-f354-4da9-b073-504f39da4d09 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.311949 Aug 24 03:44:17.423897 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1339/2604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:17 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:17.424922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:17.425764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:17.437841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:17.440580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:17.443960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.445070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:17.445792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:17.446241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.733865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:17.756476 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ed264246-a26a-4678-9f7b-455b9d725690 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.336413 Aug 24 03:44:17.772603 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1266/2605] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:17 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:18.457122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:18.460402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:18.475750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.477321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.478386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.480931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.482506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.483462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.809317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:18.826359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:18.861847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.862799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.863707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.865094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.865951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.866710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.385118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:19.405262 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c95c15e-9f68-484e-8af2-ec0a4f7088f9 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.953007 Aug 24 03:44:19.407148 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1340/2606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:18 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:19.435389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:19.441435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:19.463624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.464666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.465494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.467177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.468113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.469179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.655147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:19.670543 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a40f514-f17e-42f5-9fa4-bcacbe56fcb3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.868517 Aug 24 03:44:19.672927 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1267/2607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:18 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:19.682219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-63c7e88d-0b1d-476b-8fc7-10b3140af13a req-3e248574-df56-45b0-9cf5-29420f5ef6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f", "tag": "3a1a2e99-33ae-440a-8de1-d607808576ba"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:19.703584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-63c7e88d-0b1d-476b-8fc7-10b3140af13a req-3e248574-df56-45b0-9cf5-29420f5ef6f7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.704824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-63c7e88d-0b1d-476b-8fc7-10b3140af13a req-3e248574-df56-45b0-9cf5-29420f5ef6f7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.705624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-63c7e88d-0b1d-476b-8fc7-10b3140af13a req-3e248574-df56-45b0-9cf5-29420f5ef6f7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.723723 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-63c7e88d-0b1d-476b-8fc7-10b3140af13a req-3e248574-df56-45b0-9cf5-29420f5ef6f7 service nova] Creating event network-changed:3a1a2e99-33ae-440a-8de1-d607808576ba for instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f on n-h1-846470-15 Aug 24 03:44:19.732893 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-63c7e88d-0b1d-476b-8fc7-10b3140af13a req-3e248574-df56-45b0-9cf5-29420f5ef6f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057327 Aug 24 03:44:19.734290 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1268/2608] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:19.887974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5565be6e-d2aa-49b5-a373-d160c0869a1e tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1861 microversion: 2.1 time: 0.476592 Aug 24 03:44:19.889928 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1341/2609] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:19 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1861 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:19.921678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846470-15", "block_migration": true, "disk_over_commit": false}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:19.925209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:19.935151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.935943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.936946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.938045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.938868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.940118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.042992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lazy-loading 'flavor' on Instance uuid a79baa30-fa4f-47de-8d26-6d070734bccd {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:20.068540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Going to try to live migrate instance to n-h2-846470-15 {{(pid=122535) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:44:20.116555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:20.439899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:20.440546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:20.453023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.454139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.454965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.456522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.457567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.458376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.713311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:20.730170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab5d39aa-5a58-43c7-a3b3-641c75a37641 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.300015 Aug 24 03:44:20.731416 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1342/2610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:20 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:20.757247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:20.757879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:20.765157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.765999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.766612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.768300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.768780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.769220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.039063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:21.055171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23095b65-1f07-43dd-98c3-5ff503fffcd0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.321992 Aug 24 03:44:21.056246 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1343/2611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:20 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:21.762811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:21.764375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:21.780269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.780657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.781038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.781996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.782630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.783229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.011400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:22.108763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:22.124632 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f8871da-b2f8-4462-b187-b39b45f079c7 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.367242 Aug 24 03:44:22.126806 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1344/2612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:21 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:22.133437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:22.134270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:22.144448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.145157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.145722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.146720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.147365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.148228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.755173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:22.796051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:22.952485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:23.053158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:23.061936 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ca30a3b-9c5c-41d2-aeb8-c531d7d7c025 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.933842 Aug 24 03:44:23.071332 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1345/2613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:22 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:23.177573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.179563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:23.202811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.203773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.204587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.214928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.218999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.220296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.664116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:23.674790 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0fad3eba-f45a-494f-9531-2be1d7bcb567 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.504628 Aug 24 03:44:23.676161 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1346/2614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:23 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:23.682939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.684095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:23.692316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.693108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.693765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.694827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.695523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.696233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.731022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:44:23.786821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2975f3d8-ab28-4a8b-acee-35cc18826989 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/action" status: 202 len: 0 microversion: 2.1 time: 3.871225 Aug 24 03:44:23.787684 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1269/2615] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:44:19 2022] POST /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/action => generated 0 bytes in 3874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:23.799130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.800365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:23.809047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:23.826570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.827431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.828189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.829318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.829972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.830585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.858117 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d52050c2-8441-48d9-a11e-d1bfac0ccaf4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 204 len: 0 microversion: 2.1 time: 0.179346 Aug 24 03:44:23.859358 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1347/2616] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:44:23 2022] DELETE /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:44:23.881196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.882339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:23.895334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.899859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.900469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.902146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.903168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.905005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.181995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:24.194309 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9448b1ab-3533-4238-9ca8-bed129c8af04 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1552 microversion: 2.1 time: 0.329292 Aug 24 03:44:24.194903 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1348/2617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:23 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1552 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:24.200453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:24.201496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:24.211354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.211863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.212216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.212937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.213401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.213832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.263208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:24.275906 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a90c8e2e-787d-44b4-adeb-79e2493ba312 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.482693 Aug 24 03:44:24.276616 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1270/2618] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:23 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:24.384365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:24.393943 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd4df8d0-eb24-4074-800e-cabc2e88ec9a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.197836 Aug 24 03:44:24.394756 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1349/2619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:24 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:24.715080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:24.716248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:24.729038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.729850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.730519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.731722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.732385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.733062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.959300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:24.968745 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cde55773-cb13-4f84-9761-da0e68216f86 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.261024 Aug 24 03:44:24.969338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1271/2620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:24 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:25.216168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:25.216786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:25.225541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.226032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.226479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.227193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.227656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.228106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.300105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:25.300954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:25.307597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.308421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.309010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.309964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.310529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.311287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.485397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:25.503874 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5ac09e0-8735-49ef-b49d-53626cb7e3a7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.209676 Aug 24 03:44:25.505419 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1272/2621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:25 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:25.513874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:25.518710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:25.520518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:25.525175 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5112f8b8-802a-4459-9491-bcc63684ceca tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1552 microversion: 2.1 time: 0.312531 Aug 24 03:44:25.526112 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1350/2622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:25 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1552 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:25.535325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.536858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.538237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.540185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.542402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.543859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.706630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:25.715991 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-894a75b1-8a5c-45ea-91ed-58e1e71d0cff tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.208832 Aug 24 03:44:25.716581 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1273/2623] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:25 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:25.993229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:25.994387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:26.005688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.006933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.007965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.010634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.011641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.012539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.119328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-375e7d9d-bdb4-4336-bbe0-f4d164dcc838 req-1401876d-1564-47f5-8d65-4b2075dbf053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a57fff-dd1c-4da6-a069-721eeb327ba9", "name": "network-vif-plugged", "status": "completed", "tag": "7b45f896-efbb-49d1-885b-f24770cf2671"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:26.131269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-375e7d9d-bdb4-4336-bbe0-f4d164dcc838 req-1401876d-1564-47f5-8d65-4b2075dbf053 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.132273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-375e7d9d-bdb4-4336-bbe0-f4d164dcc838 req-1401876d-1564-47f5-8d65-4b2075dbf053 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.133082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-375e7d9d-bdb4-4336-bbe0-f4d164dcc838 req-1401876d-1564-47f5-8d65-4b2075dbf053 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.149681 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-375e7d9d-bdb4-4336-bbe0-f4d164dcc838 req-1401876d-1564-47f5-8d65-4b2075dbf053 service nova] Creating event network-vif-plugged:7b45f896-efbb-49d1-885b-f24770cf2671 for instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 on n-h1-846470-15 Aug 24 03:44:26.157163 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-375e7d9d-bdb4-4336-bbe0-f4d164dcc838 req-1401876d-1564-47f5-8d65-4b2075dbf053 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044128 Aug 24 03:44:26.158373 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1274/2624] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:26.307025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:26.319488 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f40d212-a78b-48d1-bf34-452acd24ec8d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.333554 Aug 24 03:44:26.331767 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1351/2625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:25 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:26.530008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:26.530713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:26.540313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.540936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.541992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.543598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.544792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.546011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.563514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:26.564162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:26.574711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.575204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.575901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.576863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.577561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.578210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.795332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:26.812273 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-afa113da-09fc-4170-bf5d-39c5240b3c11 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.285986 Aug 24 03:44:26.813478 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1275/2626] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:26 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:26.822781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:26.824296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:26.831575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:26.836555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.837780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.839066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.840622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.841718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.842823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.848170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99198547-d4f8-4d00-ad35-88d570b46224 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1552 microversion: 2.1 time: 0.289426 Aug 24 03:44:26.852333 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1352/2627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:26 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1552 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:27.038901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:27.049472 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c49ee31a-f6ad-4fee-9f76-6afd90ba7f26 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.233642 Aug 24 03:44:27.050233 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1276/2628] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:26 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:27.344705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:27.346522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:27.355779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.356569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.357336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.359412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.360319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.360912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.553544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:27.565765 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e67973e6-01d0-4d93-94e1-fcfbd5125477 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.227399 Aug 24 03:44:27.566529 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1353/2629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:27 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:27.836038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:27.837332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:27.854123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.854982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.855545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.856980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.860453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.861175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.874130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:27.875231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:27.885712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.886376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.887295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.888552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.890271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.891314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.899552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:28.073004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.085700 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-30de382a-e160-46a0-9a58-192222e13a67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.254256 Aug 24 03:44:28.087871 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1277/2630] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:27 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:28.096710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:28.097944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:28.106169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.106657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.107841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.109065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.109943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.110664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.117470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.143545 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-39ec8f06-e55a-40c0-a2b6-ec404810e027 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1552 microversion: 2.1 time: 0.271619 Aug 24 03:44:28.143545 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1354/2631] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:27 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1552 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:28.324651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.340934 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-000e156a-75e5-4941-9172-f544f2168f74 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.251678 Aug 24 03:44:28.341814 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1278/2632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:28 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:28.588370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:28.589083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:28.596824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.597361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.598097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.598858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.599272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.599712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.754183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.764807 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23d90f01-2d83-42dd-bbbd-d7c44532aac3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.180112 Aug 24 03:44:28.765415 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1355/2633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:28 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:29.168038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:29.172031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:29.178908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.187040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.187783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.188954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.189659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.190506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.458558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:29.482532 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4aeccfce-b0d4-43c0-a804-813414f5f7d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1552 microversion: 2.1 time: 0.323179 Aug 24 03:44:29.484652 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1356/2634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:29 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1552 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:29.499466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:29.501077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:29.516599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.518450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.520068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.522230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.523286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.525576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.622915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:29.625847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:29.641044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.642439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.643478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.646286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.647386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.650305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.786355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:29.796632 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e5d6327b-d6f8-40d8-bc19-55ee680e7b7d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.306437 Aug 24 03:44:29.801776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1357/2635] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:29 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:29.824190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:29.831167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:29.845425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.847470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.848363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.849647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.850395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.851360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.225324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:30.244439 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d752ec8-74b1-4ce6-8a04-bb91df31374f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1517 microversion: 2.1 time: 0.439426 Aug 24 03:44:30.245325 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1358/2636] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:29 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:30.508950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:30.512847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:30.541114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.541962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.542743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.544043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.544869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.545717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.739587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:30.768989 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4efb157c-4d6f-4bf7-99a4-f437c91d9536 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1510 microversion: 2.1 time: 0.263683 Aug 24 03:44:30.770128 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1359/2637] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:30 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:30.779981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-35cc9492-8b43-4aa3-bb28-673caab2b902 req-0766a59a-7643-4557-aed1-bffc8ea2cba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c514243f-2dde-48fb-868d-a27be663f606", "name": "network-vif-deleted", "tag": "fb0caa34-cb45-4bf3-9c7e-5578c04dc4d7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:30.812106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-35cc9492-8b43-4aa3-bb28-673caab2b902 req-0766a59a-7643-4557-aed1-bffc8ea2cba5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.813095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-35cc9492-8b43-4aa3-bb28-673caab2b902 req-0766a59a-7643-4557-aed1-bffc8ea2cba5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.813701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-35cc9492-8b43-4aa3-bb28-673caab2b902 req-0766a59a-7643-4557-aed1-bffc8ea2cba5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.820775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:30.835772 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f1e12463-6126-4ce8-a7c8-1031f82bc535 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 1.726205 Aug 24 03:44:30.836783 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1279/2638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:29 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:30.842920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:30.843654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:30.864046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-35cc9492-8b43-4aa3-bb28-673caab2b902 req-0766a59a-7643-4557-aed1-bffc8ea2cba5 service nova] Creating event network-vif-deleted:fb0caa34-cb45-4bf3-9c7e-5578c04dc4d7 for instance c514243f-2dde-48fb-868d-a27be663f606 on n-h1-846470-15 Aug 24 03:44:30.866426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.867207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.871174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.872313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.872867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.877883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.879557 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-35cc9492-8b43-4aa3-bb28-673caab2b902 req-0766a59a-7643-4557-aed1-bffc8ea2cba5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106004 Aug 24 03:44:30.880832 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1360/2639] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:31.102792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:31.121627 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a624f8bb-47f6-4635-90ab-8a7a55b16fc5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.281736 Aug 24 03:44:31.134142 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1280/2640] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:30 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:31.285899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:31.287465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:31.293124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:31.303440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.304286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.304938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.305973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.306822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.307401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.524817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:31.534527 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9f9cc224-a831-4704-b6ef-7a353e3eea1d tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1523 microversion: 2.1 time: 0.265396 Aug 24 03:44:31.535139 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1361/2641] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:31 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:31.811284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:31.812478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:31.821031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.822127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.822544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.824383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.825366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.826433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.875588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:31.881851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:31.894511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.895028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.895470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.896220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.896680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.897109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.953115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:31.962821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fff914cf-d54b-4184-b690-77f49b9a14f8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1345 microversion: 2.1 time: 0.155939 Aug 24 03:44:31.963625 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1281/2642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:31 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:32.154071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:32.155113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:32.170207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.170663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.171335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.172111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.172574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.173012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.224264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:32.245870 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d306b240-12a3-44c3-852b-f4380cf4c76f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.374630 Aug 24 03:44:32.263077 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1362/2643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:31 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:32.372475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:32.384012 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-48b7ab21-820f-4e3b-a5f3-131d49dd8c56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.234606 Aug 24 03:44:32.389095 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1282/2644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:32 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:32.563746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:32.564922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:32.584106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.586075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.587110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.590324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.593006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.593635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.765798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:32.777128 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a12f2ef0-0f94-4f82-a4f8-51e1faf772a3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1523 microversion: 2.1 time: 0.222452 Aug 24 03:44:32.788104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-15d2e4e6-757e-4cfd-918d-7a2f2831a63b req-d28d8f07-62a1-4047-85cb-389b1ecb9103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f", "name": "network-vif-plugged", "status": "completed", "tag": "3a1a2e99-33ae-440a-8de1-d607808576ba"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:32.795232 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1363/2645] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:32 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:32.807820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-15d2e4e6-757e-4cfd-918d-7a2f2831a63b req-d28d8f07-62a1-4047-85cb-389b1ecb9103 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.808621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-15d2e4e6-757e-4cfd-918d-7a2f2831a63b req-d28d8f07-62a1-4047-85cb-389b1ecb9103 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.809414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-15d2e4e6-757e-4cfd-918d-7a2f2831a63b req-d28d8f07-62a1-4047-85cb-389b1ecb9103 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.825981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-15d2e4e6-757e-4cfd-918d-7a2f2831a63b req-d28d8f07-62a1-4047-85cb-389b1ecb9103 service nova] Creating event network-vif-plugged:3a1a2e99-33ae-440a-8de1-d607808576ba for instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f on n-h1-846470-15 Aug 24 03:44:32.834042 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-15d2e4e6-757e-4cfd-918d-7a2f2831a63b req-d28d8f07-62a1-4047-85cb-389b1ecb9103 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048841 Aug 24 03:44:32.835977 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1283/2646] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:32.984937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:32.985775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:32.994239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.994936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.995484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.996527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.997100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.997634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.117519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:33.134751 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bfd1eda-2534-4ebd-96fc-e36d8dd1d930 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1345 microversion: 2.1 time: 0.153877 Aug 24 03:44:33.135486 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1364/2647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:32 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:33.282324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:33.283106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:33.298496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:33.299313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:33.300124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.301201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:33.301839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:33.302208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.412324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:33.413937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:33.428979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:33.430467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:33.431908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.433739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:33.434713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:33.436098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.551244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:33.575622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc39b645-7d50-4c7b-afd6-3dc4a1b91100 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.300445 Aug 24 03:44:33.577935 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1284/2648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:33 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:33.642493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:33.654796 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55ac8ed0-4a50-4eb2-afd9-941adcb0b1e3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1317 microversion: 2.1 time: 0.250901 Aug 24 03:44:33.666744 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1365/2649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:33 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:33.800759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:33.801502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:33.808570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:33.809382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:33.809806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.810651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:33.811297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:33.811791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.056612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:34.084474 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-031103c2-823d-4aa4-80d0-2d23d4d9d8cf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1523 microversion: 2.1 time: 0.287392 Aug 24 03:44:34.085789 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1285/2650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:33 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:34.117243 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:44:34.118163 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 03:44:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:44:34.161742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:34.163252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:34.177533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.178799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.179546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.181002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.182247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.183174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.302241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:34.314415 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa93b728-188f-4649-9264-97320c9182fc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1345 microversion: 2.1 time: 0.160485 Aug 24 03:44:34.315303 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1366/2651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:34 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1345 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:34.605623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:34.606576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:34.625304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.625778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.626401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.627310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.627800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.628224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.673011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:34.684763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:34.686677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:34.703692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.704301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.704813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.705612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.706080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.706857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.961544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:34.983889 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-391b06b5-cd29-4f8b-97d9-f4de76ea2851 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.388273 Aug 24 03:44:35.000267 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1286/2652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:34 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:35.014767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:35.025091 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ab8fecc-b184-47d0-b941-8fecf229edf4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1467 microversion: 2.1 time: 0.350829 Aug 24 03:44:35.025704 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1367/2653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:34 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1467 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:35.046238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:35.047001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:35.054517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.054969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.055308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.056305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.056702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.057136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.117256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:35.117969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:35.126742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.127228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.127794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.128407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.128865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.129294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.398341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:35.399530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:35.411758 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e7fd0e2f-ed0f-4cf6-a8ef-e484b2f268ea tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 200 len: 1465 microversion: 2.1 time: 0.367185 Aug 24 03:44:35.414509 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1287/2654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:35 2022] GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 1465 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:35.418235 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-27cedaa9-7153-41a4-aad8-0c46c1cbc77e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1523 microversion: 2.1 time: 0.306825 Aug 24 03:44:35.422081 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1368/2655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:35 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:35.430404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a6d471b6-fefa-406a-a97b-8e55ff436e15 req-9bb67e5d-4265-4468-8c87-bfee57fa3575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ff552d-5e9a-497e-add0-2c14f712c63e", "name": "network-vif-unplugged", "status": "completed", "tag": "615b5a9b-42ab-41a9-b137-40efe16cb240"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:35.438472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:35.441514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:35.449942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a6d471b6-fefa-406a-a97b-8e55ff436e15 req-9bb67e5d-4265-4468-8c87-bfee57fa3575 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.452237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a6d471b6-fefa-406a-a97b-8e55ff436e15 req-9bb67e5d-4265-4468-8c87-bfee57fa3575 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.459365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a6d471b6-fefa-406a-a97b-8e55ff436e15 req-9bb67e5d-4265-4468-8c87-bfee57fa3575 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.469207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.470608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.472282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.473989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.475135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.477115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.491785 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a6d471b6-fefa-406a-a97b-8e55ff436e15 req-9bb67e5d-4265-4468-8c87-bfee57fa3575 service nova] Creating event network-vif-unplugged:615b5a9b-42ab-41a9-b137-40efe16cb240 for instance b8ff552d-5e9a-497e-add0-2c14f712c63e on n-h2-846470-15 Aug 24 03:44:35.511209 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a6d471b6-fefa-406a-a97b-8e55ff436e15 req-9bb67e5d-4265-4468-8c87-bfee57fa3575 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087390 Aug 24 03:44:35.513152 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1288/2656] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:35.526580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:35.528447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:35.546616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.549900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.551489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.554270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.555258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.556390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.710069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lazy-loading 'services' on Instance uuid 5650d75d-2bd5-425e-8265-de0c96bb9d09 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:35.723236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:35.746198 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-558a1cee-423e-4175-840b-a4295662d5b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1345 microversion: 2.1 time: 0.229300 Aug 24 03:44:35.747697 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1289/2657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:35 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:35.764220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1542949645"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:35.769785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:35.782768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.784468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.785460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.787474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.788732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.790202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.886467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81cf1491-a3ee-473f-8a32-88f81f1e51ea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/os-volume_attachments/f3af96c0-f517-4e21-a967-0dda3aa0136f" status: 202 len: 0 microversion: 2.1 time: 0.461802 Aug 24 03:44:35.887282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1369/2658] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 03:44:35 2022] DELETE /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/os-volume_attachments/f3af96c0-f517-4e21-a967-0dda3aa0136f => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:36.041613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:36.044685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:36.073080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.075073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.076796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.079279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.084823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.086889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.282686 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01735388-5128-40db-8f56-863c09b9b0a1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "POST /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9/action" status: 202 len: 0 microversion: 2.1 time: 0.527249 Aug 24 03:44:36.286761 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1290/2659] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:44:35 2022] POST /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 03:44:36.304031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e4428834-c02f-4f61-9765-6f7e6d282363 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102b500ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:36.408080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:36.413959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:36.420173 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e4428834-c02f-4f61-9765-6f7e6d282363 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.125307 Aug 24 03:44:36.421922 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1291/2660] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:36 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:36.438579 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3ffa66a-7e85-4fdd-82b7-12765728b6a8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.426174 Aug 24 03:44:36.441177 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1370/2661] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:36 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:36.460318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:36.461187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:36.469881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.470536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.471085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.472723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.473824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.474370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.664920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:36.702666 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bcc6d2bc-f4c9-4234-8e4a-da03cbc56974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1523 microversion: 2.1 time: 0.243808 Aug 24 03:44:36.707606 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1292/2662] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:36 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:36.786934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:36.788911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:36.802330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.804072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.805175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.806655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.808073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.809539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.918773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:36.936575 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f5bdbb7-a6b6-452e-8292-089d40427ffa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1345 microversion: 2.1 time: 0.149070 Aug 24 03:44:36.936575 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1371/2663] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:36 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:37.441076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7c724f6e-dee5-437d-b0fa-17f415564852 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102b485d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:37.478993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:37.485029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:37.499147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:37.502462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:37.503501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:37.505367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:37.506573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:37.507711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:37.536361 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7c724f6e-dee5-437d-b0fa-17f415564852 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.099158 Aug 24 03:44:37.537449 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1293/2664] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:37 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:37.744139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:37.745499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:37.767184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:37.773618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:37.774272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:37.775124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:37.777244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:37.777842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:38.087414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:38.096270 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8616410a-fd7e-469a-a9da-2765e8369432 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1523 microversion: 2.1 time: 0.358795 Aug 24 03:44:38.096844 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1294/2665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:37 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:38.104916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-988b0f72-293d-4387-a228-3781c5e57b7f req-99e45461-2ecf-4cca-9e2f-ce9c2ebe0a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ff552d-5e9a-497e-add0-2c14f712c63e", "name": "network-vif-plugged", "status": "completed", "tag": "615b5a9b-42ab-41a9-b137-40efe16cb240"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:38.122682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-988b0f72-293d-4387-a228-3781c5e57b7f req-99e45461-2ecf-4cca-9e2f-ce9c2ebe0a1d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:38.123271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-988b0f72-293d-4387-a228-3781c5e57b7f req-99e45461-2ecf-4cca-9e2f-ce9c2ebe0a1d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:38.123804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-988b0f72-293d-4387-a228-3781c5e57b7f req-99e45461-2ecf-4cca-9e2f-ce9c2ebe0a1d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:38.162367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-988b0f72-293d-4387-a228-3781c5e57b7f req-99e45461-2ecf-4cca-9e2f-ce9c2ebe0a1d service nova] Creating event network-vif-plugged:615b5a9b-42ab-41a9-b137-40efe16cb240 for instance b8ff552d-5e9a-497e-add0-2c14f712c63e on n-h2-846470-15 Aug 24 03:44:38.169424 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-988b0f72-293d-4387-a228-3781c5e57b7f req-99e45461-2ecf-4cca-9e2f-ce9c2ebe0a1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071359 Aug 24 03:44:38.170333 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1295/2666] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:38.178542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:38.180522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:38.191425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:38.191964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:38.192864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:38.194037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:38.194683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:38.200143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:38.205403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:38.223467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90d3deb9-65c1-4de1-a90e-4d0be855ca29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.754837 Aug 24 03:44:38.228974 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1372/2667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:37 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:38.468067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:38.489660 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-081a4767-37fb-44e2-ad94-a3117544d7df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1345 microversion: 2.1 time: 0.317766 Aug 24 03:44:38.490327 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1296/2668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:38 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1345 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:38.563437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dad8ea06-01d7-4767-8856-8339b38f6d48 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10230a1430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:38.621680 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dad8ea06-01d7-4767-8856-8339b38f6d48 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.063876 Aug 24 03:44:38.623180 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1373/2669] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:38 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:38.687302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Calling method '.version_select at 0x7f103433aaf0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:38.688301 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:38.688301 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:44:38.690086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:38.690086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:38.690537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:38.708713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:38.709234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:38.710003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:38.722932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:38.723996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:38.723996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:38.731916 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b61eec22-1b80-42bf-b3c8-61014fe96f3d tempest-PortsAdminExtendedAttrsTestJSON-68187029 tempest-PortsAdminExtendedAttrsTestJSON-68187029-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.145852 Aug 24 03:44:38.740031 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1297/2670] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:44:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:39.118916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:39.120218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:39.134354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.135001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.135588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.138550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.139457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.140385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.257314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:39.259635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:39.275046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.276089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.277625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.278818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.280309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.281015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.384273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:39.402877 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6dc8f1a0-c7cf-43ce-8950-dc49d85991e3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1523 microversion: 2.1 time: 0.288692 Aug 24 03:44:39.404902 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1374/2671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:39 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:39.505147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:39.512910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:39.513847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:39.516751 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c1aa0fab-e23f-4b85-9841-18872ee47790 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.270534 Aug 24 03:44:39.531126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.531126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.531126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.531126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.531126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.531126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.532245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1298/2672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:39 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:39.560726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.561283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.562025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.562730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lazy-loading 'fault' on Instance uuid c514243f-2dde-48fb-868d-a27be663f606 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:39.611175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:39.625159 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e0e79fa-38a3-4316-85e2-cf54d2f788d2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 200 len: 1350 microversion: 2.1 time: 0.115556 Aug 24 03:44:39.627586 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1375/2673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:39 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 1350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:39.647054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6d2512c1-ba45-44a0-93e6-849c3eae37e5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102af68af0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:39.701235 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6d2512c1-ba45-44a0-93e6-849c3eae37e5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.058598 Aug 24 03:44:39.704086 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1299/2674] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:39 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:40.426035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:40.427131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:40.436312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.437272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.437902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.438798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.439417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.440043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.543597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:40.544883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:40.554411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.555196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.555998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.557339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.558626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.559538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.614259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:40.625347 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-393c676a-fea8-4051-89ce-02d2c3ddfd8c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1523 microversion: 2.1 time: 0.203183 Aug 24 03:44:40.626427 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1376/2675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:40 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:40.661331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:40.661950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:40.673331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.673826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.674273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.675009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.675686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.678603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.716176 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 HTTP/1.1 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c514243f-2dde-48fb-868d-a27be663f606'} Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:40.718082 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.722947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:40.722947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:40.722947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:40.722947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:40.722947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:40.722947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.722947 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.727081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:40.728417 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-039741fe-56bd-4c12-a56b-83694636bb16 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 404 len: 111 microversion: 2.1 time: 0.081748 Aug 24 03:44:40.731632 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1377/2676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:40 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:44:40.742527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-075ffe56-21f1-44d3-bac3-a4e31e07c133 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022e05820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:40.781985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:40.794545 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2bf9edf-261e-4b41-a2d0-2b7542fa2cc5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.258940 Aug 24 03:44:40.816148 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-075ffe56-21f1-44d3-bac3-a4e31e07c133 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.072174 Aug 24 03:44:40.820908 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1300/2677] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:40 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:40.821000 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1378/2678] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:40 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:40.905055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:40.907803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:40.921580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.922448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.923154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.924038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.924570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.925067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.945867 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606/os-volume_attachments HTTP/1.1 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': 'c514243f-2dde-48fb-868d-a27be663f606'} Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:44:40.948690 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:40.952790 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-374d8bb4-02a6-46fc-8e37-46ed9cec5f7e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049662 Aug 24 03:44:40.955312 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1301/2679] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:44:40 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:44:41.198094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-457279601", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "6b7c20d5-6e0c-43b0-8505-bb28069b1895"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:41.295318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] validate_networks() for [('6b7c20d5-6e0c-43b0-8505-bb28069b1895', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:44:41.648091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:41.648816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:41.659072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.659957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.660649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.661858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.662539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.663368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.835454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:41.836032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:41.836391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:41.836804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:41.837222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:41.848409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.850288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.850766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.851552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.852047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.852480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.873096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:41.879515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for user 69a1414940b14e459202a86bd8e9027b and project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:41.894305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:44:41.897139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:44:41.962122 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f555eea2-30dd-4c22-9a97-2f01b181bed0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775586 Aug 24 03:44:41.964188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:41.970085 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1379/2680] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:44:41.976257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-18d1eeaa-d89a-4255-b9a8-9e821e25440a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10232df9d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:41.979388 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aa235763-c1b1-4808-9dad-657649e2ed83 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1508 microversion: 2.1 time: 0.335983 Aug 24 03:44:41.989665 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1302/2681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:41 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:42.004522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:42.014045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:42.024424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.025253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.026183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.027512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.028364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.029748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.061987 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-18d1eeaa-d89a-4255-b9a8-9e821e25440a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.090053 Aug 24 03:44:42.062912 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1380/2682] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:41 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:42.068534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-3d65319b-73b7-48bd-8bd3-31b0c49c9fe0 req-5a416bee-be33-4044-a535-62a32371fc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79baa30-fa4f-47de-8d26-6d070734bccd", "name": "network-vif-unplugged", "status": "completed", "tag": "8eb13453-5453-4ce2-a0f9-64aba47b275b"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:42.090202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3d65319b-73b7-48bd-8bd3-31b0c49c9fe0 req-5a416bee-be33-4044-a535-62a32371fc65 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.090883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3d65319b-73b7-48bd-8bd3-31b0c49c9fe0 req-5a416bee-be33-4044-a535-62a32371fc65 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.091513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3d65319b-73b7-48bd-8bd3-31b0c49c9fe0 req-5a416bee-be33-4044-a535-62a32371fc65 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.106635 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-3d65319b-73b7-48bd-8bd3-31b0c49c9fe0 req-5a416bee-be33-4044-a535-62a32371fc65 service nova] Creating event network-vif-unplugged:8eb13453-5453-4ce2-a0f9-64aba47b275b for instance a79baa30-fa4f-47de-8d26-6d070734bccd on n-h1-846470-15 Aug 24 03:44:42.112852 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-3d65319b-73b7-48bd-8bd3-31b0c49c9fe0 req-5a416bee-be33-4044-a535-62a32371fc65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048481 Aug 24 03:44:42.114111 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1381/2683] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:42.119742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48bb2cb7-8840-419e-8f85-e369b06b4256 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:42.120798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48bb2cb7-8840-419e-8f85-e369b06b4256 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:42.191713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48bb2cb7-8840-419e-8f85-e369b06b4256 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:42.202103 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48bb2cb7-8840-419e-8f85-e369b06b4256 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7" status: 200 len: 1214 microversion: 2.1 time: 0.086165 Aug 24 03:44:42.216350 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1382/2684] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:42 2022] GET /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:42.223590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:42.224255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:42.231074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.231581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.232048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.232829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.233294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.233727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.400520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:42.412528 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-49fee3ee-dc26-4e1f-9d83-327f9d9fcb5c tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 200 len: 1508 microversion: 2.1 time: 0.193793 Aug 24 03:44:42.413724 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1383/2685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:42 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:42.424553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75eaee87-6dd4-4553-a4c4-a9acec65d3eb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:42.425296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75eaee87-6dd4-4553-a4c4-a9acec65d3eb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:42.448180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75eaee87-6dd4-4553-a4c4-a9acec65d3eb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:44:42.511831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:42.528840 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-33a6a0cc-973f-4213-9537-a838e834a196 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.535242 Aug 24 03:44:42.550103 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1303/2686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:41 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:42.569007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:42.569536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:42.589094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.589605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.590061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.590813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.591363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.591921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.690229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:44:42.939554 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-faedfce8-4656-4f5e-a8ef-712a62db2788 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 204 len: 0 microversion: 2.1 time: 0.385782 Aug 24 03:44:42.942852 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1304/2687] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:44:42 2022] DELETE /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:44:43.049150 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.scheduler.client.report [None req-75eaee87-6dd4-4553-a4c4-a9acec65d3eb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Deleted allocations for instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 Aug 24 03:44:43.079324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-23dd6d05-97ff-4b45-a1e1-0c5dc72a9123 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10343ee3a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:43.109232 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75eaee87-6dd4-4553-a4c4-a9acec65d3eb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7" status: 204 len: 0 microversion: 2.1 time: 0.693424 Aug 24 03:44:43.109852 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1384/2688] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:44:42 2022] DELETE /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:44:43.121421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-711d1ebf-ce48-4dcf-9abd-40193185ea7a req-e3c40e7f-c5bc-47a4-b9ca-4ea68117d05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a57fff-dd1c-4da6-a069-721eeb327ba9", "name": "network-vif-plugged", "status": "completed", "tag": "7b45f896-efbb-49d1-885b-f24770cf2671"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:43.147017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-711d1ebf-ce48-4dcf-9abd-40193185ea7a req-e3c40e7f-c5bc-47a4-b9ca-4ea68117d05c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:43.147825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-711d1ebf-ce48-4dcf-9abd-40193185ea7a req-e3c40e7f-c5bc-47a4-b9ca-4ea68117d05c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:43.148440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-711d1ebf-ce48-4dcf-9abd-40193185ea7a req-e3c40e7f-c5bc-47a4-b9ca-4ea68117d05c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:43.162060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-711d1ebf-ce48-4dcf-9abd-40193185ea7a req-e3c40e7f-c5bc-47a4-b9ca-4ea68117d05c service nova] Creating event network-vif-plugged:7b45f896-efbb-49d1-885b-f24770cf2671 for instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 on n-h1-846470-15 Aug 24 03:44:43.180318 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-711d1ebf-ce48-4dcf-9abd-40193185ea7a req-e3c40e7f-c5bc-47a4-b9ca-4ea68117d05c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068305 Aug 24 03:44:43.181705 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1385/2689] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:43.188099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:43.189288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:43.198361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:43.199160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:43.200049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:43.201095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:43.201727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:43.202323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:43.220355 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 HTTP/1.1 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7'} Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:43.222598 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:43.227406 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:43.227406 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:43.227406 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:43.227406 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:43.227406 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:43.227406 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:44:43.227406 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:44:43.229444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:43.230850 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c4260701-42c5-4dda-83a1-009bf02ea49a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7" status: 404 len: 111 microversion: 2.1 time: 0.047510 Aug 24 03:44:43.231916 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1386/2690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:43 2022] GET /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:44:43.239540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1456385503", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7e985d05-8052-49f4-894f-069701c9a6ec"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:43.340427 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-23dd6d05-97ff-4b45-a1e1-0c5dc72a9123 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.267042 Aug 24 03:44:43.344058 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1305/2691] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:43 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:43.358946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] validate_networks() for [('7e985d05-8052-49f4-894f-069701c9a6ec', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:44:43.385510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1625971611", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "6b7c20d5-6e0c-43b0-8505-bb28069b1895"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:43.462638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] validate_networks() for [('6b7c20d5-6e0c-43b0-8505-bb28069b1895', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:44:44.051515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:44.052857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:44.055056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:44.056490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:44.057234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:44.079398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.080214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.081155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.083845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.085649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.087738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.105164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:44.123827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:44.139229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for user 69a1414940b14e459202a86bd8e9027b and project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:44.169448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:44:44.172878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:44:44.265092 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f988ccb-6363-4118-afc9-f1c1f97a1cfa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883515 Aug 24 03:44:44.266092 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1306/2692] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:44:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:44:44.272989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:44.273943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:44.282826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.283641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.284297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.285458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.285936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.286368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.656077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:44.656802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:44.656987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:44.657385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:44.657824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:44.688169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.688674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.690506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.693537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.695170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.696551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.732586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Getting quotas for project d9017741914745fb8e346195e1077dae. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:44.749804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Getting quotas for user 85d63578576d4fc7b6efabde5276b860 and project d9017741914745fb8e346195e1077dae. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:44.774710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:44:44.781888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:44.793021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:44:44.801162 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ed61e11c-8946-494c-a0c9-d78b6f7b4ed3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.531207 Aug 24 03:44:44.803598 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1307/2693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:44 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:44.816965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3b9ced58-44b8-451b-93c4-702de9219a37 req-8d352ede-64f9-4a63-a711-9d442a702ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79baa30-fa4f-47de-8d26-6d070734bccd", "tag": "8eb13453-5453-4ce2-a0f9-64aba47b275b"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:44.845943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b9ced58-44b8-451b-93c4-702de9219a37 req-8d352ede-64f9-4a63-a711-9d442a702ca4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.847305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b9ced58-44b8-451b-93c4-702de9219a37 req-8d352ede-64f9-4a63-a711-9d442a702ca4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.849115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b9ced58-44b8-451b-93c4-702de9219a37 req-8d352ede-64f9-4a63-a711-9d442a702ca4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.911295 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47670161-36ee-404d-86ef-f6a5a8cc05bb tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678021 Aug 24 03:44:44.913492 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3b9ced58-44b8-451b-93c4-702de9219a37 req-8d352ede-64f9-4a63-a711-9d442a702ca4 service nova] Creating event network-changed:8eb13453-5453-4ce2-a0f9-64aba47b275b for instance a79baa30-fa4f-47de-8d26-6d070734bccd on n-h1-846470-15 Aug 24 03:44:44.918365 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1387/2694] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:44:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:44:44.925200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-08034d62-0dc2-4eb1-80ee-3cf232b2015f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:44.925857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-08034d62-0dc2-4eb1-80ee-3cf232b2015f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:44.939385 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3b9ced58-44b8-451b-93c4-702de9219a37 req-8d352ede-64f9-4a63-a711-9d442a702ca4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132696 Aug 24 03:44:44.940356 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1308/2695] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:44.956691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65ecf389-5092-46f8-9597-7f26b651c6c4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103443fca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:45.047456 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-65ecf389-5092-46f8-9597-7f26b651c6c4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.104853 Aug 24 03:44:45.048501 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1309/2696] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:44 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:45.083443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53b40b38-c004-4a91-86d7-01e60069a8fa tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:45.094560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53b40b38-c004-4a91-86d7-01e60069a8fa tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:45.095589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53b40b38-c004-4a91-86d7-01e60069a8fa tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:45.096236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53b40b38-c004-4a91-86d7-01e60069a8fa tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:45.134821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-08034d62-0dc2-4eb1-80ee-3cf232b2015f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:45.145573 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-08034d62-0dc2-4eb1-80ee-3cf232b2015f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1215 microversion: 2.1 time: 0.225965 Aug 24 03:44:45.146447 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1388/2697] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:44 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:45.174190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac6dff04-cbc6-4e1f-8d40-58239698dc99 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:45.175020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac6dff04-cbc6-4e1f-8d40-58239698dc99 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:45.189656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:45.244620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-53b40b38-c004-4a91-86d7-01e60069a8fa tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Going to try to stop instance {{(pid=122535) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:44:45.375313 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53b40b38-c004-4a91-86d7-01e60069a8fa tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/action" status: 202 len: 0 microversion: 2.1 time: 0.324554 Aug 24 03:44:45.383928 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1310/2698] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:44:45 2022] POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:45.413592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:45.414801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:45.444470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:45.444971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:45.445906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:45.446772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:45.447247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:45.448390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:45.469921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ac6dff04-cbc6-4e1f-8d40-58239698dc99 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:45.506196 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac6dff04-cbc6-4e1f-8d40-58239698dc99 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1218 microversion: 2.1 time: 0.340303 Aug 24 03:44:45.508339 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1389/2699] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:45 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1218 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:45.851465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:45.854550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:45.883232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:45.884683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:45.885508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:45.887068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:45.888479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:45.889446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.296200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:46.306025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-21adf9d9-746e-49f7-85d3-db1a99db6150 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.460579 Aug 24 03:44:46.306855 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1390/2700] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:45 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:46.311767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a8939057-02dd-4f52-bdf6-25d23dd428e1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022e05940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:46.427619 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a8939057-02dd-4f52-bdf6-25d23dd428e1 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.118200 Aug 24 03:44:46.436723 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1391/2701] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:46 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:46.448281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:46.448905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:46.461604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.464645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.465553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.469086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.470097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.470837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.542103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:46.550428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:46.554503 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06f0004f-b6f4-4c5f-b45f-c50b685e9010 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 1.166420 Aug 24 03:44:46.563355 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8adcac08-c395-4c4a-abb2-b81f615ce629 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1275 microversion: 2.1 time: 0.125034 Aug 24 03:44:46.564767 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1392/2702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:46 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:46.570808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:46.571504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:46.579582 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1311/2703] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:45 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:46.592663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.596537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.597287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.598320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.599002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.599589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.818000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:46.831213 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93cf39ca-fa96-4188-9f9a-fbd9e3965830 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1270 microversion: 2.1 time: 0.266173 Aug 24 03:44:46.840392 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1393/2704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:46 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:47.019777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a392742e-9004-4042-8e5f-f1e9852d83c1 req-58b402f6-a3b9-45d5-a86e-678316077747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ff552d-5e9a-497e-add0-2c14f712c63e", "name": "network-vif-deleted", "tag": "615b5a9b-42ab-41a9-b137-40efe16cb240"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:47.042987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a392742e-9004-4042-8e5f-f1e9852d83c1 req-58b402f6-a3b9-45d5-a86e-678316077747 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.046576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a392742e-9004-4042-8e5f-f1e9852d83c1 req-58b402f6-a3b9-45d5-a86e-678316077747 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.048294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a392742e-9004-4042-8e5f-f1e9852d83c1 req-58b402f6-a3b9-45d5-a86e-678316077747 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.090841 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a392742e-9004-4042-8e5f-f1e9852d83c1 req-58b402f6-a3b9-45d5-a86e-678316077747 service nova] Creating event network-vif-deleted:615b5a9b-42ab-41a9-b137-40efe16cb240 for instance b8ff552d-5e9a-497e-add0-2c14f712c63e on n-h2-846470-15 Aug 24 03:44:47.106661 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a392742e-9004-4042-8e5f-f1e9852d83c1 req-58b402f6-a3b9-45d5-a86e-678316077747 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095645 Aug 24 03:44:47.112913 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1312/2705] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:47.341731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:47.342508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:47.351815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.352322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.352864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.353735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.354205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.354665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.443418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-505b8c7f-f022-4e88-8fe1-028ac8bfcb9d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10342f7160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:47.529125 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-505b8c7f-f022-4e88-8fe1-028ac8bfcb9d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.090445 Aug 24 03:44:47.530117 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1313/2706] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:47 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:47.580609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:47.581760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:47.598732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.599599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.600227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.601488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.602228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.603035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.735873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:47.754220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f09bb180-ad3e-4353-bbee-96b0410aace3 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.421844 Aug 24 03:44:47.756860 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1394/2707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:47 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:47.768492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:47.770184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:47.788321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.789151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.790794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.793133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.794959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.797535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.988261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:48.013913 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dfda8c67-5da8-48ac-90c2-0671d7ea3408 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1273 microversion: 2.1 time: 0.251466 Aug 24 03:44:48.019809 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1395/2708] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:47 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:48.032441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:48.033287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:48.086696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:48.087007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:48.088611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:48.090137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:48.091020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:48.095149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:48.207261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:48.219765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ff23e02-ec8b-4b6c-8b49-4c2775c72fa0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.644925 Aug 24 03:44:48.220358 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1314/2709] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:47 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:48.220984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:48.242088 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-097fdf10-ceab-454a-a2a0-8601d9977901 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1276 microversion: 2.1 time: 0.222278 Aug 24 03:44:48.245512 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1396/2710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:48 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:48.547565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fab75f7c-f6a8-4b39-ade8-2358748b0773 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102b0f03a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:48.655773 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fab75f7c-f6a8-4b39-ade8-2358748b0773 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.114118 Aug 24 03:44:48.656520 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1315/2711] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:48 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:48.779215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:48.780105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:48.790714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:48.791457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:48.792208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:48.793189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:48.794018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:48.794863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.044092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:49.045689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:49.056518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:49.094699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.106729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.108251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.109680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.110730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.111390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.304167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:49.313926 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67b493d7-5446-4539-839b-04e1fd9d7b57 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.275660 Aug 24 03:44:49.321764 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1316/2712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:49 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:49.327842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:49.328466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:49.352088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.352599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.353185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.353780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.354252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.354688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.531285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:49.544137 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-326e6b25-c781-4eeb-a593-83efe39d7a29 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.769316 Aug 24 03:44:49.550594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1397/2713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:48 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:49.555817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:49.560593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:49.571795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.574939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.575601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.576788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.579993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.581819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.970073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:49.988311 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-614e68cb-86fc-401e-9f77-000ee3524c72 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.664802 Aug 24 03:44:50.005761 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1317/2714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:49 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:50.012401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4397fe70-a6ae-4c62-8b7c-5ba8a5885da7 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102aec2b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:50.083202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:50.099225 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3e1c954a-566d-46b2-af92-ea15edc8d647 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.545576 Aug 24 03:44:50.102146 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1398/2715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:49 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:50.112247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4397fe70-a6ae-4c62-8b7c-5ba8a5885da7 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.098097 Aug 24 03:44:50.112247 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1318/2716] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:50 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:50.345065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:50.345734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:50.364703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:50.365381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:50.366131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:50.367259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:50.368160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:50.368787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:50.567158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:50.568477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:50.580774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:50.581671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:50.582123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:50.587468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:50.588321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:50.588986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:50.594798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:50.730595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:50.749734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27b729d2-c0e7-466a-85f4-9663e7d8d0d1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.410050 Aug 24 03:44:50.750843 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1319/2717] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:50 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:50.979266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:50.994416 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa9cb649-d8ce-4521-ba9a-354d9cc181ea tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.431333 Aug 24 03:44:50.995400 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1399/2718] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:50 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:51.015223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:51.015986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:51.028212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:51.029207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:51.031287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:51.032514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:51.040170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f46b07c2-bcca-42d5-a81e-b93dd171848b req-09440c17-d151-45e6-bb18-c74b20c5e54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f592d0-43b7-4c80-8c74-6bc035624134", "tag": "d1ec25dc-55c7-4fa4-8985-62a0af54b1f4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:51.047755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:51.056531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:51.069321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f46b07c2-bcca-42d5-a81e-b93dd171848b req-09440c17-d151-45e6-bb18-c74b20c5e54f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:51.070077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f46b07c2-bcca-42d5-a81e-b93dd171848b req-09440c17-d151-45e6-bb18-c74b20c5e54f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:51.073774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f46b07c2-bcca-42d5-a81e-b93dd171848b req-09440c17-d151-45e6-bb18-c74b20c5e54f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:51.106152 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f46b07c2-bcca-42d5-a81e-b93dd171848b req-09440c17-d151-45e6-bb18-c74b20c5e54f service nova] Creating event network-changed:d1ec25dc-55c7-4fa4-8985-62a0af54b1f4 for instance d6f592d0-43b7-4c80-8c74-6bc035624134 on n-h2-846470-15 Aug 24 03:44:51.117786 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f46b07c2-bcca-42d5-a81e-b93dd171848b req-09440c17-d151-45e6-bb18-c74b20c5e54f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081216 Aug 24 03:44:51.127949 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1400/2719] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:51.134988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f60f210-cda0-47ef-92fe-f1d2c9b9e010 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10231ef550>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:51.221249 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f60f210-cda0-47ef-92fe-f1d2c9b9e010 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.091609 Aug 24 03:44:51.221816 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1401/2720] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:51 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:51.229758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:51.231877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:51.251700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:51.252205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:51.252647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:51.253369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:51.254279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:51.254279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:51.683092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:51.704282 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0fed20da-36be-456c-9a20-fc5813a7e9c0 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.480401 Aug 24 03:44:51.704282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1402/2721] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:51 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:51.779964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:51.781124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:51.792561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:51.793198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:51.794491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:51.797793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:51.798346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:51.798931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:51.954136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:51.974735 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89dfd2b4-5781-4feb-815c-cc7601692607 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.964110 Aug 24 03:44:51.987706 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1320/2722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:51 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:52.020452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:52.021985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:52.028789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:52.029941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:52.030903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:52.031892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:52.032560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:52.033934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:52.103143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:52.113596 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f710f51c-bb60-44c2-a07f-70fc54baaa23 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.342069 Aug 24 03:44:52.116178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1403/2723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:51 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:52.236774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3e49cb9d-7739-4114-87b4-08b17e43c2ad tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022ec4b80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:52.330056 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3e49cb9d-7739-4114-87b4-08b17e43c2ad tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.091508 Aug 24 03:44:52.331439 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1404/2724] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:52 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:52.510081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:52.527188 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-013918a1-422d-4cd7-99a1-d6cc6c1a9cd9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.513524 Aug 24 03:44:52.528707 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1321/2725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:52 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:52.724700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:52.725319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:52.731786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:52.732554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:52.737603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:52.737603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:52.737603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:52.737603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.004262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:53.005286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:53.014480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.015398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.016109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.017101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.017839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.018556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.045699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:53.057086 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa63bcf7-118a-414d-8cc7-a894dbfb52c3 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.336738 Aug 24 03:44:53.071471 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1405/2726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:52 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:53.136968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:53.137956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:53.148170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.148654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.149088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.149988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.150599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.151296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.293617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:53.332436 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-34dbd8d0-2989-4bf4-8e5c-292ed6dc12c4 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.313818 Aug 24 03:44:53.336126 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1322/2727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:52 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:53.349293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d3a05adc-59fb-4f16-853a-4a20e1c693f8 req-24a066d9-fe6e-43c9-ba59-10272fb8c910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54497aca-4ef9-4dc5-b569-4209b27a69e3", "tag": "6bf99d9c-f8c2-432a-be2c-76b138eaa646"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:53.377261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d3a05adc-59fb-4f16-853a-4a20e1c693f8 req-24a066d9-fe6e-43c9-ba59-10272fb8c910 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.378094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d3a05adc-59fb-4f16-853a-4a20e1c693f8 req-24a066d9-fe6e-43c9-ba59-10272fb8c910 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.379017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d3a05adc-59fb-4f16-853a-4a20e1c693f8 req-24a066d9-fe6e-43c9-ba59-10272fb8c910 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.401619 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d3a05adc-59fb-4f16-853a-4a20e1c693f8 req-24a066d9-fe6e-43c9-ba59-10272fb8c910 service nova] Creating event network-changed:6bf99d9c-f8c2-432a-be2c-76b138eaa646 for instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 on n-h2-846470-15 Aug 24 03:44:53.415129 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d3a05adc-59fb-4f16-853a-4a20e1c693f8 req-24a066d9-fe6e-43c9-ba59-10272fb8c910 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077492 Aug 24 03:44:53.416165 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1323/2728] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:53.425508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5581172d-6eea-4ee0-adaa-ca062fb3130d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102adbb940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:53.472986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:53.485809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-78536944-6dad-48a5-b924-6eef90a00bd2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.353213 Aug 24 03:44:53.487310 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1406/2729] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:53 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:53.504144 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5581172d-6eea-4ee0-adaa-ca062fb3130d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.086429 Aug 24 03:44:53.514319 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1324/2730] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:53 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:53.550269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:53.550875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:53.562920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.563436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.563905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.565830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.566541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.566964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.795656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:53.805792 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d8924b9c-7ed1-4dc4-9dc1-62611ff851b0 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.259680 Aug 24 03:44:53.806870 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1407/2731] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:53 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:54.079513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:54.080425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:54.090854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.093383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.094185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.095153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.095861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.096508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.105699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:54.169722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:54.362898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:54.365050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:54.400390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:54.412825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.415938 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-61b591b0-0007-4545-a0d3-dce16e791295 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.341051 Aug 24 03:44:54.417173 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1325/2732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:54 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:54.418077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.418778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.420038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.420726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.421371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.508264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:54.510508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:54.520093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.521720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.522400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.523391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.524112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.524795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.625007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:54.635534 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4ad5a0b7-0280-458d-90b3-dacdb8460b64 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.280674 Aug 24 03:44:54.636884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1408/2733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:54 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:54.643607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a80b8c1-5dbf-4714-8d9e-cd84194a6e7c tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10231efee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:54.717940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:54.744586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a80b8c1-5dbf-4714-8d9e-cd84194a6e7c tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.105825 Aug 24 03:44:54.747434 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1409/2734] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:54 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:54.833611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:54.834873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:54.848142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:54.858338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.859316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.860244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.861432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.862671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.863008 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6eec3926-2fba-405d-9d48-353cd6cde6a0 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.358417 Aug 24 03:44:54.863685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.864733 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1326/2735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:54 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:55.127015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:55.148581 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05fdfe10-461b-4177-8231-e0a9278f594b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.323100 Aug 24 03:44:55.149200 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1410/2736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:54 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:55.442889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:55.445283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:55.462247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:55.462804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:55.463253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:55.464095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:55.464455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:55.464896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:55.662436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:55.663031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:55.674416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=20 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:55.691446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:55.695518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:55.696023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:55.699834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:55.700605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:55.701292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:55.956395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:55.972833 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e59dd113-0474-4d0c-a1a9-37ba7d2e1513 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.316540 Aug 24 03:44:55.973422 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1411/2737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:55 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:55.985442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd4dd274-6ef1-49d7-81e0-29c524bc4522 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022e7bee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:56.037282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:56.046011 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d0eac7f-7a3b-4691-817c-5039e71914d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.608376 Aug 24 03:44:56.048949 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1327/2738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:55 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:56.059283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:56.060423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:56.072592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:56.093538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:56.094246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:56.095023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:56.095514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:56.095632 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd4dd274-6ef1-49d7-81e0-29c524bc4522 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.121138 Aug 24 03:44:56.095989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:56.096211 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1412/2739] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:55 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:56.171374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:56.173764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:56.190240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:56.190704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:56.191131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:56.202770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:56.203382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:56.203961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:56.301902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:56.347427 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50c6c1b9-eae6-4ddd-9196-c41ebd95ae6e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.296153 Aug 24 03:44:56.350056 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1328/2740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:56 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:56.491163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:56.504474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29d34012-9686-42ee-a966-2df2b4edfd37 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.337133 Aug 24 03:44:56.507782 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1413/2741] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:56 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:56.995703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:56.996672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:57.011032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:57.011695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:57.012273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:57.013799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:57.015693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:57.016776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:57.072003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:57.072460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:57.073312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:57.096964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:57.098778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:57.101364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:57.107295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:57.108115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:57.109910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:57.297586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:57.311756 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69804a3b-4d6c-4b7f-bb2e-d640e29c9bde tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.321639 Aug 24 03:44:57.312377 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1329/2742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:56 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:57.327654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b9e2114-3159-4a1d-92b3-7a8963a0eddc tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a7800d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:57.350737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:57.365681 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf4eabe6-5c54-462f-a0f3-a3da5ee9800a tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.297795 Aug 24 03:44:57.381780 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1414/2743] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:57 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:57.390192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:57.391964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:57.403464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:57.404425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:57.405156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:57.406026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:57.406688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:57.407296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:57.443300 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9b9e2114-3159-4a1d-92b3-7a8963a0eddc tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.128271 Aug 24 03:44:57.450110 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1330/2744] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:57 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:57.529482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:57.530427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:57.549598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:57.550439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:57.552744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:57.553534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:57.554048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:57.558848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:57.863224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:57.878366 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8a03ae72-6639-41ce-95c3-f87633043d06 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.494313 Aug 24 03:44:57.882535 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1415/2745] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:57 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:57.911363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:57.937843 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aeb16893-9bec-49c1-b199-6940c81b6863 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.412872 Aug 24 03:44:57.956610 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1331/2746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:57 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:58.338816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:58.340325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:58.353402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:58.354364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:58.355039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:58.356127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:58.356941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:58.357622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:58.392826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:58.394303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:58.409085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:58.409996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:58.411131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:58.412478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:58.415375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:58.416099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:58.924911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:58.933319 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a607d1bb-9131-4d15-aa75-7143cc6abde1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.545597 Aug 24 03:44:58.934570 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1332/2747] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:58 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:58.941003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea7abbe8-248e-48e1-bf63-97245b486bf6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103443f0d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:59.003824 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea7abbe8-248e-48e1-bf63-97245b486bf6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.067269 Aug 24 03:44:59.005290 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1333/2748] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:58 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:59.010567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:59.011956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:59.019141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:59.020444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:59.021120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:59.022119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:59.022665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:59.023164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:59.180083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:59.194490 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fdd292f2-487b-4cd0-a6ab-0978d6291172 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.860784 Aug 24 03:44:59.200206 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1416/2749] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:58 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:59.213108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:59.214153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:59.229610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:59.232955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:59.233801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:59.234815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:59.235563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:59.241249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:59.829829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:59.844394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4476f6aa-4a9a-4fc8-bf2e-377f7fdb1baa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1718 microversion: 2.1 time: 0.642348 Aug 24 03:44:59.849237 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1417/2750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:59 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1718 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:59.893208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:59.913767 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-721545de-87c7-4140-929e-5cffe57829c1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.907091 Aug 24 03:44:59.931704 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1334/2751] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:59 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:59.955100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:59.956028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:59.964180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:59.965058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:59.965962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:59.967107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:59.971197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:59.972262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:00.021915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1192e695-d386-4db0-82a6-6a74703d2361 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a797820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:00.110284 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1192e695-d386-4db0-82a6-6a74703d2361 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.093885 Aug 24 03:45:00.111307 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1335/2752] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:00 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:00.224180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:00.225037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:00.248990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:00.248990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:00.250602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:00.256704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:00.258626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:00.259200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:00.323302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:00.334331 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d500f2e6-eded-4be4-8d2e-3bc97577cedf tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.382951 Aug 24 03:45:00.338026 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1418/2753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:59 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:00.479695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:00.489483 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7b86c242-c5c6-48af-816b-11162a44f765 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1676 microversion: 2.1 time: 0.274304 Aug 24 03:45:00.490811 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1336/2754] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:00 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:00.679365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-4cb6f961-1e1c-4549-911f-3c77c75c394d req-7854fd57-6e2a-4b2b-b1c1-85cd7d2cac33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f592d0-43b7-4c80-8c74-6bc035624134", "name": "network-vif-plugged", "status": "completed", "tag": "d1ec25dc-55c7-4fa4-8985-62a0af54b1f4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:00.701910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4cb6f961-1e1c-4549-911f-3c77c75c394d req-7854fd57-6e2a-4b2b-b1c1-85cd7d2cac33 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:00.702858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4cb6f961-1e1c-4549-911f-3c77c75c394d req-7854fd57-6e2a-4b2b-b1c1-85cd7d2cac33 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:00.703564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4cb6f961-1e1c-4549-911f-3c77c75c394d req-7854fd57-6e2a-4b2b-b1c1-85cd7d2cac33 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:00.728156 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-4cb6f961-1e1c-4549-911f-3c77c75c394d req-7854fd57-6e2a-4b2b-b1c1-85cd7d2cac33 service nova] Creating event network-vif-plugged:d1ec25dc-55c7-4fa4-8985-62a0af54b1f4 for instance d6f592d0-43b7-4c80-8c74-6bc035624134 on n-h2-846470-15 Aug 24 03:45:00.744309 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-4cb6f961-1e1c-4549-911f-3c77c75c394d req-7854fd57-6e2a-4b2b-b1c1-85cd7d2cac33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068495 Aug 24 03:45:00.745461 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1419/2755] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:00.865847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:00.866469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:00.880066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:00.880578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:00.881029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:00.881761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:00.884208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:00.885890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:00.944637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:00.945347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:00.956458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:00.961699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:00.963219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:00.964237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:00.965107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:00.966200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.195369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:01.206250 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2c02df98-fcd6-43fd-aa4c-a78d1adccf59 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1708 microversion: 2.1 time: 0.343947 Aug 24 03:45:01.219709 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1337/2756] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:00 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1708 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:01.229028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f02573fb-b9b7-4237-b9a7-0f03b6887f5f tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102ad089d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:01.284799 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f02573fb-b9b7-4237-b9a7-0f03b6887f5f tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.076471 Aug 24 03:45:01.285823 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1338/2757] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:01 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:01.290798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07625b9b-99eb-4602-bfc9-f0950612967b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '.version_select at 0x7f102b33f670>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:01.295650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07625b9b-99eb-4602-bfc9-f0950612967b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.296534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07625b9b-99eb-4602-bfc9-f0950612967b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.297231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07625b9b-99eb-4602-bfc9-f0950612967b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.330679 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07625b9b-99eb-4602-bfc9-f0950612967b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.043392 Aug 24 03:45:01.342477 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1339/2758] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:45:01 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:01.350646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:01.351406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:01.369608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.370116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.370566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.371311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.371814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.377567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.439361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:01.454450 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c651c326-eba1-4a17-a819-03517b73565c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.514042 Aug 24 03:45:01.456352 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1420/2759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:00 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:01.464508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:01.466439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:01.473442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.474526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.475279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.476720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.477409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.478006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.483654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:01.660670 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4f98cc7-8786-4623-b5eb-269a9b6f09dd tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1861 microversion: 2.1 time: 0.318280 Aug 24 03:45:01.671691 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1340/2760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:01 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1861 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:01.671691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:01.671691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:01.675900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.676849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.677535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.678977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.679828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.680495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.933478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:01.944306 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-afc524ac-8f09-4636-b2ed-8f65a0336e19 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.486546 Aug 24 03:45:01.950330 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1421/2761] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:01 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:01.961420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:01.962404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:01.973857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.974787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.975490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:01.976645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:01.977396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:01.978049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.032898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:02.043759 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04e3ba39-379a-4f50-a921-c9054a2d39e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1653 microversion: 2.1 time: 0.381056 Aug 24 03:45:02.049362 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1341/2762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:01 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1653 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:02.079704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-086fd5e2-145d-4b60-823e-193752e5ad48 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:02.088372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-086fd5e2-145d-4b60-823e-193752e5ad48 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.089218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-086fd5e2-145d-4b60-823e-193752e5ad48 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.089894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-086fd5e2-145d-4b60-823e-193752e5ad48 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.124602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-086fd5e2-145d-4b60-823e-193752e5ad48 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Going to try to start instance {{(pid=122535) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:45:02.211156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-086fd5e2-145d-4b60-823e-193752e5ad48 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/action" status: 202 len: 0 microversion: 2.1 time: 0.135638 Aug 24 03:45:02.213056 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1342/2763] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:45:02 2022] POST /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:45:02.228333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:02.229176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:02.237065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.237792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.238770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.265173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.267687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.269111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.413645 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0772333d-df25-4cf4-8a24-5cba28193319 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1861 microversion: 2.1 time: 0.443832 Aug 24 03:45:02.415315 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1422/2764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:01 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1861 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:02.452041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa91a818-4a4f-4c7e-96bf-5076d54c34da tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022e22af0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:02.557109 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa91a818-4a4f-4c7e-96bf-5076d54c34da tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1455 microversion: 2.1 time: 0.135751 Aug 24 03:45:02.557696 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1423/2765] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:02 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:02.564887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:02.565750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:02.576048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.577290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.577904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.579181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.579837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.580423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.700183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:02.717792 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af746e9f-9ff3-4880-8abb-ca32a5c5a179 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1662 microversion: 2.1 time: 0.498453 Aug 24 03:45:02.737154 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1343/2766] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:02 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1662 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:02.745621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:02.746882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:02.758139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.759873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.761606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.763484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.764651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.765616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.882780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lazy-loading 'services' on Instance uuid a79baa30-fa4f-47de-8d26-6d070734bccd {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:45:02.914882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:02.932093 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bb6657f5-1944-4bfa-b24b-9550cac46fb5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1315 microversion: 2.1 time: 0.367653 Aug 24 03:45:02.934877 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1424/2767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:02 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:02.973627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:02.974325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:02.986099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.986688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.988601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:02.989917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:02.995567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:02.996242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:03.061411 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5dffbd61-9afb-46a8-a230-789ea24ad06a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments/ff729b4f-8973-497a-855b-fa7f644b4c22" status: 202 len: 0 microversion: 2.1 time: 0.321883 Aug 24 03:45:03.080734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1344/2768] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 03:45:02 2022] DELETE /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments/ff729b4f-8973-497a-855b-fa7f644b4c22 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:45:03.094280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:03.097327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:03.104919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:03.105338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:03.105777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:03.112768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:03.113580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:03.114054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:03.168023 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24722e17-25ba-4650-818f-29f70f97b3be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083046 Aug 24 03:45:03.173640 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1345/2769] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:03 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:03.255898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:03.266288 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-730a4438-1f0b-44a8-a2b2-ba05015b600f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.299218 Aug 24 03:45:03.268938 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1425/2770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:02 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:03.572586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f62bb01d-b4cc-49d6-b2be-87c0588b35dc tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102ad36f70>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:03.659867 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f62bb01d-b4cc-49d6-b2be-87c0588b35dc tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1464 microversion: 2.1 time: 0.080813 Aug 24 03:45:03.660891 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1346/2771] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:03 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1464 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:03.674306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a7c4277-a594-4470-acb1-1e8e58edb679 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10231ef550>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:03.750135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:03.750882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:03.784672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:03.785038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:03.785484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:03.786191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:03.786656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:03.787086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:03.803873 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a7c4277-a594-4470-acb1-1e8e58edb679 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 200 len: 1464 microversion: 2.1 time: 0.129784 Aug 24 03:45:03.804573 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1426/2772] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:03 2022] GET /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 1464 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:03.825172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:03.831619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:03.861113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:03.861672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:03.867214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:03.871466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:03.873382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:03.876970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.109360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:04.110321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:04.118677 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9541b2d2-6df8-448a-866c-ae1cae1e5c2d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1662 microversion: 2.1 time: 0.372848 Aug 24 03:45:04.121911 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b6566a5-7dee-4182-a07f-be755477cd4e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 200 len: 1465 microversion: 2.1 time: 0.303745 Aug 24 03:45:04.123151 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1427/2773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:03 2022] GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 1465 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:04.124107 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1347/2774] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:03 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1662 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:04.130997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:04.139782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:04.160977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.162456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.163249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.164348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.165119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.165823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.166247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2011019889"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:04.168854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:04.181249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.181751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.182192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.182918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.183383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.195341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.368006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:04.379483 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a394d026-4679-4f8b-88fa-015dc7b25d4e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1502 microversion: 2.1 time: 0.253897 Aug 24 03:45:04.380538 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1428/2775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:04 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:04.388583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:04.392141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:04.400708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.401636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.402301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.403271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.404158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.404869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.445099 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24206700-97b9-4abf-a5f2-2727e6605cd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062920 Aug 24 03:45:04.447991 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1429/2776] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:04 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:04.455874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-8b4513b6-e723-406f-b918-ff75146aadaf req-2450981c-8b26-4cbe-9371-a64873a7f7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54497aca-4ef9-4dc5-b569-4209b27a69e3", "name": "network-vif-plugged", "status": "completed", "tag": "6bf99d9c-f8c2-432a-be2c-76b138eaa646"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:04.473365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8b4513b6-e723-406f-b918-ff75146aadaf req-2450981c-8b26-4cbe-9371-a64873a7f7b6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.474244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8b4513b6-e723-406f-b918-ff75146aadaf req-2450981c-8b26-4cbe-9371-a64873a7f7b6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.475151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8b4513b6-e723-406f-b918-ff75146aadaf req-2450981c-8b26-4cbe-9371-a64873a7f7b6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.497372 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-8b4513b6-e723-406f-b918-ff75146aadaf req-2450981c-8b26-4cbe-9371-a64873a7f7b6 service nova] Creating event network-vif-plugged:6bf99d9c-f8c2-432a-be2c-76b138eaa646 for instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 on n-h2-846470-15 Aug 24 03:45:04.505154 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-8b4513b6-e723-406f-b918-ff75146aadaf req-2450981c-8b26-4cbe-9371-a64873a7f7b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054642 Aug 24 03:45:04.506184 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1430/2777] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:04.523383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:04.524712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:04.533326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.534169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.534794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.535766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.536396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.536984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.629059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:04.656718 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dbafeb55-9323-426a-9be7-4241a07948d8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "POST /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f/action" status: 202 len: 0 microversion: 2.1 time: 0.494129 Aug 24 03:45:04.660459 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1348/2778] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:45:04 2022] POST /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 03:45:04.671180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:04.676967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:04.688079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.692175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.692736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.695386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.695941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.696753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.849186 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bb517114-583c-4ce0-9f56-4b04b06ea48d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134/action" status: 202 len: 0 microversion: 2.1 time: 0.186893 Aug 24 03:45:04.850478 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1349/2779] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:45:04 2022] POST /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:45:04.861735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-caf24781-94b4-4c47-a903-99d518846aab tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102ae761f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:04.949090 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-caf24781-94b4-4c47-a903-99d518846aab tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.095606 Aug 24 03:45:04.954516 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1350/2780] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:04 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:04.960940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:04.963985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:04.979358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.982565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.983259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:04.985464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:04.986133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:04.987123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:05.012361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:05.030402 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05faad2a-8d81-4df4-8c04-2ef782fb1614 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.519171 Aug 24 03:45:05.031818 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1431/2781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:04 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:05.152930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:05.156294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:05.164583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:05.165987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:05.167414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:05.168529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:05.169428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:05.170512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:05.201903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:05.211595 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-faafc62a-d7fc-405e-821e-b6163216e1df tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1507 microversion: 2.1 time: 0.254853 Aug 24 03:45:05.224105 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1351/2782] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:04 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:05.379593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:05.395329 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23b3b255-e574-49dd-b6bd-078ea2bb9d37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1666 microversion: 2.1 time: 0.246593 Aug 24 03:45:05.396287 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1432/2783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:05 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1666 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:05.459775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:05.462111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:05.474573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:05.475924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:05.476617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:05.477572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:05.478254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:05.478901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:05.514705 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d331c8ee-94eb-4477-a5cb-80483221d07a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059527 Aug 24 03:45:05.515572 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1352/2784] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:05 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:05.964143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03183195-fd18-4738-9c5d-0aa77ae8b97a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1023628040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:06.021611 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03183195-fd18-4738-9c5d-0aa77ae8b97a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.061774 Aug 24 03:45:06.022497 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1433/2785] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:05 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:06.055125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:06.056782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:06.065340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.065827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.066415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.067130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.067582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.068028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.236001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:06.237445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:06.249255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.249910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.250357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.251756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.251756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.254479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.316903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:06.328529 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea6f2ee6-048b-4c2a-b7f8-dc682c298959 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1318 microversion: 2.1 time: 0.281252 Aug 24 03:45:06.329456 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1353/2786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:06 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:06.505901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:06.526739 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1ff11606-a07c-48d6-88a6-75ed1a280bfd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1487 microversion: 2.1 time: 0.295720 Aug 24 03:45:06.527109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:06.529332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:06.536408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.537472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.538080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.539141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.539781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.540345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.550384 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1434/2787] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:06 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1487 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:06.570605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:06.571138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:06.575004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-568ed6ef-6fe1-4d20-b018-96a514128ebd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052106 Aug 24 03:45:06.576198 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1354/2788] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:06 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:06.585277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.585756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.586198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.586905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.587353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.587785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.616723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:06.721760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3fc8dbad-b56d-493a-be6a-1d78c746cbce tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 204 len: 0 microversion: 2.1 time: 0.158966 Aug 24 03:45:06.732970 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1435/2789] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:06 2022] DELETE /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:45:06.741555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:06.742547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:06.749038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.749593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.750098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.750818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.751283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.751761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.862237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-85474e6f-3ddb-4f01-b4b6-d93dd5b7eff4 req-1fd4b6fc-4e44-47fe-b910-a4dd319e6763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a57fff-dd1c-4da6-a069-721eeb327ba9", "name": "network-vif-unplugged", "status": "completed", "tag": "7b45f896-efbb-49d1-885b-f24770cf2671"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:06.879431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85474e6f-3ddb-4f01-b4b6-d93dd5b7eff4 req-1fd4b6fc-4e44-47fe-b910-a4dd319e6763 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:06.881810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85474e6f-3ddb-4f01-b4b6-d93dd5b7eff4 req-1fd4b6fc-4e44-47fe-b910-a4dd319e6763 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:06.886303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85474e6f-3ddb-4f01-b4b6-d93dd5b7eff4 req-1fd4b6fc-4e44-47fe-b910-a4dd319e6763 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:06.915249 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-85474e6f-3ddb-4f01-b4b6-d93dd5b7eff4 req-1fd4b6fc-4e44-47fe-b910-a4dd319e6763 service nova] Creating event network-vif-unplugged:7b45f896-efbb-49d1-885b-f24770cf2671 for instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 on n-h1-846470-15 Aug 24 03:45:06.922208 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-85474e6f-3ddb-4f01-b4b6-d93dd5b7eff4 req-1fd4b6fc-4e44-47fe-b910-a4dd319e6763 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072689 Aug 24 03:45:06.922847 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1436/2790] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:06.994987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:07.006239 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-df4a799b-fd91-4a4c-a36c-3ca8041e85c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1493 microversion: 2.1 time: 0.267612 Aug 24 03:45:07.007075 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1355/2791] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:06 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1493 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:07.040273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2da33a4f-b3bd-476c-9d07-d35817c6318f tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022ec4430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:07.098197 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2da33a4f-b3bd-476c-9d07-d35817c6318f tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.063124 Aug 24 03:45:07.098794 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1437/2792] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:07 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:07.353063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:07.353689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:07.362065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.362809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.363698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.364581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.365295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.365877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.523721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:07.532799 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e85813e0-82b5-4db1-9f59-3d158f8f3e66 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1508 microversion: 2.1 time: 0.183878 Aug 24 03:45:07.543750 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1356/2793] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:07 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:07.557104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:07.558842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:07.565793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.566541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.567206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.567998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.568404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.569013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.594017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:07.597050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:07.604171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.605154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.605841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.606725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.607279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.608160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.644438 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6fd2a154-5ad6-4777-bbd3-4b3f2a6d6d0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059786 Aug 24 03:45:07.645176 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1357/2794] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:07 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:07.778589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:07.789532 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-860e513e-670e-4c9e-9f24-684a653f678e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1508 microversion: 2.1 time: 0.237681 Aug 24 03:45:07.804176 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1438/2795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:07 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:07.810154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:07.813149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:07.820097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.820444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.821268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.822061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.822494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.823060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.913845 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7e61e50d-1920-4646-b365-935118124d7f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "PUT /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1080 microversion: 2.1 time: 0.107459 Aug 24 03:45:07.919792 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1358/2796] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:45:07 2022] PUT /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1080 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:07.934205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:07.936418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:07.944845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.946405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.947221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:07.948585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:07.949349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:07.950000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.027817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:08.028765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:08.035086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.035829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.036440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.037321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.037977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.038382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.217272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:08.240398 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6d7802a5-ea74-44f4-bf27-cd9b0d55a841 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1493 microversion: 2.1 time: 0.216326 Aug 24 03:45:08.244373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:08.247403 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1359/2797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:08 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1493 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:08.258240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1847668f-5d5d-4763-adb1-9cef88a00d62 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102afd55e0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:08.260728 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e579fa97-3e36-448d-bbbb-f1d8cc22b7d1 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1506 microversion: 2.1 time: 0.331251 Aug 24 03:45:08.262010 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1439/2798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:07 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:08.286183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:08.287225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:08.297686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.298271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.298716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.299436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.299933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.301244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.327014 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1847668f-5d5d-4763-adb1-9cef88a00d62 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.078683 Aug 24 03:45:08.328800 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1360/2799] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:08 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:08.659341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:08.661712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:08.673952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.674697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.675190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.675969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.676718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.677164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.695109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:08.704171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e4ad42da-31af-4e6e-8eeb-54dafd9b63fc tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1506 microversion: 2.1 time: 0.422277 Aug 24 03:45:08.707452 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1440/2800] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:08 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:08.722571 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c52e7765-5f44-45b8-acc1-130b1f229ae5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069336 Aug 24 03:45:08.728715 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1361/2801] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:08 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:08.729581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:08.733127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:08.743627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.744487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.744923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.745646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.746294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.746875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.769921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:08.835853 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b2eef300-47c2-4cb3-b55f-26a3a8d80d61 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "PUT /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1082 microversion: 2.1 time: 0.109947 Aug 24 03:45:08.847693 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1441/2802] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:45:08 2022] PUT /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1082 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:08.858739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:08.859369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:08.866203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.866969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.867715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:08.868866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:08.869493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:08.870091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.094097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:09.103686 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4fe0de84-2da5-4dae-bf97-868d1722045f tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1508 microversion: 2.1 time: 0.249437 Aug 24 03:45:09.112001 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1362/2803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:08 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:09.129913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:09.130538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:09.137734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.143722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.144707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.146214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.148078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.149194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.223874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ef9cc7f3-d314-4f4e-ba12-306f383b0c0c req-d85bdf6a-e8ca-4cfa-8247-98156f403020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f592d0-43b7-4c80-8c74-6bc035624134", "name": "network-vif-deleted", "tag": "d1ec25dc-55c7-4fa4-8985-62a0af54b1f4"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:09.246559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ef9cc7f3-d314-4f4e-ba12-306f383b0c0c req-d85bdf6a-e8ca-4cfa-8247-98156f403020 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.247100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ef9cc7f3-d314-4f4e-ba12-306f383b0c0c req-d85bdf6a-e8ca-4cfa-8247-98156f403020 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.249155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ef9cc7f3-d314-4f4e-ba12-306f383b0c0c req-d85bdf6a-e8ca-4cfa-8247-98156f403020 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.280895 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ef9cc7f3-d314-4f4e-ba12-306f383b0c0c req-d85bdf6a-e8ca-4cfa-8247-98156f403020 service nova] Creating event network-vif-deleted:d1ec25dc-55c7-4fa4-8985-62a0af54b1f4 for instance d6f592d0-43b7-4c80-8c74-6bc035624134 on n-h2-846470-15 Aug 24 03:45:09.291310 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ef9cc7f3-d314-4f4e-ba12-306f383b0c0c req-d85bdf6a-e8ca-4cfa-8247-98156f403020 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072583 Aug 24 03:45:09.292152 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1363/2804] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:09.305289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:09.306014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:09.323286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.323965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.324413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.325144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.325745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.326379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.486730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:09.502002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:09.515153 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a56a3a7f-045f-446a-93f3-5497578c43dc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1285 microversion: 2.1 time: 0.221894 Aug 24 03:45:09.515984 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1364/2805] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:09 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:09.524770 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb2bc02a-834a-4664-9670-2de88a03b322 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1508 microversion: 2.1 time: 0.399097 Aug 24 03:45:09.532070 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1442/2806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:09 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:09.537510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4780fa45-2e51-45c4-81ec-54da188971be tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102ad72dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:09.561145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:09.564229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:09.583211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.583886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.585286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.587739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.589494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.590019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.638196 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4780fa45-2e51-45c4-81ec-54da188971be tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.111165 Aug 24 03:45:09.639003 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1365/2807] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:09 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:09.647223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:09.738368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:09.741228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:09.747976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:09.752667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.753456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.754101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.755139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.756186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.756673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.763601 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5cac385-695a-45e9-bb2f-5773b137a724 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 204 len: 0 microversion: 2.1 time: 0.211191 Aug 24 03:45:09.765647 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1443/2808] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:09 2022] DELETE /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:45:09.777164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:09.779140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:09.785831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.786300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.786744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.787451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.787930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.788526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.811383 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6905f2e7-3e60-4572-b9f7-51a30404fbd7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078450 Aug 24 03:45:09.812379 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1366/2809] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:09 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:45:09.816801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:09.874184 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.compute.api [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Instance is already in deleting state, ignoring this request Aug 24 03:45:09.875009 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75a9462c-d98b-453e-96ac-13ab457f884e tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 204 len: 0 microversion: 2.1 time: 0.103336 Aug 24 03:45:09.875576 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1444/2810] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:09 2022] DELETE /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:45:09.886292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:09.886292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:09.896108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.896863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.898530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.899612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:09.900182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:09.900679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:09.917517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:10.069278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:10.090010 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc1f0317-ce35-4fbe-abf9-9f197e155929 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1514 microversion: 2.1 time: 0.209004 Aug 24 03:45:10.090607 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1367/2811] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:09 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:10.536582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:10.537495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:10.545639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:10.546687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:10.548415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:10.549357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:10.550043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:10.550627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:10.601510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:10.601995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:10.602426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:10.602878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lazy-loading 'fault' on Instance uuid d6f592d0-43b7-4c80-8c74-6bc035624134 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:45:10.656787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f12f4be8-bbec-494f-ac35-e01cafc9065e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102adae040>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:10.657064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:10.669267 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-17a33d5e-e5ff-4fcf-9ea7-874904ee6327 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 200 len: 1305 microversion: 2.1 time: 0.136602 Aug 24 03:45:10.675116 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1445/2812] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:10 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:10.722275 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f12f4be8-bbec-494f-ac35-e01cafc9065e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.069824 Aug 24 03:45:10.724786 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1368/2813] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:10 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:11.113270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:11.114727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:11.121591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:11.123585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:11.124282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:11.125715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:11.126373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:11.126809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:11.377295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:11.396635 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91cf8c82-937e-42f0-9fd7-f48a083d1755 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1514 microversion: 2.1 time: 0.288103 Aug 24 03:45:11.407713 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1446/2814] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:11 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:11.692621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:11.694339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:11.702907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:11.704131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:11.704823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:11.705825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:11.706537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:11.707186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:11.725806 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 HTTP/1.1 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd6f592d0-43b7-4c80-8c74-6bc035624134'} Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:11.734385 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:11.738664 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:11.738664 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:11.738664 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:11.738664 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:11.738664 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:11.738664 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:45:11.738664 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:11.739216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3da474e0-88e2-4da6-8d14-99fae4fe8bec tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1023233dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:11.741647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:11.744498 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c5b1470-cff2-4804-bec0-233bd5d65f44 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 404 len: 111 microversion: 2.1 time: 0.057392 Aug 24 03:45:11.746282 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1369/2815] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:11 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:11.824548 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3da474e0-88e2-4da6-8d14-99fae4fe8bec tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.090438 Aug 24 03:45:11.832424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1447/2816] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:11 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:11.933546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-814315971", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "6b7c20d5-6e0c-43b0-8505-bb28069b1895"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:12.022906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] validate_networks() for [('6b7c20d5-6e0c-43b0-8505-bb28069b1895', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:45:12.093507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-da022af5-5291-44ba-9e4a-9ecbd09aff25 req-b0d0030d-1fcf-4af6-8ffc-c7532a0892ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54497aca-4ef9-4dc5-b569-4209b27a69e3", "name": "network-vif-deleted", "tag": "6bf99d9c-f8c2-432a-be2c-76b138eaa646"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:12.126766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-da022af5-5291-44ba-9e4a-9ecbd09aff25 req-b0d0030d-1fcf-4af6-8ffc-c7532a0892ce service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.127703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-da022af5-5291-44ba-9e4a-9ecbd09aff25 req-b0d0030d-1fcf-4af6-8ffc-c7532a0892ce service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.128424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-da022af5-5291-44ba-9e4a-9ecbd09aff25 req-b0d0030d-1fcf-4af6-8ffc-c7532a0892ce service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:12.144547 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-da022af5-5291-44ba-9e4a-9ecbd09aff25 req-b0d0030d-1fcf-4af6-8ffc-c7532a0892ce service nova] Creating event network-vif-deleted:6bf99d9c-f8c2-432a-be2c-76b138eaa646 for instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 on n-h2-846470-15 Aug 24 03:45:12.151948 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-da022af5-5291-44ba-9e4a-9ecbd09aff25 req-b0d0030d-1fcf-4af6-8ffc-c7532a0892ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063286 Aug 24 03:45:12.152859 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1448/2817] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:12.420818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:12.421843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:12.440177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.441020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.441739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:12.442562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.444089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.444871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:12.487851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.488500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.489278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:12.489848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lazy-loading 'fault' on Instance uuid 54497aca-4ef9-4dc5-b569-4209b27a69e3 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:45:12.539958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d63578576d4fc7b6efabde5276b860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9017741914745fb8e346195e1077dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:12.552745 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8075f6f3-f452-4093-9f70-edadb6ecd0ee tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 200 len: 1308 microversion: 2.1 time: 0.136929 Aug 24 03:45:12.553601 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1449/2818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:12 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 1308 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:12.811632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:45:12.812244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:45:12.812570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:45:12.812989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:45:12.813412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:45:12.837796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.838364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.838813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:12.839551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.840041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.840471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:12.841005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8662dcb8-273e-448f-8873-5951370f5383 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103438a820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:12.903336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:45:12.911731 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8662dcb8-273e-448f-8873-5951370f5383 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.075220 Aug 24 03:45:12.920621 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1450/2819] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:12 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:12.922165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for user 69a1414940b14e459202a86bd8e9027b and project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:45:12.937975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:45:12.942064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:45:12.977144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-0536561a-5e39-474e-8294-0ec43eea172f req-a55b3e86-8a6b-4b37-bc5c-e061d83bff77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f", "name": "network-vif-plugged", "status": "completed", "tag": "3a1a2e99-33ae-440a-8de1-d607808576ba"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:12.993344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0536561a-5e39-474e-8294-0ec43eea172f req-a55b3e86-8a6b-4b37-bc5c-e061d83bff77 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.993978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0536561a-5e39-474e-8294-0ec43eea172f req-a55b3e86-8a6b-4b37-bc5c-e061d83bff77 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.995011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0536561a-5e39-474e-8294-0ec43eea172f req-a55b3e86-8a6b-4b37-bc5c-e061d83bff77 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.010451 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69b2ff30-648d-4bd3-8dc8-775ae4b029ed tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082267 Aug 24 03:45:13.012264 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1370/2820] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:45:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:45:13.024574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-08f2354c-46f2-474f-9c45-73e4889dfef2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.025613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-08f2354c-46f2-474f-9c45-73e4889dfef2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.028085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:13.028966 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-0536561a-5e39-474e-8294-0ec43eea172f req-a55b3e86-8a6b-4b37-bc5c-e061d83bff77 service nova] Creating event network-vif-plugged:3a1a2e99-33ae-440a-8de1-d607808576ba for instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f on n-h1-846470-15 Aug 24 03:45:13.040950 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-0536561a-5e39-474e-8294-0ec43eea172f req-a55b3e86-8a6b-4b37-bc5c-e061d83bff77 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067161 Aug 24 03:45:13.042174 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1451/2821] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:13.112833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-08f2354c-46f2-474f-9c45-73e4889dfef2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:13.123826 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-08f2354c-46f2-474f-9c45-73e4889dfef2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1214 microversion: 2.1 time: 0.103609 Aug 24 03:45:13.124807 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1371/2822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:13 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:13.575532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.576226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 54497aca-4ef9-4dc5-b569-4209b27a69e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.584300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.585106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.585546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.586367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.586820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.587240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.610051 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] HTTP exception thrown: Instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 could not be found. Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Request method failure captured: Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 HTTP/1.1 Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ4w7ATG_tiNRayyrdjQPHao5cLKOY0_773DWFjFsg6GuNSw8LdIolP2K3wraQya25EvWkeoDhenFVNEM-RJwbKeABCgYucxrh_ERDdwIGSQT0Ebm-o6kS-ZjlpeVX3oSZJSu8sE3l_LZMjst2URvAchIOwf8fv4MMdYpNOhWU8P1uw Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9017741914745fb8e346195e1077dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9017741914745fb8e346195e1077dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 85d63578576d4fc7b6efabde5276b860 Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 could not be found. Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '54497aca-4ef9-4dc5-b569-4209b27a69e3'} Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 could not be found. Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 could not be found. Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.613173 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 could not be found. Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Returning 404 to user: Instance 54497aca-4ef9-4dc5-b569-4209b27a69e3 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed7db050-f253-42a4-a797-d82734568974 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3" status: 404 len: 111 microversion: 2.1 time: 0.044261 Aug 24 03:45:13.618128 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1452/2823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:13 2022] GET /compute/v2.1/servers/54497aca-4ef9-4dc5-b569-4209b27a69e3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:13.624253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.624763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.642993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.643543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.647653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.648486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.648968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.649423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.682136 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] HTTP exception thrown: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Request method failure captured: Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e HTTP/1.1 Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ4w7ATG_tiNRayyrdjQPHao5cLKOY0_773DWFjFsg6GuNSw8LdIolP2K3wraQya25EvWkeoDhenFVNEM-RJwbKeABCgYucxrh_ERDdwIGSQT0Ebm-o6kS-ZjlpeVX3oSZJSu8sE3l_LZMjst2URvAchIOwf8fv4MMdYpNOhWU8P1uw Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9017741914745fb8e346195e1077dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9017741914745fb8e346195e1077dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 85d63578576d4fc7b6efabde5276b860 Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'b8ff552d-5e9a-497e-add0-2c14f712c63e'} Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:13.695848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Returning 404 to user: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31d4b144-b24b-495d-a9bb-e71451de108b tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 404 len: 111 microversion: 2.1 time: 0.077876 Aug 24 03:45:13.703274 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1372/2824] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:13 2022] DELETE /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:13.712585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.713238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: b8ff552d-5e9a-497e-add0-2c14f712c63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.720328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.720816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.721659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.722588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.723248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.723894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.741456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] HTTP exception thrown: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Request method failure captured: Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e HTTP/1.1 Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ4w7ATG_tiNRayyrdjQPHao5cLKOY0_773DWFjFsg6GuNSw8LdIolP2K3wraQya25EvWkeoDhenFVNEM-RJwbKeABCgYucxrh_ERDdwIGSQT0Ebm-o6kS-ZjlpeVX3oSZJSu8sE3l_LZMjst2URvAchIOwf8fv4MMdYpNOhWU8P1uw Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9017741914745fb8e346195e1077dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9017741914745fb8e346195e1077dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 85d63578576d4fc7b6efabde5276b860 Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'b8ff552d-5e9a-497e-add0-2c14f712c63e'} Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.744711 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.748946 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.748946 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.748946 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.748946 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:13.748946 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:13.748946 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. Aug 24 03:45:13.748946 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.751136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Returning 404 to user: Instance b8ff552d-5e9a-497e-add0-2c14f712c63e could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:13.752289 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be992bbc-d340-423d-9096-9327232350da tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e" status: 404 len: 111 microversion: 2.1 time: 0.046154 Aug 24 03:45:13.753622 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1453/2825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:13 2022] GET /compute/v2.1/servers/b8ff552d-5e9a-497e-add0-2c14f712c63e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:13.765529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.766179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.773823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.774597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.775086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.775802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.776268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.776703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.793967 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] HTTP exception thrown: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Request method failure captured: Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 HTTP/1.1 Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ4w7ATG_tiNRayyrdjQPHao5cLKOY0_773DWFjFsg6GuNSw8LdIolP2K3wraQya25EvWkeoDhenFVNEM-RJwbKeABCgYucxrh_ERDdwIGSQT0Ebm-o6kS-ZjlpeVX3oSZJSu8sE3l_LZMjst2URvAchIOwf8fv4MMdYpNOhWU8P1uw Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9017741914745fb8e346195e1077dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9017741914745fb8e346195e1077dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 85d63578576d4fc7b6efabde5276b860 Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '1b75085c-e1de-4465-9ddb-1dba6c2519d9'} Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:13.795924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Returning 404 to user: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:13.801339 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e01a4621-fd81-4465-a346-083a3bb4cb97 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 404 len: 111 microversion: 2.1 time: 0.039798 Aug 24 03:45:13.802909 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1373/2826] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:13 2022] DELETE /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:13.808329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.809116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] [instance: 1b75085c-e1de-4465-9ddb-1dba6c2519d9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.818340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.819172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.819927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.820833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.821927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.822641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.843456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] HTTP exception thrown: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Request method failure captured: Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 HTTP/1.1 Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ4w7ATG_tiNRayyrdjQPHao5cLKOY0_773DWFjFsg6GuNSw8LdIolP2K3wraQya25EvWkeoDhenFVNEM-RJwbKeABCgYucxrh_ERDdwIGSQT0Ebm-o6kS-ZjlpeVX3oSZJSu8sE3l_LZMjst2URvAchIOwf8fv4MMdYpNOhWU8P1uw Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d9017741914745fb8e346195e1077dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d9017741914745fb8e346195e1077dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d9017741914745fb8e346195e1077dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: d9017741914745fb8e346195e1077dae Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1160813650 Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 85d63578576d4fc7b6efabde5276b860 Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerDiskConfigTestJSON-1160813650-project Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1b75085c-e1de-4465-9ddb-1dba6c2519d9'} Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:13.845247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] Returning 404 to user: Instance 1b75085c-e1de-4465-9ddb-1dba6c2519d9 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b676386-5885-46e9-829b-3a3db89d1c13 tempest-ServerDiskConfigTestJSON-1160813650 tempest-ServerDiskConfigTestJSON-1160813650-project] 10.222.0.58 "GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9" status: 404 len: 111 microversion: 2.1 time: 0.043279 Aug 24 03:45:13.853344 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1454/2827] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:13 2022] GET /compute/v2.1/servers/1b75085c-e1de-4465-9ddb-1dba6c2519d9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:13.927298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-68b91c2c-7cab-4d76-97b6-286ba6904ccd tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1034359f70>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.997664 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-68b91c2c-7cab-4d76-97b6-286ba6904ccd tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.074892 Aug 24 03:45:14.003708 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1374/2828] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:13 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:14.149739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:14.150397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:14.162426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:14.162912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:14.163346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:14.168004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:14.168494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:14.168974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:14.706003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:14.715395 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1220ae91-257c-4cc6-9496-286eeffdb990 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1266 microversion: 2.1 time: 0.574583 Aug 24 03:45:14.730025 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1455/2829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:14 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1266 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:15.019405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c697c0c5-127a-4f10-9481-ac622b1cb9e6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103424b8b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:15.080299 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c697c0c5-127a-4f10-9481-ac622b1cb9e6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.066074 Aug 24 03:45:15.094919 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1375/2830] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:15 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:15.737402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:15.738977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:15.750580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:15.752232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:15.756534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:15.757756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:15.759456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:15.761571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:16.100731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6d195790-64f1-44fa-8bf3-155a06a9099c tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1034359820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:16.126349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:16.141205 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d49b937b-9544-4a0f-839f-1a7407fb7c1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.408078 Aug 24 03:45:16.141833 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1456/2831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:15 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:16.214797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6d195790-64f1-44fa-8bf3-155a06a9099c tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.120205 Aug 24 03:45:16.215411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1376/2832] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:16 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:16.674686 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:45:16.674992 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 03:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:45:17.162762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:17.163398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:17.180376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:17.181320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:17.186584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:17.187846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:17.191153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:17.195050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:17.231424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87e3186e-0a8a-4ff2-b73a-ff872647238e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102ad72280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:17.718403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:17.746090 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cbcaa8cc-bb0e-4448-afb5-7e1f00caa933 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.582759 Aug 24 03:45:17.748733 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1457/2833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:17 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:17.764373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c791cc0c-4953-4632-b103-f07d5b1f0ca4 req-bef82160-8acc-4dae-9742-52fe2aa38127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9", "tag": "8f092b56-4331-49ca-b0e1-5edd1dc0a14d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:17.814537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c791cc0c-4953-4632-b103-f07d5b1f0ca4 req-bef82160-8acc-4dae-9742-52fe2aa38127 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:17.817426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c791cc0c-4953-4632-b103-f07d5b1f0ca4 req-bef82160-8acc-4dae-9742-52fe2aa38127 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:17.818841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c791cc0c-4953-4632-b103-f07d5b1f0ca4 req-bef82160-8acc-4dae-9742-52fe2aa38127 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:17.879243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c791cc0c-4953-4632-b103-f07d5b1f0ca4 req-bef82160-8acc-4dae-9742-52fe2aa38127 service nova] Creating event network-changed:8f092b56-4331-49ca-b0e1-5edd1dc0a14d for instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 on n-h2-846470-15 Aug 24 03:45:17.890683 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c791cc0c-4953-4632-b103-f07d5b1f0ca4 req-bef82160-8acc-4dae-9742-52fe2aa38127 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139665 Aug 24 03:45:17.893172 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1458/2834] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:18.769211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:18.769921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:18.788852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:18.790779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:18.792055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:18.794251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:18.795791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:18.797856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:19.209310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:19.214301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:19.222719 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc4041ca-dd3c-4ed2-98b0-28a54916de3a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.457557 Aug 24 03:45:19.241323 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1459/2835] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:18 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:20.249182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:20.249958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:20.271794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:20.272959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:20.274732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:20.276944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:20.278057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:20.279775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:20.518390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:20.529704 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bcde2b0-ffa9-439d-adb1-c9b71c5156cc tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.285375 Aug 24 03:45:20.530768 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1460/2836] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:20 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:21.555600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:21.556301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:21.568668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:21.569851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:21.581940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:21.584827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:21.587304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:21.588738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:22.154554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:22.164074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4176e7c0-a17e-4053-828c-70898e177b87 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.614072 Aug 24 03:45:22.168586 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1461/2837] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:21 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:22.874422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:23.119495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:23.188989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:23.190341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:23.198180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:23.199048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:23.199768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:23.200975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:23.201740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:23.202531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:23.481357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:23.499915 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07385bf2-68b9-4ab1-aa1d-4c517a36b9c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.315166 Aug 24 03:45:23.501602 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1462/2838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:23 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:23.773447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=7 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:23.785165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=11 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:24.525043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:24.526594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:24.537511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:24.538183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:24.538732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:24.539759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:24.540728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:24.551489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:24.975826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:24.991409 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bd831e0-7a88-4537-a337-ffbe5144d7d9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.471549 Aug 24 03:45:25.007700 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1463/2839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:24 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:26.013605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:26.014730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:26.034308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:26.040683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:26.041316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:26.042859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:26.043346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:26.043880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:26.586032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:26.607174 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2d0a1e3a-8a50-4e35-8c60-6a720e76ffe9 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.597322 Aug 24 03:45:26.610966 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1464/2840] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:26 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:27.055867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2999006c-562a-4610-b777-a15e7d6c7d80 req-5e9195e6-3587-4555-8918-fd8dcf636d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9", "name": "network-vif-plugged", "status": "completed", "tag": "8f092b56-4331-49ca-b0e1-5edd1dc0a14d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:27.098347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2999006c-562a-4610-b777-a15e7d6c7d80 req-5e9195e6-3587-4555-8918-fd8dcf636d02 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:27.105532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2999006c-562a-4610-b777-a15e7d6c7d80 req-5e9195e6-3587-4555-8918-fd8dcf636d02 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:27.111567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2999006c-562a-4610-b777-a15e7d6c7d80 req-5e9195e6-3587-4555-8918-fd8dcf636d02 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:27.188418 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2999006c-562a-4610-b777-a15e7d6c7d80 req-5e9195e6-3587-4555-8918-fd8dcf636d02 service nova] Creating event network-vif-plugged:8f092b56-4331-49ca-b0e1-5edd1dc0a14d for instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 on n-h2-846470-15 Aug 24 03:45:27.202262 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2999006c-562a-4610-b777-a15e7d6c7d80 req-5e9195e6-3587-4555-8918-fd8dcf636d02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148356 Aug 24 03:45:27.205483 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1465/2841] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:27.632801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:27.633813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:27.654333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:27.656362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:27.658263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:27.661273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:27.662165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:27.662912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:28.442858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:28.456046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bfdbfa02-3987-4022-886b-31bd5f7fd8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1314 microversion: 2.1 time: 0.824857 Aug 24 03:45:28.458887 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1466/2842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:27 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1314 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:29.273797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87e3186e-0a8a-4ff2-b73a-ff872647238e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 12.047183 Aug 24 03:45:29.274723 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1377/2843] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:17 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 12049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:29.482986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:29.484896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:29.514607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:29.515585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:29.517791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:29.518793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:29.521592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:29.522245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:30.201639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:30.210791 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-788bfc52-b0fe-4e3c-9bff-790928615d31 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1500 microversion: 2.1 time: 0.736969 Aug 24 03:45:30.218909 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1467/2844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:29 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1500 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:30.254380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:30.254380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:30.288472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:30.290815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c5631a8-4690-4f88-b717-bc4f6f28203b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103423a4c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:30.292575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:30.293252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:30.304710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:30.308821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:30.314260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:30.373931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lazy-loading 'flavor' on Instance uuid acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:45:30.379152 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c5631a8-4690-4f88-b717-bc4f6f28203b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.093239 Aug 24 03:45:30.379920 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1468/2845] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:30 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:30.848368 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a8d1ec3-65b1-4e1c-ba26-343d48a3d8f1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9/action" status: 202 len: 0 microversion: 2.1 time: 0.611449 Aug 24 03:45:30.850197 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1378/2846] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:45:30 2022] POST /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:45:30.864643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:30.867342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:30.884116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:30.885228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:30.891450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:30.893222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:30.894212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:30.894879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:30.966246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:30.967513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:30.982927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:30.988740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:30.989451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:30.990445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:30.991166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:30.991861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:31.063288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:31.205745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:31.217582 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-29f50d18-26c2-4fa8-976f-edea17e4e0f7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.362755 Aug 24 03:45:31.222484 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1379/2847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:30 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:31.261029 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44af4b94-6d29-4d9d-88cd-8c5b0299bc62 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 204 len: 0 microversion: 2.32 time: 0.758687 Aug 24 03:45:31.262441 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1469/2848] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:45:30 2022] DELETE /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:45:31.277594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:31.279174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:31.296074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:31.297326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:31.298155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:31.299244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:31.299969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:31.300618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:31.400069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07bcb999-451c-4da4-a4b2-39149081e61b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103423aaf0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:31.485335 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07bcb999-451c-4da4-a4b2-39149081e61b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.093349 Aug 24 03:45:31.486109 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1470/2849] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:31 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:31.675773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:31.694011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:31.712636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:31.715036 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cebd52ae-98e1-4292-a6ab-0eac3dd912b9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2956 microversion: 2.32 time: 0.447662 Aug 24 03:45:31.723874 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1380/2850] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:31 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2956 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:32.256204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:32.258173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:32.269304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:32.270121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:32.270791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:32.272319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:32.272974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:32.274152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:32.501348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-488f98ae-1244-48a0-aa99-a9f288fe6aec tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a7978b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:32.568656 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-488f98ae-1244-48a0-aa99-a9f288fe6aec tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.071667 Aug 24 03:45:32.569843 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1381/2851] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:32 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:32.754272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:32.755177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:32.766061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:32.772570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:32.774095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:32.775368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:32.776127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:32.776742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:33.064731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:33.082846 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dc054d88-08f2-435e-8ce3-16f6b2fe98fa tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.843478 Aug 24 03:45:33.088925 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1471/2852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:32 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:33.192764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:33.206055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:33.213267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:33.214777 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2f1eec0f-8ed2-4484-912a-7ce00b0d1144 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2956 microversion: 2.32 time: 0.466232 Aug 24 03:45:33.232367 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1382/2853] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:32 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2956 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:33.594643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e76f7bd6-b14c-45b0-8158-bac283f5d4a6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103423a700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:33.700784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e76f7bd6-b14c-45b0-8158-bac283f5d4a6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.118820 Aug 24 03:45:33.701404 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1472/2854] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:33 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:34.113818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:34.114660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:34.128985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:34.133431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:34.134111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:34.135532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:34.137422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:34.142869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:34.249214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:34.250362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:34.271195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:34.272163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:34.272843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:34.275729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:34.276520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:34.278752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:34.593874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:34.606819 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79d332a1-b0b2-44fa-a896-46816c2e54a4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.497008 Aug 24 03:45:34.607748 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1383/2855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:34 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:34.726025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d042ee22-a97f-49ad-be60-8b1ae3a4ea97 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10344163a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:34.799058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:34.809441 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d042ee22-a97f-49ad-be60-8b1ae3a4ea97 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.093209 Aug 24 03:45:34.816109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:34.818133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:34.818599 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1384/2856] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:34 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:34.820234 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3342bdb0-2e5e-46dc-a460-8342f9130126 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2956 microversion: 2.32 time: 0.576399 Aug 24 03:45:34.822241 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1473/2857] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:34 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2956 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:45:35.176989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1311424137", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "1be474a5-2ec3-4a2d-a71b-e0c08bc5203c"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:35.292862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] validate_networks() for [('1be474a5-2ec3-4a2d-a71b-e0c08bc5203c', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:45:35.628645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:35.629264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:35.640293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:35.640789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:35.641225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:35.641962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:35.648550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:35.649171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:36.253148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:36.267403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a774205-f9cc-4ad9-931e-40bce40ea5a2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.642918 Aug 24 03:45:36.269882 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1474/2858] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:35 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:36.278158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4ac4e057-0ff6-4d2d-9637-d391489baa51 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022770550>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:36.393308 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4ac4e057-0ff6-4d2d-9637-d391489baa51 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.120560 Aug 24 03:45:36.396905 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1475/2859] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:36 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:36.406771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:36.413831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:36.424755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:36.429110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:36.429933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:36.430923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:36.432527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:36.435615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:36.892871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:45:36.893931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:45:36.894423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:45:36.894842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:45:36.895570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:45:36.914576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:36.915452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:36.916956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:36.918107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:36.918614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:36.919060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:36.970486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:36.971063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Getting quotas for project cc61eca1851745c1817103f5f4f5bf63. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:45:36.985825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Getting quotas for user cdd1eb522b66415eb4bd0d551b2f5eb5 and project cc61eca1851745c1817103f5f4f5bf63. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:45:36.987592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:36.993726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:36.995311 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3469b1fd-0228-43b9-96e1-a93388515c58 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2935 microversion: 2.32 time: 0.596813 Aug 24 03:45:37.005814 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1476/2860] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:36 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2935 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:37.024324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:45:37.064360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:45:37.183572 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87679f72-73b1-47d1-aef7-ea70a8c48095 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.127848 Aug 24 03:45:37.187213 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1385/2861] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:45:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:45:37.197709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5dc60d31-22ce-42fa-86e1-c9f4da6a5597 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:37.198232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5dc60d31-22ce-42fa-86e1-c9f4da6a5597 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:37.291483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:37.292130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:37.310242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:37.310744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:37.311189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:37.311961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:37.312436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:37.312997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:37.419271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5dc60d31-22ce-42fa-86e1-c9f4da6a5597 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:37.434773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5dc60d31-22ce-42fa-86e1-c9f4da6a5597 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:37.436539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5dc60d31-22ce-42fa-86e1-c9f4da6a5597 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:37.443848 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5dc60d31-22ce-42fa-86e1-c9f4da6a5597 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1259 microversion: 2.21 time: 0.250587 Aug 24 03:45:37.448297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1477/2862] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:37 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:37.483845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3f76d87c-a333-4a80-91c5-6610e05fae56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103438a820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:37.667642 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3f76d87c-a333-4a80-91c5-6610e05fae56 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.213616 Aug 24 03:45:37.669424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1478/2863] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:37 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:37.808279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:37.823401 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c82c4587-65f3-4250-b23d-e712c5d53b3b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.536450 Aug 24 03:45:37.837350 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1386/2864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:37 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:38.030358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:38.031027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:38.064204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:38.064876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:38.072459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:38.074255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:38.074950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:38.075878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:38.506100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8b86dd5-31f1-4e7d-bdce-6ef362b2b90e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:38.508028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8b86dd5-31f1-4e7d-bdce-6ef362b2b90e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:38.643431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:38.741278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:38.745357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:38.765738 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d3a737ad-eae9-4cc4-8477-2c9a4aa12a24 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2914 microversion: 2.32 time: 0.735132 Aug 24 03:45:38.788151 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1479/2865] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:38 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2914 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:38.822660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4396771a-3787-49fb-9f58-b71c36bf3652 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103423a0d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:39.017197 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4396771a-3787-49fb-9f58-b71c36bf3652 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.227387 Aug 24 03:45:39.037351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8b86dd5-31f1-4e7d-bdce-6ef362b2b90e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:39.047924 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1480/2866] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:38 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:39.057508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8b86dd5-31f1-4e7d-bdce-6ef362b2b90e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:39.071328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8b86dd5-31f1-4e7d-bdce-6ef362b2b90e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:39.072207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:39.079126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:39.081369 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8b86dd5-31f1-4e7d-bdce-6ef362b2b90e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1259 microversion: 2.21 time: 0.605750 Aug 24 03:45:39.087628 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1387/2867] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:38 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1259 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:39.160265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:39.161115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:39.166687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:39.167190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:39.171978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:39.175233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:39.464886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8e53580e-ccc4-4058-ae3b-0cd0583d5cd5 req-4f303942-384f-464c-8127-75d5d65efaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-unplugged", "status": "completed", "tag": "405cade2-305c-45aa-8315-48c4d3933e72"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:39.507049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8e53580e-ccc4-4058-ae3b-0cd0583d5cd5 req-4f303942-384f-464c-8127-75d5d65efaed service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:39.508295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8e53580e-ccc4-4058-ae3b-0cd0583d5cd5 req-4f303942-384f-464c-8127-75d5d65efaed service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:39.509242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8e53580e-ccc4-4058-ae3b-0cd0583d5cd5 req-4f303942-384f-464c-8127-75d5d65efaed service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:39.546862 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8e53580e-ccc4-4058-ae3b-0cd0583d5cd5 req-4f303942-384f-464c-8127-75d5d65efaed service nova] Creating event network-vif-unplugged:405cade2-305c-45aa-8315-48c4d3933e72 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:39.572696 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8e53580e-ccc4-4058-ae3b-0cd0583d5cd5 req-4f303942-384f-464c-8127-75d5d65efaed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.292398 Aug 24 03:45:39.575209 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1388/2868] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:39.795435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:39.796877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:39.817854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:39.818400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:39.823726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:39.827939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:39.828581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:39.829045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:40.092896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:40.107064 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f522a01-8178-4711-bf47-94b6bea0167a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 1.051702 Aug 24 03:45:40.109158 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1481/2869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:39 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:40.120501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-382ad950-6019-40ca-8364-f08b18b2409f tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022755040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:40.210593 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-382ad950-6019-40ca-8364-f08b18b2409f tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1455 microversion: 2.1 time: 0.098843 Aug 24 03:45:40.212492 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1482/2870] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:40 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:40.217912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:40.218889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:40.225932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:40.227847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:40.228738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:40.229380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:40.230398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:40.231229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:40.231926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:40.273925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:40.358079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:40.374185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:40.379380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:40.387420 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-49a5bff8-d490-4f53-b39d-7bd1ecf95123 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1311 microversion: 2.21 time: 0.171011 Aug 24 03:45:40.409271 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1483/2871] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:40 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:40.560289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:40.588762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:40.592672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:40.597943 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-551337cb-3e78-4d0e-b8ef-a0cf2637e2fa tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2914 microversion: 2.32 time: 0.806946 Aug 24 03:45:40.614597 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1389/2872] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:39 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2914 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:45:41.129850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.130490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:41.160810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.161726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.162498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.164580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.168293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.169013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.226816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89435b94-4456-4bfb-8d51-bb54bd8ecd40 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102ae07700>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.314693 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89435b94-4456-4bfb-8d51-bb54bd8ecd40 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1464 microversion: 2.1 time: 0.091726 Aug 24 03:45:41.325806 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1390/2873] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1464 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:41.339722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-df209b3b-4dcb-4b73-a896-e271edc6ea8b req-30585f40-7e77-4989-a515-a6ffe3a15bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-deleted", "tag": "405cade2-305c-45aa-8315-48c4d3933e72"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:41.370636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-df209b3b-4dcb-4b73-a896-e271edc6ea8b req-30585f40-7e77-4989-a515-a6ffe3a15bd4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.372094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-df209b3b-4dcb-4b73-a896-e271edc6ea8b req-30585f40-7e77-4989-a515-a6ffe3a15bd4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.373297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-df209b3b-4dcb-4b73-a896-e271edc6ea8b req-30585f40-7e77-4989-a515-a6ffe3a15bd4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.389389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-df209b3b-4dcb-4b73-a896-e271edc6ea8b req-30585f40-7e77-4989-a515-a6ffe3a15bd4 service nova] Creating event network-vif-deleted:405cade2-305c-45aa-8315-48c4d3933e72 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:41.413346 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-df209b3b-4dcb-4b73-a896-e271edc6ea8b req-30585f40-7e77-4989-a515-a6ffe3a15bd4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081112 Aug 24 03:45:41.416162 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1391/2874] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:41.435692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc30a7ed-c24c-45a9-857c-b573368b1856 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1034397820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.527405 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc30a7ed-c24c-45a9-857c-b573368b1856 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 200 len: 1464 microversion: 2.1 time: 0.107052 Aug 24 03:45:41.530400 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1392/2875] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 1464 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:41.542586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.545769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:41.568744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.569448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.572664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.575413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.577009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.582891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.598798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:41.608771 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1efca6e-a8c0-4e91-8e0a-185bf362086f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.482651 Aug 24 03:45:41.609232 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1484/2876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:41.631178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.643197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:41.660616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.661118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.661577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.662461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.664721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.665183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.720518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:41.732558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:41.739898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:41.743955 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-128c5d3a-313e-48d3-bcbd-fd34d3d578ab tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1317 microversion: 2.21 time: 0.210361 Aug 24 03:45:41.759249 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1393/2877] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:41.765516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.766599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:41.773465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.775533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.776426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.777580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.778820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.779518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:42.087919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:42.104323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:42.106657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:42.108355 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aee2bf41-268d-42ec-947b-1f925201c7fc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2581 microversion: 2.32 time: 0.347585 Aug 24 03:45:42.109537 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1394/2878] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2581 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:42.114723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ca6f7030-177c-447a-b7f2-bb8f6f5fa352 req-6e6044c5-a9e5-48d5-bdb7-c418bee114c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-unplugged", "status": "completed", "tag": "5af2697c-af94-46c8-909d-23f7f66e37c1"}, {"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-unplugged", "status": "completed", "tag": "840eae0a-52d3-4413-af17-8df0521ff34a"}, {"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-unplugged", "status": "completed", "tag": "1aa3e47c-9374-4288-97b6-28044e86d865"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:42.127379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ca6f7030-177c-447a-b7f2-bb8f6f5fa352 req-6e6044c5-a9e5-48d5-bdb7-c418bee114c5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:42.128421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ca6f7030-177c-447a-b7f2-bb8f6f5fa352 req-6e6044c5-a9e5-48d5-bdb7-c418bee114c5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:42.129165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ca6f7030-177c-447a-b7f2-bb8f6f5fa352 req-6e6044c5-a9e5-48d5-bdb7-c418bee114c5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:42.143994 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ca6f7030-177c-447a-b7f2-bb8f6f5fa352 req-6e6044c5-a9e5-48d5-bdb7-c418bee114c5 service nova] Creating event network-vif-unplugged:5af2697c-af94-46c8-909d-23f7f66e37c1 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:42.144971 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ca6f7030-177c-447a-b7f2-bb8f6f5fa352 req-6e6044c5-a9e5-48d5-bdb7-c418bee114c5 service nova] Creating event network-vif-unplugged:840eae0a-52d3-4413-af17-8df0521ff34a for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:42.145709 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ca6f7030-177c-447a-b7f2-bb8f6f5fa352 req-6e6044c5-a9e5-48d5-bdb7-c418bee114c5 service nova] Creating event network-vif-unplugged:1aa3e47c-9374-4288-97b6-28044e86d865 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:42.152012 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ca6f7030-177c-447a-b7f2-bb8f6f5fa352 req-6e6044c5-a9e5-48d5-bdb7-c418bee114c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.040865 Aug 24 03:45:42.153475 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1395/2879] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:42.417677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-653759630", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7f7d79fe-5369-4b60-bc8d-97cdf54981c1"}], "block_device_mapping_v2": [{"uuid": "64eb6030-ebdd-42f5-8722-46cff16b3f2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:42.418406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:42.429492 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4aea0613-7f97-4ea4-94c1-e36e1495a88e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1480 microversion: 2.1 time: 0.802306 Aug 24 03:45:42.431832 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1485/2880] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1480 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:42.589732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] validate_networks() for [('7f7d79fe-5369-4b60-bc8d-97cdf54981c1', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:45:42.646410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:42.647067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:42.655479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:42.656198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:42.656463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:42.657183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:42.658041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:42.658857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:42.974415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:42.989937 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e4ec18e-206a-4a4e-8997-0d63bbf6ed32 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.362720 Aug 24 03:45:43.008178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1486/2881] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:42 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:43.018299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:43.018960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:43.027269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.027782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.028250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.028974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.029440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.029932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.410952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:43.425987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:43.428542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:43.430226 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-19794ae3-c1d3-4102-af1e-e8197bd0a215 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.417138 Aug 24 03:45:43.431395 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1487/2882] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:43 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:43.440980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:43.441603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:43.451348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.451927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.452340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.453268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.453734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.454221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.673261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:45:43.674674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:45:43.675187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:45:43.675608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:45:43.676075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:45:43.689292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.689857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.690719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.691768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.692302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.693055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.720494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:43.734321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:43.735813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:45:43.739311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:43.743139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Getting quotas for user 73ddcba828514d1882d2cd02d357bef8 and project 159a3e9d888c49c78cf8ad328a1cdfd2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:45:43.744667 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f52be88e-7b31-4f1e-b393-331c256fc3b3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2534 microversion: 2.32 time: 0.311048 Aug 24 03:45:43.745524 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1488/2883] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:43 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2534 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:43.750635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:43.751243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:43.769300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.769787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.770232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.770949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.771404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.771865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.841578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:45:43.844286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64eb6030-ebdd-42f5-8722-46cff16b3f2a',volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:45:44.054118 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2bf8541-c1b2-4a81-86c5-ff1a68789e52 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639294 Aug 24 03:45:44.056534 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1396/2884] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:45:44.065055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:44.074956 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a69ae8cd-366b-4fc9-b0e9-e9cff1f77d85 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1467 microversion: 2.1 time: 0.328077 Aug 24 03:45:44.089792 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1489/2885] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:43 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1467 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:44.095540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b43c4966-8a2d-42bf-9e54-c595abe300bc req-e674d6ec-55e8-4aa2-943c-ff0b350f02cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-deleted", "tag": "840eae0a-52d3-4413-af17-8df0521ff34a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:44.101408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b43c4966-8a2d-42bf-9e54-c595abe300bc req-e674d6ec-55e8-4aa2-943c-ff0b350f02cb service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.102021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b43c4966-8a2d-42bf-9e54-c595abe300bc req-e674d6ec-55e8-4aa2-943c-ff0b350f02cb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.102677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b43c4966-8a2d-42bf-9e54-c595abe300bc req-e674d6ec-55e8-4aa2-943c-ff0b350f02cb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.117791 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b43c4966-8a2d-42bf-9e54-c595abe300bc req-e674d6ec-55e8-4aa2-943c-ff0b350f02cb service nova] Creating event network-vif-deleted:840eae0a-52d3-4413-af17-8df0521ff34a for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:44.123924 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b43c4966-8a2d-42bf-9e54-c595abe300bc req-e674d6ec-55e8-4aa2-943c-ff0b350f02cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065764 Aug 24 03:45:44.125248 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1397/2886] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:44.142700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:44.144231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:44.165910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.168113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.170479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.174087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.174915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.177022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.206714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1e58fbf6-78d9-47d6-8ead-c31b4f142c24 req-f1cf4141-f3a9-4500-abf4-a0becf84c4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b62e581-573e-44fa-ba4b-c0b93f13ca4f", "tag": "cb204930-5f75-4268-9dcd-82c77baf2d50"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:44.233695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e58fbf6-78d9-47d6-8ead-c31b4f142c24 req-f1cf4141-f3a9-4500-abf4-a0becf84c4bf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.236967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e58fbf6-78d9-47d6-8ead-c31b4f142c24 req-f1cf4141-f3a9-4500-abf4-a0becf84c4bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.241917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e58fbf6-78d9-47d6-8ead-c31b4f142c24 req-f1cf4141-f3a9-4500-abf4-a0becf84c4bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.263159 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1e58fbf6-78d9-47d6-8ead-c31b4f142c24 req-f1cf4141-f3a9-4500-abf4-a0becf84c4bf service nova] Creating event network-changed:cb204930-5f75-4268-9dcd-82c77baf2d50 for instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f on n-h1-846470-15 Aug 24 03:45:44.276859 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1e58fbf6-78d9-47d6-8ead-c31b4f142c24 req-f1cf4141-f3a9-4500-abf4-a0becf84c4bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192715 Aug 24 03:45:44.281371 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1490/2887] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:44.303058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ddbf3e9-5a30-4084-ae5e-9f2d484e7e3d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:44.304061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7ddbf3e9-5a30-4084-ae5e-9f2d484e7e3d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:44.410852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ddbf3e9-5a30-4084-ae5e-9f2d484e7e3d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:44.419107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ddbf3e9-5a30-4084-ae5e-9f2d484e7e3d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1052 microversion: 2.1 time: 0.131369 Aug 24 03:45:44.420114 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1491/2888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:44 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1052 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:44.425757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1763501689"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:44.442765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:44.454355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.455193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.455656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.456701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.457438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.458070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.728074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53e7785e-786b-4594-aa89-e814ba4849b9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "POST /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9/action" status: 202 len: 0 microversion: 2.1 time: 0.306057 Aug 24 03:45:44.729277 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1492/2889] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:45:44 2022] POST /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 03:45:44.735701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-aeead36f-fd8c-4f4e-9c65-afca6debdde6 req-e239fb58-ea22-451f-9bdb-89f218b6d812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-unplugged", "status": "completed", "tag": "dbf9362f-58e3-48e5-ac2d-5aaac595a8a8"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:44.751263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aeead36f-fd8c-4f4e-9c65-afca6debdde6 req-e239fb58-ea22-451f-9bdb-89f218b6d812 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.752377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aeead36f-fd8c-4f4e-9c65-afca6debdde6 req-e239fb58-ea22-451f-9bdb-89f218b6d812 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.753021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aeead36f-fd8c-4f4e-9c65-afca6debdde6 req-e239fb58-ea22-451f-9bdb-89f218b6d812 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.768136 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-aeead36f-fd8c-4f4e-9c65-afca6debdde6 req-e239fb58-ea22-451f-9bdb-89f218b6d812 service nova] Creating event network-vif-unplugged:dbf9362f-58e3-48e5-ac2d-5aaac595a8a8 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:44.774664 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-aeead36f-fd8c-4f4e-9c65-afca6debdde6 req-e239fb58-ea22-451f-9bdb-89f218b6d812 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043420 Aug 24 03:45:44.776106 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1493/2890] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:44.783522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:44.784679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:44.792344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.793501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.794210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.795213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.796043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.796730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.086084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.100092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.101911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.104219 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9aa8efcf-c46b-4e48-88ca-6b8359bbbeda tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.326523 Aug 24 03:45:45.104961 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1494/2891] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:44 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:45.112041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1ea7ac0a-df7f-4c77-a54a-15b59f1c0fcb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103423aa60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:45.177574 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1ea7ac0a-df7f-4c77-a54a-15b59f1c0fcb tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.070192 Aug 24 03:45:45.188642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1495/2892] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:45 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:45.196532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:45.197311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:45.205037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:45.205534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:45.205968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.206893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:45.207363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:45.207879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.258812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.267202 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-756443af-7b87-4555-95ef-9eb4c156c7bd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 1.139341 Aug 24 03:45:45.268401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1398/2893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:44 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:45.448294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:45.450388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:45.457668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:45.458500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:45.459188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.460401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:45.461030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:45.461642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.471950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.484082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.485569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.486862 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-035efa68-a9ad-48a0-8691-322856a9dda9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 2326 microversion: 2.32 time: 0.297145 Aug 24 03:45:45.501110 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1496/2894] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:45 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 2326 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:45.592330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.600592 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47427a52-ea53-41b0-a336-48f27c9e8005 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1150 microversion: 2.1 time: 0.163390 Aug 24 03:45:45.601825 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1399/2895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:45 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1150 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:46.134445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:46.135744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:46.154476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.154476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.154476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.154476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.155129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.158818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.168276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3be78dc8-45ad-4095-a27f-24afccd03d2d req-ac28e05b-01a3-4054-9a9d-f50241886dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-deleted", "tag": "5af2697c-af94-46c8-909d-23f7f66e37c1"}, {"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-deleted", "tag": "dbf9362f-58e3-48e5-ac2d-5aaac595a8a8"}, {"server_uuid": "aa8db641-7a2b-48bf-9fbb-cbfe4b171e82", "name": "network-vif-deleted", "tag": "1aa3e47c-9374-4288-97b6-28044e86d865"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:46.193172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3be78dc8-45ad-4095-a27f-24afccd03d2d req-ac28e05b-01a3-4054-9a9d-f50241886dbb service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.193172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3be78dc8-45ad-4095-a27f-24afccd03d2d req-ac28e05b-01a3-4054-9a9d-f50241886dbb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.196284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3be78dc8-45ad-4095-a27f-24afccd03d2d req-ac28e05b-01a3-4054-9a9d-f50241886dbb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.226090 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3be78dc8-45ad-4095-a27f-24afccd03d2d req-ac28e05b-01a3-4054-9a9d-f50241886dbb service nova] Creating event network-vif-deleted:5af2697c-af94-46c8-909d-23f7f66e37c1 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:46.230324 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3be78dc8-45ad-4095-a27f-24afccd03d2d req-ac28e05b-01a3-4054-9a9d-f50241886dbb service nova] Creating event network-vif-deleted:dbf9362f-58e3-48e5-ac2d-5aaac595a8a8 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:46.231411 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3be78dc8-45ad-4095-a27f-24afccd03d2d req-ac28e05b-01a3-4054-9a9d-f50241886dbb service nova] Creating event network-vif-deleted:1aa3e47c-9374-4288-97b6-28044e86d865 for instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 on n-h2-846470-15 Aug 24 03:45:46.253849 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3be78dc8-45ad-4095-a27f-24afccd03d2d req-ac28e05b-01a3-4054-9a9d-f50241886dbb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.089913 Aug 24 03:45:46.254838 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1400/2896] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:46.264684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b6e2358-cc99-4584-853a-1e928d8fb549 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1034243e50>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:46.344224 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9b6e2358-cc99-4584-853a-1e928d8fb549 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.087688 Aug 24 03:45:46.361245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1401/2897] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:46 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:46.364182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:46.365250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:46.391058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.391966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.392833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.395624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.396479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.398289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.510418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.526785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.529154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.530865 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a37e14c2-5672-4852-bef8-c0265ed58637 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.401108 Aug 24 03:45:46.532071 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1497/2898] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:46 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:46.538592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:46.539464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:46.547212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.547988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.548634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.549577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.550179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.550813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.669818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.704412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.710651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.712679 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a265dbe-80da-4e79-8e44-71eccf54aa09 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.179202 Aug 24 03:45:46.713968 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1498/2899] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:46 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:46.723045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:46.724094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:46.734176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.734971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.735692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.737145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.738984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.739743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.820638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.829764 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a468f15-6446-4a01-a6b3-d53bf0b563b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1168 microversion: 2.1 time: 0.112194 Aug 24 03:45:46.847824 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1499/2900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:46 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1168 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:46.900349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.910180 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d10cea54-c463-4132-9193-9ca40ec0c8e4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.555937 Aug 24 03:45:46.910780 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1402/2901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:46 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:47.076014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2da977dd-50ae-4d90-9c04-c41e789b392d req-9c4c7000-24e1-4bed-b39f-1ec7c70e380d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f", "name": "network-vif-unplugged", "status": "completed", "tag": "3a1a2e99-33ae-440a-8de1-d607808576ba"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:47.102891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2da977dd-50ae-4d90-9c04-c41e789b392d req-9c4c7000-24e1-4bed-b39f-1ec7c70e380d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.106790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2da977dd-50ae-4d90-9c04-c41e789b392d req-9c4c7000-24e1-4bed-b39f-1ec7c70e380d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.116111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2da977dd-50ae-4d90-9c04-c41e789b392d req-9c4c7000-24e1-4bed-b39f-1ec7c70e380d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.142143 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2da977dd-50ae-4d90-9c04-c41e789b392d req-9c4c7000-24e1-4bed-b39f-1ec7c70e380d service nova] Creating event network-vif-unplugged:3a1a2e99-33ae-440a-8de1-d607808576ba for instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f on n-h1-846470-15 Aug 24 03:45:47.160002 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2da977dd-50ae-4d90-9c04-c41e789b392d req-9c4c7000-24e1-4bed-b39f-1ec7c70e380d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090420 Aug 24 03:45:47.161392 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1500/2902] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:47.371208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7717403a-143c-45ad-bf60-923bdfc97d5b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1034397f70>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:47.436294 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7717403a-143c-45ad-bf60-923bdfc97d5b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.070604 Aug 24 03:45:47.443765 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1403/2903] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:47 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:47.561081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:47.562033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:47.575364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.575922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.576620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.577902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.578660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.579308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.743544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:47.744206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:47.756488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.758972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.763331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.765738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.771049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.774399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.786079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:47.790595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:47.807180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:47.808976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:47.810404 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53404935-7d2b-4e32-89a5-a1b461d072bf tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.254447 Aug 24 03:45:47.811499 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1501/2904] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:47 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:47.853204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:47.854125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:47.868802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.869618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.870377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.871398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.872045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.872738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.945364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:47.956801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:47.958968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:47.961808 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ed2c0124-ba5d-459b-8d55-20920f073e3a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.222191 Aug 24 03:45:47.976837 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1404/2905] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:47 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:45:47.984822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:47.987041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:48.001659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:48.002580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:48.003262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:48.004367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:48.005202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:48.005876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:48.063346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:48.067888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:48.073714 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c8df41c-b210-418d-a0c7-e78efeb8d7b5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.224392 Aug 24 03:45:48.075045 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1502/2906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:47 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:48.453123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-26a5e6f5-8767-48b1-aead-caea831b7a72 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103423aa60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:48.517613 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-26a5e6f5-8767-48b1-aead-caea831b7a72 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.069716 Aug 24 03:45:48.526315 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1503/2907] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:48 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:48.735253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:48.743997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-204cd349-eb38-4f0b-9e72-c29e65e2ea05 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.765638 Aug 24 03:45:48.753627 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1405/2908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:47 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:48.835699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:48.837338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:48.845611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:48.846108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:48.846710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:48.847711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:48.848361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:48.848796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:48.993918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:48.994731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:49.003114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.004025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.004634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.005507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.006117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.006779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.031540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.044577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.046566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.047579 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bf38699-ee83-4e6d-b1e6-f87c0571a82a tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.216570 Aug 24 03:45:49.048913 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1504/2909] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:48 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:49.099119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:49.099771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:49.106996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.107489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.108509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.109238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.111856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.111856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.117296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.127355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.129239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.130747 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-881cef87-42d5-417b-a14e-253d694abcd9 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.141558 Aug 24 03:45:49.131330 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1406/2910] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:48 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:45:49.296830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.306577 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6223ec81-ca63-4d53-9d15-b588e0922049 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.211731 Aug 24 03:45:49.315460 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1505/2911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:49 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:49.532250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a68f9ec5-403d-4d5c-933e-39c2e6b19ecd tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10342433a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:49.597349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-eb097e2a-0542-4d28-8a88-41384c2fbb3e req-4e012451-c8d0-4c25-ab39-9dd1681ffad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "255e7979-2c2b-44f3-83f0-0cd4c67ec7df", "tag": "f7a851ab-2a51-4c7e-a577-12d55d0281f1"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:49.608089 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a68f9ec5-403d-4d5c-933e-39c2e6b19ecd tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.079854 Aug 24 03:45:49.609313 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1407/2912] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:49 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:49.617070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eb097e2a-0542-4d28-8a88-41384c2fbb3e req-4e012451-c8d0-4c25-ab39-9dd1681ffad1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.617550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eb097e2a-0542-4d28-8a88-41384c2fbb3e req-4e012451-c8d0-4c25-ab39-9dd1681ffad1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.619171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eb097e2a-0542-4d28-8a88-41384c2fbb3e req-4e012451-c8d0-4c25-ab39-9dd1681ffad1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.641027 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-eb097e2a-0542-4d28-8a88-41384c2fbb3e req-4e012451-c8d0-4c25-ab39-9dd1681ffad1 service nova] Creating event network-changed:f7a851ab-2a51-4c7e-a577-12d55d0281f1 for instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df on n-h2-846470-15 Aug 24 03:45:49.646499 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-eb097e2a-0542-4d28-8a88-41384c2fbb3e req-4e012451-c8d0-4c25-ab39-9dd1681ffad1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054417 Aug 24 03:45:49.647719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1506/2913] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:49.765243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:49.765834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:49.772726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.773551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.774337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.776058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.777926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.778966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.075929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:50.078258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:50.087424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.088415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.089221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.090558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.091952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.092466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.210334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.221749 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-99394c6f-2b5d-4ba9-9e2a-ef54bbef3d61 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.460569 Aug 24 03:45:50.223128 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1408/2914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:49 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:50.313528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.326777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.329081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.330726 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-320aea3e-b6a7-45da-811b-ed06faf93660 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.263357 Aug 24 03:45:50.331766 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1507/2915] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:50 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:50.355623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:50.356999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:50.364954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.365596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.366130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.366941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.367862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.368392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.394438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:50.395434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:50.403531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.404354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.405026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.406028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.406852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.407500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.441142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:50.449110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.461593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.462115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.463489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb513360-90bd-47e2-945e-c0d52efe674d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.130341 Aug 24 03:45:50.480529 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1508/2916] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:50 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:50.485640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:50.486253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:50.494968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.495492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.495974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.496730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.497183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.497608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.589435 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84bfb4ae-e28c-470e-8efb-c5a1f177842e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 204 len: 0 microversion: 2.42 time: 0.363474 Aug 24 03:45:50.590571 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1409/2917] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:45:50 2022] DELETE /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:45:50.602619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:50.603852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:50.616220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.617191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.617880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.619216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.619960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.620613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.745614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.756211 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1b2d3d20-3f24-46de-bd6b-d4b3d0f4d545 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.274256 Aug 24 03:45:50.757097 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1509/2918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:50 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:50.769061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-33be92f6-c8bd-48c7-a187-dd3865508211 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022755a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:50.826219 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-33be92f6-c8bd-48c7-a187-dd3865508211 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.062967 Aug 24 03:45:50.828187 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1510/2919] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:50 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:51.256733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:51.258231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:51.265509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.266369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.267047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.268111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.268852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.269516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.448585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.459108 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44867de2-6eb6-4a12-b198-ef5c23ae8483 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.210195 Aug 24 03:45:51.460805 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1511/2920] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:51 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:51.471547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:51.472566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:51.479199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.489702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.490376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.490521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.491107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.492044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.492177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.492761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.493433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.494452 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5c62cab8-b5ec-4415-9a8c-b1b7727636fa tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2961 microversion: 2.42 time: 0.897091 Aug 24 03:45:51.507696 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1410/2921] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:50 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2961 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:51.513192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:51.518015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:51.528631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.535583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.536163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.537040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.537529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.537964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.692227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.703547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.705121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.706941 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5971e600-6418-48e6-a0e4-0c83ac5be146 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.244122 Aug 24 03:45:51.708326 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1512/2922] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:51 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:51.717761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.729461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.731848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.733147 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-80560b69-8d00-4228-8f93-8314e42096d8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.236484 Aug 24 03:45:51.733967 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1411/2923] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:51 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:51.779293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:51.779845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:51.787712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.788174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.788760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.789493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.790213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.790908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.843639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3819bbe-bc1f-40bd-bd0f-72d904fc41fd tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10342430d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:51.898960 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c3819bbe-bc1f-40bd-bd0f-72d904fc41fd tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.059901 Aug 24 03:45:51.900951 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1412/2924] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:51 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:52.018528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.029472 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d51d1f6-b490-4d29-be89-930042f3fa9b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.254807 Aug 24 03:45:52.039870 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1513/2925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:51 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:52.481459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:52.482064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:52.489901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.491776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.492482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.493441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.494125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.495102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.523191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:52.523872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:52.536487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.537323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.537966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.538864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.541341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.545814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.803190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.817600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.824561 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-400ee43f-5a08-4b29-b93c-f4ae32897b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.347672 Aug 24 03:45:52.831280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.843472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.843472 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42edb663-1533-4b99-9852-5e97f5e744c9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2961 microversion: 2.42 time: 0.320977 Aug 24 03:45:52.843472 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1514/2927] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:52 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2961 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:52.848766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:52.849437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:52.849670 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1413/2927] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:52 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:52.855411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:52.856423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:52.859333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.859875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.860921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.863043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.863959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.864402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.865600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.866338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.867631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.868665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.869349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.870234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.964675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.976554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.978308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.979538 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf021042-ec2a-45f4-801f-f426dcd12661 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.128532 Aug 24 03:45:52.981813 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1414/2928] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:52 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:52.986812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01368592-037d-465e-9494-56a408de2a8c tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102adae3a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:53.047004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01368592-037d-465e-9494-56a408de2a8c tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.063776 Aug 24 03:45:53.047925 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1415/2929] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:52 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:53.056096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:53.057304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:53.061789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:53.066242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:53.066518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:53.067022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:53.067843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:53.068369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:53.068866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:53.083173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:53.085594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:53.087554 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e75062f5-aa9c-4f5d-bc06-aabef9ff9f7b tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.245445 Aug 24 03:45:53.088180 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1515/2930] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:52 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:53.377787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:53.387837 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ae0b8d9-7a19-41f1-93a0-c572bdecc345 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.337832 Aug 24 03:45:53.389340 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1416/2931] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:53 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:53.856686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:53.857502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:53.865183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:53.865995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:53.866436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:53.867158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:53.867612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:53.868258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:53.884576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:53.886101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:53.891448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:53.892564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=14 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:53.893063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:53.897996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:53.898516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:53.899049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:53.900004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:53.900664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:53.901286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.058487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.070066 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-64e615e7-4a8f-4016-96a8-f9db565b8cb8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.218297 Aug 24 03:45:54.070066 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1516/2932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:53 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:54.076011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:54.076846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:54.087701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.088452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.089074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.090363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.091100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.091530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.188332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.208799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.211272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.213045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.214685 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6ea58878-8e4c-464d-8dbf-a31d3e0cc6cd tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.143422 Aug 24 03:45:54.227747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.228803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.228985 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1517/2933] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:54 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:54.231734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af274f37-89d0-4827-a8ba-fdafd80aa2bf tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2961 microversion: 2.42 time: 0.353420 Aug 24 03:45:54.239000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5905390d-1d50-4050-966b-8c406ef9fcb4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10226c80d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:54.244685 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1417/2934] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:53 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2961 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:54.251056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:54.251784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:54.260883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.261414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.262653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.264215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.265679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.266502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.301778 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5905390d-1d50-4050-966b-8c406ef9fcb4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.071185 Aug 24 03:45:54.302597 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1518/2935] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:54 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:54.410367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:54.411311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:54.417368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:54.419624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.420505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.421273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.422145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.422681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.423178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.472129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.484310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.486591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.488123 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2b48796-22a6-467e-81ad-f1484dfd3cf1 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.242260 Aug 24 03:45:54.489095 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1418/2936] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:54 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:54.965884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.995719 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4cf5278-e540-40b6-9778-02f4a10c8bbd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.589577 Aug 24 03:45:55.010932 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1519/2937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:54 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:55.099787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:55.100534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:55.111648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.112176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.112807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.113726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.114355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.114991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.242556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:55.243177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:55.249804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.250154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.250625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.251344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.251899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.252242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.376295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.384156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.404705 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3da02d57-84c2-4787-8a9b-ac57070b8343 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.308212 Aug 24 03:45:55.411764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.417742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.419596 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ceed6c3a-70a4-40a3-8b4a-3616ee2c3ba5 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.180932 Aug 24 03:45:55.420547 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1520/2939] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:55 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:45:55.429712 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1419/2939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:55 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:55.433104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:55.433828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:55.443011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c99e449a-6cdd-420a-9b7b-f20f1b9623c8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a797430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:55.449915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.450875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.450875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.452405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.452405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.452699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.509849 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c99e449a-6cdd-420a-9b7b-f20f1b9623c8 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.078685 Aug 24 03:45:55.519760 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1420/2940] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:55 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:55.525286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:55.526337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:55.533895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.534681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.535281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.536881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.537530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.538128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.741860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.755189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.757409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.760002 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5926c73-a50b-4296-9639-806119fc508b tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2961 microversion: 2.42 time: 0.338205 Aug 24 03:45:55.761201 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1521/2941] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:55 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2961 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:55.785644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.797860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.799567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:55.801670 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-35afa113-8c71-445b-bacd-7d981425d335 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.279792 Aug 24 03:45:55.802872 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1421/2942] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:55 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:55.972153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-705bb264-3b21-4d70-9edb-c6f65cdda9fd req-e9004d58-e40b-45a0-af28-63b591f2e6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a57fff-dd1c-4da6-a069-721eeb327ba9", "name": "network-vif-plugged", "status": "completed", "tag": "7b45f896-efbb-49d1-885b-f24770cf2671"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:55.995380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-705bb264-3b21-4d70-9edb-c6f65cdda9fd req-e9004d58-e40b-45a0-af28-63b591f2e6c1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.998027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-705bb264-3b21-4d70-9edb-c6f65cdda9fd req-e9004d58-e40b-45a0-af28-63b591f2e6c1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.999246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-705bb264-3b21-4d70-9edb-c6f65cdda9fd req-e9004d58-e40b-45a0-af28-63b591f2e6c1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.017162 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-705bb264-3b21-4d70-9edb-c6f65cdda9fd req-e9004d58-e40b-45a0-af28-63b591f2e6c1 service nova] Creating event network-vif-plugged:7b45f896-efbb-49d1-885b-f24770cf2671 for instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 on n-h1-846470-15 Aug 24 03:45:56.020574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:56.023347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:56.028634 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-705bb264-3b21-4d70-9edb-c6f65cdda9fd req-e9004d58-e40b-45a0-af28-63b591f2e6c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062800 Aug 24 03:45:56.030587 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1522/2943] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:56.040662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.041211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.041648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.042373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.042962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.044062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.412102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:56.423961 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c7900515-b074-452d-b9f5-848219405de8 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.407087 Aug 24 03:45:56.424817 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1422/2944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:56 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:56.429835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:56.430903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:56.443467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.444781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.445748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.446537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:56.447541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:56.447901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.448689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.449530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.455542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.456481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.457216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.458358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.459228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.460430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.465821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:56.626183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:56.631238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:56.637857 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c5fa6ae-c883-44b8-8937-09af645b17ff tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1506 microversion: 2.1 time: 0.214206 Aug 24 03:45:56.652631 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1523/2945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:56 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:56.652631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a25430e5-6b35-4d1b-a79e-4fcba1df7639 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10226c81f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:56.712146 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a25430e5-6b35-4d1b-a79e-4fcba1df7639 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.072148 Aug 24 03:45:56.713134 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1524/2946] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:56 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:56.789068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:56.789782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:56.799155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.799699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.800162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.801111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.801582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.802092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.886857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:56.909919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:56.910797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:56.912944 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4605c498-12f3-4fc9-9404-4e924da204d3 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.470110 Aug 24 03:45:56.929069 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1423/2947] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:56 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:45:56.935482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:56.936444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:56.944161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.944857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.945463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:56.946405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:56.947175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:56.947818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:57.061614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:57.075375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:57.077765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:57.079448 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7f2d9f00-d047-40e2-aa2c-020865edb3ec tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2940 microversion: 2.42 time: 0.296406 Aug 24 03:45:57.081175 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1525/2948] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:56 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2940 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:45:57.282298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:57.295744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:57.297583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:57.298970 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c9b60257-70e8-4bca-8c92-b4ca81515393 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.368796 Aug 24 03:45:57.299538 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1424/2949] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:56 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:57.451621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:57.452916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:57.461809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:57.462885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:57.464694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:57.466574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:57.467299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:57.468135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:57.667451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:57.668344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:57.669509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:57.679283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:57.680243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac04710e-8ee8-40fa-b930-090007890c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.238881 Aug 24 03:45:57.681442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:57.682111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:57.684675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:57.687888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:57.688515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:57.692836 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1526/2950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:57 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:57.728280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-38041782-7002-4339-91bd-e61c3956ea1f tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102273ab80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:57.783369 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-38041782-7002-4339-91bd-e61c3956ea1f tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.059502 Aug 24 03:45:57.784209 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1527/2951] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:57 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:57.945888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:57.946635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:57.961699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:57.962546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:57.963323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:57.964313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:57.965051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:57.965669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:58.052418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.097533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.099156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.101975 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0add29ca-1de3-480a-8685-474bf02bc65d tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.162147 Aug 24 03:45:58.102385 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1528/2952] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:57 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:58.115239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-fc0c6480-d2ef-42ba-af6c-d4f43cba3448 req-44853c6b-bd3b-4474-93e3-87b99b2e8a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b62e581-573e-44fa-ba4b-c0b93f13ca4f", "name": "network-vif-plugged", "status": "completed", "tag": "cb204930-5f75-4268-9dcd-82c77baf2d50"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:58.133430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fc0c6480-d2ef-42ba-af6c-d4f43cba3448 req-44853c6b-bd3b-4474-93e3-87b99b2e8a7e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:58.134101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fc0c6480-d2ef-42ba-af6c-d4f43cba3448 req-44853c6b-bd3b-4474-93e3-87b99b2e8a7e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:58.134691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fc0c6480-d2ef-42ba-af6c-d4f43cba3448 req-44853c6b-bd3b-4474-93e3-87b99b2e8a7e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:58.151175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.170117 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87a5b33f-3e4f-4f6c-9b87-43bb894061f2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1527 microversion: 2.1 time: 0.508833 Aug 24 03:45:58.170826 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fc0c6480-d2ef-42ba-af6c-d4f43cba3448 req-44853c6b-bd3b-4474-93e3-87b99b2e8a7e service nova] Creating event network-vif-plugged:cb204930-5f75-4268-9dcd-82c77baf2d50 for instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f on n-h1-846470-15 Aug 24 03:45:58.174792 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1425/2953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:57 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1527 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:58.185380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:58.186044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:58.194871 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-fc0c6480-d2ef-42ba-af6c-d4f43cba3448 req-44853c6b-bd3b-4474-93e3-87b99b2e8a7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090793 Aug 24 03:45:58.196067 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1529/2954] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:58.208769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:58.210457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:58.211092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:58.213831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:58.217415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:58.218841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:58.330210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:58.331114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:58.349279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:58.349955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:58.350517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:58.351442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:58.352126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:58.353222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:58.556499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.570425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.573134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.577340 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c2308c7-8916-4943-acf3-0f19a680296c tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.252031 Aug 24 03:45:58.599140 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1530/2955] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:58 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:58.703827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:58.704612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:58.721716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:58.722280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:58.723188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:58.724083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:58.724683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:58.725258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:58.822914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.853846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.862668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.864354 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-787d7f65-3faf-47d4-b0d4-e74676d822c8 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2919 microversion: 2.42 time: 0.688561 Aug 24 03:45:58.865816 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1426/2956] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:58 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2919 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:58.874014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d80da70e-a217-4eab-bdf1-86e7e91df848 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a79ab80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:58.902906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:58.911734 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b04f8ba5-5dff-4c4d-9cd4-b26ce7860d8e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.213080 Aug 24 03:45:58.913036 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1531/2957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:58 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:58.949111 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d80da70e-a217-4eab-bdf1-86e7e91df848 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.081143 Aug 24 03:45:58.949584 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1427/2958] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:45:58 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:59.126364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:59.127178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:59.149510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.151026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.151482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.152487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.153105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.154135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.200310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:59.202183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:59.233934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.234908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.235654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.247210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.249220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.252459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.327222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:59.342119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:59.343830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:59.345178 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c98047f4-05ca-4b0c-b8ca-347094a6baf8 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.223864 Aug 24 03:45:59.346196 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1532/2959] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:59 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:59.610866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:59.612177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:59.647015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.648230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.649048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.650193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.650895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.651547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.894726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:59.912796 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-92fda46b-a552-47f9-83f4-abe4f7b0ed73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1527 microversion: 2.1 time: 0.718088 Aug 24 03:45:59.921414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:59.932544 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1428/2960] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:59 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1527 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:59.943734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0cf478e1-2462-48b2-8d8f-4475b7c9899c req-0c6cbe5c-4746-4242-8b57-b4751bccf0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-deleted", "tag": "20094682-916d-47c5-bd07-b6fb29d41cb9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:59.955596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:59.958172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:59.965660 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ecd12d7-917d-4b9b-aa35-e844f257e4a9 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1359 microversion: 2.21 time: 0.356902 Aug 24 03:45:59.967297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1533/2961] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:59 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1359 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:45:59.973379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0cf478e1-2462-48b2-8d8f-4475b7c9899c req-0c6cbe5c-4746-4242-8b57-b4751bccf0a0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.973881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0cf478e1-2462-48b2-8d8f-4475b7c9899c req-0c6cbe5c-4746-4242-8b57-b4751bccf0a0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.974336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0cf478e1-2462-48b2-8d8f-4475b7c9899c req-0c6cbe5c-4746-4242-8b57-b4751bccf0a0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.978138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:59.980517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:59.994474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.003917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.004660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:00.006325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.006981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.007740 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0cf478e1-2462-48b2-8d8f-4475b7c9899c req-0c6cbe5c-4746-4242-8b57-b4751bccf0a0 service nova] Creating event network-vif-deleted:20094682-916d-47c5-bd07-b6fb29d41cb9 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:00.008346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:00.026288 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0cf478e1-2462-48b2-8d8f-4475b7c9899c req-0c6cbe5c-4746-4242-8b57-b4751bccf0a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091824 Aug 24 03:46:00.026942 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1429/2962] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:00.040188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:00.059087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:00.075882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.076809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.077498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:00.078478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.079168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.079855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:00.404179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:00.423360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:00.426573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:00.428134 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e1cbca88-84a2-499d-b94f-eafb12e08913 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2872 microversion: 2.42 time: 0.459508 Aug 24 03:46:00.436436 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1534/2963] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:45:59 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2872 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:00.442109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d927074-522e-4256-8376-2a9c15b9339c tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10226c1160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:00.554911 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d927074-522e-4256-8376-2a9c15b9339c tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.117040 Aug 24 03:46:00.562263 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1535/2964] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:00 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:00.569145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f7fa8c5a-8cb4-4445-8ca7-2cfc34302c7e req-b768381e-1ccc-4cd4-8fce-5636e24b8e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-unplugged", "status": "completed", "tag": "ada7addd-bf30-4193-8194-ddce03d8df90"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:00.595017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f7fa8c5a-8cb4-4445-8ca7-2cfc34302c7e req-b768381e-1ccc-4cd4-8fce-5636e24b8e87 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.595639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f7fa8c5a-8cb4-4445-8ca7-2cfc34302c7e req-b768381e-1ccc-4cd4-8fce-5636e24b8e87 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.596410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f7fa8c5a-8cb4-4445-8ca7-2cfc34302c7e req-b768381e-1ccc-4cd4-8fce-5636e24b8e87 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:00.622482 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f7fa8c5a-8cb4-4445-8ca7-2cfc34302c7e req-b768381e-1ccc-4cd4-8fce-5636e24b8e87 service nova] Creating event network-vif-unplugged:ada7addd-bf30-4193-8194-ddce03d8df90 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:00.634063 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f7fa8c5a-8cb4-4445-8ca7-2cfc34302c7e req-b768381e-1ccc-4cd4-8fce-5636e24b8e87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066688 Aug 24 03:46:00.635181 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1536/2965] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:00.643159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:00.644153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:00.653551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.654073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.654715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:00.655457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.656933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.657407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:00.782931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:00.801415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:00.802794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:00.808665 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8afb0a2b-d85c-46b3-adbb-917aa200d449 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.167631 Aug 24 03:46:00.824411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1537/2966] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:00 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:00.953052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:00.953666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:00.967382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.967939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.968408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:00.971774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:00.979828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:00.980444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:01.314724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:01.332858 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6716ea6a-b998-4cc9-a027-e29d05b2cc67 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 1.296488 Aug 24 03:46:01.336459 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1430/2967] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:00 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:01.358085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:01.360112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:01.374660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:01.382362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:01.382975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:01.383500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:01.383696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-603a48a9-80e8-4a90-a508-43402e7f3e4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1527 microversion: 2.1 time: 0.434848 Aug 24 03:46:01.384325 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1538/2968] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:00 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1527 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:01.385188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:01.386976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:01.389128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:01.462312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:01.462906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:01.468147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:01.481376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:01.481921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:01.482362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:01.483083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:01.483529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:01.501766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:01.751451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:01.773161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:01.776876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:01.790415 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-307ba24c-377b-4e3a-8a08-4ec14c9a504f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1552 microversion: 2.21 time: 0.448782 Aug 24 03:46:01.791146 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1431/2969] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:01 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1552 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:01.812387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b7a0046d-33e2-479f-bca6-d46949fb1e6a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1034382280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:01.921908 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b7a0046d-33e2-479f-bca6-d46949fb1e6a tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1455 microversion: 2.1 time: 0.126623 Aug 24 03:46:01.922501 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1432/2970] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:01 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:01.954409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:01.955160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:01.974428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:01.974937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:01.975382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:01.983998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:01.984505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:01.984957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:02.020078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:02.031517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:02.037825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:02.042445 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e8d320a-ee4b-4c9e-adca-5191127265d9 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2712 microversion: 2.42 time: 0.584464 Aug 24 03:46:02.047201 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1539/2971] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:01 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2712 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:02.061043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:02.062122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:02.072991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:02.087383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:02.094418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:02.095093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:02.096019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:02.096679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:02.097247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:02.310575 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4c25454-a48e-4dd3-a7c0-b659a3db279e tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 204 len: 0 microversion: 2.21 time: 0.375063 Aug 24 03:46:02.310817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:02.315825 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1433/2972] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:46:01 2022] DELETE /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:46:02.332333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:02.334566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:02.343305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:02.344062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:02.344634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:02.345658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:02.346406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:02.349075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:02.350401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:02.351383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:02.355201 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-84db7b2d-ffb5-4167-a9b4-8a69caa80470 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.306386 Aug 24 03:46:02.358977 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1540/2973] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:02 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:02.364223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:02.385221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:02.404853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:02.405613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:02.406720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:02.408509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:02.409762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:02.412292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:03.205637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:03.234763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:03.241424 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e00a3b12-a338-4276-904d-3d5a3b9089c1 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1210 microversion: 2.1 time: 0.880994 Aug 24 03:46:03.250918 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1541/2974] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:02 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1210 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:03.257598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:03.259702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:03.263428 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c09d44c7-66d7-42d1-825d-0b74760d3587 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1558 microversion: 2.21 time: 0.941331 Aug 24 03:46:03.265433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:03.267106 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1434/2975] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:02 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1558 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:03.268701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:03.280572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bfd2b6f3-cb66-4bc0-9359-2ae5a9f97e0a req-49d64846-0b96-4998-b280-fec4c88c2db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-unplugged", "status": "completed", "tag": "efcdcdd4-3cc4-4b59-9e73-b000f5f70269"}, {"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-unplugged", "status": "completed", "tag": "ded6684b-2e32-4bbb-be0f-f0be069a1304"}, {"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-unplugged", "status": "completed", "tag": "20cb989b-08a0-48e3-8702-22885f1f572e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:03.302828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:03.303869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:03.308017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:03.309425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:03.312168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:03.314576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:03.330427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfd2b6f3-cb66-4bc0-9359-2ae5a9f97e0a req-49d64846-0b96-4998-b280-fec4c88c2db8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:03.337666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfd2b6f3-cb66-4bc0-9359-2ae5a9f97e0a req-49d64846-0b96-4998-b280-fec4c88c2db8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:03.338324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfd2b6f3-cb66-4bc0-9359-2ae5a9f97e0a req-49d64846-0b96-4998-b280-fec4c88c2db8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:03.383413 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bfd2b6f3-cb66-4bc0-9359-2ae5a9f97e0a req-49d64846-0b96-4998-b280-fec4c88c2db8 service nova] Creating event network-vif-unplugged:efcdcdd4-3cc4-4b59-9e73-b000f5f70269 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:03.389278 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bfd2b6f3-cb66-4bc0-9359-2ae5a9f97e0a req-49d64846-0b96-4998-b280-fec4c88c2db8 service nova] Creating event network-vif-unplugged:ded6684b-2e32-4bbb-be0f-f0be069a1304 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:03.395423 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bfd2b6f3-cb66-4bc0-9359-2ae5a9f97e0a req-49d64846-0b96-4998-b280-fec4c88c2db8 service nova] Creating event network-vif-unplugged:20cb989b-08a0-48e3-8702-22885f1f572e for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:03.412922 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bfd2b6f3-cb66-4bc0-9359-2ae5a9f97e0a req-49d64846-0b96-4998-b280-fec4c88c2db8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.138999 Aug 24 03:46:03.414047 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1435/2976] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:03.436752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a78c261-a392-4902-a872-4d8072742911 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a79a3a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:03.857136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:03.872541 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c0bb90a-2cf6-47f8-8442-9836e1e1820d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.614300 Aug 24 03:46:03.892471 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1542/2977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:03 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:03.906825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a57af615-02e2-4d93-a550-193daa5c4603 req-89f1a28e-1e84-4ecd-84af-b77846f4b3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-deleted", "tag": "efcdcdd4-3cc4-4b59-9e73-b000f5f70269"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:03.944228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a57af615-02e2-4d93-a550-193daa5c4603 req-89f1a28e-1e84-4ecd-84af-b77846f4b3b9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:03.947998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a57af615-02e2-4d93-a550-193daa5c4603 req-89f1a28e-1e84-4ecd-84af-b77846f4b3b9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:03.949063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a57af615-02e2-4d93-a550-193daa5c4603 req-89f1a28e-1e84-4ecd-84af-b77846f4b3b9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:03.999716 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a57af615-02e2-4d93-a550-193daa5c4603 req-89f1a28e-1e84-4ecd-84af-b77846f4b3b9 service nova] Creating event network-vif-deleted:efcdcdd4-3cc4-4b59-9e73-b000f5f70269 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:04.017900 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a57af615-02e2-4d93-a550-193daa5c4603 req-89f1a28e-1e84-4ecd-84af-b77846f4b3b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123831 Aug 24 03:46:04.019319 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1543/2978] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:04.025330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:04.042144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:04.070102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:04.071168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:04.071935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:04.072983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:04.073722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:04.074963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:05.127465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:05.153513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:05.161658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:05.163493 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07049e93-3be4-4976-8200-931757a5859e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2712 microversion: 2.42 time: 1.142609 Aug 24 03:46:05.164696 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1544/2979] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:04 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2712 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:05.180159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:05.185594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:05.228794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:05.230197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:05.230895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:05.231978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:05.232690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:05.233376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:05.297162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:05.783916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:05.810866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:05.813343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:05.822967 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fdb159bb-90e6-4b10-93c4-94ccd402b74a tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.656859 Aug 24 03:46:05.823645 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1545/2980] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:05 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:05.843454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:05.845359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:05.869120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:05.869532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:05.870005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:05.879935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:05.881956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:05.886934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:06.211523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:06.226335 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9507542-eadd-44df-b00e-05cd54510211 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1198 microversion: 2.1 time: 0.401094 Aug 24 03:46:06.228543 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1546/2981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:05 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1198 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:06.235288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:06.236274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:06.264157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:06.266499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:06.267130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:06.272312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:06.273762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:06.275227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:06.966107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:06.992872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:06.994537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdd1eb522b66415eb4bd0d551b2f5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc61eca1851745c1817103f5f4f5bf63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:07.017254 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5159f2e-32e8-4195-abe3-3fa521ba8539 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 200 len: 1558 microversion: 2.21 time: 0.766046 Aug 24 03:46:07.018259 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1547/2982] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:06 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 1558 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:07.029580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:07.039611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:07.073947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:07.074479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:07.074937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:07.075719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:07.076170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:07.076602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:07.784575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:07.814953 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-33102d87-dcb6-4c01-b2d4-e63970b9efb6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.795690 Aug 24 03:46:07.815734 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1548/2983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:07 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:07.820854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-0011a8ab-558d-4b05-9cef-fa6559832abe req-b804d359-d9e9-4592-b816-6abbeae26fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9", "name": "network-vif-plugged", "status": "completed", "tag": "8f092b56-4331-49ca-b0e1-5edd1dc0a14d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:07.867143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0011a8ab-558d-4b05-9cef-fa6559832abe req-b804d359-d9e9-4592-b816-6abbeae26fc7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:07.868028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0011a8ab-558d-4b05-9cef-fa6559832abe req-b804d359-d9e9-4592-b816-6abbeae26fc7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:07.869168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0011a8ab-558d-4b05-9cef-fa6559832abe req-b804d359-d9e9-4592-b816-6abbeae26fc7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:07.921920 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-0011a8ab-558d-4b05-9cef-fa6559832abe req-b804d359-d9e9-4592-b816-6abbeae26fc7 service nova] Creating event network-vif-plugged:8f092b56-4331-49ca-b0e1-5edd1dc0a14d for instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 on n-h2-846470-15 Aug 24 03:46:07.943492 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-0011a8ab-558d-4b05-9cef-fa6559832abe req-b804d359-d9e9-4592-b816-6abbeae26fc7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125978 Aug 24 03:46:07.944899 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1549/2984] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:07.968562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:07.969603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:07.998349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:07.999135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:07.999595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:08.006604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:08.008388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:08.008886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:08.452158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:08.471163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:08.473913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:08.477695 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bec17cc-5c94-4af2-8d13-d4d2400cb4df tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 2373 microversion: 2.42 time: 0.530648 Aug 24 03:46:08.479676 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1550/2985] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:07 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 2373 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:08.485987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:08.486596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:08.501699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:08.515549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:08.519820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:08.525109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:08.526188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:08.527358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:08.877696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:08.897118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:08.905162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:08.906475 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-642db829-a316-4af3-917f-9deaaa124dcc tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.425257 Aug 24 03:46:08.912055 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1551/2986] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:08 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:08.929603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e2e7f29b-6c41-49d5-8ebf-93664df3b63e req-947c4eb4-8da0-4329-bffe-7e799d159775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-deleted", "tag": "ded6684b-2e32-4bbb-be0f-f0be069a1304"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:08.967986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2e7f29b-6c41-49d5-8ebf-93664df3b63e req-947c4eb4-8da0-4329-bffe-7e799d159775 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:08.968386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2e7f29b-6c41-49d5-8ebf-93664df3b63e req-947c4eb4-8da0-4329-bffe-7e799d159775 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:08.968819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2e7f29b-6c41-49d5-8ebf-93664df3b63e req-947c4eb4-8da0-4329-bffe-7e799d159775 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:09.045342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e2e7f29b-6c41-49d5-8ebf-93664df3b63e req-947c4eb4-8da0-4329-bffe-7e799d159775 service nova] Creating event network-vif-deleted:ded6684b-2e32-4bbb-be0f-f0be069a1304 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:09.058809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e2e7f29b-6c41-49d5-8ebf-93664df3b63e req-947c4eb4-8da0-4329-bffe-7e799d159775 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131060 Aug 24 03:46:09.061864 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1552/2987] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:09.075736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:09.079566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:09.125746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:09.126070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:09.126831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:09.127178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:09.127639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:09.128132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:09.848539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:09.872065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86a1c2d9-af35-468c-8409-5edf3553ae1a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1198 microversion: 2.1 time: 0.798289 Aug 24 03:46:09.872887 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1553/2988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:09 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1198 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:09.903930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:09.913393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:09.937613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:09.942202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:09.942944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:09.946548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:09.947258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:09.947897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:10.010023 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] HTTP exception thrown: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Request method failure captured: Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f HTTP/1.1 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ7ePQWNqGd1FlDU7XaFV5fKMu_kK5MKjUV5YzazEYBcRrW2LiXO5d7fHX0l0O9zS66ve8MDpO3onQYPZicicihtIHicBVwzl5pcCC8e0cDoHRWn6j6VqV8dIcS0DRqgUBgug6vO1HJ-ewwaGFrZSoqEWSg8Z9UZ9_FiOODQvFNZT0E Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cc61eca1851745c1817103f5f4f5bf63 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cc61eca1851745c1817103f5f4f5bf63 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-InstanceActionsV221TestJSON-236969380-project Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cdd1eb522b66415eb4bd0d551b2f5eb5 Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-InstanceActionsV221TestJSON-236969380-project Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '3b62e581-573e-44fa-ba4b-c0b93f13ca4f'} Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:10.012744 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:10.018014 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:10.018014 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:10.018014 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:10.018014 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:10.018014 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:10.018014 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:10.018014 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:10.018014 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:10.030419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Returning 404 to user: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:10.032366 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d723a03-b2ad-48e4-8d3b-43810b40dfe5 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 404 len: 111 microversion: 2.21 time: 0.135509 Aug 24 03:46:10.036772 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1554/2989] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:09 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:10.045967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:10.055337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:10.076651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:10.094303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:10.095185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:10.096286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:10.100756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:10.102467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:10.601459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:10.615133 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1b678b67-464b-44f0-b788-5c2190093c4c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.575468 Aug 24 03:46:10.616093 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1555/2990] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:10 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:10.624126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:10.625096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:10.651067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:10.652625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:10.654307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:10.657511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:10.659653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:10.663490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:10.917166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:10.938271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:10.943580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:10.948142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-52a47517-948d-4552-87f0-0a64b5d4ef96 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.329404 Aug 24 03:46:10.956567 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1556/2991] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:10 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:10.978671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:10.979561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:10.998659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:10.999381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:11.004540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:11.007101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:11.007872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:11.008729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:11.354559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:11.381322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:11.383797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:11.385380 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8a2d536-b380-4b6c-8cf4-7215e18ebef1 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.423749 Aug 24 03:46:11.404819 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1557/2992] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:10 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:11.417545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '.version_select at 0x7f10226ccaf0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:11.424950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:11.484393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:11.485129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:11.485922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:11.486925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:11.487541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:11.488142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:11.662127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fbbd805c-d8eb-4d07-9606-c2837dc1679f tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.254987 Aug 24 03:46:11.665507 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1558/2993] 10.222.0.58 () {60 vars in 1337 bytes} [Wed Aug 24 03:46:11 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f/os-instance-actions => generated 611 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:46:11.678543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:11.686076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:11.706840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:11.712793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:11.713525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:11.715063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:11.715862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:11.716359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.306040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:12.326331 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcefb2c2-39ee-42a9-97e7-dcd2d156e847 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1198 microversion: 2.1 time: 0.659295 Aug 24 03:46:12.330196 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1559/2994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:11 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1198 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:12.344872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1692ee89-b139-4e10-829c-4cf8f891dbc3 req-539d1238-02de-480f-b9d4-62fbc4d3975a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b62e581-573e-44fa-ba4b-c0b93f13ca4f", "name": "network-vif-deleted", "tag": "cb204930-5f75-4268-9dcd-82c77baf2d50"}, {"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-deleted", "tag": "ada7addd-bf30-4193-8194-ddce03d8df90"}, {"server_uuid": "a85d3507-2b80-457f-a93e-c1c6810ef584", "name": "network-vif-deleted", "tag": "20cb989b-08a0-48e3-8702-22885f1f572e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:12.379181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1692ee89-b139-4e10-829c-4cf8f891dbc3 req-539d1238-02de-480f-b9d4-62fbc4d3975a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.381245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1692ee89-b139-4e10-829c-4cf8f891dbc3 req-539d1238-02de-480f-b9d4-62fbc4d3975a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.383216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1692ee89-b139-4e10-829c-4cf8f891dbc3 req-539d1238-02de-480f-b9d4-62fbc4d3975a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.420214 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1692ee89-b139-4e10-829c-4cf8f891dbc3 req-539d1238-02de-480f-b9d4-62fbc4d3975a service nova] Creating event network-vif-deleted:cb204930-5f75-4268-9dcd-82c77baf2d50 for instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f on n-h1-846470-15 Aug 24 03:46:12.422544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1692ee89-b139-4e10-829c-4cf8f891dbc3 req-539d1238-02de-480f-b9d4-62fbc4d3975a service nova] Creating event network-vif-deleted:ada7addd-bf30-4193-8194-ddce03d8df90 for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:12.424659 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1692ee89-b139-4e10-829c-4cf8f891dbc3 req-539d1238-02de-480f-b9d4-62fbc4d3975a service nova] Creating event network-vif-deleted:20cb989b-08a0-48e3-8702-22885f1f572e for instance a85d3507-2b80-457f-a93e-c1c6810ef584 on n-h1-846470-15 Aug 24 03:46:12.440845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1692ee89-b139-4e10-829c-4cf8f891dbc3 req-539d1238-02de-480f-b9d4-62fbc4d3975a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107661 Aug 24 03:46:12.445182 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1560/2995] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:12.472272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:12.473701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:12.491526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.494424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.495083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.498471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.499416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.500260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.904630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:12.923929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-40f78475-0d05-4e23-aa5b-ef0b4e6200ba tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.462040 Aug 24 03:46:12.927501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1561/2996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:12 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:12.935814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:12.936338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:12.965406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.966699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.967265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.972147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.973326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.973937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.019537 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] HTTP exception thrown: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Request method failure captured: Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f HTTP/1.1 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ7ePQWNqGd1FlDU7XaFV5fKMu_kK5MKjUV5YzazEYBcRrW2LiXO5d7fHX0l0O9zS66ve8MDpO3onQYPZicicihtIHicBVwzl5pcCC8e0cDoHRWn6j6VqV8dIcS0DRqgUBgug6vO1HJ-ewwaGFrZSoqEWSg8Z9UZ9_FiOODQvFNZT0E Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cc61eca1851745c1817103f5f4f5bf63 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cc61eca1851745c1817103f5f4f5bf63 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-InstanceActionsV221TestJSON-236969380-project Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cdd1eb522b66415eb4bd0d551b2f5eb5 Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-InstanceActionsV221TestJSON-236969380-project Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '3b62e581-573e-44fa-ba4b-c0b93f13ca4f'} Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:13.025183 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Returning 404 to user: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-178f9606-f349-4ddd-a2bb-479623e34486 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 404 len: 111 microversion: 2.21 time: 0.102723 Aug 24 03:46:13.034094 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1562/2997] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:46:12 2022] DELETE /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:13.047711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:13.047711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:13.053540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.054183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.054694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.056030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.056648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.057298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.310887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:13.320806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:13.339731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:13.348463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:13.350568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:13.358505 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d719e482-8be5-4f5c-9b37-1d62c8aa2d51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.322325 Aug 24 03:46:13.369437 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1563/2998] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:13 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:13.378932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:13.379946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:13.389086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.389775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.390269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.391199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.392121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.392594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.608674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:13.650204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:13.669406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '632b0aa8a4694c378ba66f9c2ddf453d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f897cfbb438455f8ff5aabd10ab4135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:13.673752 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c0d353d-52aa-44f8-9496-433c7f2461cf tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 200 len: 1603 microversion: 2.32 time: 0.302980 Aug 24 03:46:13.684150 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1564/2999] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:13 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 1603 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:13.689705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:13.699381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] [instance: 3b62e581-573e-44fa-ba4b-c0b93f13ca4f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:13.730430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.735472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.736492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.742670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.746630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.747515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.805630 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] HTTP exception thrown: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Request method failure captured: Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f HTTP/1.1 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ7ePQWNqGd1FlDU7XaFV5fKMu_kK5MKjUV5YzazEYBcRrW2LiXO5d7fHX0l0O9zS66ve8MDpO3onQYPZicicihtIHicBVwzl5pcCC8e0cDoHRWn6j6VqV8dIcS0DRqgUBgug6vO1HJ-ewwaGFrZSoqEWSg8Z9UZ9_FiOODQvFNZT0E Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cc61eca1851745c1817103f5f4f5bf63 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc61eca1851745c1817103f5f4f5bf63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cc61eca1851745c1817103f5f4f5bf63 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-236969380 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-InstanceActionsV221TestJSON-236969380-project Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cdd1eb522b66415eb4bd0d551b2f5eb5 Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-InstanceActionsV221TestJSON-236969380-project Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '3b62e581-573e-44fa-ba4b-c0b93f13ca4f'} Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.822376 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:13.828147 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.828147 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:13.828147 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:13.828147 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:13.828147 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:13.828147 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:13.828147 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. Aug 24 03:46:13.828147 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:13.830758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] Returning 404 to user: Instance 3b62e581-573e-44fa-ba4b-c0b93f13ca4f could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:13.832026 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a794add-8534-4975-928f-e021d2f7b7f0 tempest-InstanceActionsV221TestJSON-236969380 tempest-InstanceActionsV221TestJSON-236969380-project] 10.222.0.58 "GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f" status: 404 len: 111 microversion: 2.21 time: 0.146387 Aug 24 03:46:13.833470 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1565/3000] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:13 2022] GET /compute/v2.1/servers/3b62e581-573e-44fa-ba4b-c0b93f13ca4f => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:13.855827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:13.856765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:13.873750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.885912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.895326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.896242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.900245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.900790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.906216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:14.677148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:14.688751 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-25c948f9-b718-4dac-b296-781676fb7900 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1198 microversion: 2.1 time: 0.850683 Aug 24 03:46:14.700115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1566/3001] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:13 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1198 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:14.717853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:14.718753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:14.736170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:14.737001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:14.737616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:14.738711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:14.739331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:14.739966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:16.272771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:16.291971 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f2e3ce35-8e60-44de-afd5-5252388c866a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 1.580058 Aug 24 03:46:16.307178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1567/3002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:14 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:16.316940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:16.320285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:16.342436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:16.352553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:16.356289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:16.357257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:16.358080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:16.368475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:16.654568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:16.670058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:16.684048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:16.686083 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-62f92dd2-6092-4986-b72d-861af0536607 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.377163 Aug 24 03:46:16.686965 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1568/3003] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:16 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:16.704014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:16.706104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:16.724849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:16.733939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:16.734811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:16.736060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:16.736802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:16.737488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:16.771588 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] HTTP exception thrown: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Request method failure captured: Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 HTTP/1.1 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0ZwpzcF_c73K8gqV_b7fcVy1DFk6DD4ToZegtBRByGWn2TGoACVwhMOEeOzgz4SSpshHl2bm-2VSxqciTmMO9oj5qWuKb5KC_hyxQ3CLti8YPt_ISnP2ssCoTNv9nh6XZzHoRdT1soiDXoM7teVm9vcOwJzPTIBc8JInU-DHaWlVg Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 7f897cfbb438455f8ff5aabd10ab4135 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 7f897cfbb438455f8ff5aabd10ab4135 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TaggedBootDevicesTest-324263961-project Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 632b0aa8a4694c378ba66f9c2ddf453d Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TaggedBootDevicesTest-324263961-project Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'aa8db641-7a2b-48bf-9fbb-cbfe4b171e82'} Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:16.778368 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:16.783143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:16.783143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:16.783143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:16.783143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:16.783143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:16.783143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:16.783143 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:16.787262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Returning 404 to user: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:16.788570 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca6023fd-4cef-4553-a770-ccb3f80f2826 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 404 len: 111 microversion: 2.32 time: 0.099619 Aug 24 03:46:16.795431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1569/3004] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:16 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:16.801460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:16.806137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:16.826420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:16.827504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:16.829689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:16.836633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:16.837599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:16.838328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.248496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:17.265171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c67b6bbd-bdb3-4560-9904-f562d094ac5a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1198 microversion: 2.1 time: 0.467910 Aug 24 03:46:17.271039 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1570/3005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:16 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1198 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:17.277336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ead5820e-d379-42b0-a43a-85402cf0da3b req-74f5767a-2c70-4d6f-a569-b25849032718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255e7979-2c2b-44f3-83f0-0cd4c67ec7df", "name": "network-vif-plugged", "status": "completed", "tag": "f7a851ab-2a51-4c7e-a577-12d55d0281f1"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:17.398913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ead5820e-d379-42b0-a43a-85402cf0da3b req-74f5767a-2c70-4d6f-a569-b25849032718 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.405136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ead5820e-d379-42b0-a43a-85402cf0da3b req-74f5767a-2c70-4d6f-a569-b25849032718 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.408011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ead5820e-d379-42b0-a43a-85402cf0da3b req-74f5767a-2c70-4d6f-a569-b25849032718 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.496951 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ead5820e-d379-42b0-a43a-85402cf0da3b req-74f5767a-2c70-4d6f-a569-b25849032718 service nova] Creating event network-vif-plugged:f7a851ab-2a51-4c7e-a577-12d55d0281f1 for instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df on n-h2-846470-15 Aug 24 03:46:17.518035 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ead5820e-d379-42b0-a43a-85402cf0da3b req-74f5767a-2c70-4d6f-a569-b25849032718 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245135 Aug 24 03:46:17.525894 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1571/3006] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:17.534166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-22cc330b-b2cb-4105-8bb3-85f7a1890166 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '.version_select at 0x7f10226b9ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:17.638811 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-22cc330b-b2cb-4105-8bb3-85f7a1890166 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-359630964" status: 204 len: 0 microversion: 2.32 time: 0.110967 Aug 24 03:46:17.645760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1572/3007] 10.222.0.58 () {60 vars in 1259 bytes} [Wed Aug 24 03:46:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-359630964 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:46:17.671120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:17.676772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:17.697745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.701852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.702452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.703230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.706079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.706623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:18.604065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:18.615028 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b54d9639-6ba0-4f79-b07f-8162365fd9ef tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.968000 Aug 24 03:46:18.633764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1573/3008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:17 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:18.659784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:18.661708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:18.681732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:18.683447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:18.685802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:18.691739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:18.693746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:18.697006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:18.834570 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a78c261-a392-4902-a872-4d8072742911 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1464 microversion: 2.1 time: 15.414856 Aug 24 03:46:18.847656 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1436/3009] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:03 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1464 bytes in 15430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:18.868913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:18.869877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:18.899106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:18.899582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:18.903745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:18.904835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:18.906560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:18.912033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:19.034234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.060415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.062895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.065337 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67d5d725-dbb8-4095-96d1-09a9191bcb66 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.428019 Aug 24 03:46:19.083838 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1574/3010] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:18 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:19.091211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dc770973-ad08-479c-b3a0-1887f0fb89b6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10226de790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:19.186654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dc770973-ad08-479c-b3a0-1887f0fb89b6 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 200 len: 1464 microversion: 2.1 time: 0.099611 Aug 24 03:46:19.188938 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1575/3011] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:19 2022] GET /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:19.202026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:19.202681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:19.218782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:19.219309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:19.219793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:19.220535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:19.221000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:19.230801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:19.256199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.271720 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b6f5c36b-af54-4c59-bca5-427cbb5f0fff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1198 microversion: 2.1 time: 0.422726 Aug 24 03:46:19.272747 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1437/3012] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:18 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1198 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:19.616588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.646069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8665a88b-cd88-4776-9276-6d182a2c4999 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 200 len: 1478 microversion: 2.1 time: 0.448038 Aug 24 03:46:19.646867 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1576/3013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:19 2022] GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 1478 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:19.655034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:19.656000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:19.669446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:19.670255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:19.671889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:19.672624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:19.673086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:19.673513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.101941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:20.106906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.119159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.120219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.121783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.123804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.124564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.125266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.277001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.289602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7be71fb9-9da6-4f3d-b8d5-56043215b735 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.638620 Aug 24 03:46:20.314674 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1438/3014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:19 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:20.320994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:20.322004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.335171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.338514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.340268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.343411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.344029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.345663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.381417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.401096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.409693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.415604 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f19ef6d-d19b-4f82-9f1b-548563061fab tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.322950 Aug 24 03:46:20.436735 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1577/3015] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:20 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:20.606244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.615469 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26d16c70-770c-4126-8e9f-58bfac15c529 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1381 microversion: 2.1 time: 0.299013 Aug 24 03:46:20.616544 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1439/3016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:20 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1381 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:20.641977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:20.642737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.654066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.654573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.655154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.655926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.657182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.657836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.672078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:20.672886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.692666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.693616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.694281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.695272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.696304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.696867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.885786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.895034 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a23288f-8845-416b-9979-897e71e34f60 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 200 len: 1465 microversion: 2.1 time: 0.230631 Aug 24 03:46:20.895932 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1440/3017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:20 2022] GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 1465 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:20.923068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5f66b23-84d5-4bfa-892b-db86bbdf49de tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a7abaf0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.051586 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5f66b23-84d5-4bfa-892b-db86bbdf49de tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images?changes-since=2022-08-24T03%3A44%3A10Z" status: 200 len: 1904 microversion: 2.1 time: 0.132428 Aug 24 03:46:21.053305 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1441/3018] 10.222.0.58 () {58 vars in 1199 bytes} [Wed Aug 24 03:46:20 2022] GET /compute/v2.1/images?changes-since=2022-08-24T03%3A44%3A10Z => generated 1904 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:21.092430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-48ee9c26-3bc3-4faf-a44f-c57473367843 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10343ee1f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.195894 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-48ee9c26-3bc3-4faf-a44f-c57473367843 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-433153226" status: 200 len: 484 microversion: 2.1 time: 0.107610 Aug 24 03:46:21.196651 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1442/3019] 10.222.0.58 () {58 vars in 1229 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-433153226 => generated 484 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:21.215520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9830ab57-857a-4c4b-8b2a-ebb5ed338647 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a7978b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.348426 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9830ab57-857a-4c4b-8b2a-ebb5ed338647 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images?server=70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 200 len: 958 microversion: 2.1 time: 0.141852 Aug 24 03:46:21.352172 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1443/3020] 10.222.0.58 () {58 vars in 1209 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/images?server=70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 958 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:21.367140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.367862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:21.387345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.388265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.389002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.390443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.392901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.393518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.560607 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da8253c5-1455-48fa-9169-c7b4bb0f3a52 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1534 microversion: 2.1 time: 0.923828 Aug 24 03:46:21.563987 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1578/3021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:20 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1534 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:21.582691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4246fab-c309-43fe-b87c-66d8fb14d3f3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10226ccaf0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.716552 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4246fab-c309-43fe-b87c-66d8fb14d3f3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 485 microversion: 2.1 time: 0.146542 Aug 24 03:46:21.720811 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1579/3022] 10.222.0.58 () {58 vars in 1317 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 485 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:21.735294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.736169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:21.755229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.757340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.758758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.764648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.765320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.766107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.228867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:22.243488 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e02c4c6a-3618-4968-87d1-5701a80afe4b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.889211 Aug 24 03:46:22.261658 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1444/3023] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:22.280349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:22.288368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:22.320221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.320750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.323587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.324861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.331278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.333027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.895883 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6226a1f9-0846-4974-a60f-19178a66c6cf tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1534 microversion: 2.1 time: 0.632618 Aug 24 03:46:22.909281 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1445/3024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:22 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1534 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:22.938898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2549693f-81a5-43de-8bba-3712b0ad2352 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a797dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:23.036923 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2549693f-81a5-43de-8bba-3712b0ad2352 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 485 microversion: 2.1 time: 0.125619 Aug 24 03:46:23.037716 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1446/3025] 10.222.0.58 () {58 vars in 1303 bytes} [Wed Aug 24 03:46:22 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 485 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:23.068018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f9aa28b9-2ceb-4750-a7b9-f492af7994b1 req-71ec3c26-e225-48d9-a6dd-f2939d1ea285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a57fff-dd1c-4da6-a069-721eeb327ba9", "name": "network-vif-unplugged", "status": "completed", "tag": "7b45f896-efbb-49d1-885b-f24770cf2671"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:23.085365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:23.103277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:23.109660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:23.116302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9aa28b9-2ceb-4750-a7b9-f492af7994b1 req-71ec3c26-e225-48d9-a6dd-f2939d1ea285 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.116854 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-924e6d53-b941-476f-a168-7534ac4707fd tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 1.390355 Aug 24 03:46:23.124229 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1580/3026] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:23.128671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9aa28b9-2ceb-4750-a7b9-f492af7994b1 req-71ec3c26-e225-48d9-a6dd-f2939d1ea285 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.129809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9aa28b9-2ceb-4750-a7b9-f492af7994b1 req-71ec3c26-e225-48d9-a6dd-f2939d1ea285 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.140780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:23.143281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:23.179269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.180221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.180833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.181747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.182358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.183071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.185868 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f9aa28b9-2ceb-4750-a7b9-f492af7994b1 req-71ec3c26-e225-48d9-a6dd-f2939d1ea285 service nova] Creating event network-vif-unplugged:7b45f896-efbb-49d1-885b-f24770cf2671 for instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 on n-h1-846470-15 Aug 24 03:46:23.198970 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f9aa28b9-2ceb-4750-a7b9-f492af7994b1 req-71ec3c26-e225-48d9-a6dd-f2939d1ea285 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159973 Aug 24 03:46:23.199997 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1447/3027] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:23.208059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c4edc44-6ead-4b3d-ad1b-0621c0e045a7 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:23.216642 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:23.216642 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:46:23.221201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4edc44-6ead-4b3d-ad1b-0621c0e045a7 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.221639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4edc44-6ead-4b3d-ad1b-0621c0e045a7 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.222108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4edc44-6ead-4b3d-ad1b-0621c0e045a7 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.222884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4edc44-6ead-4b3d-ad1b-0621c0e045a7 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.223368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4edc44-6ead-4b3d-ad1b-0621c0e045a7 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.223824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4edc44-6ead-4b3d-ad1b-0621c0e045a7 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.269904 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c4edc44-6ead-4b3d-ad1b-0621c0e045a7 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.068341 Aug 24 03:46:23.270819 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1448/3028] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 03:46:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:23.271252 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2739369a-74f9-408d-a7bf-5a5d58638267 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144342 Aug 24 03:46:23.279023 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1581/3029] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:46:23 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:46:23.283887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-73c6efb2-b156-4469-863a-9c6e79a2b42d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a7ab280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:23.298160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:23.299479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:23.319270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.321402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.325174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.342548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.346047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.347329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.567153 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-73c6efb2-b156-4469-863a-9c6e79a2b42d tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.294639 Aug 24 03:46:23.587937 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1449/3030] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:46:23 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:23.593277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846470-15", "block_migration": false, "disk_over_commit": false}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:23.606636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:23.631580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.638785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.639561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.640635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.641513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.642154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.702316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lazy-loading 'flavor' on Instance uuid 255e7979-2c2b-44f3-83f0-0cd4c67ec7df {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:46:23.734855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Going to try to live migrate instance to n-h1-846470-15 {{(pid=122535) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 03:46:24.036809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:24.046467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-389aceed-cd1e-4910-b87c-225aa701e016 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.772504 Aug 24 03:46:24.055122 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1582/3031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:23 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:24.060759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:24.092004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:24.115703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.116433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.117027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.117962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.118600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.128431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.200130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:24.491439 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af7c8975-ef17-4575-aaee-01124fb0c4af tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 204 len: 0 microversion: 2.1 time: 0.427739 Aug 24 03:46:24.495736 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1583/3032] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:46:24 2022] DELETE /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:24.524911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86ccf620-07e1-4cae-befb-cbf60286e3c2 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10226c89d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:24.667516 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86ccf620-07e1-4cae-befb-cbf60286e3c2 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.170228 Aug 24 03:46:24.679393 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1584/3033] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:46:24 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:24.711945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:24.713837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:24.745075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.745932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.761252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.763392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.768211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.772935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.019233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:25.042386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:25.046332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:25.050427 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f363e1c-5e0d-4f6f-ad4e-1c8e043470d4 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.376307 Aug 24 03:46:25.053692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1585/3034] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:24 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:25.064659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:25.070072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:25.085209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.086010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.086612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.091905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.092834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.094310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.137517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.809502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:25.818339 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c89af2fe-1f4d-4dac-9dcd-39309a48d8b0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1672 microversion: 2.1 time: 0.763266 Aug 24 03:46:25.824703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1586/3035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:25 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1672 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:25.834578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cfd7227b-3659-4833-a68d-123fa51ae256 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10227719d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:26.012238 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cfd7227b-3659-4833-a68d-123fa51ae256 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.186131 Aug 24 03:46:26.020464 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1587/3036] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:46:25 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:26.025188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:26.025817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:26.056436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.057404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.059938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.067726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.067726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.067726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.593595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:26.604982 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-008344b7-5ac2-4b1b-b266-4acc4af2651c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.590723 Aug 24 03:46:26.608166 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1588/3037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:26 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:26.631285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db937b59-e26d-441a-b3c6-32e968db5cb0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10226c81f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:26.778205 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db937b59-e26d-441a-b3c6-32e968db5cb0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/detail?changes-since=2022-08-24T03%3A44%3A06Z" status: 200 len: 6335 microversion: 2.1 time: 0.168544 Aug 24 03:46:26.793145 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1589/3038] 10.222.0.58 () {58 vars in 1220 bytes} [Wed Aug 24 03:46:26 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-24T03%3A44%3A06Z => generated 6335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:26.806464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:26.807098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:26.815066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:26.833986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.834804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.835237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.846452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.849091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.851587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:27.180953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:27.205186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:27.217409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:27.219507 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ddc954e1-004c-47a8-9b4d-42923c9945be tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.424567 Aug 24 03:46:27.238874 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1590/3039] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:26 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:27.247215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fa2e4ef-380b-48c3-b114-75d844252613 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022771f70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:27.338454 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fa2e4ef-380b-48c3-b114-75d844252613 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-433153226" status: 200 len: 664 microversion: 2.1 time: 0.098309 Aug 24 03:46:27.339749 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1591/3040] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Aug 24 03:46:27 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-433153226 => generated 664 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:27.345732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:27.346519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:27.353616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:27.354110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:27.354625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:27.355323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:27.356115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:27.357019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:27.743554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:27.770893 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-02eede93-e8c9-467c-a3a8-a76e36558929 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1672 microversion: 2.1 time: 0.427065 Aug 24 03:46:27.778416 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1592/3041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:27 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1672 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:27.787874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc87ffd0-3e39-4079-86a7-a310e82976d0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10226c1ca0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:27.884644 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc87ffd0-3e39-4079-86a7-a310e82976d0 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1467 microversion: 2.1 time: 0.104184 Aug 24 03:46:27.885436 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1593/3042] 10.222.0.58 () {58 vars in 1338 bytes} [Wed Aug 24 03:46:27 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1467 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:27.890778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:27.891876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:27.899896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:27.900642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:27.901246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:27.902467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:27.903091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:27.904022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:28.425585 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a212f388-4fed-432f-8ff4-42dc228ea126 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df/action" status: 202 len: 0 microversion: 2.1 time: 4.836252 Aug 24 03:46:28.427150 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1450/3043] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:46:23 2022] POST /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df/action => generated 0 bytes in 4839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:46:28.433680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-25742e54-e96e-41ea-a5e0-1e4b510d8880 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a7b7160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:28.468133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:28.477304 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-504485ff-a513-42e5-9290-bf394e68349a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1522 microversion: 2.1 time: 0.590398 Aug 24 03:46:28.487833 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1594/3044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:27 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:28.525010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:28.525721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:28.551647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:28.552170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:28.552820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:28.554223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:28.554880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:28.561415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:28.592109 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-25742e54-e96e-41ea-a5e0-1e4b510d8880 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1467 microversion: 2.1 time: 0.163485 Aug 24 03:46:28.593715 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1451/3045] 10.222.0.58 () {58 vars in 1324 bytes} [Wed Aug 24 03:46:28 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1467 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:28.628205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:28.629635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:28.644403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:28.648498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:28.653281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:28.655075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:28.655865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:28.669288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:28.813777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:28.837596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:28.840142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:28.842082 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20c67e4f-fefd-4f06-9e2d-e8679fca3b64 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.353118 Aug 24 03:46:28.855709 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1595/3046] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:28 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:28.855709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23359bb6-fdd5-46e2-a7bf-531bf5581380 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103438a700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.004705 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23359bb6-fdd5-46e2-a7bf-531bf5581380 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7110 microversion: 2.1 time: 0.159413 Aug 24 03:46:29.005338 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1596/3047] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 24 03:46:28 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7110 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:29.038189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.040930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:29.054744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.055551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.056176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.057070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.057759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.058695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.516544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:29.524970 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1897ded3-be42-42bd-a1c1-6ec31d69723d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1604 microversion: 2.1 time: 0.499944 Aug 24 03:46:29.525809 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1597/3048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:29 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1604 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:29.539495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8d3528f3-d057-4a89-a3d7-d1e633fd19d4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022695d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.635510 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8d3528f3-d057-4a89-a3d7-d1e633fd19d4 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.108172 Aug 24 03:46:29.639595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:29.652120 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1598/3049] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 24 03:46:29 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:29.657031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.658273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:29.663303 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a6015c4-dd2d-4a70-9589-2446bce9e86b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 1.055778 Aug 24 03:46:29.679418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.680247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.680436 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1452/3050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:28 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:29.680879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.681916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.682481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.683098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.688768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b1dd01e-1383-4f74-861c-a76081649092 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1034382ca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.760124 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b1dd01e-1383-4f74-861c-a76081649092 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/940ed0d3-700a-4ac5-a26b-97e9311e8ce3" status: 200 len: 784 microversion: 2.1 time: 0.076082 Aug 24 03:46:29.762268 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1453/3051] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:29 2022] GET /compute/v2.1/images/940ed0d3-700a-4ac5-a26b-97e9311e8ce3 => generated 784 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:29.785596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5c1f0bbe-6509-43da-a958-8708e64ecbe9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103439c160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.853363 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5c1f0bbe-6509-43da-a958-8708e64ecbe9 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.078960 Aug 24 03:46:29.854651 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1454/3052] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:46:29 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:29.898606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.900441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:29.927649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.930169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.936339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.937186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.937674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.938111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.148455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:30.153416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:30.169889 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4daa1518-008a-488b-b792-1b4cd805e155 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1504 microversion: 2.1 time: 0.527514 Aug 24 03:46:30.171007 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1599/3053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:29 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:30.175125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:30.176332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca860ef1-9e3b-4e74-9d5d-af268b064733 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f103438ad30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:30.224490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:30.233953 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dec7ce37-c2fc-4707-b2ac-0433e7648587 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.364207 Aug 24 03:46:30.239163 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1455/3054] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:29 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:30.263927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:30.269328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:30.301027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.303210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.317137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.319859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.322737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.325793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.369481 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] HTTP exception thrown: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Request method failure captured: Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 HTTP/1.1 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0ZwpzcF_c73K8gqV_b7fcVy1DFk6DD4ToZegtBRByGWn2TGoACVwhMOEeOzgz4SSpshHl2bm-2VSxqciTmMO9oj5qWuKb5KC_hyxQ3CLti8YPt_ISnP2ssCoTNv9nh6XZzHoRdT1soiDXoM7teVm9vcOwJzPTIBc8JInU-DHaWlVg Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 7f897cfbb438455f8ff5aabd10ab4135 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 7f897cfbb438455f8ff5aabd10ab4135 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TaggedBootDevicesTest-324263961-project Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 632b0aa8a4694c378ba66f9c2ddf453d Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TaggedBootDevicesTest-324263961-project Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'aa8db641-7a2b-48bf-9fbb-cbfe4b171e82'} Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:30.378927 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.383161 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.390979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Returning 404 to user: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:30.393973 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be638597-37bd-4487-a1cd-b3ce9c50469e tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 404 len: 111 microversion: 2.32 time: 0.148360 Aug 24 03:46:30.394894 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1456/3055] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:46:30 2022] DELETE /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:30.413797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:30.415127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] [instance: aa8db641-7a2b-48bf-9fbb-cbfe4b171e82] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:30.454625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.455146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.455604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.456378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.456841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.457269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.513956 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] HTTP exception thrown: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Request method failure captured: Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 HTTP/1.1 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0ZwpzcF_c73K8gqV_b7fcVy1DFk6DD4ToZegtBRByGWn2TGoACVwhMOEeOzgz4SSpshHl2bm-2VSxqciTmMO9oj5qWuKb5KC_hyxQ3CLti8YPt_ISnP2ssCoTNv9nh6XZzHoRdT1soiDXoM7teVm9vcOwJzPTIBc8JInU-DHaWlVg Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 7f897cfbb438455f8ff5aabd10ab4135 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f897cfbb438455f8ff5aabd10ab4135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 7f897cfbb438455f8ff5aabd10ab4135 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TaggedBootDevicesTest-324263961 Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TaggedBootDevicesTest-324263961-project Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 632b0aa8a4694c378ba66f9c2ddf453d Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TaggedBootDevicesTest-324263961-project Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'aa8db641-7a2b-48bf-9fbb-cbfe4b171e82'} Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:30.515568 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.522446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:30.522446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:30.522446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:30.522446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:30.522446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:30.522446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. Aug 24 03:46:30.522446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:30.527319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] Returning 404 to user: Instance aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:30.527319 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ebcd5d34-7b82-4e1b-b09c-703cf93e3b77 tempest-TaggedBootDevicesTest-324263961 tempest-TaggedBootDevicesTest-324263961-project] 10.222.0.58 "GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82" status: 404 len: 111 microversion: 2.32 time: 0.126792 Aug 24 03:46:30.533478 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1457/3056] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:30 2022] GET /compute/v2.1/servers/aa8db641-7a2b-48bf-9fbb-cbfe4b171e82 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:30.548258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:30.549080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:30.562092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.568855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.569577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.570527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.571182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.571844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.168393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.181053 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bc266531-c118-466a-b62f-7a2fca242fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 200 len: 1322 microversion: 2.1 time: 0.634820 Aug 24 03:46:31.184587 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1458/3057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:30 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 1322 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:31.201612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:31.203246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:31.220729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.221912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.222648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.223932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.224813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.226048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.530974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca860ef1-9e3b-4e74-9d5d-af268b064733 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "DELETE /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7" status: 204 len: 0 microversion: 2.1 time: 1.358469 Aug 24 03:46:31.532823 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1600/3058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:30 2022] DELETE /compute/v2.1/images/051cba0c-5a64-42d2-b6f1-c71da7b59fd7 => generated 0 bytes in 1361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:31.541294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-4f234504-f667-4e78-af9a-090f20158017 req-da0ae571-72dd-4782-a44d-f1eab639bfaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5650d75d-2bd5-425e-8265-de0c96bb9d09", "name": "network-vif-deleted", "tag": "dcd1ebcd-1f5d-48ff-b959-70cda70c0d18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:31.576130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4f234504-f667-4e78-af9a-090f20158017 req-da0ae571-72dd-4782-a44d-f1eab639bfaf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.578459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4f234504-f667-4e78-af9a-090f20158017 req-da0ae571-72dd-4782-a44d-f1eab639bfaf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.579059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4f234504-f667-4e78-af9a-090f20158017 req-da0ae571-72dd-4782-a44d-f1eab639bfaf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.600435 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-4f234504-f667-4e78-af9a-090f20158017 req-da0ae571-72dd-4782-a44d-f1eab639bfaf service nova] Creating event network-vif-deleted:dcd1ebcd-1f5d-48ff-b959-70cda70c0d18 for instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 on n-h1-846470-15 Aug 24 03:46:31.620317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.631778 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-4f234504-f667-4e78-af9a-090f20158017 req-da0ae571-72dd-4782-a44d-f1eab639bfaf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074311 Aug 24 03:46:31.633520 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1601/3059] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:31.643889 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cf494d71-a662-4044-837e-2c11dae090e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.456457 Aug 24 03:46:31.646666 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1459/3060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:31 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:31.664695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:31.667346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:31.670607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:31.676226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:31.706120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.708428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.710772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.712006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.715287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.716609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.718674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.719408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.719944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.725181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.726068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.730321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.935449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.947789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.950429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.953061 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-38e97aaa-13cb-4bac-aad3-f69bd5316764 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.304207 Aug 24 03:46:31.954635 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1460/3061] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:31 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:31.961847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24abf457-2cb3-4852-8e09-1e5dfb3e911e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1034382e50>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:32.287267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:32.297472 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f6526dc9-5c6d-42aa-abdd-aa4e6bcb2e28 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1504 microversion: 2.1 time: 0.658004 Aug 24 03:46:32.302418 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1602/3062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:31 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1504 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:32.647306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e29da0e-db68-4e81-b0ab-4ca08ffea5d7 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Action: 'create', calling method: .version_select at 0x7f10226c8af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1684259574"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:32.991242 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24abf457-2cb3-4852-8e09-1e5dfb3e911e tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "DELETE /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7" status: 204 len: 0 microversion: 2.1 time: 1.034392 Aug 24 03:46:32.992085 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1461/3063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:31 2022] DELETE /compute/v2.1/images/a859f634-6625-4f8f-a806-a9bc7acacff7 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:33.008142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:33.012707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:33.033665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:33.034224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:33.038532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:33.039793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:33.040479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:33.041723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:33.095554 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] HTTP exception thrown: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Request method failure captured: Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 HTTP/1.1 Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ2nNzF92F7ozXo3ryS2w9e7wuuQoA9s2hb2S4t-WXhw0VSFq47NsDGRrC19fL_nNj21Axs5FVUa2Ke1dFFwv9KEdZYghgCrRtwmsgvIxRNG1lVAEWE-5nmdjithEOq86Zf2tmM9WVL5Zepa1hj5IbZnT6MZ8ia_L0KI74tFRa4jcko Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ca968a4777ea4164be5ff3174d4291d5 Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '5650d75d-2bd5-425e-8265-de0c96bb9d09'} Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:33.097441 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:33.102361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:33.102361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:33.102361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:33.102361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:33.102361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:33.102361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:46:33.102361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:33.105438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Returning 404 to user: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:33.114249 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf4284b4-38d9-4135-a385-e54b0cf47bae tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 404 len: 111 microversion: 2.1 time: 0.120699 Aug 24 03:46:33.115193 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1462/3064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:32 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:33.120606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:33.127179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:33.139467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:33.141435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:33.142103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:33.143034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:33.146146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:33.146822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:33.244543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:33.592600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:33.598391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:33.605610 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5f3a4738-1845-4163-b0de-24c8dbeb89d7 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.488886 Aug 24 03:46:33.607148 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1463/3065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:33 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:33.638776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:33.640373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:33.660155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:33.661483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:33.662383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:33.663457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:33.667455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:33.668581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:33.794693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:33.819536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:33.827020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:33.833061 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b04bc931-a1ad-47d9-953e-f66129db3994 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.224648 Aug 24 03:46:33.850311 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1464/3066] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:33 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:33.852779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-076ba646-aaa5-46c9-9c7b-ad7cea7474c5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a79ab80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:34.580194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-076ba646-aaa5-46c9-9c7b-ad7cea7474c5 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "DELETE /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b" status: 204 len: 0 microversion: 2.1 time: 0.730536 Aug 24 03:46:34.581882 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1465/3067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:33 2022] DELETE /compute/v2.1/images/826046fb-bef2-44c3-87f9-7eed421f8d1b => generated 0 bytes in 733 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:34.589361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19c1c546-a688-483a-a9cc-1434e26ca9d2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '.version_select at 0x7f1034382d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:34.617465 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19c1c546-a688-483a-a9cc-1434e26ca9d2 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904152849" status: 202 len: 0 microversion: 2.1 time: 0.034281 Aug 24 03:46:34.618768 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1466/3068] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:46:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904152849 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:46:34.643185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:34.644214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:34.655268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:34.658476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:34.658935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:34.659695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:34.662012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:34.665747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:34.987234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:34.996643 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3fb4a9cf-0b7a-4f36-8994-29e11c693170 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 200 len: 1447 microversion: 2.1 time: 0.376525 Aug 24 03:46:35.000432 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1467/3069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:34 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 1447 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:35.009823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e71e18ad-c3b9-4e35-88c3-1f74478eeafb req-adc6c93d-0b88-4df0-b4ed-6d23e523f7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "8f092b56-4331-49ca-b0e1-5edd1dc0a14d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:35.033009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e71e18ad-c3b9-4e35-88c3-1f74478eeafb req-adc6c93d-0b88-4df0-b4ed-6d23e523f7a8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.035413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e71e18ad-c3b9-4e35-88c3-1f74478eeafb req-adc6c93d-0b88-4df0-b4ed-6d23e523f7a8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.042690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e71e18ad-c3b9-4e35-88c3-1f74478eeafb req-adc6c93d-0b88-4df0-b4ed-6d23e523f7a8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.079115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.server_external_events [req-e71e18ad-c3b9-4e35-88c3-1f74478eeafb req-adc6c93d-0b88-4df0-b4ed-6d23e523f7a8 service nova] Unable to find a host for instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9. Dropping event network-vif-unplugged {{(pid=122535) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:46:35.084052 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e71e18ad-c3b9-4e35-88c3-1f74478eeafb req-adc6c93d-0b88-4df0-b4ed-6d23e523f7a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.078551 Aug 24 03:46:35.085108 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1468/3070] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 03:46:35.090618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:35.092612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:35.103821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.104635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.105256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.106138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.106764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.108138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.148516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:35.267316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea6f462b-7651-4994-957d-f5f3205f8b63 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 204 len: 0 microversion: 2.1 time: 0.180866 Aug 24 03:46:35.268268 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1469/3071] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:46:35 2022] DELETE /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:35.283755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:35.284757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:35.299286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.299807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.300246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.300950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.301400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.301818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.918833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:35.928230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b4fd9d0-3cfe-4419-b597-e912463e4f00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.658695 Aug 24 03:46:35.932137 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1470/3072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:35 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:35.937181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:35.937808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:35.961185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.963763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.964160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.965159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.965702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.966183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.537824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:36.547857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:36.549803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:36.551336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c1ee16c4-9f7c-4255-8dbb-e3150f598dd2 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1604 microversion: 2.42 time: 0.618020 Aug 24 03:46:36.568110 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1471/3073] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:35 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1604 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:36.575139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:36.576070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:36.583102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:36.592489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:36.593266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.594104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:36.594784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:36.595549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.629612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:36.640734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.api [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Working on deleting snapshot 20b94c49-3621-423b-9a0b-359d5a06b324 from shelved instance... Aug 24 03:46:37.278886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Doing local delete in cell a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) {{(pid=122535) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 24 03:46:37.280731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:37.281467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:37.282162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:37.284343 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.api [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 24 03:46:37.290375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] deallocate_for_instance() {{(pid=122535) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 24 03:46:38.821396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Updating instance_info_cache with network_info: [] {{(pid=122535) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 03:46:39.586141 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee6d5a1c-4c62-4589-abf0-5d9c59e53723 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 204 len: 0 microversion: 2.1 time: 3.014265 Aug 24 03:46:39.595831 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1472/3074] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:46:36 2022] DELETE /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 0 bytes in 3024 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:39.597123 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e29da0e-db68-4e81-b0ab-4ca08ffea5d7 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 7.283789 Aug 24 03:46:39.602219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:39.602779 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1603/3075] 10.222.0.58 () {60 vars in 1155 bytes} [Wed Aug 24 03:46:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 7299 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 03:46:39.607198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:39.621034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4da96441-05da-473c-960f-e6488ab52e61 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'create', calling method: .version_select at 0x7f1022e22280>, body: {"keypair": {"name": "tempest-keypair-607230203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfRgsAMWOo7xIcoDzO7mq6dpaEXYnhYezMTgWuQbvDPdYgLl5smb5o6tQTLPOGUOT4uc4PBfee5w3yaQnqrNaNSAyQetb/TdqQ1UKvBY/vxt9dKz+Cr76jAT6UQSijQYQ=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:39.623320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.625219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.626060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.627973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.631937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.634220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.713126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-4da96441-05da-473c-960f-e6488ab52e61 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Getting quotas for project de5a2a3c9cdc428d81a1ade5f5102e6d. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:46:39.720305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-4da96441-05da-473c-960f-e6488ab52e61 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Getting quotas for user ca968a4777ea4164be5ff3174d4291d5 and project de5a2a3c9cdc428d81a1ade5f5102e6d. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:46:39.728089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.730733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.731805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.732721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lazy-loading 'fault' on Instance uuid 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:46:39.788016 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4da96441-05da-473c-960f-e6488ab52e61 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180724 Aug 24 03:46:39.789975 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1604/3076] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:46:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:39.813030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:39.814334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:39.822226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.823629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.825019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.826035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.826672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.827883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.859784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:39.880506 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4339eb7e-86aa-4731-a8c2-b588d7d0a281 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 200 len: 1307 microversion: 2.1 time: 0.281986 Aug 24 03:46:39.885149 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1473/3077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:39 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:39.903058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:39.904100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:39.931735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.935630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.938149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.943065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.943646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.946773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.064661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.065730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.066955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.068213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lazy-loading 'fault' on Instance uuid a85d3507-2b80-457f-a93e-c1c6810ef584 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:46:40.085656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:40.215990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:40.231143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:40.235189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27a98cafcc0e4f899bbed446fc4f0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9ef66358704edf814e8a1f0012e0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:40.243034 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-007dd96b-38aa-4517-a3f6-34447d15dd51 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 200 len: 1371 microversion: 2.42 time: 0.350423 Aug 24 03:46:40.244173 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1474/3078] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:39 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 1371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:40.256463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d5b0e63b-03b3-4b68-9bdc-2d253e480cf8 req-1db03493-1fbb-46d0-bf3f-15cdd1ad3d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f", "name": "network-vif-deleted", "tag": "3a1a2e99-33ae-440a-8de1-d607808576ba"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:40.290733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d5b0e63b-03b3-4b68-9bdc-2d253e480cf8 req-1db03493-1fbb-46d0-bf3f-15cdd1ad3d79 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.291298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d5b0e63b-03b3-4b68-9bdc-2d253e480cf8 req-1db03493-1fbb-46d0-bf3f-15cdd1ad3d79 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.293264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d5b0e63b-03b3-4b68-9bdc-2d253e480cf8 req-1db03493-1fbb-46d0-bf3f-15cdd1ad3d79 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.322668 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d5b0e63b-03b3-4b68-9bdc-2d253e480cf8 req-1db03493-1fbb-46d0-bf3f-15cdd1ad3d79 service nova] Creating event network-vif-deleted:3a1a2e99-33ae-440a-8de1-d607808576ba for instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f on n-h1-846470-15 Aug 24 03:46:40.336282 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d5b0e63b-03b3-4b68-9bdc-2d253e480cf8 req-1db03493-1fbb-46d0-bf3f-15cdd1ad3d79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090539 Aug 24 03:46:40.337215 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1475/3079] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:40.344980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.345641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:40.355770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.358061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.358749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.359784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.360423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.361493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.382731 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 HTTP/1.1 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9'} Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:40.384946 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.390279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:40.390279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:40.390279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:40.390279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:40.390279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:40.390279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:46:40.390279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.392048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:40.393154 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-791133ab-82cd-4a05-9178-8a687049964d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 404 len: 111 microversion: 2.1 time: 0.054760 Aug 24 03:46:40.395116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:40.397945 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1476/3080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:40.415426 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-01e0a489-87dc-4c94-8b30-56c3c11ececc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.622470 Aug 24 03:46:40.416196 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1605/3081] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:39 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:40.439366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ce942ff-ec39-4056-b5ec-1b7f3d064d13 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a756dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.505233 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ce942ff-ec39-4056-b5ec-1b7f3d064d13 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 200 len: 345 microversion: 2.1 time: 0.104780 Aug 24 03:46:40.506763 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1477/3082] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:40.572436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-842094228", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "6b7c20d5-6e0c-43b0-8505-bb28069b1895"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:40.655958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] validate_networks() for [('6b7c20d5-6e0c-43b0-8505-bb28069b1895', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:46:40.906862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.907515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:40.920059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.920582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.921276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.927120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.928195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.928920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.983496 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] HTTP exception thrown: Instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f could not be found. Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Request method failure captured: Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f HTTP/1.1 Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ6FkhzhIBUjfepTaluf9Jww_zTfOxtp9grKmxTaNkpFF7W7S-iJYaXHxRpjAd8J8NN1Wu1V-RQGuJPw7iWofEdoLovaUjtKjybCoqx5LG57iY5xI2HBxEcPVgkvld5wmNYkofQ9XUL_7pjBH9QNUjJily0uhigSb4rj6iBfJVJpPZs Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecbbd1614938483089ab1d1efc22dbed Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListImageFiltersTestJSON-1285798817 Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecbbd1614938483089ab1d1efc22dbed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecbbd1614938483089ab1d1efc22dbed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecbbd1614938483089ab1d1efc22dbed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecbbd1614938483089ab1d1efc22dbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListImageFiltersTestJSON-1285798817 Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecbbd1614938483089ab1d1efc22dbed Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1285798817 Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListImageFiltersTestJSON-1285798817-project Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: fb1dd0f130454573873a7f5e1542e874 Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListImageFiltersTestJSON-1285798817-project Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f could not be found. Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f'} Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f could not be found. Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f could not be found. Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:40.985775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f could not be found. Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Returning 404 to user: Instance 1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-65ad64fd-3aec-4231-b8fb-0413ad1b6576 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f" status: 404 len: 111 microversion: 2.1 time: 0.085600 Aug 24 03:46:40.990632 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1478/3083] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/servers/1f4ba0ed-6a08-4cb1-b1b0-dd3c61cbf94f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:46:40.999384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.999940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:41.016155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.016656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.017103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.017824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.018333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.018756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.048522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:41.171121 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-254c1223-0221-45ca-8c5b-96ca9e98562b tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "DELETE /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 204 len: 0 microversion: 2.1 time: 0.176358 Aug 24 03:46:41.172315 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1479/3084] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:46:40 2022] DELETE /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:41.188135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:41.188851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:41.207648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.208087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.208540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.209650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.210241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.210702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.561800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:46:41.562221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:46:41.562689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:46:41.563094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:46:41.563501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:46:41.580801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.581917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.582312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.583447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.584990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.586238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.607924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:41.620598 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b2828f4f-7a0e-42be-80ad-1c085ce06b99 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 200 len: 1471 microversion: 2.1 time: 0.442097 Aug 24 03:46:41.622130 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1480/3085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:41 2022] GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:41.629433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:41.630397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:41.641135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.642072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.642774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.644091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.644769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.645412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.659791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:46:41.665745 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] HTTP exception thrown: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Request method failure captured: Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 HTTP/1.1 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0xLdK7d3-C_hINWyWaN_baZu8zI1V9LTt_vTFULOKJM7Jzjn57-rmn1fwIBKj4qNu-1VxeRaqVe0DX7yXh6oP-U1YyJgpoRFfeRhL5tnKqPmnPxSVxCEFCStBVgpS_dEALzxFJkXbGRSiOEUQykK6mAotw6MflRcOA33tDVLkaYaA Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 7a9ef66358704edf814e8a1f0012e0c3 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 7a9ef66358704edf814e8a1f0012e0c3 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TaggedBootDevicesTest_v242-1059167772-project Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 27a98cafcc0e4f899bbed446fc4f0432 Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1059167772-project Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a85d3507-2b80-457f-a93e-c1c6810ef584'} Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:41.668414 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Returning 404 to user: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-75fe17a1-08e2-45ae-bc69-e817405a9b7e tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 404 len: 111 microversion: 2.42 time: 0.047086 Aug 24 03:46:41.673571 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1481/3086] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:41 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:41.676331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:41.676944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:41.680528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for user 69a1414940b14e459202a86bd8e9027b and project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:46:41.681069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:41.686090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.686640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.687182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.687932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.688614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.689424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.720149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:46:41.722795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:46:41.805105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-382fba51-cbe3-46d7-85ad-1e373b2ccea2 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236742 Aug 24 03:46:41.813968 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1606/3087] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:46:41.824536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-259b0d69-a555-467a-bd44-3f386739a6ae tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f10226c1a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:41.934766 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-259b0d69-a555-467a-bd44-3f386739a6ae tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 200 len: 346 microversion: 2.1 time: 0.121517 Aug 24 03:46:41.936333 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1607/3088] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:46:41 2022] GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:41.948002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba2cc7d0-e013-40ab-958a-a2b07d182471 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '.version_select at 0x7f1034384160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:41.986479 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba2cc7d0-e013-40ab-958a-a2b07d182471 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231689129" status: 204 len: 0 microversion: 2.42 time: 0.047274 Aug 24 03:46:41.989715 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1608/3089] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 03:46:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231689129 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:46:42.004930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2061e853-6d0e-4f39-bd30-0b4738aeb6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:42.007502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2061e853-6d0e-4f39-bd30-0b4738aeb6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:42.063251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:42.081462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79f3da84-651f-46b2-b66a-6c1b7decd551 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.406588 Aug 24 03:46:42.084824 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1482/3090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:41 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:42.095778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1e3fb18c-fc8e-46d1-87b4-1a2dfbf3f46c tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Action: 'create', calling method: .version_select at 0x7f102a76caf0>, body: {"snapshot": {"volume_id": "8156a2c8-c5b1-4ef0-88cf-6fc84e11035e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1409440235"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:42.307514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2061e853-6d0e-4f39-bd30-0b4738aeb6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:42.338248 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2061e853-6d0e-4f39-bd30-0b4738aeb6bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1214 microversion: 2.1 time: 0.346842 Aug 24 03:46:42.346588 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1609/3091] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:41 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1214 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:42.438953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d0dc092a-b845-4194-a705-f5eaa1948787 req-64665137-f519-4ff6-9214-d0093dfa430a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9", "name": "network-vif-deleted", "tag": "8f092b56-4331-49ca-b0e1-5edd1dc0a14d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:42.467604 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1e3fb18c-fc8e-46d1-87b4-1a2dfbf3f46c tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.381638 Aug 24 03:46:42.468435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1483/3092] 10.222.0.58 () {60 vars in 1162 bytes} [Wed Aug 24 03:46:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:42.469435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d0dc092a-b845-4194-a705-f5eaa1948787 req-64665137-f519-4ff6-9214-d0093dfa430a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:42.469930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d0dc092a-b845-4194-a705-f5eaa1948787 req-64665137-f519-4ff6-9214-d0093dfa430a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:42.470369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d0dc092a-b845-4194-a705-f5eaa1948787 req-64665137-f519-4ff6-9214-d0093dfa430a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:42.482186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c566ce9d-2aef-42d5-a7a1-6edf45bc6e9e tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a756b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:42.514828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.compute.server_external_events [req-d0dc092a-b845-4194-a705-f5eaa1948787 req-64665137-f519-4ff6-9214-d0093dfa430a service nova] Unable to find a host for instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9. Dropping event network-vif-deleted {{(pid=122536) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:46:42.515785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d0dc092a-b845-4194-a705-f5eaa1948787 req-64665137-f519-4ff6-9214-d0093dfa430a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.081321 Aug 24 03:46:42.527034 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1610/3093] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 93 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 03:46:42.547034 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c566ce9d-2aef-42d5-a7a1-6edf45bc6e9e tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 200 len: 287 microversion: 2.1 time: 0.071086 Aug 24 03:46:42.548257 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1484/3094] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:42 2022] GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:42.560927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-18c5f0d8-02d7-4d27-bd12-78e21d03e4d1 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f10226c8040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:42.649560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:42.651968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:42.659166 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-18c5f0d8-02d7-4d27-bd12-78e21d03e4d1 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.103314 Aug 24 03:46:42.659990 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1611/3095] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 24 03:46:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:42.671958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-633224b2-c12b-4037-9e9d-29f138e6a668 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102265b3a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:42.683492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:42.685782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:42.686561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:42.688110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:42.693866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:42.695331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:42.750879 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-633224b2-c12b-4037-9e9d-29f138e6a668 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 200 len: 287 microversion: 2.1 time: 0.083403 Aug 24 03:46:42.752032 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1612/3096] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:42 2022] GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:43.104607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:43.105480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:43.119631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.120527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.121374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.122304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.123049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.123643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.610809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:43.629612 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c8eeec1b-c566-4ada-bcaf-a44cfe279915 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 200 len: 1471 microversion: 2.1 time: 0.989169 Aug 24 03:46:43.632053 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1485/3097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:42 2022] GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 1471 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:43.641589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:43.646690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:43.662141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.665562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.666031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.666846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.667538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.668229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.789011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:43.808952 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f7b565d1-ac29-4708-8fad-2759e8d05b6d tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1266 microversion: 2.1 time: 0.172385 Aug 24 03:46:43.811053 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1486/3098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:43 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:43.829577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-34e550f9-1228-4ea3-a0f7-7fc0b17b1ad9 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a75c9d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:43.853880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:43.870745 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-611f9579-e3a4-4602-bf3a-ac4204bb6571 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.769874 Aug 24 03:46:43.873094 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1613/3099] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:43 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:43.894822 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-34e550f9-1228-4ea3-a0f7-7fc0b17b1ad9 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 200 len: 287 microversion: 2.1 time: 0.080778 Aug 24 03:46:43.895904 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1487/3100] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:43 2022] GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:44.201853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1731509373", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "649d30e3-a245-45b4-ba70-7650bdd4e741"}], "security_groups": [{"name": "tempest-securitygroup--643574701"}], "key_name": "tempest-keypair-607230203", "user_data": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:44.528645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] validate_networks() for [('649d30e3-a245-45b4-ba70-7650bdd4e741', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:46:44.683397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:44.686172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:44.741360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:44.743546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:44.744939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:44.747622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:44.751381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:44.754240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:45.144265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1dd0f130454573873a7f5e1542e874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbbd1614938483089ab1d1efc22dbed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:45.159374 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a1ff0142-b41f-4eca-9ef1-2f0486f52621 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 200 len: 1429 microversion: 2.1 time: 0.507837 Aug 24 03:46:45.162049 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1488/3101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:44 2022] GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 1429 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:45.168246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:45.169423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:45.182377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:45.183446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:45.184754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:45.192121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:45.193093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:45.193943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:45.456649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:45.469530 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ccebbb6-51c4-47b0-8b24-19dbea99f5a6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1272 microversion: 2.1 time: 0.306059 Aug 24 03:46:45.474060 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1489/3102] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:45 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:45.479203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:45.479877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:45.502664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:45.505466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:45.505974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:45.506748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:45.507233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:45.507689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:46.110222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:46.123817 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ac71456-2871-4634-8fe3-cf0834139972 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.647881 Aug 24 03:46:46.140076 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1490/3103] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:45 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:46.159226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0d3d4ff-8aba-4410-9637-e7689dbec56e tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a76cca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:46.250213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0d3d4ff-8aba-4410-9637-e7689dbec56e tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 200 len: 288 microversion: 2.1 time: 0.103923 Aug 24 03:46:46.251266 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1491/3104] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:46 2022] GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:46.257071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-87ffadd1-1e16-4fdf-8158-db33da4170c0 req-bf613614-5131-4deb-9814-2dd4251d149c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a57fff-dd1c-4da6-a069-721eeb327ba9", "name": "network-vif-deleted", "tag": "7b45f896-efbb-49d1-885b-f24770cf2671"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:46.288147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-87ffadd1-1e16-4fdf-8158-db33da4170c0 req-bf613614-5131-4deb-9814-2dd4251d149c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:46.288653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-87ffadd1-1e16-4fdf-8158-db33da4170c0 req-bf613614-5131-4deb-9814-2dd4251d149c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:46.291383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-87ffadd1-1e16-4fdf-8158-db33da4170c0 req-bf613614-5131-4deb-9814-2dd4251d149c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:46.326493 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-87ffadd1-1e16-4fdf-8158-db33da4170c0 req-bf613614-5131-4deb-9814-2dd4251d149c service nova] Creating event network-vif-deleted:7b45f896-efbb-49d1-885b-f24770cf2671 for instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 on n-h1-846470-15 Aug 24 03:46:46.342167 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-87ffadd1-1e16-4fdf-8158-db33da4170c0 req-bf613614-5131-4deb-9814-2dd4251d149c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087523 Aug 24 03:46:46.345236 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1492/3105] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:46.362221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:46.364696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] [instance: 70a57fff-dd1c-4da6-a069-721eeb327ba9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:46.382877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:46.383658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:46.384418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:46.385696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:46.389758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:46.390406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:46.418949 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] HTTP exception thrown: Instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 could not be found. Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Request method failure captured: Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 HTTP/1.1 Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ6FkhzhIBUjfepTaluf9Jww_zTfOxtp9grKmxTaNkpFF7W7S-iJYaXHxRpjAd8J8NN1Wu1V-RQGuJPw7iWofEdoLovaUjtKjybCoqx5LG57iY5xI2HBxEcPVgkvld5wmNYkofQ9XUL_7pjBH9QNUjJily0uhigSb4rj6iBfJVJpPZs Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecbbd1614938483089ab1d1efc22dbed Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListImageFiltersTestJSON-1285798817 Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecbbd1614938483089ab1d1efc22dbed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecbbd1614938483089ab1d1efc22dbed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecbbd1614938483089ab1d1efc22dbed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecbbd1614938483089ab1d1efc22dbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListImageFiltersTestJSON-1285798817 Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecbbd1614938483089ab1d1efc22dbed Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1285798817 Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListImageFiltersTestJSON-1285798817-project Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: fb1dd0f130454573873a7f5e1542e874 Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListImageFiltersTestJSON-1285798817-project Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 could not be found. Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '70a57fff-dd1c-4da6-a069-721eeb327ba9'} Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 could not be found. Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 could not be found. Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:46.432259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 could not be found. Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Returning 404 to user: Instance 70a57fff-dd1c-4da6-a069-721eeb327ba9 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3224a02d-f932-4498-a6c8-1ce192fba980 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9" status: 404 len: 111 microversion: 2.1 time: 0.085504 Aug 24 03:46:46.440797 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1493/3106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:46 2022] GET /compute/v2.1/servers/70a57fff-dd1c-4da6-a069-721eeb327ba9 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:46.445360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3eb1120d-6b23-4d96-ad25-613f927b741e tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a76c550>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:46.566572 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3eb1120d-6b23-4d96-ad25-613f927b741e tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 202 len: 0 microversion: 2.1 time: 0.130975 Aug 24 03:46:46.571820 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1494/3107] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 24 03:46:46 2022] DELETE /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:46:46.580009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2e527fdd-561e-4c7e-98e9-55e7d28116c3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f102a76c430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:46.744307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:46:46.745576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:46:46.746354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:46:46.747022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:46:46.747592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:46:46.765074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:46.765865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:46.768521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:46.769519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:46.770435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:46.771088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:46.805053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Getting quotas for project de5a2a3c9cdc428d81a1ade5f5102e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:46:46.822588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Getting quotas for user ca968a4777ea4164be5ff3174d4291d5 and project de5a2a3c9cdc428d81a1ade5f5102e6d. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:46:46.891770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:46:46.900490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:46:46.987523 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2e527fdd-561e-4c7e-98e9-55e7d28116c3 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "DELETE /compute/v2.1/images/ca17815b-f3d7-4166-b272-131526ea458a" status: 204 len: 0 microversion: 2.1 time: 0.413575 Aug 24 03:46:46.988296 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1495/3108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:46 2022] DELETE /compute/v2.1/images/ca17815b-f3d7-4166-b272-131526ea458a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:46.994471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:46.995585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:47.016622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:47.018931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:47.019936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:47.023617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:47.023617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:47.025138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:47.046662 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc60519f-9956-439f-b5ff-c043536c8c83 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.849724 Aug 24 03:46:47.057223 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1614/3109] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:46:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 2861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:46:47.069425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b931859c-0035-4512-8f74-70d6a06a65e6 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102265b430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:47.157896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b931859c-0035-4512-8f74-70d6a06a65e6 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 200 len: 287 microversion: 2.1 time: 0.098631 Aug 24 03:46:47.168474 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1615/3110] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:47 2022] GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:47.174499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-724b7df4-552b-4a66-8b70-d368ac96d0c2 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f1022651d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:47.650196 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-724b7df4-552b-4a66-8b70-d368ac96d0c2 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "DELETE /compute/v2.1/images/9ea7a2b9-daaa-4445-92c8-500a440e63a5" status: 204 len: 0 microversion: 2.1 time: 0.479756 Aug 24 03:46:47.650771 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1616/3111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:47 2022] DELETE /compute/v2.1/images/9ea7a2b9-daaa-4445-92c8-500a440e63a5 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:47.655959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2765ae36-99bd-4c73-9bae-3ca9d644034b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:47.656570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2765ae36-99bd-4c73-9bae-3ca9d644034b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:47.826505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2765ae36-99bd-4c73-9bae-3ca9d644034b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:47.842553 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2765ae36-99bd-4c73-9bae-3ca9d644034b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1237 microversion: 2.1 time: 0.188230 Aug 24 03:46:47.856085 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1617/3112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:47 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1237 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:47.869229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:47.872442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:47.888895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:47.889758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:47.890364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:47.892063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:47.894519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:47.895493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:48.396870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:48.401595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:48.413591 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e643422-3294-4625-8a91-0a500a5db54d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.551705 Aug 24 03:46:48.414227 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1618/3113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:47 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:48.416302 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a2044d50-da17-48cd-a621-6e5881e30e9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 1.423912 Aug 24 03:46:48.417161 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1496/3114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:46 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:48.427298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e97fd6cc-2ef7-41f6-a918-e9cb9f6ad763 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a76c0d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:48.453375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-daef5681-af74-494a-bf33-9fca1b83e241 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] Calling method '.version_select at 0x7f10343a0dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:48.535064 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e97fd6cc-2ef7-41f6-a918-e9cb9f6ad763 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 200 len: 287 microversion: 2.1 time: 0.111764 Aug 24 03:46:48.535656 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1497/3115] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:48 2022] GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:48.866805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:48.867504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:48.890034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:48.891628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:48.896404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:48.897503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:48.900414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:48.901208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:48.992780 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-daef5681-af74-494a-bf33-9fca1b83e241 tempest-ListImageFiltersTestJSON-1285798817 tempest-ListImageFiltersTestJSON-1285798817-project] 10.222.0.58 "DELETE /compute/v2.1/images/f901becb-71ce-482e-8956-e24cfd83e950" status: 204 len: 0 microversion: 2.1 time: 0.573967 Aug 24 03:46:48.996675 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1619/3116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:48 2022] DELETE /compute/v2.1/images/f901becb-71ce-482e-8956-e24cfd83e950 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:49.442755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:49.443384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:49.464874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:49.467522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:49.469497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:49.471865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:49.475142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:49.475631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:49.804401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:49.832497 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d15f9796-8625-45ff-887f-d9efee8653d5 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1289 microversion: 2.1 time: 0.971091 Aug 24 03:46:49.835920 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1498/3117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:48 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1289 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:49.862911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:49.863799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:49.883335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:49.884257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:49.888436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:49.889401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:49.901205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:49.902110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:50.145314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:50.156916 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bb72fdc-fe63-4099-ba52-c1f5f5d289aa tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.720352 Aug 24 03:46:50.160428 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1620/3118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:49 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:50.172627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f8091d9-83ac-4a85-b9c7-b6725148ca68 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f1023021f70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:50.231638 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f8091d9-83ac-4a85-b9c7-b6725148ca68 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 200 len: 287 microversion: 2.1 time: 0.070046 Aug 24 03:46:50.232701 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1621/3119] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:50 2022] GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:50.856724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:50.857356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:50.870436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:50.870946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:50.874369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:50.876453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:50.881951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:50.882656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:51.110111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:51.125589 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9f59ae24-afde-4ccb-9dc6-968cd59d28e3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1295 microversion: 2.1 time: 0.274059 Aug 24 03:46:51.127520 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1622/3120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:50 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1295 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:51.205969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:51.208257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:51.218408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:51.219170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:51.219982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:51.221206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:51.221973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:51.222831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:51.287280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:51.324208 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c64af49-4db6-43a2-9842-778e426eb1bb tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 1.483787 Aug 24 03:46:51.340431 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1499/3121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:49 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:51.351121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09ee2b95-267f-4b57-880c-2411ca3fc60f tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a76c0d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:51.406253 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-09ee2b95-267f-4b57-880c-2411ca3fc60f tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] HTTP exception thrown: Snapshot f712fd4a-9cfa-4937-99d1-3b98dfe8b23a could not be found. Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09ee2b95-267f-4b57-880c-2411ca3fc60f tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Request method failure captured: Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a HTTP/1.1 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ8Xpu0Dn7tSmCXcX0xJDhHUOgHWqeLzNm1VN0-qDXgw97RaYqWQn6yGVeuHsY0Ye8aAi0E6qjRfDc7j8Mz_Tzro-cyTcEsuH1ogRtX3SH0T6EqMuar8vxrmS5wk5m6dynbsV_zJupp_SH2t7mXw2VbgX9LJKhdd7fH5YN8xrrvJCUo Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0b12b13c5613490ea4abc12582b3e5d5 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0b12b13c5613490ea4abc12582b3e5d5 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesSnapshotsTestJSON-817606877-project Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 2c3f280b3df74d369b442277b095f5cd Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesSnapshotsTestJSON-817606877-project Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: exception: Snapshot f712fd4a-9cfa-4937-99d1-3b98dfe8b23a could not be found. Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'f712fd4a-9cfa-4937-99d1-3b98dfe8b23a'} Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f712fd4a-9cfa-4937-99d1-3b98dfe8b23a could not be found. (HTTP 404) (Request-ID: req-4a0eb75b-6d68-42c4-810d-755fc3592263) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:46:51.412035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f712fd4a-9cfa-4937-99d1-3b98dfe8b23a could not be found. Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f712fd4a-9cfa-4937-99d1-3b98dfe8b23a could not be found. Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f712fd4a-9cfa-4937-99d1-3b98dfe8b23a could not be found. Aug 24 03:46:51.417921 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:51.421300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09ee2b95-267f-4b57-880c-2411ca3fc60f tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Returning 404 to user: Snapshot f712fd4a-9cfa-4937-99d1-3b98dfe8b23a could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:51.422120 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09ee2b95-267f-4b57-880c-2411ca3fc60f tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a" status: 404 len: 111 microversion: 2.1 time: 0.083999 Aug 24 03:46:51.423155 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1500/3122] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:51 2022] GET /compute/v2.1/os-snapshots/f712fd4a-9cfa-4937-99d1-3b98dfe8b23a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:51.431618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53f6494d-d1f9-44f9-91b5-416be43bbcee tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a75c160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:51.521973 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53f6494d-d1f9-44f9-91b5-416be43bbcee tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 202 len: 0 microversion: 2.1 time: 0.094368 Aug 24 03:46:51.523089 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1501/3123] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:46:51 2022] DELETE /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:46:51.532948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd0c32da-a60d-4035-8c1e-0b257c05fde1 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a75c4c0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:51.650241 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd0c32da-a60d-4035-8c1e-0b257c05fde1 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 200 len: 345 microversion: 2.1 time: 0.121825 Aug 24 03:46:51.660747 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1502/3124] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:46:51 2022] GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:51.834834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:51.863427 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b882dc3-4ca2-4280-a7ef-5aee2a270bf5 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.678642 Aug 24 03:46:51.866735 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1623/3125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:51 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:51.916462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:51.917105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:51.930351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:51.937099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:51.939153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:51.940618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:51.941312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:51.942207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.033705 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] HTTP exception thrown: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Request method failure captured: Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 HTTP/1.1 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ0xLdK7d3-C_hINWyWaN_baZu8zI1V9LTt_vTFULOKJM7Jzjn57-rmn1fwIBKj4qNu-1VxeRaqVe0DX7yXh6oP-U1YyJgpoRFfeRhL5tnKqPmnPxSVxCEFCStBVgpS_dEALzxFJkXbGRSiOEUQykK6mAotw6MflRcOA33tDVLkaYaA Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 7a9ef66358704edf814e8a1f0012e0c3 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 7a9ef66358704edf814e8a1f0012e0c3 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TaggedBootDevicesTest_v242-1059167772-project Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 27a98cafcc0e4f899bbed446fc4f0432 Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1059167772-project Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a85d3507-2b80-457f-a93e-c1c6810ef584'} Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:52.037968 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.043501 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.045853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Returning 404 to user: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:52.046797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-328d15fb-2faa-4fa3-a8bd-3eee353030ee tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 404 len: 111 microversion: 2.42 time: 0.134699 Aug 24 03:46:52.047375 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1503/3126] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:46:51 2022] DELETE /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:52.056736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:52.057783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] [instance: a85d3507-2b80-457f-a93e-c1c6810ef584] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:52.077251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:52.079569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:52.081015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.083290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:52.084724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:52.085684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.150673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:52.152015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:52.174084 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] HTTP exception thrown: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.178392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:52.184886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:52.185527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Request method failure captured: Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 HTTP/1.1 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ0xLdK7d3-C_hINWyWaN_baZu8zI1V9LTt_vTFULOKJM7Jzjn57-rmn1fwIBKj4qNu-1VxeRaqVe0DX7yXh6oP-U1YyJgpoRFfeRhL5tnKqPmnPxSVxCEFCStBVgpS_dEALzxFJkXbGRSiOEUQykK6mAotw6MflRcOA33tDVLkaYaA Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 7a9ef66358704edf814e8a1f0012e0c3 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a9ef66358704edf814e8a1f0012e0c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 7a9ef66358704edf814e8a1f0012e0c3 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1059167772 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TaggedBootDevicesTest_v242-1059167772-project Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 27a98cafcc0e4f899bbed446fc4f0432 Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1059167772-project Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a85d3507-2b80-457f-a93e-c1c6810ef584'} Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.186814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:52.192294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.192294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:52.192294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:52.192294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:52.192294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:52.192294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:52.192294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. Aug 24 03:46:52.192294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:52.193023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:52.193023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:52.193023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.193341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] Returning 404 to user: Instance a85d3507-2b80-457f-a93e-c1c6810ef584 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:52.194303 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da42a909-e101-45a6-abaa-4db1f04c0d77 tempest-TaggedBootDevicesTest_v242-1059167772 tempest-TaggedBootDevicesTest_v242-1059167772-project] 10.222.0.58 "GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584" status: 404 len: 111 microversion: 2.42 time: 0.139284 Aug 24 03:46:52.195034 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1624/3127] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:52 2022] GET /compute/v2.1/servers/a85d3507-2b80-457f-a93e-c1c6810ef584 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:46:52.350724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:52.352537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:52.376443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:52.378620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:52.382991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.385879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:52.389774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:52.390296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.444318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:52.461681 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c015e6fd-eeed-4ae9-86b2-9751b3fd8dcf tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1295 microversion: 2.1 time: 0.316352 Aug 24 03:46:52.462465 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1504/3128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:52 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1295 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:52.476805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:52.630866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:52.643185 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99723d0c-9fd1-4a65-a9b1-025ab29e9af6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 0.298246 Aug 24 03:46:52.656419 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1625/3129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:52 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:52.666912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72231dbe-7f9a-4e68-9432-1a3534c04b8d tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102a76c550>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:52.765976 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72231dbe-7f9a-4e68-9432-1a3534c04b8d tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 200 len: 345 microversion: 2.1 time: 0.103315 Aug 24 03:46:52.780515 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1505/3130] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:46:52 2022] GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:52.895441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:52.896157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:52.911516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:52.914591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:52.915030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.915888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:52.920376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:52.921296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:53.124396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:53.133492 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cba65d4f-de80-4080-b0f8-dc9aeede1128 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.243529 Aug 24 03:46:53.134120 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1626/3131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:52 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:53.431311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6dd48bf5-4e63-4db1-9d0c-6c536a2244c0 tempest-AZV2TestJSON-858535350 tempest-AZV2TestJSON-858535350-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:53.433114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd48bf5-4e63-4db1-9d0c-6c536a2244c0 tempest-AZV2TestJSON-858535350 tempest-AZV2TestJSON-858535350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:53.433646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd48bf5-4e63-4db1-9d0c-6c536a2244c0 tempest-AZV2TestJSON-858535350 tempest-AZV2TestJSON-858535350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:53.434107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd48bf5-4e63-4db1-9d0c-6c536a2244c0 tempest-AZV2TestJSON-858535350 tempest-AZV2TestJSON-858535350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:53.434866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd48bf5-4e63-4db1-9d0c-6c536a2244c0 tempest-AZV2TestJSON-858535350 tempest-AZV2TestJSON-858535350-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:53.435389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd48bf5-4e63-4db1-9d0c-6c536a2244c0 tempest-AZV2TestJSON-858535350 tempest-AZV2TestJSON-858535350-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:53.435878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd48bf5-4e63-4db1-9d0c-6c536a2244c0 tempest-AZV2TestJSON-858535350 tempest-AZV2TestJSON-858535350-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:53.474346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:53.509274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:53.513318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:53.525033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:53.529414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:53.531286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:53.533514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:53.536981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:53.538051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:53.552102 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6dd48bf5-4e63-4db1-9d0c-6c536a2244c0 tempest-AZV2TestJSON-858535350 tempest-AZV2TestJSON-858535350-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.448845 Aug 24 03:46:53.553099 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1506/3132] 10.222.0.58 () {58 vars in 1164 bytes} [Wed Aug 24 03:46:53 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:46:53.669518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:53.670624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:53.690400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:53.690928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:53.691371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:53.692133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:53.692589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:53.693014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.119089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:54.128992 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fb6084f4-a885-45b6-b7b6-9eab3a599505 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 0.638825 Aug 24 03:46:54.130330 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1627/3133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:53 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:54.136803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2c8a325b-8c5d-40b1-a2d1-aeef6de1ce7b req-e6b43426-9028-4bd3-bd4d-da09d4e161a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd33548-7ee6-48cf-aa74-2f649e35ee8c", "tag": "32814333-75ce-463c-8d1f-57a6b9fa2b8e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:54.149378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2c8a325b-8c5d-40b1-a2d1-aeef6de1ce7b req-e6b43426-9028-4bd3-bd4d-da09d4e161a2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.150537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2c8a325b-8c5d-40b1-a2d1-aeef6de1ce7b req-e6b43426-9028-4bd3-bd4d-da09d4e161a2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.151308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2c8a325b-8c5d-40b1-a2d1-aeef6de1ce7b req-e6b43426-9028-4bd3-bd4d-da09d4e161a2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.171537 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2c8a325b-8c5d-40b1-a2d1-aeef6de1ce7b req-e6b43426-9028-4bd3-bd4d-da09d4e161a2 service nova] Creating event network-changed:32814333-75ce-463c-8d1f-57a6b9fa2b8e for instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c on n-h1-846470-15 Aug 24 03:46:54.185708 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2c8a325b-8c5d-40b1-a2d1-aeef6de1ce7b req-e6b43426-9028-4bd3-bd4d-da09d4e161a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053714 Aug 24 03:46:54.186761 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1628/3134] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:54.203482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-26230929-7b35-468f-90be-0cf55f1a4b63 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f102265b9d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:54.311251 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-26230929-7b35-468f-90be-0cf55f1a4b63 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 200 len: 345 microversion: 2.1 time: 0.120079 Aug 24 03:46:54.322335 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1629/3135] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:46:54 2022] GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:54.337265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:54.347658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:54.366016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.374253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.377205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.377999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.378483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.378912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.532826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:54.549103 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f617e8db-6ca1-45ae-a410-67a850e59246 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 0.887242 Aug 24 03:46:54.555937 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1507/3136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:53 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:55.157968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:55.159199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:55.179897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:55.183474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:55.185263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.188353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:55.191778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:55.192455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.328361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:55.340287 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23ac41ea-fdce-4cdc-9602-8f1dadc87051 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 1.013208 Aug 24 03:46:55.340889 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1630/3137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:54 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:55.354690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b0f158e-017b-434a-9b9d-b5d2d2b6228f tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f1022f380d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:55.464134 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b0f158e-017b-434a-9b9d-b5d2d2b6228f tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 200 len: 345 microversion: 2.1 time: 0.112896 Aug 24 03:46:55.473424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1631/3138] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:46:55 2022] GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:55.577433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:55.578044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:55.604237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:55.607968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:55.611871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:55.613884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.614809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:55.616903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:55.619106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.906260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:55.947955 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02e1daa6-17b8-4bf4-a2ac-0786d9458711 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 0.794585 Aug 24 03:46:55.950026 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1508/3139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:55 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:56.158341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:56.169358 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f325f00b-dacb-42fd-9c9e-f3c58a7df1b3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 0.603255 Aug 24 03:46:56.185120 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1632/3140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:55 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:56.368340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:56.368969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:56.405199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:56.405698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:56.425599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:56.426947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:56.427783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:56.428245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:56.480368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ef57350-7682-49a8-b882-f0239a4e9ddb tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f10343a0dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:56.547053 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9ef57350-7682-49a8-b882-f0239a4e9ddb tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] HTTP exception thrown: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ef57350-7682-49a8-b882-f0239a4e9ddb tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Request method failure captured: Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e HTTP/1.1 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ8Xpu0Dn7tSmCXcX0xJDhHUOgHWqeLzNm1VN0-qDXgw97RaYqWQn6yGVeuHsY0Ye8aAi0E6qjRfDc7j8Mz_Tzro-cyTcEsuH1ogRtX3SH0T6EqMuar8vxrmS5wk5m6dynbsV_zJupp_SH2t7mXw2VbgX9LJKhdd7fH5YN8xrrvJCUo Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0b12b13c5613490ea4abc12582b3e5d5 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0b12b13c5613490ea4abc12582b3e5d5 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesSnapshotsTestJSON-817606877-project Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2c3f280b3df74d369b442277b095f5cd Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesSnapshotsTestJSON-817606877-project Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: exception: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8156a2c8-c5b1-4ef0-88cf-6fc84e11035e'} Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. (HTTP 404) (Request-ID: req-66c720b5-8721-408f-bbff-6311d275b90e) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:46:56.549377 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.554237 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.560268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ef57350-7682-49a8-b882-f0239a4e9ddb tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Returning 404 to user: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:56.560268 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ef57350-7682-49a8-b882-f0239a4e9ddb tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 404 len: 109 microversion: 2.1 time: 0.081862 Aug 24 03:46:56.560268 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1633/3141] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:46:56 2022] GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:46:56.577225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b49b51b-902b-47e0-a0e3-68bdc07aeb66 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f1022e70280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:56.660195 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6b49b51b-902b-47e0-a0e3-68bdc07aeb66 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] HTTP exception thrown: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b49b51b-902b-47e0-a0e3-68bdc07aeb66 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Request method failure captured: Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e HTTP/1.1 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ8Xpu0Dn7tSmCXcX0xJDhHUOgHWqeLzNm1VN0-qDXgw97RaYqWQn6yGVeuHsY0Ye8aAi0E6qjRfDc7j8Mz_Tzro-cyTcEsuH1ogRtX3SH0T6EqMuar8vxrmS5wk5m6dynbsV_zJupp_SH2t7mXw2VbgX9LJKhdd7fH5YN8xrrvJCUo Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0b12b13c5613490ea4abc12582b3e5d5 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0b12b13c5613490ea4abc12582b3e5d5 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesSnapshotsTestJSON-817606877-project Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2c3f280b3df74d369b442277b095f5cd Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesSnapshotsTestJSON-817606877-project Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: exception: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8156a2c8-c5b1-4ef0-88cf-6fc84e11035e'} Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. (HTTP 404) (Request-ID: req-5c28ae2e-c205-41fc-aa6e-9dcfa603ff83) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:46:56.662689 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.667776 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.678128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b49b51b-902b-47e0-a0e3-68bdc07aeb66 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Returning 404 to user: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:56.680634 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b49b51b-902b-47e0-a0e3-68bdc07aeb66 tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 404 len: 109 microversion: 2.1 time: 0.112851 Aug 24 03:46:56.684432 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1634/3142] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:46:56 2022] DELETE /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:46:56.693443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3f95900-a820-4a18-984d-c2c80ef08cab tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Calling method '.version_select at 0x7f10226518b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:56.741336 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c3f95900-a820-4a18-984d-c2c80ef08cab tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] HTTP exception thrown: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3f95900-a820-4a18-984d-c2c80ef08cab tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Request method failure captured: Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e HTTP/1.1 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ8Xpu0Dn7tSmCXcX0xJDhHUOgHWqeLzNm1VN0-qDXgw97RaYqWQn6yGVeuHsY0Ye8aAi0E6qjRfDc7j8Mz_Tzro-cyTcEsuH1ogRtX3SH0T6EqMuar8vxrmS5wk5m6dynbsV_zJupp_SH2t7mXw2VbgX9LJKhdd7fH5YN8xrrvJCUo Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0b12b13c5613490ea4abc12582b3e5d5 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b12b13c5613490ea4abc12582b3e5d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0b12b13c5613490ea4abc12582b3e5d5 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-817606877 Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesSnapshotsTestJSON-817606877-project Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 2c3f280b3df74d369b442277b095f5cd Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesSnapshotsTestJSON-817606877-project Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: exception: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8156a2c8-c5b1-4ef0-88cf-6fc84e11035e'} Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. (HTTP 404) (Request-ID: req-35ddd01d-a477-4aa5-bb09-298e7247d53a) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:46:56.743468 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3f95900-a820-4a18-984d-c2c80ef08cab tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] Returning 404 to user: Volume 8156a2c8-c5b1-4ef0-88cf-6fc84e11035e could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3f95900-a820-4a18-984d-c2c80ef08cab tempest-VolumesSnapshotsTestJSON-817606877 tempest-VolumesSnapshotsTestJSON-817606877-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e" status: 404 len: 109 microversion: 2.1 time: 0.057378 Aug 24 03:46:56.750816 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1635/3143] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:46:56 2022] GET /compute/v2.1/os-volumes/8156a2c8-c5b1-4ef0-88cf-6fc84e11035e => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:56.967354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:56.972696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:56.973262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:57.000949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:57.003731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:57.004473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:57.005317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:57.008960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:57.009454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:57.809306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:57.823242 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f31e6cc-c2ba-4c16-b123-18961c2b5fe7 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 0.856506 Aug 24 03:46:57.838868 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1636/3144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:56 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:57.852120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:57.853557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:57.871853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=20 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:57.874605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:57.878425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:57.879136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:57.881787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:57.882435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:57.886242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:58.274803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:58.302995 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-811969e6-5f79-4f51-89d3-8de50c3667f9 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 1.940627 Aug 24 03:46:58.304822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:58.324896 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1509/3145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:56 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:58.335934 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-446e1bc8-20aa-455c-bfbd-29f01885266e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 0.491225 Aug 24 03:46:58.337420 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1637/3146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:57 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:58.399441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-abc1dcca-aa45-466c-b1b4-b12579e2219d req-6420206c-1525-4f32-8bb3-1579c3874548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c716676e-7f28-467b-81a9-7fa48c4d622d", "tag": "05d20c3f-ba12-4443-98d9-f14bb070a81d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:58.428493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-abc1dcca-aa45-466c-b1b4-b12579e2219d req-6420206c-1525-4f32-8bb3-1579c3874548 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:58.428981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-abc1dcca-aa45-466c-b1b4-b12579e2219d req-6420206c-1525-4f32-8bb3-1579c3874548 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:58.429413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-abc1dcca-aa45-466c-b1b4-b12579e2219d req-6420206c-1525-4f32-8bb3-1579c3874548 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:58.469480 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-abc1dcca-aa45-466c-b1b4-b12579e2219d req-6420206c-1525-4f32-8bb3-1579c3874548 service nova] Creating event network-changed:05d20c3f-ba12-4443-98d9-f14bb070a81d for instance c716676e-7f28-467b-81a9-7fa48c4d622d on n-h1-846470-15 Aug 24 03:46:58.483761 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-abc1dcca-aa45-466c-b1b4-b12579e2219d req-6420206c-1525-4f32-8bb3-1579c3874548 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091191 Aug 24 03:46:58.485797 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1510/3147] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:58.848116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:58.849796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:58.893451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:58.895955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:58.898759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:58.902789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:58.903579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:58.905347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:59.341608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:59.346835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:59.358665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:59.359538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:59.360284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:59.361849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:59.362473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:59.363064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:59.982289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:00.007838 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e499f4ab-b9f2-450c-8c32-2ccd36e1d8a6 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 1.161728 Aug 24 03:47:00.026570 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1638/3148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:58 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:00.066044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:00.067544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:00.113935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:00.115337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:00.117095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:00.121180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:00.125454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:00.126166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:00.778622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:00.795478 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7f2c87e-b20e-4e79-a6a9-63c88c86f9c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 0.749902 Aug 24 03:47:00.796277 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1639/3149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:00 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:00.807959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f12def06-4bcc-41fa-846d-c1fe7b40ad39 req-9d05efd3-59fb-4f07-8a93-f641e73c0000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd33548-7ee6-48cf-aa74-2f649e35ee8c", "name": "network-vif-plugged", "status": "completed", "tag": "32814333-75ce-463c-8d1f-57a6b9fa2b8e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:00.830398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f12def06-4bcc-41fa-846d-c1fe7b40ad39 req-9d05efd3-59fb-4f07-8a93-f641e73c0000 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:00.844188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f12def06-4bcc-41fa-846d-c1fe7b40ad39 req-9d05efd3-59fb-4f07-8a93-f641e73c0000 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:00.844786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f12def06-4bcc-41fa-846d-c1fe7b40ad39 req-9d05efd3-59fb-4f07-8a93-f641e73c0000 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:00.875074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f12def06-4bcc-41fa-846d-c1fe7b40ad39 req-9d05efd3-59fb-4f07-8a93-f641e73c0000 service nova] Creating event network-vif-plugged:32814333-75ce-463c-8d1f-57a6b9fa2b8e for instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c on n-h1-846470-15 Aug 24 03:47:00.887738 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f12def06-4bcc-41fa-846d-c1fe7b40ad39 req-9d05efd3-59fb-4f07-8a93-f641e73c0000 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089007 Aug 24 03:47:00.888265 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1640/3150] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:00.904442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-51d9355d-9807-41e3-b279-5df80d3e4fb8 req-e5797237-ea59-448a-adc6-c4f0a67109cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255e7979-2c2b-44f3-83f0-0cd4c67ec7df", "name": "network-vif-unplugged", "status": "completed", "tag": "f7a851ab-2a51-4c7e-a577-12d55d0281f1"}, {"name": "network-changed", "server_uuid": "255e7979-2c2b-44f3-83f0-0cd4c67ec7df", "tag": "f7a851ab-2a51-4c7e-a577-12d55d0281f1"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:00.917155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-51d9355d-9807-41e3-b279-5df80d3e4fb8 req-e5797237-ea59-448a-adc6-c4f0a67109cc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:00.918021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-51d9355d-9807-41e3-b279-5df80d3e4fb8 req-e5797237-ea59-448a-adc6-c4f0a67109cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:00.918664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-51d9355d-9807-41e3-b279-5df80d3e4fb8 req-e5797237-ea59-448a-adc6-c4f0a67109cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:00.946062 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-51d9355d-9807-41e3-b279-5df80d3e4fb8 req-e5797237-ea59-448a-adc6-c4f0a67109cc service nova] Creating event network-vif-unplugged:f7a851ab-2a51-4c7e-a577-12d55d0281f1 for instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df on n-h2-846470-15 Aug 24 03:47:00.947884 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-51d9355d-9807-41e3-b279-5df80d3e4fb8 req-e5797237-ea59-448a-adc6-c4f0a67109cc service nova] Creating event network-changed:f7a851ab-2a51-4c7e-a577-12d55d0281f1 for instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df on n-h2-846470-15 Aug 24 03:47:00.965906 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-51d9355d-9807-41e3-b279-5df80d3e4fb8 req-e5797237-ea59-448a-adc6-c4f0a67109cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.073356 Aug 24 03:47:00.970920 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1641/3151] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:01.052123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:01.053815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:01.070897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.072226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.074828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.082052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.082732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.083197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.171830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:01.186560 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b0b8723f-3cb9-434c-b7ba-c4e191a752eb tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 1.852633 Aug 24 03:47:01.187765 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1511/3152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:59 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:01.825130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:01.825992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:01.840448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.841198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.843510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.844503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.847963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.848589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:02.653015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:02.668049 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ac045ee-8a67-4ca7-b64e-e39faf96ba66 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 0.847297 Aug 24 03:47:02.689628 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1512/3153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:01 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:02.703848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:02.718346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:02.727186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:02.727186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:02.728096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:02.730338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:02.734825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:02.735482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:03.214229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:03.230263 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eb09a3a0-8c74-4191-929d-ce13069da302 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.536105 Aug 24 03:47:03.234863 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1513/3154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:02 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:03.337377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:03.351706 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd73aa9b-c422-40f5-8e29-37deb4c8cde0 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 2.304082 Aug 24 03:47:03.354398 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1642/3155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:01 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:03.704581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:03.706538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:03.712662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:03.728204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:03.729573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:03.730191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:03.731165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:03.732146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:03.733071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:04.265415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:04.266697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:04.282413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:04.284393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:04.290535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:04.291715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:04.292492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:04.293220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:05.072226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:05.090342 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2e21f8c9-4bbd-4868-a7ae-5c1f37d67881 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 1.392479 Aug 24 03:47:05.114524 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1514/3156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:03 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:05.136563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:05.144758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:05.187720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:05.188247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:05.188704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:05.189456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:05.201526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:05.203382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:05.630914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:05.643317 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-987f3f0d-4e9d-4b2d-8181-86368d1d27ef tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 1.380032 Aug 24 03:47:05.647868 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1643/3157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:04 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:06.123211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:06.124009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:06.145153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:06.145723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:06.146173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:06.146917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:06.147415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:06.151359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:06.241215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:06.262532 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-83d97179-9cd1-4ccd-8de3-29e515f7ae0f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 1.142168 Aug 24 03:47:06.266984 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1515/3158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:05 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:06.669105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:06.669901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:06.688307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:06.689002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:06.689643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:06.690602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:06.693648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:06.694514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:07.264097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:07.276867 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e858c56d-7e85-424e-8456-3848910915dc tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.612633 Aug 24 03:47:07.277387 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1516/3159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:06 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:07.305463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:07.309680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:07.328635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:07.328959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:07.329521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:07.330370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:07.330984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:07.331469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:07.908205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:07.923767 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7838e8d1-ad4d-4cec-a15e-541567435b96 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1314 microversion: 2.1 time: 1.805978 Aug 24 03:47:07.925689 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1644/3160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:06 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1314 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:08.083805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:08.117490 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16818463-9213-4475-805c-627df6395048 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 0.834222 Aug 24 03:47:08.123174 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1517/3161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:07 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:08.305364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:08.306514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:08.328082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:08.328976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:08.331315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:08.334509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:08.336426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:08.338191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:08.896808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:08.928112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47a38dfc-51f3-4b2d-b396-e8caeba2a467 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.628461 Aug 24 03:47:08.934639 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1645/3162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:08 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:08.950141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:08.950925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:08.964712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:08.965826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:08.967077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:08.968081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:08.968669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:08.969190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:09.162503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:09.163578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:09.175745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:09.177647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:09.184886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:09.186172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:09.187020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:09.187834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:09.563968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:09.580502 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5174ca85-2477-4c01-987d-545eb55bb73d tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 0.422499 Aug 24 03:47:09.581119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1646/3163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:09 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:09.953417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:09.954086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:09.961568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:09.968051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:09.968946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:09.971735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:09.972453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:09.973065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:10.062408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:10.082009 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-00f7a5d7-3d3b-4cc3-b619-16f2fb06145a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1501 microversion: 2.1 time: 1.137651 Aug 24 03:47:10.112537 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1518/3164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:08 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1501 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:10.125276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-42fc7565-c672-4a5d-a771-d35b15ab15c7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:10.150581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42fc7565-c672-4a5d-a771-d35b15ab15c7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:10.151814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42fc7565-c672-4a5d-a771-d35b15ab15c7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:10.152639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42fc7565-c672-4a5d-a771-d35b15ab15c7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:10.213664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-42fc7565-c672-4a5d-a771-d35b15ab15c7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Going to try to stop instance {{(pid=122535) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:47:10.284247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-42fc7565-c672-4a5d-a771-d35b15ab15c7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c/action" status: 202 len: 0 microversion: 2.1 time: 0.169443 Aug 24 03:47:10.285616 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1519/3165] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:47:10 2022] POST /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:47:10.306816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:10.307821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:10.328120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:10.328910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:10.329546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:10.331776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:10.339189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:10.339925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:10.685871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:10.714995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ff845ee1-439e-417c-95f2-6e1fcb2196e6 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.765971 Aug 24 03:47:10.716266 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1647/3166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:09 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:10.738504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:10.741557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:10.766692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:10.768790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:10.769832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:10.771823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:10.774033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:10.776761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:11.406707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:11.431498 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-938bc024-adbe-4075-af35-8580fdd71679 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 1.137764 Aug 24 03:47:11.443800 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1520/3167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:10 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:11.456562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8f66dd5a-5ddd-4472-aa4e-8c3985156506 req-36c29e1f-00f1-46bb-beff-2615873c44dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c716676e-7f28-467b-81a9-7fa48c4d622d", "name": "network-vif-plugged", "status": "completed", "tag": "05d20c3f-ba12-4443-98d9-f14bb070a81d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:11.460507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:11.480223 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-982ef1f9-9933-4e37-9438-d82c90411910 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 0.762509 Aug 24 03:47:11.496860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8f66dd5a-5ddd-4472-aa4e-8c3985156506 req-36c29e1f-00f1-46bb-beff-2615873c44dd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:11.497509 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1648/3168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:10 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:11.497707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8f66dd5a-5ddd-4472-aa4e-8c3985156506 req-36c29e1f-00f1-46bb-beff-2615873c44dd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:11.506251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8f66dd5a-5ddd-4472-aa4e-8c3985156506 req-36c29e1f-00f1-46bb-beff-2615873c44dd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:11.552181 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8f66dd5a-5ddd-4472-aa4e-8c3985156506 req-36c29e1f-00f1-46bb-beff-2615873c44dd service nova] Creating event network-vif-plugged:05d20c3f-ba12-4443-98d9-f14bb070a81d for instance c716676e-7f28-467b-81a9-7fa48c4d622d on n-h1-846470-15 Aug 24 03:47:11.563420 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8f66dd5a-5ddd-4472-aa4e-8c3985156506 req-36c29e1f-00f1-46bb-beff-2615873c44dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118098 Aug 24 03:47:11.564735 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1521/3169] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:11.755613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:11.767247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:11.779026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:11.781586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:11.782095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:11.782870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:11.783360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:11.783824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:11.798943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:12.305510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:12.317064 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-905b461f-d5de-4200-961e-478ef25e7c0a tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 0.569061 Aug 24 03:47:12.318407 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1649/3170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:11 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:12.469647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:12.470847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:12.495424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=59 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:12.504147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:12.511629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:12.512892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:12.521328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:12.521797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:12.526106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:12.528209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:12.528683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:12.534439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:12.535061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:12.535499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:12.536284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:12.538007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:12.541290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:12.900809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:12.912494 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-02771bc7-33ef-4369-9df1-03c9fd2064d3 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1362 microversion: 2.1 time: 0.405217 Aug 24 03:47:12.916211 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1650/3171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:12 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:13.257698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-146543366", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "f30af055-aca5-4fda-9609-37ddbefb7665"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:13.397582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] validate_networks() for [('f30af055-aca5-4fda-9609-37ddbefb7665', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:47:13.496556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:13.506331 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-95f2a526-9e48-4518-bcd0-2186b8a3f219 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 1.045127 Aug 24 03:47:13.525076 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1522/3172] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:12 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:13.539440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:13.553279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:13.570081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:13.579119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:13.583199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:13.584648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:13.586722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:13.587386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.466002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:47:14.470841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:47:14.471600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:47:14.472661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:47:14.474133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:47:14.506364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:14.507755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:14.510528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.514198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:14.517022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:14.518437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.556251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Getting quotas for project 6587f65fd57a4f63805ea7073c326e12. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:47:14.566943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Getting quotas for user cdf1db24596847a388ac2ceb69c90e60 and project 6587f65fd57a4f63805ea7073c326e12. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:47:14.605463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:47:14.608033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:47:14.723730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5797741b-d5cb-47be-b361-760c6e924e7b tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805590 Aug 24 03:47:14.732569 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1651/3173] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:47:14.738524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:14.740021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:14.748354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:14.749264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:14.749939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.750944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:14.752170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:14.753244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.931794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:14.936819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:14.956634 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b4cd4bc-79de-46d7-b370-1ae3f11f4420 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 1.428884 Aug 24 03:47:14.959086 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1523/3174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:13 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:14.979959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:14.988140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:15.024390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.026142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.032343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.033699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.034558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.035513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.201656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:15.213672 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c884982b-3013-40ad-9c80-b20f1be3026b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1548 microversion: 2.1 time: 0.477117 Aug 24 03:47:15.217901 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1652/3175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:14 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1548 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:15.223026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-13edc281-953c-4dd6-980f-e85215a10e24 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:15.236009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-13edc281-953c-4dd6-980f-e85215a10e24 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:15.495450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-13edc281-953c-4dd6-980f-e85215a10e24 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:15.513401 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-13edc281-953c-4dd6-980f-e85215a10e24 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1216 microversion: 2.1 time: 0.294016 Aug 24 03:47:15.516763 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1653/3176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:15 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1216 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:15.527722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:15.528256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:15.566107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.568569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.579375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.580453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.581084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.581627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:16.004611 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-551cb3a5-a946-41f4-9b9c-74afb6fcfb51 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.480943 Aug 24 03:47:16.018860 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1654/3177] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:47:15 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-interface => generated 285 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:16.020020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:16.029461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:16.030435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:16.058109 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be0871fb-dca0-4618-b8d4-94204cb16e43 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 1.078687 Aug 24 03:47:16.058109 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1524/3178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:14 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:16.090695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:16.091286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:16.094666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:16.098253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:16.099207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:16.101002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:16.540776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:16.543790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:16.554712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:16.555563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:16.556239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:16.559831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:16.560609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:16.561882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:16.917900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:16.936214 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-25b54d4c-3a64-42c4-b8f5-1607432fc688 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1268 microversion: 2.1 time: 0.396610 Aug 24 03:47:16.937162 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1525/3179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:16 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1268 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:17.095446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:17.096842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:17.110400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:17.112845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:17.113620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:17.116403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:17.117496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:17.118504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:17.684027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:17.701336 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c132e292-7024-4830-8baf-982a4f2e2e27 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1391 microversion: 2.1 time: 1.677812 Aug 24 03:47:17.702621 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1655/3180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:16 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1391 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:17.985200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:17.985843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:17.997543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:17.997543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:17.998031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:17.998788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:17.999359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:17.999709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:18.600313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:18.613671 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42131e5d-61f1-43c4-9963-01451ecddf53 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1274 microversion: 2.1 time: 0.649116 Aug 24 03:47:18.631713 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1656/3181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:17 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1274 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:18.729375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:18.730227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:18.746536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:18.757581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24b5642e-3865-4d0e-94e3-cabb26ce7e99 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 1.667439 Aug 24 03:47:18.763464 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1526/3182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:17 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:18.770283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:18.771064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:18.771690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:18.772591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:18.775112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:18.775866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.349701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:19.360671 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb8e2722-8fe1-42a1-a608-c85c6aa7fa3e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1381 microversion: 2.1 time: 0.635826 Aug 24 03:47:19.371707 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1657/3183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:18 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1381 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:19.387013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93dda677-b192-49ae-8170-eb553fb898b8 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '.version_select at 0x7f102a7ba310>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:19.391903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93dda677-b192-49ae-8170-eb553fb898b8 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.392435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93dda677-b192-49ae-8170-eb553fb898b8 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.393046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93dda677-b192-49ae-8170-eb553fb898b8 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.404251 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-93dda677-b192-49ae-8170-eb553fb898b8 tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.022489 Aug 24 03:47:19.405297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1527/3184] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:47:19 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:19.419749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:19.420790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:19.428142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.429052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.429727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.430705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.431550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.432281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.651918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:19.653155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:19.663759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.667778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.668929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.670346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.673950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.675143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.796588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:19.809605 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5ad0984f-3887-4a5b-b583-ede2a499aa9c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1274 microversion: 2.1 time: 0.164199 Aug 24 03:47:19.810687 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1528/3185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:19 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:19.816689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:19.817923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:19.827499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.829042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.829610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.830584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.831428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.832156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:20.381905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:20.394774 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88f1bf91-f58a-4fcb-9a7c-a01b0c0fcc72 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 0.582548 Aug 24 03:47:20.395928 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1529/3186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:19 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:20.445182 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96c89b01-5054-448c-a0e6-050315a3370b tempest-LiveMigrationTest-930558194 tempest-LiveMigrationTest-930558194-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1534 microversion: 2.1 time: 1.030202 Aug 24 03:47:20.445792 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1658/3187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:19 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1534 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:20.482153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:20.482799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:20.531855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:20.532589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:20.533245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:20.534477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:20.535107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:20.535874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:20.597986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:47:20.770241 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-189a4e80-7ce3-4925-b427-0756cb728997 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "DELETE /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 204 len: 0 microversion: 2.1 time: 0.293321 Aug 24 03:47:20.772079 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1530/3188] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:47:20 2022] DELETE /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:47:20.782712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:20.783654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:20.794681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:20.795827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:20.796610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:20.798178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:20.798913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:20.799572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:20.839526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:20.840258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:20.852980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:20.854169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:20.854741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:20.855596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:20.856360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:20.857650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:21.469644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:21.490368 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07dd4e8a-176d-4a16-9b73-73b5abea4d37 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 0.656174 Aug 24 03:47:21.493810 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1531/3189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:20 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:21.506950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:21.508430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:21.525309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:21.528012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:21.529250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:21.531180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:21.532747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:21.533934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:21.595587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:21.610955 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d6836ffb-643c-4781-b288-c427b1e60e69 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1387 microversion: 2.1 time: 0.834431 Aug 24 03:47:21.612012 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1659/3190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:20 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1387 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:22.015333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2feba59b-91d2-4446-9b54-2ae63ee29096 req-a474a6b4-b6f3-4450-9ab7-98945884b59e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c716676e-7f28-467b-81a9-7fa48c4d622d", "tag": "05d20c3f-ba12-4443-98d9-f14bb070a81d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:22.037431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2feba59b-91d2-4446-9b54-2ae63ee29096 req-a474a6b4-b6f3-4450-9ab7-98945884b59e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:22.038157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2feba59b-91d2-4446-9b54-2ae63ee29096 req-a474a6b4-b6f3-4450-9ab7-98945884b59e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:22.038786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2feba59b-91d2-4446-9b54-2ae63ee29096 req-a474a6b4-b6f3-4450-9ab7-98945884b59e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:22.056180 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2feba59b-91d2-4446-9b54-2ae63ee29096 req-a474a6b4-b6f3-4450-9ab7-98945884b59e service nova] Creating event network-changed:05d20c3f-ba12-4443-98d9-f14bb070a81d for instance c716676e-7f28-467b-81a9-7fa48c4d622d on n-h1-846470-15 Aug 24 03:47:22.063498 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2feba59b-91d2-4446-9b54-2ae63ee29096 req-a474a6b4-b6f3-4450-9ab7-98945884b59e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.450088 Aug 24 03:47:22.064988 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1660/3191] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:22.299481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:22.316525 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8c636b9c-c0e1-437b-abba-ea174d407c9c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 0.820392 Aug 24 03:47:22.317129 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1532/3192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:21 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:22.527248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:22.528736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:22.543713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:22.546070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:22.546643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:22.548784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:22.551247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:22.551763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:22.638033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:22.638814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:22.654085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:22.661157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:22.662800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:22.664790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:22.667342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:22.668309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:23.242248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:23.260747 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d24a87fb-8e5a-4a8e-b841-5a64b4329cc9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 0.741096 Aug 24 03:47:23.261335 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1661/3193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:22 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:23.349903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:23.350940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:23.358424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:23.359315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:23.360043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:23.361001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:23.361872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:23.362569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:23.885618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:23.942563 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a8a1c3d9-9126-4c97-bad0-3cc4cce2eba1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 0.593596 Aug 24 03:47:23.946060 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1662/3194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:23 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:24.195211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:24.218228 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eda4d432-92d1-4f83-b0f3-e5cde258a4ff tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1387 microversion: 2.1 time: 1.577966 Aug 24 03:47:24.218835 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1533/3195] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:22 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1387 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:24.286138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:24.286656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:24.301620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:24.302471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:24.304831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:24.305562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:24.306020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:24.306564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:24.378921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cffa9b5e-e3d3-48e2-9e99-702098640035 req-c3c286e8-4d6a-4bb9-8ac1-e526e9232265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b259dfe8-1af8-4b5d-82c2-aa4eed63b69b", "tag": "2b048e59-b443-419b-8e47-0ddb91fffc3f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:24.406327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cffa9b5e-e3d3-48e2-9e99-702098640035 req-c3c286e8-4d6a-4bb9-8ac1-e526e9232265 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:24.407060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cffa9b5e-e3d3-48e2-9e99-702098640035 req-c3c286e8-4d6a-4bb9-8ac1-e526e9232265 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:24.414428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cffa9b5e-e3d3-48e2-9e99-702098640035 req-c3c286e8-4d6a-4bb9-8ac1-e526e9232265 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:24.443105 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cffa9b5e-e3d3-48e2-9e99-702098640035 req-c3c286e8-4d6a-4bb9-8ac1-e526e9232265 service nova] Creating event network-changed:2b048e59-b443-419b-8e47-0ddb91fffc3f for instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b on n-h2-846470-15 Aug 24 03:47:24.468307 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cffa9b5e-e3d3-48e2-9e99-702098640035 req-c3c286e8-4d6a-4bb9-8ac1-e526e9232265 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090042 Aug 24 03:47:24.468988 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1534/3196] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:24.540396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:24.934495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:24.943439 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-35cebfbf-5269-4d39-a41b-98bebcd743ca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 0.661453 Aug 24 03:47:24.948759 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1663/3197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:24 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:24.968170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:24.969178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:24.980352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:24.982977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:24.983813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:24.984923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:24.986726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:24.988313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:25.247081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:25.247916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:25.260282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:25.260787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:25.261251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:25.261988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:25.262451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:25.264666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:25.471079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:25.486389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af2fa642-920a-40a5-a1c0-d998b6f5793e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 0.525012 Aug 24 03:47:25.487557 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1535/3198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:24 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:25.500409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:25.518521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:25.532638 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8507003e-ded9-4047-8a4a-19da8252de93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1183 microversion: 2.1 time: 0.289848 Aug 24 03:47:25.536182 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1664/3199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:25 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:25.976659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:25.977299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:25.988286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:25.988790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:25.995179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:25.996081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:25.996576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:25.997021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:26.241845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:26.251903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-46731922-25ee-4a88-8f42-44f896593125 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 0.281638 Aug 24 03:47:26.256442 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1536/3200] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:25 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:26.519891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:26.522172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:26.523384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fe040e8c-e6ae-41b0-b6d0-90898d226e5a req-e870646b-b198-43f5-9f71-030a5c947cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255e7979-2c2b-44f3-83f0-0cd4c67ec7df", "name": "network-vif-deleted", "tag": "f7a851ab-2a51-4c7e-a577-12d55d0281f1"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:26.532630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:26.535778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:26.543755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:26.545392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:26.546869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:26.547614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:26.548634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:26.562619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe040e8c-e6ae-41b0-b6d0-90898d226e5a req-e870646b-b198-43f5-9f71-030a5c947cd2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:26.563439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe040e8c-e6ae-41b0-b6d0-90898d226e5a req-e870646b-b198-43f5-9f71-030a5c947cd2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:26.564197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe040e8c-e6ae-41b0-b6d0-90898d226e5a req-e870646b-b198-43f5-9f71-030a5c947cd2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:26.605627 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fe040e8c-e6ae-41b0-b6d0-90898d226e5a req-e870646b-b198-43f5-9f71-030a5c947cd2 service nova] Creating event network-vif-deleted:f7a851ab-2a51-4c7e-a577-12d55d0281f1 for instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df on n-h1-846470-15 Aug 24 03:47:26.625644 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fe040e8c-e6ae-41b0-b6d0-90898d226e5a req-e870646b-b198-43f5-9f71-030a5c947cd2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104568 Aug 24 03:47:26.627741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1537/3201] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:26.646711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:26.648617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:26.671560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:26.673111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:26.674052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:26.677623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:26.702791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:26.703546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:26.841956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:26.856148 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d5e3ed1d-53ff-4930-a4f7-1ecfe1d6d889 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1183 microversion: 2.1 time: 0.222897 Aug 24 03:47:26.857121 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1538/3202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:26 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:27.218122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:27.233775 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f895275f-7ad6-4bd8-8795-b648398222e3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 0.722451 Aug 24 03:47:27.251236 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1665/3203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:26 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:27.278347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:27.279775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:27.294654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:27.295164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:27.295608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:27.301815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:27.302661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:27.305071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:27.888167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:27.890369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:27.909049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:27.912121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:27.913357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:27.916074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:27.916747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:27.918920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:27.972481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:28.002416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1af1b576-cf73-4e7c-96f4-d2fa6a821e47 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 0.720776 Aug 24 03:47:28.003104 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1539/3204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:27 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:28.104568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:28.122187 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d28173ca-82ee-4e9e-96db-42365dd41429 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1183 microversion: 2.1 time: 0.244848 Aug 24 03:47:28.125134 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1666/3205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:27 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:28.266352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:28.269712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:28.290681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:28.291765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:28.292524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:28.293321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:28.294068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:28.294817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:28.979768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:28.985604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:29.000974 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-749a9e0b-110f-4130-9226-2492adca6274 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 0.738844 Aug 24 03:47:29.002130 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1540/3206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:28 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:29.028166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:29.028913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:29.043064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:29.043561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:29.048329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:29.049284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:29.049752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:29.050191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:29.152337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:29.153306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:29.169207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:29.172862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:29.174596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:29.177109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:29.178724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:29.180765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:29.335590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:29.348316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:29.352310 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06042f54-e169-42b1-94dc-129fbb15b888 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1183 microversion: 2.1 time: 0.208188 Aug 24 03:47:29.358445 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1541/3207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:29 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:29.362112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4460ea60-76ec-45b0-970b-9e97950aaccf tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 0.338326 Aug 24 03:47:29.364025 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1667/3208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:29 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:30.023227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:30.024502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:30.042854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:30.044102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:30.046786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:30.050132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:30.051430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:30.053037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:30.381272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:30.383184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:30.402889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:30.403513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:30.404368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:30.407023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:30.409439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:30.412857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:30.479223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:30.480167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:30.496984 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5cf1dad9-bf96-45bb-ac27-844330ad08db tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 0.476353 Aug 24 03:47:30.499970 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1542/3209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:30 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:30.510468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:30.524366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:30.547415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:30.548821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:30.552987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:30.555111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:30.559568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:30.561493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:30.714745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:30.733021 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10437045-5bc4-4cd4-907e-003ac509aa79 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1183 microversion: 2.1 time: 0.355323 Aug 24 03:47:30.748432 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1668/3210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:30 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:30.921806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:31.012486 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0ff7cb2c-fcb7-42a3-b284-5dc8bf533e0f tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 0.493402 Aug 24 03:47:31.014578 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1543/3211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:30 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:31.519258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:31.520588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:31.533060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:31.535788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:31.536492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:31.538377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:31.539067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:31.540843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:31.767111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:31.768054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:31.784720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:31.785383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:31.785913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:31.786751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:31.787399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:31.787989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:31.944394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:31.959915 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b1507aa2-42bd-468d-abbe-1cb9bb835e40 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 200 len: 1183 microversion: 2.1 time: 0.198961 Aug 24 03:47:31.960978 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1544/3212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:31 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 1183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:32.313633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2131883169", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "0c7aa778-b4c1-42e2-8a1c-f56868d96a21"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:32.422647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] validate_networks() for [('0c7aa778-b4c1-42e2-8a1c-f56868d96a21', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:47:32.854286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:32.876262 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bccdfe0e-4cd5-4fd5-8d94-389a701f2a27 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 1.361041 Aug 24 03:47:32.876903 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1669/3213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:31 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:32.899309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:32.907214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:32.932218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:32.934014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:32.935515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:32.938424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:32.940571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:32.945376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:33.412625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:47:33.413716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:47:33.414358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:47:33.414774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:47:33.415266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:47:33.430946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:33.431853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:33.432631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:33.433541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:33.434341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:33.434946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:33.463850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Getting quotas for project a69908c03ba742b7a50d7e9c955e12ff. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:47:33.470462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Getting quotas for user 1321ec33efd14167a53103c6b5b96088 and project a69908c03ba742b7a50d7e9c955e12ff. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:47:33.496387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:47:33.499545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:47:33.569426 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-39f4fd85-d410-4df5-91af-f1dded212777 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560004 Aug 24 03:47:33.585467 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1545/3214] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:47:33.592797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:33.593951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 255e7979-2c2b-44f3-83f0-0cd4c67ec7df] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:33.604767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:33.605618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:33.606365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:33.607319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:33.608092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:33.623896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:33.641676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:33.654228 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-68713503-22ad-4ed1-ae7a-3d818a6f1fd9 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 0.772851 Aug 24 03:47:33.654820 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1670/3215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:32 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:33.673658 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] HTTP exception thrown: Instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df could not be found. Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Request method failure captured: Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df HTTP/1.1 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1S2IWZ0NTS5RFvBC_FL9gtr1JffCzLJkxmPTt451Z7ARgdij-LakevwDa7PH0DQ0ymjcr47x7O9eTODrIdH5YZDuYsj5IVK4-6Oa5XoBUQ_NawtWzlNC6SBPcb3OeVVVmykmyhIcjmyHI8sq8C1U4CDaARQNrJdqsI8PQPYP2nEdM Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 159a3e9d888c49c78cf8ad328a1cdfd2 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-LiveMigrationTest-374128082 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-LiveMigrationTest-374128082 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 159a3e9d888c49c78cf8ad328a1cdfd2 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-LiveMigrationTest-374128082 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-LiveMigrationTest-374128082-project Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 73ddcba828514d1882d2cd02d357bef8 Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-LiveMigrationTest-374128082-project Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df could not be found. Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '255e7979-2c2b-44f3-83f0-0cd4c67ec7df'} Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df could not be found. Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df could not be found. Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:47:33.681842 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:33.687290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:33.687290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:47:33.687290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:47:33.687290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:47:33.687290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:47:33.687290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df could not be found. Aug 24 03:47:33.687290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:33.689685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Returning 404 to user: Instance 255e7979-2c2b-44f3-83f0-0cd4c67ec7df could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:47:33.690990 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-29358c4a-fa92-4fa4-a4bf-26d58a3d6d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df" status: 404 len: 111 microversion: 2.1 time: 0.103820 Aug 24 03:47:33.693655 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1546/3216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:33 2022] GET /compute/v2.1/servers/255e7979-2c2b-44f3-83f0-0cd4c67ec7df => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:47:33.824103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-864959264", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "0c7aa778-b4c1-42e2-8a1c-f56868d96a21"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:33.901250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:33.902143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:33.923932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:33.927621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:33.929111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:33.932791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:33.936984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:33.938810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:34.015573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] validate_networks() for [('0c7aa778-b4c1-42e2-8a1c-f56868d96a21', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:47:35.052647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:35.061651 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aba15932-067b-4967-af87-6333679e868c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 1.164953 Aug 24 03:47:35.087734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1547/3217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:33 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:35.096626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:35.105634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:35.130366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.131257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.131974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:35.132904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.144004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.144814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:35.552501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:47:35.554060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:47:35.555101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:47:35.555797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:47:35.556811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:47:35.609021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.610249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.614319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:35.619162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.620555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.621823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:35.709741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Getting quotas for project a69908c03ba742b7a50d7e9c955e12ff. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:47:35.733423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Getting quotas for user 1321ec33efd14167a53103c6b5b96088 and project a69908c03ba742b7a50d7e9c955e12ff. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:47:35.805726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:47:35.813331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:47:36.052778 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48c120dc-f767-46f9-81f6-8104fb85e795 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.236022 Aug 24 03:47:36.059771 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1671/3218] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:47:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:47:36.095318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:36.096343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:36.128148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:36.143233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:36.150810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:36.151738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:36.152254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:36.152704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:37.080032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:37.081133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:37.090466 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49fe05dc-5f16-4066-87c5-7a113edfaa31 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 2.001171 Aug 24 03:47:37.095795 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90e6074a-7a22-4669-9771-13b31d25ed3f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 1.007512 Aug 24 03:47:37.097637 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1672/3219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:36 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:37.100037 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1548/3220] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:35 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:37.103488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-245641644", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "451", "networks": [{"uuid": "0c7aa778-b4c1-42e2-8a1c-f56868d96a21"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:37.107144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f1004fb7-d779-472b-aaa4-73a3db33a2d6 req-48dc33a0-96be-4603-a8db-eac49e5fd2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b259dfe8-1af8-4b5d-82c2-aa4eed63b69b", "name": "network-vif-plugged", "status": "completed", "tag": "2b048e59-b443-419b-8e47-0ddb91fffc3f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:37.156777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f1004fb7-d779-472b-aaa4-73a3db33a2d6 req-48dc33a0-96be-4603-a8db-eac49e5fd2b4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:37.157761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f1004fb7-d779-472b-aaa4-73a3db33a2d6 req-48dc33a0-96be-4603-a8db-eac49e5fd2b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:37.161838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f1004fb7-d779-472b-aaa4-73a3db33a2d6 req-48dc33a0-96be-4603-a8db-eac49e5fd2b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:37.207897 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f1004fb7-d779-472b-aaa4-73a3db33a2d6 req-48dc33a0-96be-4603-a8db-eac49e5fd2b4 service nova] Creating event network-vif-plugged:2b048e59-b443-419b-8e47-0ddb91fffc3f for instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b on n-h2-846470-15 Aug 24 03:47:37.215378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] validate_networks() for [('0c7aa778-b4c1-42e2-8a1c-f56868d96a21', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:47:37.223375 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f1004fb7-d779-472b-aaa4-73a3db33a2d6 req-48dc33a0-96be-4603-a8db-eac49e5fd2b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121373 Aug 24 03:47:37.224208 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1549/3221] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:38.111585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:38.112564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:38.124766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:38.125251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:38.128418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:38.129338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:38.132938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:38.133659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:38.595645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:47:38.596641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:47:38.597921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:47:38.599500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:47:38.600447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:47:38.649200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:38.651374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:38.653029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:38.657192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:38.659549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:38.661763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:38.710139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Getting quotas for project a69908c03ba742b7a50d7e9c955e12ff. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:47:38.720914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Getting quotas for user 1321ec33efd14167a53103c6b5b96088 and project a69908c03ba742b7a50d7e9c955e12ff. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:47:38.757022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:47:38.789492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:47:38.974803 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d572af2-3453-4c5b-a6c1-f6334749ae3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875454 Aug 24 03:47:38.980663 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1673/3222] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:47:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:47:39.003545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:39.008707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:39.030798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:39.031560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:39.032211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:39.033091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:39.036702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:39.037358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:39.492537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:39.518555 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26d415de-9bce-4927-b3c8-b97ee6620dd8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1316 microversion: 2.1 time: 1.410094 Aug 24 03:47:39.523603 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1550/3223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:38 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1316 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:39.544023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53434ac4-3948-4cc9-94f0-ce690d326c56 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:39.549417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-53434ac4-3948-4cc9-94f0-ce690d326c56 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:39.595034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:39.610450 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c80ad24-64ed-4b81-9d2d-958a80e82c85 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 0.628150 Aug 24 03:47:39.616605 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1674/3224] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:38 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:40.001733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-53434ac4-3948-4cc9-94f0-ce690d326c56 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:40.011232 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53434ac4-3948-4cc9-94f0-ce690d326c56 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1220 microversion: 2.1 time: 0.486364 Aug 24 03:47:40.025325 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1551/3225] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:39 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1220 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:40.559820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:40.560446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:40.585079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:40.585586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:40.586027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:40.586760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:40.587243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:40.587699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:40.640891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:40.641520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:40.663198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:40.663737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:40.664220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:40.665078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:40.665706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:40.666148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.116452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:41.136272 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66ac44cc-ef2e-4490-83c6-2b879fe975d4 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1505 microversion: 2.1 time: 0.588934 Aug 24 03:47:41.153113 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1675/3226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:40 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:41.167918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:41.168986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:41.189684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.190207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.190656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.191389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.196311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.197415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.373641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:41.385263 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24bde2ef-54a2-4a2a-83fb-a97212b7368b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1272 microversion: 2.1 time: 0.230614 Aug 24 03:47:41.385858 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1676/3227] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:41 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:41.400753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:41.403626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:41.434972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.436204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.436661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.437375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.437834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.438253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.549252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:41.550338 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c2c2973-167a-44cc-813b-5e7c1d62f099 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b/os-instance-actions/req-5797741b-d5cb-47be-b361-760c6e924e7b" status: 200 len: 313 microversion: 2.1 time: 0.163509 Aug 24 03:47:41.556183 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1677/3228] 10.222.0.58 () {58 vars in 1419 bytes} [Wed Aug 24 03:47:41 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b/os-instance-actions/req-5797741b-d5cb-47be-b361-760c6e924e7b => generated 313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:41.564945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:41.567347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:41.601412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.601824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.602258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.603013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.603556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.620289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.744550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:41.759476 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e32adfec-2ce5-41fc-aef6-22059737d9ad tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1511 microversion: 2.1 time: 1.120812 Aug 24 03:47:41.760576 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1552/3229] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:40 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1511 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:41.799455 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-059d5279-bb42-4707-96b6-36bc82a7b0c8 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "POST /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b/action" status: 202 len: 0 microversion: 2.1 time: 0.238213 Aug 24 03:47:41.821312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1678/3230] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:47:41 2022] POST /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:47:41.829307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:41.830641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:41.842076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.843218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.844112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.845236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.846050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.846768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.910196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:41.910787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:41.923494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.924270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.929010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.930065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.930696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.931438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.015784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:47:42.201210 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60bf6314-1edd-414e-88ee-65085cccc37c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 204 len: 0 microversion: 2.1 time: 0.294709 Aug 24 03:47:42.203002 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1679/3231] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:47:41 2022] DELETE /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:47:42.215581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:42.216565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:42.234245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:42.236836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:42.245634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.247091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:42.250091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:42.250563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.644800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:42.654893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:42.658988 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0b4fd08e-6328-442e-bdf2-2f68d3210520 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1668 microversion: 2.1 time: 0.451639 Aug 24 03:47:42.663844 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1680/3232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:42 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1668 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:42.667319 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-39ad52be-1c6d-4a75-b641-b4c50ea6ecf6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1507 microversion: 2.1 time: 0.844238 Aug 24 03:47:42.669734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:42.681965 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1553/3233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:41 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1507 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:42.684785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:42.770352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:42.783722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:42.784692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:42.784877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:42.785051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.785704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:42.786301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:42.786911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.792381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:42.801253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:42.801863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:42.804540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.806292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:42.808380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:42.810731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.890807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:42.904383 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93312ba7-5b57-40a9-9a3f-6f17805845b8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1278 microversion: 2.1 time: 0.243050 Aug 24 03:47:42.905006 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1681/3234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:42 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:43.444176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:43.456380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:43.472469 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-21c87480-da90-49dd-8161-0f5ecbb6155e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1488 microversion: 2.1 time: 0.694209 Aug 24 03:47:43.473074 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1554/3235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:42 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1488 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:43.508574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:43.511754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:43.533534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:43.533734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:43.535003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:43.536169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:43.539084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:43.541760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:43.666971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:47:43.692539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:43.693549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:43.720710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:43.721494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:43.722483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:43.724047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:43.735272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:43.736596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:43.803875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:43.931658 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-82447a3b-8e71-4c53-b5a7-9685562ff705 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 204 len: 0 microversion: 2.1 time: 0.439810 Aug 24 03:47:43.932378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1682/3236] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:47:43 2022] DELETE /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:47:43.938171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:43.939025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:43.946280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:43.947029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:43.947733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:43.948547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:43.949441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:43.950465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.347023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:44.364331 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0639cff-044f-4b85-bff5-7bcf18f97fca tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1507 microversion: 2.1 time: 0.430377 Aug 24 03:47:44.375750 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1683/3237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:43 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:44.386307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:44.391184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:44.406114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:44.408283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:44.409841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.411298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:44.412436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:44.413333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.898097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:44.939051 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-872cc8f7-8ad0-47ec-8d7e-375a237c0500 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1320 microversion: 2.1 time: 0.571317 Aug 24 03:47:44.939679 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1684/3238] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:44 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1320 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:44.969783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:44.977468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:45.000054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:45.000846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:45.001464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:45.002372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:45.003013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:45.003815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:45.317861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:45.330136 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5f21b399-b5bf-46b2-838f-ef1563986c00 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1668 microversion: 2.1 time: 1.647942 Aug 24 03:47:45.330747 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1555/3239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:43 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1668 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:45.387049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:45.387707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:45.400989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:45.401417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:45.401868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:45.402673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:45.405474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:45.406183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:45.409044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:45.426886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-984d43ef-ea22-48c9-a71f-c59b08ae6814 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1494 microversion: 2.1 time: 0.469499 Aug 24 03:47:45.429241 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1685/3240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:44 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1494 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:45.964471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:45.965907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:45.979911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:45.980390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:45.980839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:45.981691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:45.981992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:45.982455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.267859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:46.280850 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-40de5c1f-8871-4f3b-a0eb-175e3441e05d tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1512 microversion: 2.1 time: 0.897940 Aug 24 03:47:46.282302 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1556/3241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:45 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1512 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:46.291071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e895a2f5-c77c-44e4-a342-dea9b3351009 req-ae346e91-7e2e-4279-944d-05b66d038c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d362ddfc-9185-45a6-b23b-b2a8e4049bd1", "tag": "75b13e9b-2b50-423b-b7b5-acfac31fcf8e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:46.305764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e895a2f5-c77c-44e4-a342-dea9b3351009 req-ae346e91-7e2e-4279-944d-05b66d038c81 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.307189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e895a2f5-c77c-44e4-a342-dea9b3351009 req-ae346e91-7e2e-4279-944d-05b66d038c81 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.308663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e895a2f5-c77c-44e4-a342-dea9b3351009 req-ae346e91-7e2e-4279-944d-05b66d038c81 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.336809 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e895a2f5-c77c-44e4-a342-dea9b3351009 req-ae346e91-7e2e-4279-944d-05b66d038c81 service nova] Creating event network-changed:75b13e9b-2b50-423b-b7b5-acfac31fcf8e for instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 on n-h2-846470-15 Aug 24 03:47:46.346712 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e895a2f5-c77c-44e4-a342-dea9b3351009 req-ae346e91-7e2e-4279-944d-05b66d038c81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060554 Aug 24 03:47:46.347968 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1557/3242] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:46.362931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:46.364040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:46.373838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.374625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.376726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.378185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.378817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.379402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.399620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:46.417702 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3923a8f-f403-4494-bf0d-8a62cdc1959f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1320 microversion: 2.1 time: 0.457871 Aug 24 03:47:46.420031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1686/3243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:45 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:46.454689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:46.457798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:46.472871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.476299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.480544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.483463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.489495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.489495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.958496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:46.975756 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-727ef0a5-2126-4640-8b3d-662c3c57c61c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1494 microversion: 2.1 time: 0.529230 Aug 24 03:47:46.993514 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1687/3244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:46 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1494 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:47.000483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-bb704070-be4d-4969-bd95-5394f10f581c req-5a7a91fd-1ba0-4876-bdb2-0dbd2baf1dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c670f3-658f-4e9c-a8f1-48bcca0bed67", "tag": "4ba606b5-d890-44a7-8a46-3c8b2d41038a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:47.018558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bb704070-be4d-4969-bd95-5394f10f581c req-5a7a91fd-1ba0-4876-bdb2-0dbd2baf1dc7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.019735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bb704070-be4d-4969-bd95-5394f10f581c req-5a7a91fd-1ba0-4876-bdb2-0dbd2baf1dc7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.020318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bb704070-be4d-4969-bd95-5394f10f581c req-5a7a91fd-1ba0-4876-bdb2-0dbd2baf1dc7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.047555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bb704070-be4d-4969-bd95-5394f10f581c req-5a7a91fd-1ba0-4876-bdb2-0dbd2baf1dc7 service nova] Creating event network-changed:4ba606b5-d890-44a7-8a46-3c8b2d41038a for instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 on n-h2-846470-15 Aug 24 03:47:47.053418 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-bb704070-be4d-4969-bd95-5394f10f581c req-5a7a91fd-1ba0-4876-bdb2-0dbd2baf1dc7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057790 Aug 24 03:47:47.056051 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1688/3245] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:47.292155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:47.310563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:47.311298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:47.323696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.324514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.325187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.326445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.329373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.330135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.332164 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2403165c-aa40-4e34-9af6-d3e8321c9377 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1668 microversion: 2.1 time: 0.973384 Aug 24 03:47:47.334666 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1558/3246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:46 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1668 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:47.443135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:47.444616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:47.460995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.463922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.465782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.466750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.467578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.468193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.814465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:47.835583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e82233ed-d5da-49ac-b116-e5e459bbc5b3 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1505 microversion: 2.1 time: 0.529272 Aug 24 03:47:47.847986 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1689/3247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:47 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:47.861399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '.version_select at 0x7f1022e7bf70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:47.861970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:47.877445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.877993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.878455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.879300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.879792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.880413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.923109 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67747540-470c-4645-a46e-2791186e4638 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.066302 Aug 24 03:47:47.924270 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1690/3248] 10.222.0.58 () {58 vars in 1296 bytes} [Wed Aug 24 03:47:47 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b/os-instance-actions => generated 611 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:47:47.938120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:47.938634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:47.945453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.946203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.947948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.948874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.949688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.950277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.985349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:47:48.246545 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcfb5e9c-c4d2-4a40-902e-8b966007a6ef tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 204 len: 0 microversion: 2.1 time: 0.312152 Aug 24 03:47:48.251709 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1691/3249] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:47:47 2022] DELETE /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:47:48.264066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:48.264821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:48.266876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:48.291459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:48.294979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:48.297056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:48.298840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:48.301127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:48.301863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:48.471275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:48.512153 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-efe43206-b7bb-43c3-9f37-31acb6c24314 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1320 microversion: 2.1 time: 1.073494 Aug 24 03:47:48.520493 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1559/3250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:47 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1320 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:48.538804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:48.539860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:48.551392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:48.554718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:48.565078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:48.570363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:48.571179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:48.572064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:48.628282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:48.644442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e5cad703-81da-441d-958a-6fc7d21cac1b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 200 len: 1452 microversion: 2.1 time: 0.388132 Aug 24 03:47:48.659942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1692/3251] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:48 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 1452 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:48.673568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:48.676378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:48.689790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:48.695854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:48.698631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:48.699499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:48.701742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:48.703472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:48.704561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:48.744572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:48.884848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:48.896740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3925e4e3-49fa-4e10-8f53-12a6949bd3ac tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1600 microversion: 2.1 time: 0.234029 Aug 24 03:47:48.899228 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1693/3252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:48 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1600 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:48.909740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a65a9fe9-7050-4aaa-a9a8-782d04b1009d req-fd6a57ac-307c-4eca-8b4e-5a5ebaa3d914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd33548-7ee6-48cf-aa74-2f649e35ee8c", "name": "network-vif-deleted", "tag": "32814333-75ce-463c-8d1f-57a6b9fa2b8e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:48.940855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a65a9fe9-7050-4aaa-a9a8-782d04b1009d req-fd6a57ac-307c-4eca-8b4e-5a5ebaa3d914 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:48.940855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a65a9fe9-7050-4aaa-a9a8-782d04b1009d req-fd6a57ac-307c-4eca-8b4e-5a5ebaa3d914 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:48.940855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a65a9fe9-7050-4aaa-a9a8-782d04b1009d req-fd6a57ac-307c-4eca-8b4e-5a5ebaa3d914 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:48.963426 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a65a9fe9-7050-4aaa-a9a8-782d04b1009d req-fd6a57ac-307c-4eca-8b4e-5a5ebaa3d914 service nova] Creating event network-vif-deleted:32814333-75ce-463c-8d1f-57a6b9fa2b8e for instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c on n-h1-846470-15 Aug 24 03:47:48.977036 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a65a9fe9-7050-4aaa-a9a8-782d04b1009d req-fd6a57ac-307c-4eca-8b4e-5a5ebaa3d914 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073798 Aug 24 03:47:48.980601 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1694/3253] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:49.116561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:49.143341 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-421d7b8c-9892-4ba1-a085-e87de1f93275 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1511 microversion: 2.1 time: 0.621119 Aug 24 03:47:49.144323 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1560/3254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:48 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1511 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:49.534675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:49.536084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:49.549008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:49.549841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:49.550461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:49.554133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:49.554911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:49.555549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:49.669252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:49.669927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:49.684205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:49.689249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:49.691230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:49.692308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:49.693987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:49.697387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:49.732812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:49.738268 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c HTTP/1.1 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '2fd33548-7ee6-48cf-aa74-2f649e35ee8c'} Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:47:49.742446 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:49.749846 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:49.749846 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:47:49.749846 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:47:49.749846 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:47:49.749846 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:47:49.749846 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:47:49.749846 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:49.752226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:47:49.754687 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81e9ac0a-e4d5-4512-a6f1-b9cb30f8514b tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 404 len: 111 microversion: 2.1 time: 0.092446 Aug 24 03:47:49.762621 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1561/3255] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:49 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:47:49.925984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:49.926720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:49.949835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:49.950551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:49.953506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:49.974976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:49.981291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:49.984109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:50.037219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:50.053982 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec527abe-31bc-4d0b-b494-54ba47d54a3e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1320 microversion: 2.1 time: 0.524327 Aug 24 03:47:50.056613 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1695/3256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:49 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:50.062598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:50.167275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:50.167830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:50.178417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:50.178913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:50.179350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:50.191223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:50.193850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:50.195271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:50.247833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:50.264199 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26f63593-218e-4262-94ec-df6023104b93 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1319 microversion: 2.1 time: 0.346259 Aug 24 03:47:50.269882 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1562/3257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:49 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:50.284574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-643017447", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "6b7c20d5-6e0c-43b0-8505-bb28069b1895"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:50.419851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] validate_networks() for [('6b7c20d5-6e0c-43b0-8505-bb28069b1895', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:47:50.715303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:50.738721 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e9bb024-0193-4be1-8bd8-3bda50eb37c0 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1511 microversion: 2.1 time: 0.575934 Aug 24 03:47:50.741699 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1696/3258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:50 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1511 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:51.057718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9fb4aca7-7721-473b-9353-68b9570e0375 req-46db2bd1-8377-4415-95b5-9b3f31a2e31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79baa30-fa4f-47de-8d26-6d070734bccd", "name": "network-vif-deleted", "tag": "8eb13453-5453-4ce2-a0f9-64aba47b275b"}, {"name": "network-changed", "server_uuid": "124fdab8-7ac7-4400-b99f-20cc282263d4", "tag": "6aea8380-f95a-435d-bc4d-7a5faf8dbd42"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:51.086152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9fb4aca7-7721-473b-9353-68b9570e0375 req-46db2bd1-8377-4415-95b5-9b3f31a2e31c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.088760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9fb4aca7-7721-473b-9353-68b9570e0375 req-46db2bd1-8377-4415-95b5-9b3f31a2e31c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.090888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9fb4aca7-7721-473b-9353-68b9570e0375 req-46db2bd1-8377-4415-95b5-9b3f31a2e31c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:51.117110 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9fb4aca7-7721-473b-9353-68b9570e0375 req-46db2bd1-8377-4415-95b5-9b3f31a2e31c service nova] Creating event network-vif-deleted:8eb13453-5453-4ce2-a0f9-64aba47b275b for instance a79baa30-fa4f-47de-8d26-6d070734bccd on n-h2-846470-15 Aug 24 03:47:51.118729 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9fb4aca7-7721-473b-9353-68b9570e0375 req-46db2bd1-8377-4415-95b5-9b3f31a2e31c service nova] Creating event network-changed:6aea8380-f95a-435d-bc4d-7a5faf8dbd42 for instance 124fdab8-7ac7-4400-b99f-20cc282263d4 on n-h1-846470-15 Aug 24 03:47:51.158144 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9fb4aca7-7721-473b-9353-68b9570e0375 req-46db2bd1-8377-4415-95b5-9b3f31a2e31c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.113462 Aug 24 03:47:51.162514 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1697/3259] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:51.176685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:51.179217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:51.192933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.192933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.192933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:51.193987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.194583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.195169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:51.717266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:47:51.717964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:47:51.718132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:47:51.718846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:47:51.719479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:47:51.742315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.743423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.744222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:51.745270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.746014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.747167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:51.780068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:47:51.788957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Getting quotas for user 69a1414940b14e459202a86bd8e9027b and project ecfa603927cb4c67b703a483adf2e350. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:47:51.812401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:47:51.817014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:47:51.835351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:51.846701 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5b85220-6940-4e15-9be6-5fd6c50f1753 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1320 microversion: 2.1 time: 0.680132 Aug 24 03:47:51.847854 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1698/3260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:51 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1320 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:51.880714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:51.883520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:51.891450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.892514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.893033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:51.893821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.894781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.895419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:51.902118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:51.936599 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ceb811d-e8c8-4f17-bf1a-c4292d4917d8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.663370 Aug 24 03:47:51.943035 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1563/3261] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:47:51.950181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:51.955575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:51.966672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.967185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.967629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:51.973806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:51.976856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:51.979000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:52.055036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:52.082554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:52.082923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:52.083827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lazy-loading 'fault' on Instance uuid a79baa30-fa4f-47de-8d26-6d070734bccd {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:47:52.195055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:52.210980 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32799a73-45ad-4dda-8add-fb949f503b45 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1324 microversion: 2.1 time: 0.348328 Aug 24 03:47:52.214764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1699/3262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:51 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:52.234703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-deb96103-7a0f-4350-b808-891fc4f3c398 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:52.238223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-deb96103-7a0f-4350-b808-891fc4f3c398 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:52.262283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:52.297222 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0692ee3a-895b-432c-995a-e3b6b2bed620 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1511 microversion: 2.1 time: 0.348459 Aug 24 03:47:52.299658 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1564/3263] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:51 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:52.572228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-deb96103-7a0f-4350-b808-891fc4f3c398 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:52.606053 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-deb96103-7a0f-4350-b808-891fc4f3c398 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1214 microversion: 2.1 time: 0.379745 Aug 24 03:47:52.610274 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1700/3264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:52 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1214 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:52.874783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:52.875518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:52.887896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:52.888869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:52.889773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:52.891396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:52.892234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:52.894239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:53.099197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:53.112706 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-40ff41fe-ca5b-4a03-ab77-64e85e0fb70c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1320 microversion: 2.1 time: 0.243671 Aug 24 03:47:53.124594 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1565/3265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:52 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:53.233470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:53.235783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:53.254903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:53.256007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:53.256671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:53.257802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:53.258499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:53.259245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:53.322091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:53.323345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:53.339541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:53.340403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:53.341256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:53.341959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:53.342575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:53.343272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lazy-loading 'fault' on Instance uuid a79baa30-fa4f-47de-8d26-6d070734bccd {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:47:53.343546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:53.345388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:53.346695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:53.348262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:53.856064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:53.889845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f408260d-e6e2-416b-b2c2-f90009f48c04 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 200 len: 1324 microversion: 2.1 time: 0.660807 Aug 24 03:47:53.896271 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1701/3266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:53 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 1324 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:53.921031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:53.931866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:53.960735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:53.964807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:53.970115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:53.972443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:53.973106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:53.978086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:54.369689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:54.382430 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f808b848-3de0-4499-9c74-1ec3d2c5c243 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1266 microversion: 2.1 time: 0.481027 Aug 24 03:47:54.395966 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1702/3267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:53 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1266 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:54.408421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:54.411845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:54.435940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:54.436648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:54.437093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:54.437843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:54.438495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:54.439116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:54.463145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:54.475394 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b9c235a-b5f5-4269-9d3e-26044cd78a6c tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1511 microversion: 2.1 time: 1.157487 Aug 24 03:47:54.477929 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1566/3268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:53 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1511 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:54.924202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:54.925101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: a79baa30-fa4f-47de-8d26-6d070734bccd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:54.937222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:54.937726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:54.938171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:54.941862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:54.942363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:54.942809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:54.984541 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] HTTP exception thrown: Instance a79baa30-fa4f-47de-8d26-6d070734bccd could not be found. Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Request method failure captured: Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd HTTP/1.1 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ1S2IWZ0NTS5RFvBC_FL9gtr1JffCzLJkxmPTt451Z7ARgdij-LakevwDa7PH0DQ0ymjcr47x7O9eTODrIdH5YZDuYsj5IVK4-6Oa5XoBUQ_NawtWzlNC6SBPcb3OeVVVmykmyhIcjmyHI8sq8C1U4CDaARQNrJdqsI8PQPYP2nEdM Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 159a3e9d888c49c78cf8ad328a1cdfd2 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-LiveMigrationTest-374128082 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-LiveMigrationTest-374128082 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 159a3e9d888c49c78cf8ad328a1cdfd2 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-LiveMigrationTest-374128082 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-LiveMigrationTest-374128082-project Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 73ddcba828514d1882d2cd02d357bef8 Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-LiveMigrationTest-374128082-project Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a79baa30-fa4f-47de-8d26-6d070734bccd could not be found. Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a79baa30-fa4f-47de-8d26-6d070734bccd'} Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a79baa30-fa4f-47de-8d26-6d070734bccd could not be found. Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a79baa30-fa4f-47de-8d26-6d070734bccd could not be found. Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:47:54.986141 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a79baa30-fa4f-47de-8d26-6d070734bccd could not be found. Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Returning 404 to user: Instance a79baa30-fa4f-47de-8d26-6d070734bccd could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:47:54.992067 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f9e70720-e0da-4b97-9eae-3f6f61d975be tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd" status: 404 len: 111 microversion: 2.1 time: 0.068252 Aug 24 03:47:55.000282 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1567/3269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:54 2022] GET /compute/v2.1/servers/a79baa30-fa4f-47de-8d26-6d070734bccd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:47:55.008220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b7b1ec39-c9cd-4fc6-9020-1224f501e095 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '.version_select at 0x7f102a7270d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:55.044755 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b7b1ec39-c9cd-4fc6-9020-1224f501e095 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-858906865" status: 202 len: 0 microversion: 2.1 time: 0.040364 Aug 24 03:47:55.045352 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1568/3270] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-858906865 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:47:55.185286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:55.199877 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-30b3001f-ace9-48aa-ad81-5b3987180a4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1320 microversion: 2.1 time: 0.804929 Aug 24 03:47:55.202206 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1703/3271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:54 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1320 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:55.411237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-17cab453-6641-4c19-a37d-1451e9cb082e req-c53d476d-3dc4-4d73-9368-776b70bce6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c670f3-658f-4e9c-a8f1-48bcca0bed67", "name": "network-vif-plugged", "status": "completed", "tag": "4ba606b5-d890-44a7-8a46-3c8b2d41038a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:55.414366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:55.421302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:55.430954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:55.433834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:55.436194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17cab453-6641-4c19-a37d-1451e9cb082e req-c53d476d-3dc4-4d73-9368-776b70bce6cc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:55.438933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:55.441135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:55.442003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:55.442901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17cab453-6641-4c19-a37d-1451e9cb082e req-c53d476d-3dc4-4d73-9368-776b70bce6cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:55.443759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:55.445724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17cab453-6641-4c19-a37d-1451e9cb082e req-c53d476d-3dc4-4d73-9368-776b70bce6cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:55.489990 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-17cab453-6641-4c19-a37d-1451e9cb082e req-c53d476d-3dc4-4d73-9368-776b70bce6cc service nova] Creating event network-vif-plugged:4ba606b5-d890-44a7-8a46-3c8b2d41038a for instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 on n-h2-846470-15 Aug 24 03:47:55.516019 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-17cab453-6641-4c19-a37d-1451e9cb082e req-c53d476d-3dc4-4d73-9368-776b70bce6cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108409 Aug 24 03:47:55.517466 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1704/3272] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:55.532237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:55.540413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:55.557630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:55.561653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:55.564711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:55.565748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:55.569084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:55.569814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:55.926332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:55.935985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:55.950996 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0c70909-531c-4d4f-83a8-600a67b69ea6 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1469 microversion: 2.1 time: 0.430845 Aug 24 03:47:55.952110 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0853b1f4-e5bf-4d2c-a403-5bded853cb13 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1272 microversion: 2.1 time: 0.549214 Aug 24 03:47:55.952966 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1705/3273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:55 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:55.955176 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1569/3274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:55 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1272 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:55.960553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-fb069ee5-38ae-46a3-92e4-6964cf226df7 req-1ed3e91c-9119-40da-b4dc-1672ce81d77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b259dfe8-1af8-4b5d-82c2-aa4eed63b69b", "name": "network-vif-deleted", "tag": "2b048e59-b443-419b-8e47-0ddb91fffc3f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:55.977858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fb069ee5-38ae-46a3-92e4-6964cf226df7 req-1ed3e91c-9119-40da-b4dc-1672ce81d77d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:55.979369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fb069ee5-38ae-46a3-92e4-6964cf226df7 req-1ed3e91c-9119-40da-b4dc-1672ce81d77d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:55.980485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fb069ee5-38ae-46a3-92e4-6964cf226df7 req-1ed3e91c-9119-40da-b4dc-1672ce81d77d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:55.998263 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fb069ee5-38ae-46a3-92e4-6964cf226df7 req-1ed3e91c-9119-40da-b4dc-1672ce81d77d service nova] Creating event network-vif-deleted:2b048e59-b443-419b-8e47-0ddb91fffc3f for instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b on n-h2-846470-15 Aug 24 03:47:56.005711 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-fb069ee5-38ae-46a3-92e4-6964cf226df7 req-1ed3e91c-9119-40da-b4dc-1672ce81d77d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050689 Aug 24 03:47:56.007120 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1706/3275] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:56.228577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:56.229861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:56.243066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:56.246580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:56.247643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:56.248858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:56.250059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:56.251402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:56.984451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:56.986348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:56.997825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:56.998983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.000045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.001569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:57.002844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.003998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.063313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:47:57.239281 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fba4efeb-a60b-4303-9409-072bd1f83d4e tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 204 len: 0 microversion: 2.1 time: 0.264160 Aug 24 03:47:57.242415 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1707/3276] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:47:56 2022] DELETE /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:47:57.257522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:57.260325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:57.274848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:57.276370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.278316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.280878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:57.282496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.284090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.341033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:57.365852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d97a3db-475b-47ff-8e3a-04054f4ba3ab tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1320 microversion: 2.1 time: 1.146939 Aug 24 03:47:57.367682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:57.369525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.370657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.372226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lazy-loading 'fault' on Instance uuid b259dfe8-1af8-4b5d-82c2-aa4eed63b69b {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:47:57.385107 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1570/3277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:56 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1320 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:57.402932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:57.403559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:57.422312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:57.423823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.424446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.426201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:57.431684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.433118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.499229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1db24596847a388ac2ceb69c90e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6587f65fd57a4f63805ea7073c326e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:57.528739 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd4d654c-117e-4da0-bd5a-1b9d4510cbc7 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 200 len: 1306 microversion: 2.1 time: 0.282679 Aug 24 03:47:57.535166 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1708/3278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:57 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 1306 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:57.553592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:57.557901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:57.588929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:57.590618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.591652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.593691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:57.598699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:57.600806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:57.827136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:57.838958 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d20f69a-e665-4e2e-8aef-f18183b75c12 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1272 microversion: 2.1 time: 0.452629 Aug 24 03:47:57.839594 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1571/3279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:57 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1272 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:58.398114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:58.402452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:58.403832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:58.413012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:58.414026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:58.414629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:58.416105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:58.416776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:58.417363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:58.436076 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-124c1331-d4a0-49a9-9105-c2b15a8a902c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1485 microversion: 2.1 time: 0.898554 Aug 24 03:47:58.437114 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1709/3280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:57 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1485 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:58.563112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:58.564232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] [instance: b259dfe8-1af8-4b5d-82c2-aa4eed63b69b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:58.593305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:58.594192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:58.594982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:58.603923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:58.605113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:58.607987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:58.654034 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] HTTP exception thrown: Instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b could not be found. Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Request method failure captured: Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b HTTP/1.1 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ9AWxYrKTyFw5OMweBz6H2dYCmN2gjXvdtbjr9XQdqQ44yCV03PFKxXJ9h9NwAaDYNhOWW_Wnxy0zOPeUFRWZdsulME1SlHjH9H5QM6M5FCypYY1XlQjqJvxfsdTbfOIngCd64gk20DgDQruvoU4WuHWcUGPwq5CkLsBsxTKr7zc0M Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6587f65fd57a4f63805ea7073c326e12 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-InstanceActionsTestJSON-720975430 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6587f65fd57a4f63805ea7073c326e12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6587f65fd57a4f63805ea7073c326e12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6587f65fd57a4f63805ea7073c326e12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6587f65fd57a4f63805ea7073c326e12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-InstanceActionsTestJSON-720975430 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6587f65fd57a4f63805ea7073c326e12 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-InstanceActionsTestJSON-720975430 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-InstanceActionsTestJSON-720975430-project Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cdf1db24596847a388ac2ceb69c90e60 Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-InstanceActionsTestJSON-720975430-project Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b could not be found. Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'b259dfe8-1af8-4b5d-82c2-aa4eed63b69b'} Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b could not be found. Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b could not be found. Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:47:58.658435 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:47:58.663565 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:47:58.663565 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:47:58.663565 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:47:58.663565 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:47:58.663565 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:47:58.663565 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b could not be found. Aug 24 03:47:58.663565 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:47:58.666593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] Returning 404 to user: Instance b259dfe8-1af8-4b5d-82c2-aa4eed63b69b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:47:58.667928 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec35a4dd-a621-4acd-a099-50610aa077d5 tempest-InstanceActionsTestJSON-720975430 tempest-InstanceActionsTestJSON-720975430-project] 10.222.0.58 "GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b" status: 404 len: 111 microversion: 2.1 time: 0.114908 Aug 24 03:47:58.669050 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1710/3281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:58 2022] GET /compute/v2.1/servers/b259dfe8-1af8-4b5d-82c2-aa4eed63b69b => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:47:58.866584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:58.867349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:58.886951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:58.889143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:58.891372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:58.892124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:58.892668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:58.893101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:59.357090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:59.372981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-989fe58b-c291-48b8-a434-a53b5d867a04 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1510 microversion: 2.1 time: 0.973032 Aug 24 03:47:59.375784 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1572/3282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:58 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1510 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:59.397405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:59.398216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:59.425033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:59.425634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:59.425963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:59.426738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:59.427140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:59.427569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:00.304761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:00.347706 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc506bca-08e0-4183-bb40-c9b04108c527 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1321 microversion: 2.1 time: 0.954132 Aug 24 03:48:00.350622 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1573/3283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:59 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1321 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:00.370021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:00.371223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:00.393814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:00.394487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:00.394938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:00.396510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:00.400540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:00.402120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:00.986564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:01.000401 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c234eb4f-8ed7-431a-9e7d-5ce6f675a94a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 2.144141 Aug 24 03:48:01.000793 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1711/3284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:58 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:01.020808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-030cab50-00d6-4c33-b729-ed45411ab093 req-8e6cf3d0-6e40-407c-a567-96464e020bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124fdab8-7ac7-4400-b99f-20cc282263d4", "name": "network-vif-plugged", "status": "completed", "tag": "6aea8380-f95a-435d-bc4d-7a5faf8dbd42"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:01.052848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-030cab50-00d6-4c33-b729-ed45411ab093 req-8e6cf3d0-6e40-407c-a567-96464e020bc9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:01.059389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-030cab50-00d6-4c33-b729-ed45411ab093 req-8e6cf3d0-6e40-407c-a567-96464e020bc9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:01.059885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-030cab50-00d6-4c33-b729-ed45411ab093 req-8e6cf3d0-6e40-407c-a567-96464e020bc9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:01.090380 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-030cab50-00d6-4c33-b729-ed45411ab093 req-8e6cf3d0-6e40-407c-a567-96464e020bc9 service nova] Creating event network-vif-plugged:6aea8380-f95a-435d-bc4d-7a5faf8dbd42 for instance 124fdab8-7ac7-4400-b99f-20cc282263d4 on n-h1-846470-15 Aug 24 03:48:01.109056 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-030cab50-00d6-4c33-b729-ed45411ab093 req-8e6cf3d0-6e40-407c-a567-96464e020bc9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107029 Aug 24 03:48:01.115862 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1712/3285] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:01.374558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:01.375769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:01.407207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:01.413717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:01.416474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:01.417456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:01.419236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:01.419839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:01.705496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:01.737085 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ce31d8c-0b7e-4bc5-86d5-a2b00e27d60c tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 200 len: 1485 microversion: 2.1 time: 1.382766 Aug 24 03:48:01.753807 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1574/3286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:00 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 1485 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:01.769679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f9b57ae4-99e7-4c4e-9cf4-eb7bee6a2798 req-bbc1d451-62b2-4dc0-869e-acf6c2f1e591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2931983-47d8-44fe-a4e0-023ee36a6791", "name": "network-vif-deleted", "tag": "55e49a5b-9646-4067-99d0-2e062d0d64f7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:01.792618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:01.796305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9b57ae4-99e7-4c4e-9cf4-eb7bee6a2798 req-bbc1d451-62b2-4dc0-869e-acf6c2f1e591 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:01.797281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9b57ae4-99e7-4c4e-9cf4-eb7bee6a2798 req-bbc1d451-62b2-4dc0-869e-acf6c2f1e591 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:01.798769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9b57ae4-99e7-4c4e-9cf4-eb7bee6a2798 req-bbc1d451-62b2-4dc0-869e-acf6c2f1e591 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:01.819786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:01.823336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f9b57ae4-99e7-4c4e-9cf4-eb7bee6a2798 req-bbc1d451-62b2-4dc0-869e-acf6c2f1e591 service nova] Creating event network-vif-deleted:55e49a5b-9646-4067-99d0-2e062d0d64f7 for instance e2931983-47d8-44fe-a4e0-023ee36a6791 on n-h2-846470-15 Aug 24 03:48:01.830615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f9b57ae4-99e7-4c4e-9cf4-eb7bee6a2798 req-bbc1d451-62b2-4dc0-869e-acf6c2f1e591 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086425 Aug 24 03:48:01.832376 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1575/3287] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:02.030197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:02.031441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:02.043510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:02.047598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:02.048232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:02.053993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:02.055790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:02.058931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:02.059905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:02.060040 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ec6392c-557f-478f-913d-842012c2421d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1321 microversion: 2.1 time: 0.689451 Aug 24 03:48:02.076128 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1713/3288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:01 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1321 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:02.433807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:02.454094 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c5c23e8-9ca5-4640-bc31-a13e290219ea tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 0.432616 Aug 24 03:48:02.455019 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1576/3289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:02 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:02.762783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:02.763407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: e2931983-47d8-44fe-a4e0-023ee36a6791] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:02.772709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:02.777871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:02.780605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:02.781249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:02.782964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:02.785875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:02.787927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:02.845264 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] HTTP exception thrown: Instance e2931983-47d8-44fe-a4e0-023ee36a6791 could not be found. Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Request method failure captured: Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 HTTP/1.1 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ1S2IWZ0NTS5RFvBC_FL9gtr1JffCzLJkxmPTt451Z7ARgdij-LakevwDa7PH0DQ0ymjcr47x7O9eTODrIdH5YZDuYsj5IVK4-6Oa5XoBUQ_NawtWzlNC6SBPcb3OeVVVmykmyhIcjmyHI8sq8C1U4CDaARQNrJdqsI8PQPYP2nEdM Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 159a3e9d888c49c78cf8ad328a1cdfd2 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-LiveMigrationTest-374128082 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-LiveMigrationTest-374128082 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 159a3e9d888c49c78cf8ad328a1cdfd2 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-LiveMigrationTest-374128082 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-LiveMigrationTest-374128082-project Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 73ddcba828514d1882d2cd02d357bef8 Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-LiveMigrationTest-374128082-project Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance e2931983-47d8-44fe-a4e0-023ee36a6791 could not be found. Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'e2931983-47d8-44fe-a4e0-023ee36a6791'} Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2931983-47d8-44fe-a4e0-023ee36a6791 could not be found. Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2931983-47d8-44fe-a4e0-023ee36a6791 could not be found. Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:02.849181 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:02.854870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:02.854870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:02.854870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:02.854870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:02.854870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:02.854870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2931983-47d8-44fe-a4e0-023ee36a6791 could not be found. Aug 24 03:48:02.854870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:02.857079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Returning 404 to user: Instance e2931983-47d8-44fe-a4e0-023ee36a6791 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:02.859224 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2edfdc7c-383c-4e42-b45d-651669f72d86 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791" status: 404 len: 111 microversion: 2.1 time: 0.101383 Aug 24 03:48:02.863835 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1714/3290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:02 2022] GET /compute/v2.1/servers/e2931983-47d8-44fe-a4e0-023ee36a6791 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:02.870864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:02.871789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:02.878951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:02.879621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:02.880334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:02.881304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:02.882119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:02.882771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:02.926762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:48:03.088077 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-35eb1fd4-b362-4cda-b817-346bcc2061bd tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 204 len: 0 microversion: 2.1 time: 0.221391 Aug 24 03:48:03.092033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:03.093397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:03.093530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1577/3291] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:02 2022] DELETE /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:48:03.108412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:03.110639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:03.122167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:03.124050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:03.124953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:03.128927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:03.130981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:03.131676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:03.132119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:03.133406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:03.134263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:03.135613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:03.136325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:03.137487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:03.541215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:03.565350 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0ae1c1a8-724b-4f41-8a62-c7f522a0f6a4 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1499 microversion: 2.1 time: 0.465650 Aug 24 03:48:03.588906 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1578/3292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:03 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1499 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:03.607344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-eff10e5c-e186-41db-9809-8fc72f7964be req-fb3c6e2f-88a0-4a02-b637-73d343c3c7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d362ddfc-9185-45a6-b23b-b2a8e4049bd1", "name": "network-vif-plugged", "status": "completed", "tag": "75b13e9b-2b50-423b-b7b5-acfac31fcf8e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:03.632584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-eff10e5c-e186-41db-9809-8fc72f7964be req-fb3c6e2f-88a0-4a02-b637-73d343c3c7fd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:03.633665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-eff10e5c-e186-41db-9809-8fc72f7964be req-fb3c6e2f-88a0-4a02-b637-73d343c3c7fd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:03.635039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-eff10e5c-e186-41db-9809-8fc72f7964be req-fb3c6e2f-88a0-4a02-b637-73d343c3c7fd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:03.660931 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-eff10e5c-e186-41db-9809-8fc72f7964be req-fb3c6e2f-88a0-4a02-b637-73d343c3c7fd service nova] Creating event network-vif-plugged:75b13e9b-2b50-423b-b7b5-acfac31fcf8e for instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 on n-h2-846470-15 Aug 24 03:48:03.668264 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-eff10e5c-e186-41db-9809-8fc72f7964be req-fb3c6e2f-88a0-4a02-b637-73d343c3c7fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077814 Aug 24 03:48:03.670350 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1579/3293] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:03.698040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:03.700891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:03.723492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:03.728164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:03.728513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:03.729378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:03.730209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:03.732935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:03.734933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:03.740725 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d91fd413-a26d-4f05-970b-6e39cb6aec2c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1321 microversion: 2.1 time: 0.662379 Aug 24 03:48:03.741242 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1715/3294] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:03 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1321 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:03.816214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:03.948351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-68720cec-fc1c-4069-9b7a-5ef2b79d4651 req-9a4b80a8-fbbb-4cbd-a63d-c5822a6e1339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c71c41-7d29-483d-a112-6dd9672dd4dc", "tag": "0671e371-0fdd-4c82-b5f7-6632fcad4e91"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:03.971289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-68720cec-fc1c-4069-9b7a-5ef2b79d4651 req-9a4b80a8-fbbb-4cbd-a63d-c5822a6e1339 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:03.971821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-68720cec-fc1c-4069-9b7a-5ef2b79d4651 req-9a4b80a8-fbbb-4cbd-a63d-c5822a6e1339 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:03.972318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-68720cec-fc1c-4069-9b7a-5ef2b79d4651 req-9a4b80a8-fbbb-4cbd-a63d-c5822a6e1339 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:04.001323 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-68720cec-fc1c-4069-9b7a-5ef2b79d4651 req-9a4b80a8-fbbb-4cbd-a63d-c5822a6e1339 service nova] Creating event network-changed:0671e371-0fdd-4c82-b5f7-6632fcad4e91 for instance 79c71c41-7d29-483d-a112-6dd9672dd4dc on n-h1-846470-15 Aug 24 03:48:04.013532 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-68720cec-fc1c-4069-9b7a-5ef2b79d4651 req-9a4b80a8-fbbb-4cbd-a63d-c5822a6e1339 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068983 Aug 24 03:48:04.020440 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1716/3295] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:04.596976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:04.609608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:04.610313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:04.616355 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ca9853c-af34-4858-8c9e-4e0e968e0dd8 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 0.944188 Aug 24 03:48:04.616906 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1580/3296] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:03 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:04.634131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:04.634648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:04.635098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:04.635883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:04.636423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:04.636892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:04.767205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:04.768292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:04.781349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:04.782088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:04.782720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:04.783654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:04.784325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:04.785810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:04.956108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:04.968611 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b9a4a118-bfe4-49f7-a7dd-3945b96e113b tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1499 microversion: 2.1 time: 0.364089 Aug 24 03:48:04.980515 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1717/3297] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:04 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1499 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:05.639269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:05.644927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:05.659527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:05.660382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:05.660979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:05.661871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:05.662515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:05.662947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:05.677149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:06.519990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:06.537624 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5dbb8f6e-b0ff-4e1f-9e25-4b37d09ab96e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 0.903141 Aug 24 03:48:06.543688 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1718/3298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:05 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:06.557945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:06.558726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:06.573402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:06.576008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:06.576615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:06.577143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:06.578113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:06.578834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:06.580461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:06.587108 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c8058dc2-6c08-4779-bfaa-60ed34b73bf0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1321 microversion: 2.1 time: 1.824332 Aug 24 03:48:06.592777 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1581/3299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:04 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1321 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:07.264657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5b3f971a-2b5b-4a68-9ccc-63cbae8370b9 req-0dfcbcb2-e4ff-4ed7-91b5-91a6e4b3bfcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6220a504-caa0-4aaf-829e-73fd6a11c887", "name": "network-vif-deleted", "tag": "1eda95c9-2580-4337-8578-3cc683db5689"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:07.295830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5b3f971a-2b5b-4a68-9ccc-63cbae8370b9 req-0dfcbcb2-e4ff-4ed7-91b5-91a6e4b3bfcb service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:07.296344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5b3f971a-2b5b-4a68-9ccc-63cbae8370b9 req-0dfcbcb2-e4ff-4ed7-91b5-91a6e4b3bfcb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:07.297988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5b3f971a-2b5b-4a68-9ccc-63cbae8370b9 req-0dfcbcb2-e4ff-4ed7-91b5-91a6e4b3bfcb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:07.343318 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5b3f971a-2b5b-4a68-9ccc-63cbae8370b9 req-0dfcbcb2-e4ff-4ed7-91b5-91a6e4b3bfcb service nova] Creating event network-vif-deleted:1eda95c9-2580-4337-8578-3cc683db5689 for instance 6220a504-caa0-4aaf-829e-73fd6a11c887 on n-h2-846470-15 Aug 24 03:48:07.376980 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5b3f971a-2b5b-4a68-9ccc-63cbae8370b9 req-0dfcbcb2-e4ff-4ed7-91b5-91a6e4b3bfcb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115804 Aug 24 03:48:07.377607 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1582/3300] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:07.463117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:07.516244 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58fd19a9-14bd-404d-ba49-1c76572c317f tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1499 microversion: 2.1 time: 0.968482 Aug 24 03:48:07.521919 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1719/3301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:06 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1499 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:07.570686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:07.571516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:07.606249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:07.606895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:07.607178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:07.607920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:07.612012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:07.618133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:07.620592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:07.628507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:07.670749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:07.674012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:07.675753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:07.682912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:07.698140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:07.702871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:08.262240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:08.271050 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9cc8fec6-10fd-41f5-9eda-98852deb6c97 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 0.705600 Aug 24 03:48:08.271878 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1583/3302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:07 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:08.542381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:08.543227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:08.552806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:08.559737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:08.562809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:08.563869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:08.566109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:08.566843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:08.657588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:08.697838 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1df8103-2d97-4ad9-9b14-ce03e3eb8d89 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1511 microversion: 2.1 time: 1.085072 Aug 24 03:48:08.703958 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1720/3303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:07 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1511 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:08.732633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:08.739678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:08.788055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:08.793186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:08.794601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:08.797377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:08.809585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:08.810090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:08.816505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:08.820639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:08.824600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:08.826461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lazy-loading 'fault' on Instance uuid 6220a504-caa0-4aaf-829e-73fd6a11c887 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:48:09.110243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ddcba828514d1882d2cd02d357bef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159a3e9d888c49c78cf8ad328a1cdfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:09.127002 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-015258f4-42e6-4e72-aaa6-5735b2e15038 tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 200 len: 1300 microversion: 2.1 time: 0.581969 Aug 24 03:48:09.127743 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1584/3304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:08 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 1300 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:09.256380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:09.266268 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f0f6b95-eed8-41a0-a68b-d2cc2ec68265 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 200 len: 1510 microversion: 2.1 time: 0.540892 Aug 24 03:48:09.267424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1721/3305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:08 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:09.287819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:09.301413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:09.302312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:09.310153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:09.311291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:09.326921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:09.332314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:09.334770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:09.337740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:09.340501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:09.341217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:09.341347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:09.341924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:09.342427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:09.343237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:09.344107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:09.344786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:09.548982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:09.665896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:09.674078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:09.674991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:09.675599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:09.714198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:09.727995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba6875ba-b7a1-48b2-af26-7de0dbc86a11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 0.422801 Aug 24 03:48:09.729288 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1722/3306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:09 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:10.163799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:10.164418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] [instance: 6220a504-caa0-4aaf-829e-73fd6a11c887] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:10.195592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:10.196537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:10.197350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:10.198673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:10.199376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:10.200010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:10.222753 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] HTTP exception thrown: Instance 6220a504-caa0-4aaf-829e-73fd6a11c887 could not be found. Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Request method failure captured: Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 HTTP/1.1 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ1S2IWZ0NTS5RFvBC_FL9gtr1JffCzLJkxmPTt451Z7ARgdij-LakevwDa7PH0DQ0ymjcr47x7O9eTODrIdH5YZDuYsj5IVK4-6Oa5XoBUQ_NawtWzlNC6SBPcb3OeVVVmykmyhIcjmyHI8sq8C1U4CDaARQNrJdqsI8PQPYP2nEdM Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 159a3e9d888c49c78cf8ad328a1cdfd2 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-LiveMigrationTest-374128082 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/159a3e9d888c49c78cf8ad328a1cdfd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-LiveMigrationTest-374128082 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 159a3e9d888c49c78cf8ad328a1cdfd2 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-LiveMigrationTest-374128082 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-LiveMigrationTest-374128082-project Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 73ddcba828514d1882d2cd02d357bef8 Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-LiveMigrationTest-374128082-project Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 6220a504-caa0-4aaf-829e-73fd6a11c887 could not be found. Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '6220a504-caa0-4aaf-829e-73fd6a11c887'} Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6220a504-caa0-4aaf-829e-73fd6a11c887 could not be found. Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6220a504-caa0-4aaf-829e-73fd6a11c887 could not be found. Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:10.224932 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:10.230166 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:10.230166 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:10.230166 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:10.230166 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:10.230166 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:10.230166 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6220a504-caa0-4aaf-829e-73fd6a11c887 could not be found. Aug 24 03:48:10.230166 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:10.231998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] Returning 404 to user: Instance 6220a504-caa0-4aaf-829e-73fd6a11c887 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:10.233085 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a20e84b-c147-432e-b005-70e33616c02d tempest-LiveMigrationTest-374128082 tempest-LiveMigrationTest-374128082-project] 10.222.0.58 "GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887" status: 404 len: 111 microversion: 2.1 time: 0.075234 Aug 24 03:48:10.234303 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1723/3307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:10 2022] GET /compute/v2.1/servers/6220a504-caa0-4aaf-829e-73fd6a11c887 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:10.752656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:10.753438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:10.768229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:10.782327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:10.783102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:10.789933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:10.790701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:10.791317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:11.098732 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba39ae99-8878-4dd6-bc13-08dfdc5a5b9d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 1.814978 Aug 24 03:48:11.100190 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1585/3308] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 24 03:48:09 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:11.126234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:11.138637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:11.140494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2131883169', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:11.167544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:11.173146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:11.181547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:11.182838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:11.186928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:11.192407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:11.557835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:11.913316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:11.935424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:11.946521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:11.947476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:12.481431 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cabf63c8-024b-46cb-9cb1-7db789d7e74e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2131883169" status: 200 len: 1514 microversion: 2.1 time: 1.359154 Aug 24 03:48:12.482498 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1586/3309] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:48:11 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2131883169 => generated 1514 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:12.512426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:12.525911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:12.531223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:12.547195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:12.548103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:12.548796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:12.549792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:12.554769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:12.555601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:13.032645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:13.043220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-649b2c6a-626f-4b9f-82ac-b4924c489c30 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 2.294488 Aug 24 03:48:13.066419 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1724/3310] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:10 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:13.388542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:13.486942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:13.494824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:13.498313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:13.499470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:13.500326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:14.081954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:14.090776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:14.141866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:14.142262 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8bbc11e-e633-4db3-bf0b-0bd1648eef71 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 1.634516 Aug 24 03:48:14.143168 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1587/3311] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 24 03:48:12 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:14.143683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:14.144555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:14.146889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:14.147595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:14.149766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:14.174307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:14.179063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:14.179527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.servers [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Removing options 'limit' from query {{(pid=122535) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 03:48:14.181762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:14.193239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:14.196612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:14.197311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:14.198725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:14.214296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:14.215122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:14.267608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:14.282902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:14.285025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:14.287937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:14.813575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:14.839891 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9f43127-8275-44ff-8f31-5bb5405fcd4a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 0.758855 Aug 24 03:48:14.842714 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1725/3312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:14 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:14.927219 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-952fb36a-458b-4926-b9e3-d43677436ccd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.756600 Aug 24 03:48:14.943862 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1588/3313] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 03:48:14 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:14.980411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:15.005985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:15.009186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:15.094651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:15.099691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:15.101579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.104138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:15.105486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:15.108129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.403069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:15.530683 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-26018205-1b4f-4739-b38f-b608cddb0ce6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.553344 Aug 24 03:48:15.533391 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1726/3314] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:48:14 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:15.548429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:15.554651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:15.555596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.servers [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Removing options 'limit' from query {{(pid=122535) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 03:48:15.557416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:15.593097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:15.594383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:15.595030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.596068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:15.599379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:15.600289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.645974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:15.680954 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e908172-f896-455f-9c4f-1e26cab7537d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.137697 Aug 24 03:48:15.682287 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1589/3315] 10.222.0.58 () {58 vars in 1150 bytes} [Wed Aug 24 03:48:15 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:15.694099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:15.704125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:15.705220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:15.719546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:15.725549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:15.726414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.727541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:15.728378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:15.729103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.787386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:15.879521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:15.881494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:15.907770 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-426d5539-d383-47fb-8df0-b9355ba49a60 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.217124 Aug 24 03:48:15.913124 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1727/3316] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 03:48:15 2022] GET /compute/v2.1/servers => generated 1010 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:15.928451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:15.929626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:15.930324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:15.931254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.932720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:15.933392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:15.937070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.947179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:15.948111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:16.002678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:16.003173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:16.003611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:16.018508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:16.018999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:16.019437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:16.328063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:16.474784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c37aaf85-87eb-4fee-ab4f-f322b54ae0ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.555450 Aug 24 03:48:16.475437 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1728/3317] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:48:15 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:16.492770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:16.504176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:16.507204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.compute.servers [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Removing options 'limit' from query {{(pid=122536) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 03:48:16.512013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:16.535605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:16.536678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:16.537604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:16.539288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:16.540455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:16.541215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:16.600925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:16.610904 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3e4ccbbb-640d-4467-b168-b080d6e2a4c6 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 0.749682 Aug 24 03:48:16.616870 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c664d8e-44df-4b77-901f-5959b8222a4c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.131269 Aug 24 03:48:16.619310 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1729/3318] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 24 03:48:16 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:16.624950 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1590/3319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:15 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:16.641244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:16.653164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:16.655740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2131883169', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:16.671401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:16.673492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:16.676017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:16.680050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:16.681085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:16.684166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:16.694484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f897fa24-bb15-494c-8062-3a7db6103a44 req-99ff2970-6f0b-49ed-8bdd-9f7853f92a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c71c41-7d29-483d-a112-6dd9672dd4dc", "name": "network-vif-plugged", "status": "completed", "tag": "0671e371-0fdd-4c82-b5f7-6632fcad4e91"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:16.715819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f897fa24-bb15-494c-8062-3a7db6103a44 req-99ff2970-6f0b-49ed-8bdd-9f7853f92a0f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:16.716622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f897fa24-bb15-494c-8062-3a7db6103a44 req-99ff2970-6f0b-49ed-8bdd-9f7853f92a0f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:16.718083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f897fa24-bb15-494c-8062-3a7db6103a44 req-99ff2970-6f0b-49ed-8bdd-9f7853f92a0f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:16.744298 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f897fa24-bb15-494c-8062-3a7db6103a44 req-99ff2970-6f0b-49ed-8bdd-9f7853f92a0f service nova] Creating event network-vif-plugged:0671e371-0fdd-4c82-b5f7-6632fcad4e91 for instance 79c71c41-7d29-483d-a112-6dd9672dd4dc on n-h1-846470-15 Aug 24 03:48:16.759324 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f897fa24-bb15-494c-8062-3a7db6103a44 req-99ff2970-6f0b-49ed-8bdd-9f7853f92a0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071853 Aug 24 03:48:16.766096 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1591/3320] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:16.863900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:17.035349 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe117f5e-8527-4da6-b28f-050b645297bb tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2131883169" status: 200 len: 346 microversion: 2.1 time: 0.399151 Aug 24 03:48:17.040685 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1730/3321] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:48:16 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2131883169 => generated 346 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:17.053512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fae947c1-4605-4b9b-bc60-ac04aaa5c3ca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:17.073985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fae947c1-4605-4b9b-bc60-ac04aaa5c3ca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:17.079691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fae947c1-4605-4b9b-bc60-ac04aaa5c3ca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:17.080367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fae947c1-4605-4b9b-bc60-ac04aaa5c3ca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:17.159739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fae947c1-4605-4b9b-bc60-ac04aaa5c3ca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Going to try to stop instance {{(pid=122535) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:48:17.266628 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fae947c1-4605-4b9b-bc60-ac04aaa5c3ca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "POST /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.217029 Aug 24 03:48:17.270427 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1592/3322] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:48:17 2022] POST /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:48:17.293531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:17.293924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:17.317447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:17.319406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:17.322897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:17.325993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:17.330473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:17.332607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:17.643370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:17.644625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:17.672006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:17.672689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:17.673827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:17.677781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:17.678581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:17.681116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:18.253950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:18.271504 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f0130838-ea42-4eea-94fa-34a8297f73ec tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1314 microversion: 2.1 time: 0.633757 Aug 24 03:48:18.273557 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1593/3323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:17 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:18.383692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:18.392321 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b57c7e22-5c27-40ec-9a97-fef93ad38d44 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 1.103954 Aug 24 03:48:18.396626 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1731/3324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:17 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:19.295368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:19.297405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:19.308420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:19.310401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:19.313136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:19.314926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:19.317977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:19.319120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:19.418420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:19.420729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:19.423687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:19.442118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:19.447329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:19.447811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:19.448563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:19.449016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:19.449442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:19.782971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:19.797030 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c709e4e6-c491-4164-94a4-affc47c38b88 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.383507 Aug 24 03:48:19.800429 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1732/3325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:19 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:20.129874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:20.139354 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49554e1e-2506-4e7c-8055-6da9ac567134 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1501 microversion: 2.1 time: 0.848283 Aug 24 03:48:20.140533 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1594/3326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:19 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1501 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:20.162111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:20.162663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:20.179807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:20.181076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:20.181949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:20.182967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:20.183659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:20.184382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:20.255540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lazy-loading 'flavor' on Instance uuid 79c71c41-7d29-483d-a112-6dd9672dd4dc {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:48:20.397454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:20.490095 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3f621615-0016-4284-ae0e-4a2a5bbc0211 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "POST /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc/action" status: 202 len: 0 microversion: 2.1 time: 0.332148 Aug 24 03:48:20.491174 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1733/3327] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:48:20 2022] POST /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:48:20.500733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:20.502181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:20.517962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:20.522136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:20.524192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:20.527150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:20.529213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:20.530709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:20.546735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:20.821964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:20.823471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:20.842963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:20.844326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:20.845482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:20.846541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:20.847182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:20.854015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:21.236657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:21.248684 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-158e52cd-d848-42da-b78d-b35ff1b2fd4b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.432886 Aug 24 03:48:21.249767 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1734/3328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:20 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:21.604438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:21.617289 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-57b4ea7f-c226-4a59-8b9d-688f0f829bd4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1509 microversion: 2.1 time: 1.121153 Aug 24 03:48:21.618339 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1595/3329] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:20 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1509 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:22.132068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1492874186", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "7a99e069-8e17-4d00-ae91-a1de82f2c86b"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:22.273805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] validate_networks() for [('7a99e069-8e17-4d00-ae91-a1de82f2c86b', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:22.275900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:22.276719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:22.288566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:22.289201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:22.292258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:22.293026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:22.293507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:22.293945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:23.314759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:23.329416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7e239a43-79ea-4dbd-9e75-c74a29b26439 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 1.058344 Aug 24 03:48:23.332052 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1596/3330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:22 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:23.340305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:23.349789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:23.379283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:23.385134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:23.386053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:23.390682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:23.397923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:23.399905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.113982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:24.145772 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e5ad209-3682-41c5-b30c-1db7a1387fa4 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1492 microversion: 2.1 time: 0.807447 Aug 24 03:48:24.149868 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1597/3331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:23 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1492 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:24.182100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:24.183633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:24.208480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.209778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.210754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.212371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.212371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.220256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.271645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:24.287822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:48:24.464486 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a95c946-73a9-4ada-a220-f6ed6d3dc8d7 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 204 len: 0 microversion: 2.1 time: 0.293990 Aug 24 03:48:24.468858 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1598/3332] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:24 2022] DELETE /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:48:24.488367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:24.489123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:24.507075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.507639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.508287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.509158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.509685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.510126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.593085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:24.593630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:24.594003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:24.594793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:24.595218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:24.618081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.618619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.622146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.623566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.624307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.630962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.698528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Getting quotas for project a8dc921cf81944b9858afda3098e219f. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:24.720415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Getting quotas for user 7e6694115e084b78b1a47596f56e8434 and project a8dc921cf81944b9858afda3098e219f. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:24.747562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:24.755210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:24.865292 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-46fa45c9-8058-4b5c-a03a-1143e64eb760 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.600355 Aug 24 03:48:24.866092 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1735/3333] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:24.879496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:24.887741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:24.908644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.909374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.909932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.910770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.911351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.911925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:25.427264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:25.440309 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0330046e-5590-4035-8423-89e9c89c9545 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1498 microversion: 2.1 time: 0.564586 Aug 24 03:48:25.443019 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1736/3334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:24 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1498 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:25.453714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6eac0d91-0217-46ac-ac7b-ab85e92d12b4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:25.454763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6eac0d91-0217-46ac-ac7b-ab85e92d12b4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:25.609632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=10 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:25.696376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6eac0d91-0217-46ac-ac7b-ab85e92d12b4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:25.715136 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6eac0d91-0217-46ac-ac7b-ab85e92d12b4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1228 microversion: 2.1 time: 0.270592 Aug 24 03:48:25.716239 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1737/3335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:25 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1228 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:26.109006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:26.153064 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7f407be7-f883-4662-b711-4555af31f724 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 1.684949 Aug 24 03:48:26.156440 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1599/3336] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:24 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:26.465234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:26.466347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:26.503260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.508459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.510419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.513674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.520438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.523167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.744272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:26.745608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:26.764301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.766623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.769502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.772938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.773723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.776942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:27.053469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:27.081914 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63191525-7f75-4ca7-ba8f-72eb9ee2b620 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1498 microversion: 2.1 time: 0.623513 Aug 24 03:48:27.084649 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1738/3337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:26 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1498 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:27.183383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:27.184043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:27.197388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:27.197901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:27.198350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:27.199261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:27.199556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:27.230088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:27.368357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:27.379473 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ab36862-94b7-4baa-b97a-d858ed075051 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1280 microversion: 2.1 time: 0.640223 Aug 24 03:48:27.394682 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1600/3338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:26 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1280 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:27.677462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:27.693043 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b59953dd-a250-4f15-8e76-28b188ad7d47 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.514792 Aug 24 03:48:27.708443 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1739/3339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:27 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:28.104123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:28.104756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:28.118059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.118472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.118920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.120540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.121228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.121845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.415241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:28.416376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:28.444003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.445214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.446255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.447771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.451870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.457581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.684780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:28.692934 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-288fd506-6c8d-4fc4-ae50-18def6cf88cb tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1286 microversion: 2.1 time: 0.286723 Aug 24 03:48:28.697298 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1740/3340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:28 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1286 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:28.722566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:28.723731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:28.739226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.740779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.741598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.745063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.745854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.746508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:29.010320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:29.020689 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07e4864f-697b-4980-800d-3134bb5555c4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.308695 Aug 24 03:48:29.023024 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1741/3341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:28 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:29.094363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:29.106570 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-71dc7cad-727a-48e3-a60d-8abcc97cd7c5 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1498 microversion: 2.1 time: 1.006685 Aug 24 03:48:29.112248 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1601/3342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:28 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1498 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:29.749391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:29.750014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:29.750908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-24e3bc5c-01ab-4490-8d4c-b3d389edc6da req-a0fc0525-3931-47b8-a56a-adf43416739d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c71c41-7d29-483d-a112-6dd9672dd4dc", "name": "network-vif-deleted", "tag": "0671e371-0fdd-4c82-b5f7-6632fcad4e91"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:29.792447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-24e3bc5c-01ab-4490-8d4c-b3d389edc6da req-a0fc0525-3931-47b8-a56a-adf43416739d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:29.794120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:29.797472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:29.798947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:29.801474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:29.802680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:29.803548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-24e3bc5c-01ab-4490-8d4c-b3d389edc6da req-a0fc0525-3931-47b8-a56a-adf43416739d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:29.804564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:29.807393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-24e3bc5c-01ab-4490-8d4c-b3d389edc6da req-a0fc0525-3931-47b8-a56a-adf43416739d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:29.865503 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-24e3bc5c-01ab-4490-8d4c-b3d389edc6da req-a0fc0525-3931-47b8-a56a-adf43416739d service nova] Creating event network-vif-deleted:0671e371-0fdd-4c82-b5f7-6632fcad4e91 for instance 79c71c41-7d29-483d-a112-6dd9672dd4dc on n-h1-846470-15 Aug 24 03:48:29.879874 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-24e3bc5c-01ab-4490-8d4c-b3d389edc6da req-a0fc0525-3931-47b8-a56a-adf43416739d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149153 Aug 24 03:48:29.884653 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1602/3343] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:29.983979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:29.994823 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0d18cfcb-afac-41e3-8ee9-dcbd7464f7f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1286 microversion: 2.1 time: 0.263930 Aug 24 03:48:29.999360 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1742/3344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:29 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1286 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:30.052977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:30.054118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:30.065355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.066359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.067077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.072012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.074426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.079693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.140193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:30.141011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:30.184225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.184774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.185227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.190844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.191330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.191799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.309830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.310598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.311050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.311509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lazy-loading 'fault' on Instance uuid 79c71c41-7d29-483d-a112-6dd9672dd4dc {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:48:30.397997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a1414940b14e459202a86bd8e9027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfa603927cb4c67b703a483adf2e350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:30.409044 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aac2ff71-94ec-49d7-a9c4-1778c04f4896 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 200 len: 1304 microversion: 2.1 time: 0.276629 Aug 24 03:48:30.411746 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1743/3345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:30 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 1304 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:31.022259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.024475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.041535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.042025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.042456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.047206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.052539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.053368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.258336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:31.291981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84de6406-fc13-4110-aa45-24762afea943 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 1.241130 Aug 24 03:48:31.293725 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1603/3346] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:30 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:31.438239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.439959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.462740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:31.475079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.478927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.479479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.481530 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6274763d-d220-4247-ae4f-22237e9db0cc tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 0.462487 Aug 24 03:48:31.482428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.482925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.483367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.485430 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1744/3347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:31 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:31.558710 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc HTTP/1.1 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '79c71c41-7d29-483d-a112-6dd9672dd4dc'} Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.566000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.571535 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.571535 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.571535 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.571535 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.571535 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.571535 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.571535 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.575053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.577632 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7803ff78-05c7-4528-93d6-f33f6221c00c tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 404 len: 111 microversion: 2.1 time: 0.148380 Aug 24 03:48:31.579138 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1604/3348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:31 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:31.613559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.614904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.644234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.650723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.651535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.658915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.662197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.663004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.699880 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc HTTP/1.1 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '79c71c41-7d29-483d-a112-6dd9672dd4dc'} Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:31.705029 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.710530 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.713433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.719090 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1d18db4-7a32-4c04-895e-9f40bfdf662e tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 404 len: 111 microversion: 2.1 time: 0.125129 Aug 24 03:48:31.723609 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1745/3349] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:31 2022] DELETE /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:31.733461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.734774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 79c71c41-7d29-483d-a112-6dd9672dd4dc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.755821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.759154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.760869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.764457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.766396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.771397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.837219 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc HTTP/1.1 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '79c71c41-7d29-483d-a112-6dd9672dd4dc'} Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.839610 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance 79c71c41-7d29-483d-a112-6dd9672dd4dc could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b51c9252-2a73-426d-9cda-d38e219fde24 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc" status: 404 len: 111 microversion: 2.1 time: 0.115310 Aug 24 03:48:31.850451 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1605/3350] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:31 2022] GET /compute/v2.1/servers/79c71c41-7d29-483d-a112-6dd9672dd4dc => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:31.856025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.856839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.901011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.901957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.902605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.903594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.904319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.904962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.928376 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c HTTP/1.1 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '2fd33548-7ee6-48cf-aa74-2f649e35ee8c'} Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:31.930920 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:31.936266 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.938855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.940100 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d3979a01-d607-47dc-b770-7740e6ebada1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 404 len: 111 microversion: 2.1 time: 0.089666 Aug 24 03:48:31.941209 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1746/3351] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:31 2022] DELETE /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:31.950240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.950876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: 2fd33548-7ee6-48cf-aa74-2f649e35ee8c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.962974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.963491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.963992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.974439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.975309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.976152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.026236 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c HTTP/1.1 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '2fd33548-7ee6-48cf-aa74-2f649e35ee8c'} Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.028206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.032764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.032764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.032764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.032764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:32.032764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:32.032764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. Aug 24 03:48:32.032764 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.034334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance 2fd33548-7ee6-48cf-aa74-2f649e35ee8c could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:32.039113 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-14c0a11b-e16c-4edc-9466-4fed7f379ed3 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c" status: 404 len: 111 microversion: 2.1 time: 0.093574 Aug 24 03:48:32.040623 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1606/3352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:31 2022] GET /compute/v2.1/servers/2fd33548-7ee6-48cf-aa74-2f649e35ee8c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:48:32.052167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:32.053476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:32.080260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.081066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.081515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.082292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.082762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.083350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.143479 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 HTTP/1.1 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9'} Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:32.147279 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-670ec7e2-981a-4454-ac34-10ecafab7210 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 404 len: 111 microversion: 2.1 time: 0.102225 Aug 24 03:48:32.153824 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1747/3353] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:32 2022] DELETE /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:32.158573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:32.159239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:32.182911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.183424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.183907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.184670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.185212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.185721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.220750 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 HTTP/1.1 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9'} Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.222848 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:32.227811 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90ee0e46-52f7-46d7-b40f-7f36961ffd19 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9" status: 404 len: 111 microversion: 2.1 time: 0.069844 Aug 24 03:48:32.229058 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1607/3354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:32 2022] GET /compute/v2.1/servers/acb00cfe-fe82-4cee-9b3d-dae8a66a5bc9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:32.235444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:32.236954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:32.247889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.248642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.249446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.250952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.251529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.252242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.274274 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 HTTP/1.1 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd6f592d0-43b7-4c80-8c74-6bc035624134'} Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:32.276629 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.282817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.285971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:32.287011 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5662efa4-b461-4bd9-8ba2-24726cf6b64a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 404 len: 111 microversion: 2.1 time: 0.056371 Aug 24 03:48:32.287594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1748/3355] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:32 2022] DELETE /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:48:32.304044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:32.306266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: d6f592d0-43b7-4c80-8c74-6bc035624134] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:32.314837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:32.315566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:32.320902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.322355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.323040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.324386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.325139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.325820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.327844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.328857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.330728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.331812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.332845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.333472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.351296 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 HTTP/1.1 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd6f592d0-43b7-4c80-8c74-6bc035624134'} Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.356901 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.363181 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.363181 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.363181 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.363181 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:32.363181 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:32.363181 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. Aug 24 03:48:32.363181 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.366314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance d6f592d0-43b7-4c80-8c74-6bc035624134 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:32.367969 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-154019c4-6583-4ab6-a6f3-916a3514f1fd tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134" status: 404 len: 111 microversion: 2.1 time: 0.072261 Aug 24 03:48:32.373407 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1608/3356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:32 2022] GET /compute/v2.1/servers/d6f592d0-43b7-4c80-8c74-6bc035624134 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:48:32.380003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:32.380928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:32.388840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.389707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.390379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.391336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.392084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.392998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.413341 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 HTTP/1.1 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7'} Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:32.417026 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.426579 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.430239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:32.432499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6351d373-a5a4-4914-944e-2ac8928c9ef1 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7" status: 404 len: 111 microversion: 2.1 time: 0.056948 Aug 24 03:48:32.433397 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1609/3357] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:32 2022] DELETE /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:32.444119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:32.445237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:32.458283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.460490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.461507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.462860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.464090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.464785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.485804 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 HTTP/1.1 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7'} Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.489090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.496308 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.496308 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.496308 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.496308 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:32.496308 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:32.496308 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. Aug 24 03:48:32.496308 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.496308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:32.497441 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a5e16042-6f18-4ff4-b51c-a8bd9fe1344f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7" status: 404 len: 111 microversion: 2.1 time: 0.057272 Aug 24 03:48:32.510513 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1610/3358] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:32 2022] GET /compute/v2.1/servers/a6fbdfbf-f1b5-432d-a89a-9dfe588f3ac7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:32.517348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:32.517846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:32.526987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.527827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.529652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.534359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:32.535595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:32.536776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.734892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:32.746336 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24894235-e2c5-4542-9214-16b3501467e4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.435660 Aug 24 03:48:32.751511 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1749/3359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:32 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:33.407034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:33.425613 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a2d823cf-5cc4-4e78-a07e-4ccb1eeabf6e tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 0.913510 Aug 24 03:48:33.427031 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1611/3360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:32 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:33.776514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:33.777120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:33.792367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.792877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.793328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.794369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.795178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.795965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.222122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:34.230635 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3c341480-4218-4e4a-9f0e-b656fe719290 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.458266 Aug 24 03:48:34.238318 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1750/3361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:33 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:34.457247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:34.457908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:34.487740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.488234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.488686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.489419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.490848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.492874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:35.261317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:35.262019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:35.264410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.295364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:35.296305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:35.296848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:35.297300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:35.299110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:35.299583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:35.300649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:35.312585 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae2212d6-f057-405b-a333-4bab00cc2b4c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 0.858107 Aug 24 03:48:35.313426 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1612/3362] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:34 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:35.419349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-46a4a607-a672-40d3-812f-d6b2f22ae2dc req-a5ac69d7-cf5f-4480-9be9-1494931c2982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b11b08f-62ed-4616-bf0f-3e82f4e2249f", "tag": "aac7df7f-a0e7-4430-b8a0-282941c84f56"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:35.444910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-46a4a607-a672-40d3-812f-d6b2f22ae2dc req-a5ac69d7-cf5f-4480-9be9-1494931c2982 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:35.449544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-46a4a607-a672-40d3-812f-d6b2f22ae2dc req-a5ac69d7-cf5f-4480-9be9-1494931c2982 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:35.451108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-46a4a607-a672-40d3-812f-d6b2f22ae2dc req-a5ac69d7-cf5f-4480-9be9-1494931c2982 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:35.500144 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-46a4a607-a672-40d3-812f-d6b2f22ae2dc req-a5ac69d7-cf5f-4480-9be9-1494931c2982 service nova] Creating event network-changed:aac7df7f-a0e7-4430-b8a0-282941c84f56 for instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f on n-h2-846470-15 Aug 24 03:48:35.516758 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-46a4a607-a672-40d3-812f-d6b2f22ae2dc req-a5ac69d7-cf5f-4480-9be9-1494931c2982 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107411 Aug 24 03:48:35.520769 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1613/3363] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:35.702067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.785967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:35.802000 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-746974a0-7fea-4937-8c34-70c92da0756f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.545024 Aug 24 03:48:35.805260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1751/3364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:35 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:36.341650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:36.342685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:36.362727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:36.366393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:36.366923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:36.371877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:36.372297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:36.372766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:36.826365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:36.827697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:36.840995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:36.846825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:36.847282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:36.848101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:36.848558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:36.848995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:37.212233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:37.224629 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-292d098a-4b0b-4637-b4b9-641637636062 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.402664 Aug 24 03:48:37.225370 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1752/3365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:36 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:37.230431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:37.230748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:37.256606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:37.257703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:37.264388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:37.265660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:37.266159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:37.266602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:37.315212 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f6f0caab-0993-479c-a707-2f6d346a37e1 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/ips" status: 200 len: 146 microversion: 2.1 time: 0.088305 Aug 24 03:48:37.316234 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1753/3366] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:48:37 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/ips => generated 146 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:37.496889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:37.515592 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19c63b9c-8511-40ad-b34c-6036db7eecec tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 1.177997 Aug 24 03:48:37.520416 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1614/3367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:36 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:38.253962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:38.255438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:38.272189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:38.275361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:38.276185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:38.277313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:38.280804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:38.281555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:38.339197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:38.489706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:38.490228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:38.509505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:38.510850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:38.513489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:38.514852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:38.517040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:38.518257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:38.565604 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 HTTP/1.1 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'c514243f-2dde-48fb-868d-a27be663f606'} Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:38.571628 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.576689 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.580940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:38.585700 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8556618-c8c7-4f9b-aa4c-c4a21917781a tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 404 len: 111 microversion: 2.1 time: 0.100135 Aug 24 03:48:38.588917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:38.596696 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1615/3368] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:38 2022] DELETE /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:38.633360 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37ddda99-0db5-4a41-ad0c-9ad2319b3556 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1521 microversion: 2.1 time: 0.383296 Aug 24 03:48:38.634398 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1754/3369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:38 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:38.649859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:38.649859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:38.670457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:38.671070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: c514243f-2dde-48fb-868d-a27be663f606] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:38.674933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:38.676384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:38.677147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:38.678348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:38.679216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:38.680971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:38.706066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:38.707516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:38.708341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:38.709899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:38.710693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:38.711510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:38.781463 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 HTTP/1.1 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c514243f-2dde-48fb-868d-a27be663f606'} Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:38.793775 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance c514243f-2dde-48fb-868d-a27be663f606 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:38.798292 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d7d4aacf-708b-4427-ab32-56f8036b557f tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606" status: 404 len: 111 microversion: 2.1 time: 0.137357 Aug 24 03:48:38.800930 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1755/3370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:38 2022] GET /compute/v2.1/servers/c514243f-2dde-48fb-868d-a27be663f606 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:38.903614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:38.907463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:38.917226 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac5ada1a-497f-450b-b7a3-0d8f35686400 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 0.319115 Aug 24 03:48:38.918104 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1616/3371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:38 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:39.202782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1697808858", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:39.291500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:39.296196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1616741959", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "4b4b0f73-47dd-4e40-8f8a-2b8508c60e5b"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:39.412600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] validate_networks() for [('4b4b0f73-47dd-4e40-8f8a-2b8508c60e5b', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:39.710260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:39.710750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:39.711435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:39.712239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:39.713492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:39.731547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:39.732259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:39.732940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:39.734355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:39.734864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:39.735297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:39.776482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:39.786510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for user 1121b62203674b82ae3c7cfcb3112eb5 and project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:39.808851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:39.813146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:39.925325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-471c37d1-3349-4694-9a23-afe6d04ba62e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123003 Aug 24 03:48:39.926296 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1756/3372] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:39.938221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:39.938717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:39.981113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:39.981616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:39.982089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:39.982844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:39.983303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:39.983745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:40.030942 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 HTTP/1.1 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'da0caddd-5b22-458c-9054-70aaf23a5d10'} Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:40.033395 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:40.038914 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-25bc64ef-d8f5-4819-8b04-8002896a5f73 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "DELETE /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 404 len: 111 microversion: 2.1 time: 0.105922 Aug 24 03:48:40.051902 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1757/3373] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:39 2022] DELETE /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:40.061054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:40.061810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:40.097210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:40.097717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:40.098165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:40.098882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:40.099340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:40.099801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:40.650218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:40.659068 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab3669cc-f8ee-41b8-a5e7-6931f11e80ff tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1498 microversion: 2.1 time: 0.605901 Aug 24 03:48:40.663581 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1758/3374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:40 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1498 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:40.681931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d6265d78-dd44-4400-8d89-928c2c109311 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:40.682833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d6265d78-dd44-4400-8d89-928c2c109311 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:40.893746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d6265d78-dd44-4400-8d89-928c2c109311 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:40.903442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d6265d78-dd44-4400-8d89-928c2c109311 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1213 microversion: 2.1 time: 0.226998 Aug 24 03:48:40.904329 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1759/3375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:40 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1213 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:40.937482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:40.937958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:40.995218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:40.997695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:40.998990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:40.999822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.001341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.004320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.400540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:41.440954 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0d581244-03a1-40ed-90f1-bea8c9e0a2d0 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 0.535105 Aug 24 03:48:41.445041 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1760/3376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:40 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:41.461039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:41.462279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:41.463025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:41.463595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:41.464500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:41.478641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:41.480774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] [instance: da0caddd-5b22-458c-9054-70aaf23a5d10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:41.485097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.485855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.486449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.500053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.500606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.501058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.504728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.509327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.510366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.511532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.517756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.517756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.563821 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] HTTP exception thrown: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Request method failure captured: Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 HTTP/1.1 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ5PD-GCMnm_R9gXHNWqddebXCfdArcUEkapG2QQdqZ5jOx7GN8ltx3r4l6z4zbKxpMv5MrD3ruf8lnNbfi3g3-ZhiFKRH9J0t2ZOmTquO4P3qHU7d5dq3oSpedc9teOCIy9UHYZQaQiBodg82PwzDpMHnPCU3p58PfTDK52ViGWed0 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ecfa603927cb4c67b703a483adf2e350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: ecfa603927cb4c67b703a483adf2e350 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178857496 Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 69a1414940b14e459202a86bd8e9027b Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-1178857496-project Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'da0caddd-5b22-458c-9054-70aaf23a5d10'} Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:41.568057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] Returning 404 to user: Instance da0caddd-5b22-458c-9054-70aaf23a5d10 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:41.574294 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5004587a-5316-45a7-bc3d-9c42233c1e11 tempest-DeleteServersTestJSON-1178857496 tempest-DeleteServersTestJSON-1178857496-project] 10.222.0.58 "GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10" status: 404 len: 111 microversion: 2.1 time: 0.124717 Aug 24 03:48:41.575450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Getting quotas for project 132aea84f10441f0bb7e83a28d42a493. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:41.577571 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1761/3377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:41 2022] GET /compute/v2.1/servers/da0caddd-5b22-458c-9054-70aaf23a5d10 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:41.587565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Getting quotas for user 5d094306e1f5485ba58fa320e13100a6 and project 132aea84f10441f0bb7e83a28d42a493. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:41.590695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08da4ca5-a0cb-44ce-b8f5-c877c27ed2c0"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:41.605857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:41.639089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.639621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.648841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.649835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.650235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.650671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.655050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:41.671130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:41.811419 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d32f1c89-cd3b-4db8-bf9e-2a152e9b3954 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.892144 Aug 24 03:48:41.821781 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1617/3378] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:41.846462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:41.878939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:41.878939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:41.905592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.907181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.907683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.908761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.910446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.910750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.164407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:42.284261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b3aba58b-a296-4b84-8674-c5bcfa71f2ed tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705370 Aug 24 03:48:42.290195 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-938aa85e-0ed3-44b7-8e50-6057d91eb329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.467261 Aug 24 03:48:42.290779 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1618/3379] 10.222.0.58 () {58 vars in 1154 bytes} [Wed Aug 24 03:48:41 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:42.292524 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1762/3380] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:48:41 2022] POST /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:42.311865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74e7d198-603f-4a67-8e6b-51a09ccf136c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.312453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74e7d198-603f-4a67-8e6b-51a09ccf136c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:42.315969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.316783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:42.330919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.333759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.334512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.340418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.347192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.347566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.513118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74e7d198-603f-4a67-8e6b-51a09ccf136c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:42.540765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74e7d198-603f-4a67-8e6b-51a09ccf136c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1217 microversion: 2.1 time: 0.248620 Aug 24 03:48:42.541610 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1619/3381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:42.572349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67c121b8-75e9-4f85-8491-a4a87331a128 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:42.587988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c121b8-75e9-4f85-8491-a4a87331a128 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.602495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c121b8-75e9-4f85-8491-a4a87331a128 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.602889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c121b8-75e9-4f85-8491-a4a87331a128 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.710278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-67c121b8-75e9-4f85-8491-a4a87331a128 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Going to try to start instance {{(pid=122535) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:48:42.846122 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67c121b8-75e9-4f85-8491-a4a87331a128 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "POST /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.291419 Aug 24 03:48:42.854064 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1620/3382] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:48:42 2022] POST /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:48:42.872213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.876799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:42.889641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.892382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.893877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.896580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.897288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.899510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.927791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:42.938420 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f28caa0f-a1ce-49fe-bc6c-8472c2d7cd81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1265 microversion: 2.1 time: 0.644501 Aug 24 03:48:42.947483 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1763/3383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1265 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:42.974544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.979060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:43.008002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:43.012853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:43.018506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:43.020314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:43.024586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:43.025433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:43.977838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:43.998047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bcea5b09-0cb7-46bb-9f9d-1f7a0c17b3c5 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1507 microversion: 2.1 time: 1.046355 Aug 24 03:48:43.999004 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1764/3384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1507 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:44.014221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:44.015157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:44.019995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:44.036270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:44.037567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:44.040208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:44.042303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:44.048148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:44.048925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:44.250764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:44.266666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:44.274265 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c260da7-febf-4375-8d3a-4d08964a1385 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1269 microversion: 2.1 time: 0.272236 Aug 24 03:48:44.275476 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1765/3385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:44 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1269 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:44.280403 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-65bae35d-3c71-4aab-be48-7ac694975df4 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 1.421947 Aug 24 03:48:44.280630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:44.281004 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1621/3386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:44.287307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:44.300222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:44.301081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:44.301712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:44.302923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:44.303706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:44.305552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:44.616812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:44.653370 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44365cdd-812b-4345-8ea9-af5756a1bf5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1271 microversion: 2.1 time: 0.376698 Aug 24 03:48:44.658575 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1766/3387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:44 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1271 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:45.025410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:45.026049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:45.033694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:45.059230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.059919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.060378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.088427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.089449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.090437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.299815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:45.302525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:45.325449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.326332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.327077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.328078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.329183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.329859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.645268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:45.662562 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d889a7b-cf91-4d28-bbde-07b37cbc478a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1275 microversion: 2.1 time: 0.370078 Aug 24 03:48:45.667024 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1767/3388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:45 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1275 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:45.684475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:45.685396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:45.696594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.697449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.698105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.699150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.699815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.700432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.846185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:45.860234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b2a3d9e-4ad5-4249-b742-fb74f74c030b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1507 microversion: 2.1 time: 0.834958 Aug 24 03:48:45.873052 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1622/3389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:45 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1507 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:45.891566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:45.894943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:45.914003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.914931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.917173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.918983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.920294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.924433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.060081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:46.081225 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87d87241-6ec4-4c28-a900-3406f36fda10 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1271 microversion: 2.1 time: 0.205883 Aug 24 03:48:46.082937 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1623/3390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:45 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:46.210223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:46.223263 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3838446-7dff-43a8-9086-d14086ed89f8 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 0.550650 Aug 24 03:48:46.224106 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1768/3391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:45 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:46.327147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d4f2b9bb-145a-40e0-8bbc-226e09158d6e req-f6429dcb-5a3f-4088-96ea-b38c50c0def7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b11b08f-62ed-4616-bf0f-3e82f4e2249f", "name": "network-vif-plugged", "status": "completed", "tag": "aac7df7f-a0e7-4430-b8a0-282941c84f56"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:46.349298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d4f2b9bb-145a-40e0-8bbc-226e09158d6e req-f6429dcb-5a3f-4088-96ea-b38c50c0def7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.353768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d4f2b9bb-145a-40e0-8bbc-226e09158d6e req-f6429dcb-5a3f-4088-96ea-b38c50c0def7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.355644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d4f2b9bb-145a-40e0-8bbc-226e09158d6e req-f6429dcb-5a3f-4088-96ea-b38c50c0def7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.393861 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d4f2b9bb-145a-40e0-8bbc-226e09158d6e req-f6429dcb-5a3f-4088-96ea-b38c50c0def7 service nova] Creating event network-vif-plugged:aac7df7f-a0e7-4430-b8a0-282941c84f56 for instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f on n-h2-846470-15 Aug 24 03:48:46.393861 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d4f2b9bb-145a-40e0-8bbc-226e09158d6e req-f6429dcb-5a3f-4088-96ea-b38c50c0def7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069334 Aug 24 03:48:46.393861 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1624/3392] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:46.688109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:46.688660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:46.719797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.722606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.725172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.729626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.731447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.732715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.887035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:46.889456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:46.910078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.910578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.911017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.912439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.912935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.913365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.986041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:47.003098 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f356f5c2-b553-4924-87a3-10a239240408 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1275 microversion: 2.1 time: 0.319098 Aug 24 03:48:47.004058 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1769/3393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:46 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1275 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:47.102718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:47.103333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:47.115069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.116067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.116766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.118066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.121102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.122119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.587891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:47.603598 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7df9e33b-044e-417f-a7eb-6179466e5927 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.503911 Aug 24 03:48:47.604270 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1770/3394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:47 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:47.634716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:47.637206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:47.648372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.649961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.650612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.651984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.653444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.654589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.834845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:47.844075 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4d5face-aee9-4705-9632-dc36bcd28a0b tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1511 microversion: 2.1 time: 0.962073 Aug 24 03:48:47.844964 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1625/3395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:46 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1511 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:47.872823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:47.892433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:47.893241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.servers [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Removing options 'limit' from query {{(pid=122535) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 03:48:47.894060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:47.895508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.896256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.896913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.905382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.905966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.907018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.912050 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aba0dd21-accb-4f31-8bb0-19c86435193c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.041483 Aug 24 03:48:47.915813 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1626/3396] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 24 03:48:47 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:48:47.929203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:47.931228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:47.942982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.943703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.944697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.946247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.946871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.947506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.333849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:48.353069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0600ad3-7d18-469e-95d1-947abb0e310c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1328 microversion: 2.1 time: 0.747626 Aug 24 03:48:48.355052 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1771/3397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:47 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1328 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:48.373031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:48.374455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:48.402875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:48.408541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:48.410207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.412058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:48.414189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:48.414865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.077760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:49.095370 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d87ed0b-9e3f-45b9-a8cc-b75cab241a1a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.735672 Aug 24 03:48:49.096263 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1772/3398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:48 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:49.108033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:49.111770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:49.125595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.127888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.128637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.129594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.133405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.134040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.146802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:49.718074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:49.737171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1bfa8478-b610-4e3c-9d80-be482c1b311f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.639552 Aug 24 03:48:49.753677 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1773/3399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:49 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:49.771638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:49.775734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:49.795883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:49.815286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:49.817424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.818516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.818975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.819726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.820905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.821532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.826491 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fac7a0ba-bd04-49fe-9363-5d06d03842e7 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1511 microversion: 2.1 time: 1.903491 Aug 24 03:48:49.831314 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1627/3400] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:47 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1511 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:49.858874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:49.867938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:49.890045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.894492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.894963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.895735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.896207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.898466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.265411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:50.303400 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-afe344ba-08bc-4990-b5d9-255ea27047dd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1527 microversion: 2.1 time: 0.548091 Aug 24 03:48:50.316296 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1774/3401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:49 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1527 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:50.346109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.347918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:50.375808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.380119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.383830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.385284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.388482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.390527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.404021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:50.421732 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-075f9700-d937-41d4-8dae-19b9f0746e1e tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 200 len: 1510 microversion: 2.1 time: 0.566677 Aug 24 03:48:50.422347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1628/3402] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:49 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 1510 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:50.438263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.440832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:50.463829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.466399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.468211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.470969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.472628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.474526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.902084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:51.171696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:51.187803 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae489b55-2f4f-45e5-93d8-c68bd9689006 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1527 microversion: 2.1 time: 0.760367 Aug 24 03:48:51.194347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1629/3403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:50 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1527 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:51.208435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:51.212548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:51.239074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.240534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.243101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.244087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.244957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.246728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.764126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:51.775821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a957307b-8c39-4e6d-b428-9bcc885ba154 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1510 microversion: 2.1 time: 0.579505 Aug 24 03:48:51.789696 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1630/3404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:51 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1510 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:51.816372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-15f7d636-2784-4a27-bbc2-983e52c802b4 req-c0803e7b-ad8e-4a55-a861-53a800e6d098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47cbf84-c598-4d84-b81a-8eca598e1f10", "tag": "7f5412b6-161b-4e0a-959a-bc19d45e58f6"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:51.841542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-15f7d636-2784-4a27-bbc2-983e52c802b4 req-c0803e7b-ad8e-4a55-a861-53a800e6d098 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.843448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-15f7d636-2784-4a27-bbc2-983e52c802b4 req-c0803e7b-ad8e-4a55-a861-53a800e6d098 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.846744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-15f7d636-2784-4a27-bbc2-983e52c802b4 req-c0803e7b-ad8e-4a55-a861-53a800e6d098 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.876264 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-15f7d636-2784-4a27-bbc2-983e52c802b4 req-c0803e7b-ad8e-4a55-a861-53a800e6d098 service nova] Creating event network-changed:7f5412b6-161b-4e0a-959a-bc19d45e58f6 for instance c47cbf84-c598-4d84-b81a-8eca598e1f10 on n-h1-846470-15 Aug 24 03:48:51.887070 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-15f7d636-2784-4a27-bbc2-983e52c802b4 req-c0803e7b-ad8e-4a55-a861-53a800e6d098 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095396 Aug 24 03:48:51.888862 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1631/3405] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:51.915992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:51.916448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:51.932284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.934263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.936564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.939269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.940216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.941033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.038353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:52.119896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:52.133935 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b96286cb-6af4-4563-87c7-e48137e1f6a4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 1.800095 Aug 24 03:48:52.136254 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1775/3406] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:50 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:52.472952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:52.505619 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a993a904-a540-4260-bf82-c8529e4d3889 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.613050 Aug 24 03:48:52.508059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1632/3407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:51 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:52.521934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:52.526075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:52.527077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:52.533682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:52.534496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:52.535125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.535829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.536377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.537815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.538609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.539291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.544760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:52.572054 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] HTTP exception thrown: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Request method failure captured: Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f HTTP/1.1 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ-EPN4M9hTZs1GNWbLlAFYKbkUqAKIOlwlc-cCeFJjftH9IwL9wR0MkxFv58hvOJQpragSruWKJOZqLZ44AQJIKc9YxpkCgKC1Kk2UUdNQyXkC75vHTKr-sG8Wzkn9LOWSZK478_d9xYj8nZEm2QesPgRLlf2K1mkTMGg4-uDukX6c Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 1d2091ee056f4379b649ffdafdf1b311 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-377706449 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1d2091ee056f4379b649ffdafdf1b311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1d2091ee056f4379b649ffdafdf1b311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1d2091ee056f4379b649ffdafdf1b311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1d2091ee056f4379b649ffdafdf1b311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-377706449 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 1d2091ee056f4379b649ffdafdf1b311 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-377706449 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestMultiTenantJSON-377706449-project Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0024ad71f1fd46a2beb81c1235491154 Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-377706449-project Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9b11b08f-62ed-4616-bf0f-3e82f4e2249f'} Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:52.574247 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:52.579692 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:52.585057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Returning 404 to user: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:52.585057 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-910e4406-8fdf-4239-871a-aae93d58a658 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 404 len: 111 microversion: 2.1 time: 0.445585 Aug 24 03:48:52.585057 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1776/3408] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:52 2022] DELETE /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 111 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:52.595619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:52.596410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:52.606076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.606609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.607119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.608691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.609471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.609928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.887154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.887893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.888522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.889687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.890356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.890966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.936122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:52.945166 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd55f10a-fa15-459f-bacb-ec8e25d1095c tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1527 microversion: 2.1 time: 0.354524 Aug 24 03:48:52.948227 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1777/3409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:52 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1527 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:52.973354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Action: 'update', calling method: >, body: {"server": {"name": "9b11b08f-62ed-4616-bf0f-3e82f4e2249f_new"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:52.977924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:52.992791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.993665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.994357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.995901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.999643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.000412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.037210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:53.041422 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] HTTP exception thrown: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Request method failure captured: Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: request: PUT /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f HTTP/1.1 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 64 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ-EPN4M9hTZs1GNWbLlAFYKbkUqAKIOlwlc-cCeFJjftH9IwL9wR0MkxFv58hvOJQpragSruWKJOZqLZ44AQJIKc9YxpkCgKC1Kk2UUdNQyXkC75vHTKr-sG8Wzkn9LOWSZK478_d9xYj8nZEm2QesPgRLlf2K1mkTMGg4-uDukX6c Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 1d2091ee056f4379b649ffdafdf1b311 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-377706449 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1d2091ee056f4379b649ffdafdf1b311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1d2091ee056f4379b649ffdafdf1b311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1d2091ee056f4379b649ffdafdf1b311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1d2091ee056f4379b649ffdafdf1b311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-377706449 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 1d2091ee056f4379b649ffdafdf1b311 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-377706449 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestMultiTenantJSON-377706449-project Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0024ad71f1fd46a2beb81c1235491154 Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-377706449-project Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "9b11b08f-62ed-4616-bf0f-3e82f4e2249f_new"}} Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9b11b08f-62ed-4616-bf0f-3e82f4e2249f', 'body': {'server': {'name': '9b11b08f-62ed-4616-bf0f-3e82f4e2249f_new'}}} Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:48:53.045033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:48:53.049643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:48:53.055759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] Returning 404 to user: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:53.057019 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9cfafa4b-c5c1-40a4-8b24-449cc6154684 tempest-ServersNegativeTestMultiTenantJSON-377706449 tempest-ServersNegativeTestMultiTenantJSON-377706449-project] 10.222.0.58 "PUT /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 404 len: 111 microversion: 2.1 time: 0.087706 Aug 24 03:48:53.063773 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1778/3410] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:48:52 2022] PUT /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:48:53.072483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.074858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.092635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.093138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.093583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.094301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.094760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.095191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.169315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:48:53.184458 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-238a5ef9-9781-4e78-b3f4-70b58c6ca291 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 345 microversion: 2.1 time: 0.671933 Aug 24 03:48:53.196033 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1633/3411] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:48:52 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 345 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:53.201396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.202588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.214480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.215052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.216307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.217325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.218022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.218681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.309464 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-26b1c73f-f696-4a1a-aa54-8bad723a723d tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 204 len: 0 microversion: 2.1 time: 0.243649 Aug 24 03:48:53.313264 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1779/3412] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:53 2022] DELETE /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:48:53.328557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.329381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.335912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.336840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.337457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.339263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.340883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.341499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.638254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.649929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03aa3517-6481-425f-b60b-8bb85f00aba2 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1511 microversion: 2.1 time: 0.338171 Aug 24 03:48:53.653119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1780/3413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:53.657579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.676039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-850ef219-d603-4b69-ad3a-d9885e6052a5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.475941 Aug 24 03:48:53.677177 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1634/3414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:53.679686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.682370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.697043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.698097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.714205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.715035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.715698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.719228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.722441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.723359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.730326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.731600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.733903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.735478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.736309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.736948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.961708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.964169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:53.992765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c4b6f21-901d-4ee3-8b28-f6e7df8c1e61 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.303178 Aug 24 03:48:54.000675 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1635/3415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.010009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.010982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.020004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.020975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.021662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.022724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.023376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.023900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.081656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.090782 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3ba2797-6617-4ddc-9f63-2f1be4d98628 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1533 microversion: 2.1 time: 0.434753 Aug 24 03:48:54.091375 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1781/3416] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1533 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.113421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6fb4752f-ca6c-411c-b295-141846ae0dcd req-03ece5dd-291a-4181-b2db-f786633d5d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7eca2fd-22fc-4140-b851-057050766706", "tag": "2ca66ae5-64cb-4870-abe6-9f20a7249240"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:54.124358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6fb4752f-ca6c-411c-b295-141846ae0dcd req-03ece5dd-291a-4181-b2db-f786633d5d46 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.125149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6fb4752f-ca6c-411c-b295-141846ae0dcd req-03ece5dd-291a-4181-b2db-f786633d5d46 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.125761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6fb4752f-ca6c-411c-b295-141846ae0dcd req-03ece5dd-291a-4181-b2db-f786633d5d46 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.138441 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6fb4752f-ca6c-411c-b295-141846ae0dcd req-03ece5dd-291a-4181-b2db-f786633d5d46 service nova] Creating event network-changed:2ca66ae5-64cb-4870-abe6-9f20a7249240 for instance f7eca2fd-22fc-4140-b851-057050766706 on n-h2-846470-15 Aug 24 03:48:54.144487 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6fb4752f-ca6c-411c-b295-141846ae0dcd req-03ece5dd-291a-4181-b2db-f786633d5d46 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038976 Aug 24 03:48:54.145342 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1782/3417] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:54.225483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.234232 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-33743f69-1e62-40b6-85e5-412d5fde9bc6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 200 len: 1510 microversion: 2.1 time: 0.236988 Aug 24 03:48:54.235135 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1636/3418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.256549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.258397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.269271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.269999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.270491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.271224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.271755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.272629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.594391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.616583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ffa509e7-4e23-48cb-99ea-2b0b91c4a329 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1510 microversion: 2.1 time: 0.364610 Aug 24 03:48:54.644608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1783/3419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.651627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.657654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.659015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:54.669883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.670530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.671132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.671892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.676156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.676808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.711563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.713011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.722895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.723758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.724398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.726157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.731724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.734033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.769285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:54.854347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.880977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.886875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.887877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.151077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.174202 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-821e004a-6eca-4eba-8af7-401839ac5683 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.477531 Aug 24 03:48:55.175178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1784/3420] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:55.198364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:55.199839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:55.208040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.208776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.209832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.210906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.211577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.213073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.303369 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ce6bfe9e-27e4-4bbc-a2e1-01bfbbf8d563 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.657242 Aug 24 03:48:55.304012 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1637/3421] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:55.332108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:55.333032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:55.348356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.350310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.351768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.353850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.354498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.355214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.629398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.645574 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-269c74e9-f8f9-434a-a0a1-4aa70c35731b tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1533 microversion: 2.1 time: 0.315926 Aug 24 03:48:55.647642 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1638/3422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1533 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:55.665745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:55.685741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.686615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:55.818245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.843757 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1974f4b-75c9-47f2-a196-a6930dd0c272 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.653174 Aug 24 03:48:55.844956 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1785/3423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:55.858854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.859419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.859969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.860790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.861282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.861707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.922423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:55.977525 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58d3a087-78dd-43fa-b11f-a787d59b0799 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.325309 Aug 24 03:48:55.979637 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1639/3424] 10.222.0.58 () {58 vars in 1150 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:55.992941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.006268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.011140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:56.029040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.029750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.030988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.031955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.032435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.032930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.175283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:56.196751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.198237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:56.219620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.220545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.221168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.223290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.224027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.224691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.266540 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3230485-7079-423d-97ef-3b02d47ce611 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.277514 Aug 24 03:48:56.267653 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1786/3425] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:56.298949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.305348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.306142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:56.316229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.319070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.319532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.322801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.323165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.323595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.517341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:56.561414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.571453 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c12e120f-ffd0-4f63-8baf-0e08e394749b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.379265 Aug 24 03:48:56.599219 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1640/3426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:56.645167 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e4c9682-2236-4df1-830d-263b3e054a63 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.359936 Aug 24 03:48:56.647646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1787/3427] 10.222.0.58 () {58 vars in 1196 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:56.663496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.675055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.676541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:56.688579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.690215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.690949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.691954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.693220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.694185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.694890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.699350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'name': '2131883169', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:56.708198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.708993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.710067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.713134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.714454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.715413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.895147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:57.069443 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2fdbbea0-cb31-4858-bad0-d213f71400a6 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?name=2131883169" status: 200 len: 346 microversion: 2.1 time: 0.409703 Aug 24 03:48:57.077168 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1641/3428] 10.222.0.58 () {58 vars in 1156 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers?name=2131883169 => generated 346 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:57.105412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.106057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:57.126876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.127391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.128899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.130553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.131154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.131617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.214857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.242179 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c96f32a9-4e93-4b9f-8b21-6ea9c43eb19f tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1533 microversion: 2.1 time: 0.573628 Aug 24 03:48:57.245299 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1788/3429] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1533 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:57.260306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.279793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.280997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:57.315628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.316724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.317581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.320149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.322232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.323012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.594180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.606335 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-524e29e6-9071-4dc1-85ab-372d66a9efe0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.516819 Aug 24 03:48:57.608136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:57.608948 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1642/3430] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:57.618845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.624536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:57.654435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:57.688656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.689595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.689957 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3bb851b-1395-4913-9b6e-fd5ad467b4ec tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.442128 Aug 24 03:48:57.690434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.690568 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1789/3431] 10.222.0.58 () {58 vars in 1154 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:57.699328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.700580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.701202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.703012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.715446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.718007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-213188316', 'deleted': False, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:48:57.729737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.730155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.730660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.732321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.732725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.733137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.889359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:48:57.992086 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-775feedb-2816-49d5-b951-d7587dc72389 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-213188316" status: 200 len: 346 microversion: 2.1 time: 0.289430 Aug 24 03:48:57.996197 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1790/3432] 10.222.0.58 () {58 vars in 1228 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-213188316 => generated 346 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:58.010176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:58.011172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:58.018566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.019352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.019991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.020893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.021560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.022168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.073150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:48:58.191092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:58.232136 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f1606ea8-5136-40db-b092-6b801b567f3d tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.618196 Aug 24 03:48:58.233347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1643/3433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:58.269659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:58.270284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:58.300386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.301435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.303041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.304671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.305761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.317858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.360317 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3561b56e-9049-4383-8ecc-5ffde549a8ef tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 204 len: 0 microversion: 2.1 time: 0.357397 Aug 24 03:48:58.362515 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1791/3434] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:58 2022] DELETE /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:48:58.375734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:58.377994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:58.394665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.396135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.398435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.400628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.402127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.403547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.793552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:58.808324 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-548017dc-4e0b-496c-8a50-dc29fb96ea81 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1516 microversion: 2.1 time: 0.439544 Aug 24 03:48:58.810818 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1792/3435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:58 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1516 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:58.821779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:58.823863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:58.842489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.844879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.845704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.847069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.848029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.848697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.208561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.220462 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b989016f-76fc-47be-b1a9-d7b2c209147d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.408217 Aug 24 03:48:59.224968 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1793/3436] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:58 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:59.257195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:59.258409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:59.274706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.275836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.276498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.277616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.278280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.279403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.327360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.342295 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f32e8f4f-b03f-4ba9-b763-0d7a8ec2cedd tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1533 microversion: 2.1 time: 1.076421 Aug 24 03:48:59.346358 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1644/3437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:58 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1533 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:59.616503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.632104 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32dac29b-4b63-4b1e-8bd0-bd50a51f070b tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.376880 Aug 24 03:48:59.633531 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1794/3438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:59 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:59.832489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:59.833456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:59.849034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.864608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.867934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.869241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.872967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.873683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.246814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.247425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.273333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.285247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.289090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.293849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.296429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.298220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.549860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.572552 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b036e22-aee1-4cd4-b283-3aff3ffd3bca tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1516 microversion: 2.1 time: 0.745867 Aug 24 03:49:00.573427 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1645/3439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:59 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1516 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:00.591073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2001cf92-72c8-40fd-8c6c-5f2aa9a09d35 req-40c0be93-5fd4-48b8-acee-c02497ac5a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b11b08f-62ed-4616-bf0f-3e82f4e2249f", "name": "network-vif-deleted", "tag": "aac7df7f-a0e7-4430-b8a0-282941c84f56"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:00.640523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2001cf92-72c8-40fd-8c6c-5f2aa9a09d35 req-40c0be93-5fd4-48b8-acee-c02497ac5a67 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.645142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2001cf92-72c8-40fd-8c6c-5f2aa9a09d35 req-40c0be93-5fd4-48b8-acee-c02497ac5a67 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.647273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2001cf92-72c8-40fd-8c6c-5f2aa9a09d35 req-40c0be93-5fd4-48b8-acee-c02497ac5a67 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.698829 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2001cf92-72c8-40fd-8c6c-5f2aa9a09d35 req-40c0be93-5fd4-48b8-acee-c02497ac5a67 service nova] Creating event network-vif-deleted:aac7df7f-a0e7-4430-b8a0-282941c84f56 for instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f on n-h2-846470-15 Aug 24 03:49:00.715013 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2001cf92-72c8-40fd-8c6c-5f2aa9a09d35 req-40c0be93-5fd4-48b8-acee-c02497ac5a67 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136869 Aug 24 03:49:00.718520 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1646/3440] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:00.741931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.743219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.766975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.770147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.772217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.774921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.776579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.777046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.856022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.870451 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dd4f11fe-c460-4141-b37c-fd07aef5bdc1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.629045 Aug 24 03:49:00.873768 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1795/3441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:00.887304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.892238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.913675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.915621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.916377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.917501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.921465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.928564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.950611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.954012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.966577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.967735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lazy-loading 'fault' on Instance uuid 9b11b08f-62ed-4616-bf0f-3e82f4e2249f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:01.325424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:01.326763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6694115e084b78b1a47596f56e8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dc921cf81944b9858afda3098e219f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:01.337263 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-54d6b2a6-f54c-4c2c-baea-3dfa71e2437c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.461992 Aug 24 03:49:01.338686 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1796/3442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:01.345430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.348736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.356169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8e11e9bf-a0d1-4611-ad31-77719a9125b9 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 200 len: 1318 microversion: 2.1 time: 0.635202 Aug 24 03:49:01.356968 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1647/3443] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:01.368773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.374058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.375658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.377465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.378168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.378983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.423269 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b6ec3837-d0c7-408b-bae4-e4f069b58981 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082591 Aug 24 03:49:01.424509 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1797/3444] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:01.441367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.442798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.450989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.451992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.452841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.453832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.454711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.455373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.518306 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24d10fed-f181-4c84-8db0-00c8459fef2c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/08da4ca5-a0cb-44ce-b8f5-c877c27ed2c0" status: 200 len: 194 microversion: 2.1 time: 0.083405 Aug 24 03:49:01.519919 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1648/3445] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/08da4ca5-a0cb-44ce-b8f5-c877c27ed2c0 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:01.599509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.600071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.612376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.622225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.623703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.630569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.631541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.633220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.894714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.896210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.911002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.911884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.912531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.913442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.915909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.923384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.399581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:02.420876 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-71e6123f-58e3-4e20-aa9c-4f04d29ce344 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.521035 Aug 24 03:49:02.421711 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1649/3446] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:02.443533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:02.444460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:02.470448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.472377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.473831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.478766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.479871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.480622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.658841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:02.683132 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1f825820-f2fb-47e0-8cf8-a737d508e118 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 200 len: 1516 microversion: 2.1 time: 1.082104 Aug 24 03:49:02.690140 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1798/3447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 1516 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:02.712142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:02.713262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] [instance: 9b11b08f-62ed-4616-bf0f-3e82f4e2249f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:02.741333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.744626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.745335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.749376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.750213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.751065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.796833 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] HTTP exception thrown: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Request method failure captured: Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f HTTP/1.1 Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ9yK6pa_f9L7SyDJOoVGTCeYLyBoALis9TnPyeGplkuiNdGAVQOddKzvcVi6WEiYYjvbHUiX2QIy_E_MxvVFiIWh2HliLx65OzL8aQy1pJuYXy2pKyY73jPqtjl9V9R6bM9CQJyRBNLk54-VnYhDhVLGyhSLum7VS7jMrh3TbhCvYQ Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a8dc921cf81944b9858afda3098e219f Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-458491960 Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8dc921cf81944b9858afda3098e219f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8dc921cf81944b9858afda3098e219f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8dc921cf81944b9858afda3098e219f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8dc921cf81944b9858afda3098e219f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-458491960 Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a8dc921cf81944b9858afda3098e219f Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-458491960 Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestMultiTenantJSON-458491960-project Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 7e6694115e084b78b1a47596f56e8434 Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-458491960-project Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9b11b08f-62ed-4616-bf0f-3e82f4e2249f'} Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:49:02.804605 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. Aug 24 03:49:02.810828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:02.812727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] Returning 404 to user: Instance 9b11b08f-62ed-4616-bf0f-3e82f4e2249f could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:02.817241 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24e259b9-4459-4353-b9aa-96fdaef20201 tempest-ServersNegativeTestMultiTenantJSON-458491960 tempest-ServersNegativeTestMultiTenantJSON-458491960-project] 10.222.0.58 "GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f" status: 404 len: 111 microversion: 2.1 time: 0.125421 Aug 24 03:49:02.818532 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1799/3448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:02 2022] GET /compute/v2.1/servers/9b11b08f-62ed-4616-bf0f-3e82f4e2249f => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:02.828606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7d72a8a8-ebb6-4160-ad1e-45a322915419 req-37e53a3d-5cf9-421e-9794-431c2c982af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c670f3-658f-4e9c-a8f1-48bcca0bed67", "name": "network-vif-deleted", "tag": "4ba606b5-d890-44a7-8a46-3c8b2d41038a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:02.856476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d72a8a8-ebb6-4160-ad1e-45a322915419 req-37e53a3d-5cf9-421e-9794-431c2c982af6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.857228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d72a8a8-ebb6-4160-ad1e-45a322915419 req-37e53a3d-5cf9-421e-9794-431c2c982af6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.858147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7d72a8a8-ebb6-4160-ad1e-45a322915419 req-37e53a3d-5cf9-421e-9794-431c2c982af6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.908486 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7d72a8a8-ebb6-4160-ad1e-45a322915419 req-37e53a3d-5cf9-421e-9794-431c2c982af6 service nova] Creating event network-vif-deleted:4ba606b5-d890-44a7-8a46-3c8b2d41038a for instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 on n-h2-846470-15 Aug 24 03:49:02.935033 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7d72a8a8-ebb6-4160-ad1e-45a322915419 req-37e53a3d-5cf9-421e-9794-431c2c982af6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114801 Aug 24 03:49:02.936004 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1800/3449] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:03.203938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:03.224784 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-934464fc-dff1-41d6-9436-7c5dc92026fc tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.801702 Aug 24 03:49:03.225572 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1650/3450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:02 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:03.452977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:03.454917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:03.490133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.492558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.494132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.495300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.496156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.497226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.708146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:03.708935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: f1c670f3-658f-4e9c-a8f1-48bcca0bed67] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:03.726689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.727279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.735902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.736896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.737390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.737838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.805780 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] HTTP exception thrown: Instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 could not be found. Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Request method failure captured: Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 HTTP/1.1 Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ9Ts-MTj4WQ7MiGrX5nP8CiVABMbfiLTL-2luIzRX9xpC665-Rf9h_J9UdvDywNu-2ZwSp3x6JPwSxGYAxvrHLkTke2RQcOxPbhhYK4QYShNmB2tnEMSSptyBIX_lcoNSHFYNE84vWINDOy2DueoqlIGr5DXTnQr14QL-775kuBX5I Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a69908c03ba742b7a50d7e9c955e12ff Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a69908c03ba742b7a50d7e9c955e12ff Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListServerFiltersTestJSON-375325419-project Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 1321ec33efd14167a53103c6b5b96088 Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListServerFiltersTestJSON-375325419-project Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 could not be found. Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'f1c670f3-658f-4e9c-a8f1-48bcca0bed67'} Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 could not be found. Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 could not be found. Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:03.818775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:03.823497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:03.823497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:03.823497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:03.823497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:03.823497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:03.823497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 could not be found. Aug 24 03:49:03.823497 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:03.823497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Returning 404 to user: Instance f1c670f3-658f-4e9c-a8f1-48bcca0bed67 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:03.827718 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3606f678-6b02-4a72-b043-da9a3ada7570 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67" status: 404 len: 111 microversion: 2.1 time: 0.122912 Aug 24 03:49:03.834694 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1651/3451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:03 2022] GET /compute/v2.1/servers/f1c670f3-658f-4e9c-a8f1-48bcca0bed67 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:03.849371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b64f984c-5592-45c1-b28b-942fd923f267 req-4af071d9-fc2f-4392-88be-06a7757442a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47cbf84-c598-4d84-b81a-8eca598e1f10", "name": "network-vif-plugged", "status": "completed", "tag": "7f5412b6-161b-4e0a-959a-bc19d45e58f6"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:03.912327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b64f984c-5592-45c1-b28b-942fd923f267 req-4af071d9-fc2f-4392-88be-06a7757442a9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.915187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b64f984c-5592-45c1-b28b-942fd923f267 req-4af071d9-fc2f-4392-88be-06a7757442a9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.917453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b64f984c-5592-45c1-b28b-942fd923f267 req-4af071d9-fc2f-4392-88be-06a7757442a9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.935193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:03.961518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:03.970786 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b64f984c-5592-45c1-b28b-942fd923f267 req-4af071d9-fc2f-4392-88be-06a7757442a9 service nova] Creating event network-vif-plugged:7f5412b6-161b-4e0a-959a-bc19d45e58f6 for instance c47cbf84-c598-4d84-b81a-8eca598e1f10 on n-h1-846470-15 Aug 24 03:49:03.986023 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b64f984c-5592-45c1-b28b-942fd923f267 req-4af071d9-fc2f-4392-88be-06a7757442a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149000 Aug 24 03:49:03.988216 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1652/3452] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:03.988625 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bd863d9-9ce0-479b-915f-8a845060aa83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.541481 Aug 24 03:49:03.989605 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1801/3453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:03 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:04.013135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:04.014206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:04.034306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.035389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.039776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.058673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.060086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.061119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.136062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:04.254191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:04.255481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:04.283704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.284934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.289322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.317131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.321096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.325109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.332647 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae432a10-89eb-4001-9f7a-dbc7524f99bd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "DELETE /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 204 len: 0 microversion: 2.1 time: 0.341337 Aug 24 03:49:04.340188 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1653/3454] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:03 2022] DELETE /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:04.366293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:04.369136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:04.387615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.388611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.393008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.394026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.394558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.395025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.782098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.784723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.791925 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-38c48065-b230-49ec-bef8-e2db1bcaa14a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.546643 Aug 24 03:49:04.792529 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1802/3455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:04 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:04.800260 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5f001d69-a4a7-4528-9bec-e5d0d9ef64d8 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 200 len: 1516 microversion: 2.1 time: 0.457595 Aug 24 03:49:04.803410 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1654/3456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:04 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 1516 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:05.022017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.022777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.034637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.041242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.042246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.043263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.043997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.044659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.364362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:05.382847 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef7be955-1efd-432b-9265-7376c354c6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.363070 Aug 24 03:49:05.385891 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1803/3457] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:05.634598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17ed975a-3d04-4c4f-a6db-af3ab53e7f9d"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:05.638078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.645111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:05.663809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.665957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.667238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.668706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.669931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.670780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.834043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.834991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.853008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.853509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.853956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.859480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.861100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.861778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.620693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:06.637928 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-674e8973-09db-4874-b1b4-3670d985bf13 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 0.808972 Aug 24 03:49:06.652115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1804/3458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:06.660028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:06.661116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:06.668565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.669563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.670388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.671752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.672756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.673486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.699524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:06.763540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:07.027732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.051268 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bcc8c72f-8622-4d81-9dde-2d24d0042608 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 200 len: 1516 microversion: 2.1 time: 0.396379 Aug 24 03:49:07.055657 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1805/3459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:06 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 1516 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:07.089787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:07.090983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:07.142739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.145468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.146970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.149878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.150869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.151547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.288142 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49cb7862-970a-4e19-a266-a1990ea09bea tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "POST /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.661402 Aug 24 03:49:07.296252 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1655/3460] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:49:05 2022] POST /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments => generated 194 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:07.668330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:07.669906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:07.695197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.704241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.705062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.706581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.707774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.712005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.712553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.730531 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3174b28f-e0f5-4588-89fa-b6db689c555b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1313 microversion: 2.1 time: 0.669648 Aug 24 03:49:07.732692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1806/3461] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:07 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:08.090527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.091140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:08.115245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:08.118654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.128489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.136304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.141403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.148764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.149226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.023655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:09.040231 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ed5ff8d-4c62-4686-94b2-3e743ce84b25 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 200 len: 1516 microversion: 2.1 time: 0.953731 Aug 24 03:49:09.055353 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1807/3462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:08 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 1516 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:09.055353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:09.055353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:09.070364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.071095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.071800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.072925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.073395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.073827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.250446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:09.286097 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f026430e-f874-4945-bdb0-2830530de4ca tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 1.623091 Aug 24 03:49:09.290185 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1656/3463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:07 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:09.950444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c9127277-822a-4120-a4bd-30c94d9c2d47 req-2128be74-b2d6-4860-8176-702f178ef629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7eca2fd-22fc-4140-b851-057050766706", "name": "network-vif-plugged", "status": "completed", "tag": "2ca66ae5-64cb-4870-abe6-9f20a7249240"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:09.981944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c9127277-822a-4120-a4bd-30c94d9c2d47 req-2128be74-b2d6-4860-8176-702f178ef629 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.992541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c9127277-822a-4120-a4bd-30c94d9c2d47 req-2128be74-b2d6-4860-8176-702f178ef629 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.996026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c9127277-822a-4120-a4bd-30c94d9c2d47 req-2128be74-b2d6-4860-8176-702f178ef629 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.045955 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c9127277-822a-4120-a4bd-30c94d9c2d47 req-2128be74-b2d6-4860-8176-702f178ef629 service nova] Creating event network-vif-plugged:2ca66ae5-64cb-4870-abe6-9f20a7249240 for instance f7eca2fd-22fc-4140-b851-057050766706 on n-h2-846470-15 Aug 24 03:49:10.064191 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c9127277-822a-4120-a4bd-30c94d9c2d47 req-2128be74-b2d6-4860-8176-702f178ef629 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118049 Aug 24 03:49:10.076995 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1657/3464] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:10.092651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:10.093867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:10.117751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.119300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.121519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.124061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.127842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.128512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.198286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:10.217527 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a9f9132-e226-4d05-ac7b-de39858f50ea tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1462 microversion: 2.1 time: 1.167635 Aug 24 03:49:10.218262 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1808/3465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:09 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1462 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:10.586102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:10.600239 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f854a8d1-c630-4c52-8de8-c2352e1b801f tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 200 len: 1474 microversion: 2.1 time: 0.519922 Aug 24 03:49:10.612075 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1658/3466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:10 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 1474 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:10.615164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:10.619142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:10.640340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.641594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.642524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.645672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.647403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.652304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.743088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:10.743801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:10.767025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:10.778449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.779348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.781488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.782635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.788531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.792507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.741477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.784240 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a161b552-5a33-49de-985c-040689dce343 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1317 microversion: 2.1 time: 1.178527 Aug 24 03:49:11.785680 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1659/3467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:10 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1317 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:11.958871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1869562061", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "554b35cf-4ac3-400f-bc5c-e5197cedfc71"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:12.163658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] validate_networks() for [('554b35cf-4ac3-400f-bc5c-e5197cedfc71', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:49:12.781211 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a384dae-dd60-406b-9cbb-540255d164f3 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1615 microversion: 2.1 time: 2.539434 Aug 24 03:49:12.802668 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1809/3468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:10 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1615 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:12.829322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:12.833201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:12.854692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.856787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.857558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.859084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.860147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.860812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.016734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.018566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.020050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.021097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lazy-loading 'fault' on Instance uuid 124fdab8-7ac7-4400-b99f-20cc282263d4 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:13.492365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:13.504604 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d8dfa373-a498-429a-9d27-934a4b3ec220 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 200 len: 1310 microversion: 2.1 time: 0.696956 Aug 24 03:49:13.505489 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1810/3469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:12 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 1310 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:13.521995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-3950ee9d-6596-4dc2-b678-232fde5f14ed req-45713ce7-236f-475d-81b8-7d04609d02d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124fdab8-7ac7-4400-b99f-20cc282263d4", "name": "network-vif-deleted", "tag": "6aea8380-f95a-435d-bc4d-7a5faf8dbd42"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:13.564731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3950ee9d-6596-4dc2-b678-232fde5f14ed req-45713ce7-236f-475d-81b8-7d04609d02d9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.566705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3950ee9d-6596-4dc2-b678-232fde5f14ed req-45713ce7-236f-475d-81b8-7d04609d02d9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.567451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3950ee9d-6596-4dc2-b678-232fde5f14ed req-45713ce7-236f-475d-81b8-7d04609d02d9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.595231 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-3950ee9d-6596-4dc2-b678-232fde5f14ed req-45713ce7-236f-475d-81b8-7d04609d02d9 service nova] Creating event network-vif-deleted:6aea8380-f95a-435d-bc4d-7a5faf8dbd42 for instance 124fdab8-7ac7-4400-b99f-20cc282263d4 on n-h1-846470-15 Aug 24 03:49:13.609416 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-3950ee9d-6596-4dc2-b678-232fde5f14ed req-45713ce7-236f-475d-81b8-7d04609d02d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101544 Aug 24 03:49:13.613974 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1811/3470] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:13.630412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:13.639105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:13.662939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.665625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.669309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.673151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.681685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.683192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.203180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:14.240127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba516903-841b-48f9-88b5-2ae78905c1db tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1504 microversion: 2.1 time: 0.622835 Aug 24 03:49:14.245208 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1812/3471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:13 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1504 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:14.264819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:14.266029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:14.280261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.283395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.285326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.290534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.291294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.292104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.342270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a2df41be4453484cae6f9c2edf037086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4dda06fc5fd4b9b850d7ee32d6faaad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:14.343420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] flavor_id is None. Assuming migration. {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 03:49:14.344505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 03:49:14.490925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:49:14.492409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:49:14.492610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:49:14.493935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:49:14.493935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:49:14.524013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.525768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.527548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.531047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.534932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.535528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.607720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Getting quotas for project b4bc29828b484cbf820b514d4f5098b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:49:14.636580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Getting quotas for user e1ee8f9878c749b7ac27e36de77b4cf8 and project b4bc29828b484cbf820b514d4f5098b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:49:14.678616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:49:14.682642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:49:14.808190 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-661ea606-3797-4a2b-8a8b-615a7ac35f67 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.021251 Aug 24 03:49:14.809039 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1660/3472] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:49:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:49:14.826751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:14.827580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:14.843711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.844579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.849706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.851074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.851944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.852643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.870405 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f5241538-9ae2-49bc-8d27-4cb39f140c98 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10/action" status: 202 len: 0 microversion: 2.1 time: 0.623580 Aug 24 03:49:14.871039 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1813/3473] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:49:14 2022] POST /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:49:14.901319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:14.902257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: 124fdab8-7ac7-4400-b99f-20cc282263d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:14.928143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.930180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.931904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.934793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.939226 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e10db82b-d726-40b4-8757-b2e8c4b8421a tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706/ips" status: 200 len: 107 microversion: 2.1 time: 0.128397 Aug 24 03:49:14.939829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.940347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.946421 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1661/3474] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:49:14 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706/ips => generated 107 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:14.976200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8531d9f-4216-43ba-9588-e093c8e2b4cc tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:14.977359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f8531d9f-4216-43ba-9588-e093c8e2b4cc tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:15.014238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:15.022542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] HTTP exception thrown: Instance 124fdab8-7ac7-4400-b99f-20cc282263d4 could not be found. Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Request method failure captured: Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 HTTP/1.1 Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ9Ts-MTj4WQ7MiGrX5nP8CiVABMbfiLTL-2luIzRX9xpC665-Rf9h_J9UdvDywNu-2ZwSp3x6JPwSxGYAxvrHLkTke2RQcOxPbhhYK4QYShNmB2tnEMSSptyBIX_lcoNSHFYNE84vWINDOy2DueoqlIGr5DXTnQr14QL-775kuBX5I Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a69908c03ba742b7a50d7e9c955e12ff Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a69908c03ba742b7a50d7e9c955e12ff Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ListServerFiltersTestJSON-375325419-project Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 1321ec33efd14167a53103c6b5b96088 Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ListServerFiltersTestJSON-375325419-project Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 124fdab8-7ac7-4400-b99f-20cc282263d4 could not be found. Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '124fdab8-7ac7-4400-b99f-20cc282263d4'} Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124fdab8-7ac7-4400-b99f-20cc282263d4 could not be found. Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124fdab8-7ac7-4400-b99f-20cc282263d4 could not be found. Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:15.030646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:15.036643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:15.036643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:15.036643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:15.036643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:15.036643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:15.036643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124fdab8-7ac7-4400-b99f-20cc282263d4 could not be found. Aug 24 03:49:15.036643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:15.044099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Returning 404 to user: Instance 124fdab8-7ac7-4400-b99f-20cc282263d4 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:15.047278 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5bd5c074-b40c-4c8d-a0ca-1dd44b4be6fd tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4" status: 404 len: 111 microversion: 2.1 time: 0.166705 Aug 24 03:49:15.051333 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1814/3475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:14 2022] GET /compute/v2.1/servers/124fdab8-7ac7-4400-b99f-20cc282263d4 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:15.076967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:15.078178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:15.111592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.112126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.112824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.130918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.131727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.132023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.660913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8531d9f-4216-43ba-9588-e093c8e2b4cc tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:15.674482 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8531d9f-4216-43ba-9588-e093c8e2b4cc tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1225 microversion: 2.1 time: 0.726401 Aug 24 03:49:15.675707 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1662/3476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:14 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1225 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:15.687093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:15.691146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:15.714667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.717380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.724103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.725833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.739499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.740650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.943603 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f0a0278d-ced2-4f1f-98c4-047d0871b81c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706/ips" status: 200 len: 107 microversion: 2.1 time: 0.261163 Aug 24 03:49:15.958870 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1663/3477] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:49:15 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706/ips => generated 107 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:15.971688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:15.974910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:16.005454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.006360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.008372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.010494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.018155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.019146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.075196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:16.452939 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a9959df9-3c1c-4167-8958-a2c552916d55 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 204 len: 0 microversion: 2.1 time: 0.495479 Aug 24 03:49:16.455993 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1664/3478] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:15 2022] DELETE /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:16.469673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:16.472645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:16.490712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.501041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.502442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.505758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.506548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.507291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.579358 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-421e1081-0bfe-42c6-aab2-32faa09ac5c7 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706/ips/tempest-ServerAddressesTestJSON-17683208-network" status: 200 len: 92 microversion: 2.1 time: 0.121367 Aug 24 03:49:16.583015 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1665/3479] 10.222.0.58 () {58 vars in 1395 bytes} [Wed Aug 24 03:49:16 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706/ips/tempest-ServerAddressesTestJSON-17683208-network => generated 92 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:49:16.592053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:16.592959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:16.602102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.604411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.605113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.609905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.610685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.611503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.197788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.215898 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-46e36a5d-8749-4a74-b92d-e12d8cd6c390 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1517 microversion: 2.1 time: 0.631262 Aug 24 03:49:17.218947 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1666/3480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:16 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1517 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:17.235444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.236958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.251230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.252194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.252832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.253788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.254552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.255362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.379093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:17.411924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.432165 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-448b96a6-445c-45b3-859f-3487e2a0eec1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1471 microversion: 2.1 time: 2.375343 Aug 24 03:49:17.433131 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1815/3481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:15 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1471 bytes in 2381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:17.453126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.454889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.485981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.492614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.505187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.516618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.523438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.524355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.668233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:17.835792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.866674 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-711b6b3f-f1d0-42db-8a9d-a33eb2c48df4 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 204 len: 0 microversion: 2.1 time: 0.645096 Aug 24 03:49:17.868010 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c3dc7dc-e2a0-494b-a3fa-e94ab3f94db6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1229 microversion: 2.1 time: 0.430966 Aug 24 03:49:17.868745 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1667/3482] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:17 2022] DELETE /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:17.882244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.883505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.895789 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1816/3483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1229 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:17.928261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.935079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.937755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.939280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.940940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.942534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.242281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:18.247122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:18.298190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.299397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.300603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.312498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.313619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.315148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.534048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:18.546065 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9c471a2c-5efb-4ad6-86d1-3f10e904f20c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1510 microversion: 2.1 time: 0.671339 Aug 24 03:49:18.546739 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1668/3484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1510 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:18.563455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:18.572911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:18.599997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.600921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.602709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.604062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.604922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.606037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.484938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:19.497290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:19.501830 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c9265dba-0239-4ddb-a439-71de85dd5335 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1517 microversion: 2.1 time: 1.266361 Aug 24 03:49:19.504755 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1817/3485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:18 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1517 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:19.519910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:19.525388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:19.532997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0dad7462-b62f-4022-96fb-bc9ad3300c68 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1471 microversion: 2.1 time: 0.983172 Aug 24 03:49:19.536766 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1669/3486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:18 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1471 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:19.542431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:19.543275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:19.545160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.546158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:19.546943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:19.547551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.573503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:19.577338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:19.594505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:19.595925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:19.608719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.618968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:19.625007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:19.629297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.906570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:19.916168 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29d3110d-42ec-42d4-a0d9-06c2ab01a33c tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1277 microversion: 2.1 time: 0.409926 Aug 24 03:49:19.917391 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1818/3487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:19 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1277 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:20.525041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:20.525744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:20.548186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.548863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.549314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.550284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.553242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.553987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.878370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:20.892292 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3bb40fcc-c9ad-4d80-aa05-d1ab25726fb4 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1517 microversion: 2.1 time: 0.371033 Aug 24 03:49:20.895801 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1819/3488] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:20 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1517 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:20.906989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:20.911226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:20.932510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.935048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.935374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.941114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.942493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.943615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.566679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:21.579112 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c4ac03f-32ed-4a04-a84e-39e51234c1e5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1510 microversion: 2.1 time: 2.013031 Aug 24 03:49:21.585335 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1670/3489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:19 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1510 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:21.591120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:21.595263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:21.619725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.620833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.621561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.624157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.625365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.626460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.726463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:21.741646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e177442f-af46-40bd-81c6-acd5a61b75d0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1471 microversion: 2.1 time: 0.844108 Aug 24 03:49:21.744944 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1820/3490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:20 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1471 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:21.880010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:21.904767 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8382f99c-d7a9-4a76-bd5c-f349b1d6e5fe tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1283 microversion: 2.1 time: 0.314961 Aug 24 03:49:21.905766 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1671/3491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:21 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1283 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:21.915473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:21.916626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:21.924432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.925419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.926156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.927240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.928120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.928768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.932507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:22.309633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:22.331743 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec140fc3-3797-406a-b895-b450a866bef0 tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1517 microversion: 2.1 time: 0.420871 Aug 24 03:49:22.342981 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1821/3492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:21 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1517 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:22.370207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9a7a8989-5f03-4587-a49c-4ab16f1fcb85 req-391b0269-a02d-4a43-aab9-d1b3defaf35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d362ddfc-9185-45a6-b23b-b2a8e4049bd1", "name": "network-vif-unplugged", "status": "completed", "tag": "75b13e9b-2b50-423b-b7b5-acfac31fcf8e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:22.395237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9a7a8989-5f03-4587-a49c-4ab16f1fcb85 req-391b0269-a02d-4a43-aab9-d1b3defaf35f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.396121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9a7a8989-5f03-4587-a49c-4ab16f1fcb85 req-391b0269-a02d-4a43-aab9-d1b3defaf35f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.399160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9a7a8989-5f03-4587-a49c-4ab16f1fcb85 req-391b0269-a02d-4a43-aab9-d1b3defaf35f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.421438 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9a7a8989-5f03-4587-a49c-4ab16f1fcb85 req-391b0269-a02d-4a43-aab9-d1b3defaf35f service nova] Creating event network-vif-unplugged:75b13e9b-2b50-423b-b7b5-acfac31fcf8e for instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 on n-h2-846470-15 Aug 24 03:49:22.431635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9a7a8989-5f03-4587-a49c-4ab16f1fcb85 req-391b0269-a02d-4a43-aab9-d1b3defaf35f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069852 Aug 24 03:49:22.433079 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1672/3493] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:22.609607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:22.612478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:22.630801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.637026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.637982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.639498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.643192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.643769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.766638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:22.767556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:22.782464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.791412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.792185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.793090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.793642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.794150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.047803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:23.060921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f7adc230-3dcf-48a3-a880-60e63b5d47ea tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1510 microversion: 2.1 time: 0.462842 Aug 24 03:49:23.084083 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1822/3494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:22 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1510 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:23.092147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:23.094204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:23.103656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.104608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.105327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.106358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.107088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.108428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.285752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:23.300552 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-00774a17-8651-4253-b812-41e08247f0a3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1283 microversion: 2.1 time: 0.214088 Aug 24 03:49:23.314852 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1823/3495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:23 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1283 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:23.363807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:23.364631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:23.374243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.376342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.379795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.380757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.381378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.384647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.667223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:23.695762 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-02c5364e-7c6a-4239-95da-32771aef94df tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1517 microversion: 2.1 time: 0.336029 Aug 24 03:49:23.738969 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1824/3496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:23 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1517 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:23.791138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:23.851548 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8e0feaf-ee49-4cef-9a35-7eeb0c39be28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1471 microversion: 2.1 time: 1.086833 Aug 24 03:49:23.855526 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1673/3497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:22 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1471 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:24.093756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:24.095182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:24.121531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.122052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.122478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.123285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.129257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.130325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.139802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2debe67a-1d28-4818-a97c-50b50ffe6792 req-101edb48-8ffb-4eb1-8e15-a05bf2e9a638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d362ddfc-9185-45a6-b23b-b2a8e4049bd1", "name": "network-vif-deleted", "tag": "75b13e9b-2b50-423b-b7b5-acfac31fcf8e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:24.188586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2debe67a-1d28-4818-a97c-50b50ffe6792 req-101edb48-8ffb-4eb1-8e15-a05bf2e9a638 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.191130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2debe67a-1d28-4818-a97c-50b50ffe6792 req-101edb48-8ffb-4eb1-8e15-a05bf2e9a638 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.191591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2debe67a-1d28-4818-a97c-50b50ffe6792 req-101edb48-8ffb-4eb1-8e15-a05bf2e9a638 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.248281 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2debe67a-1d28-4818-a97c-50b50ffe6792 req-101edb48-8ffb-4eb1-8e15-a05bf2e9a638 service nova] Creating event network-vif-deleted:75b13e9b-2b50-423b-b7b5-acfac31fcf8e for instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 on n-h2-846470-15 Aug 24 03:49:24.256423 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2debe67a-1d28-4818-a97c-50b50ffe6792 req-101edb48-8ffb-4eb1-8e15-a05bf2e9a638 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125049 Aug 24 03:49:24.260018 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1674/3498] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:24.323942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:24.325121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:24.342841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.343491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.344080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.344905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.345394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.345925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.563345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:24.593736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:24.610519 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1ae6ac62-5076-4657-ac58-77162aabe363 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1510 microversion: 2.1 time: 0.517169 Aug 24 03:49:24.627713 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1825/3499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:24 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:24.627713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-18006e5e-169f-45f9-b50b-afd9ea741efb req-ba122493-d596-457f-9dac-3ad223b1e754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7eca2fd-22fc-4140-b851-057050766706", "name": "network-vif-unplugged", "status": "completed", "tag": "2ca66ae5-64cb-4870-abe6-9f20a7249240"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:24.671510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-18006e5e-169f-45f9-b50b-afd9ea741efb req-ba122493-d596-457f-9dac-3ad223b1e754 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.674340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-18006e5e-169f-45f9-b50b-afd9ea741efb req-ba122493-d596-457f-9dac-3ad223b1e754 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.675125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-18006e5e-169f-45f9-b50b-afd9ea741efb req-ba122493-d596-457f-9dac-3ad223b1e754 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.715945 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-18006e5e-169f-45f9-b50b-afd9ea741efb req-ba122493-d596-457f-9dac-3ad223b1e754 service nova] Creating event network-vif-unplugged:2ca66ae5-64cb-4870-abe6-9f20a7249240 for instance f7eca2fd-22fc-4140-b851-057050766706 on n-h2-846470-15 Aug 24 03:49:24.722882 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-18006e5e-169f-45f9-b50b-afd9ea741efb req-ba122493-d596-457f-9dac-3ad223b1e754 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105736 Aug 24 03:49:24.724134 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1826/3500] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:24.733065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:24.734473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:24.743804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.745018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.745888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.747359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.748286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.749142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.802951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.804555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.805239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.806903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lazy-loading 'fault' on Instance uuid d362ddfc-9185-45a6-b23b-b2a8e4049bd1 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:24.862666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1321ec33efd14167a53103c6b5b96088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69908c03ba742b7a50d7e9c955e12ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:24.874236 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f31f62a-bd2f-4263-b725-e06eaa6dff6c tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 200 len: 1311 microversion: 2.1 time: 0.147425 Aug 24 03:49:24.875097 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1827/3501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:24 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:24.888061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:24.897776 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de57a03f-7e69-41a1-a902-4547b13345d3 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1283 microversion: 2.1 time: 0.575479 Aug 24 03:49:24.898235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:24.899260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:24.900792 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1675/3502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:24 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1283 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:24.907159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.907646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.908302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.909451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.910079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.910673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.253933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:25.269012 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-169c23c0-4cc1-4cf6-9b17-0cc70400c46e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1471 microversion: 2.1 time: 0.378952 Aug 24 03:49:25.275225 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1828/3503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:24 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1471 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:25.637470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:25.638584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:25.648311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.649161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.650103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.651528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.652444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.653122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.688770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.724849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.726030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.726558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.727482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lazy-loading 'fault' on Instance uuid f7eca2fd-22fc-4140-b851-057050766706 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:25.827575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d094306e1f5485ba58fa320e13100a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132aea84f10441f0bb7e83a28d42a493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:25.838994 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a66d339c-1ce1-47c6-8df3-7d9cb5d753d5 tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 200 len: 1307 microversion: 2.1 time: 0.205700 Aug 24 03:49:25.845471 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1676/3504] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:25 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 1307 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:25.901185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:25.902016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] [instance: d362ddfc-9185-45a6-b23b-b2a8e4049bd1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:25.914195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.916254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.921903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:25.923344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:25.928362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.931518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.932440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.933248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.934838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.940439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.941074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.943553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.945030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.946319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.977258 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] HTTP exception thrown: Instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 could not be found. Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Request method failure captured: Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 HTTP/1.1 Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ9Ts-MTj4WQ7MiGrX5nP8CiVABMbfiLTL-2luIzRX9xpC665-Rf9h_J9UdvDywNu-2ZwSp3x6JPwSxGYAxvrHLkTke2RQcOxPbhhYK4QYShNmB2tnEMSSptyBIX_lcoNSHFYNE84vWINDOy2DueoqlIGr5DXTnQr14QL-775kuBX5I Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a69908c03ba742b7a50d7e9c955e12ff Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69908c03ba742b7a50d7e9c955e12ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a69908c03ba742b7a50d7e9c955e12ff Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-375325419 Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ListServerFiltersTestJSON-375325419-project Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 1321ec33efd14167a53103c6b5b96088 Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ListServerFiltersTestJSON-375325419-project Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 could not be found. Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd362ddfc-9185-45a6-b23b-b2a8e4049bd1'} Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 could not be found. Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 could not be found. Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:25.978983 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 could not be found. Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] Returning 404 to user: Instance d362ddfc-9185-45a6-b23b-b2a8e4049bd1 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:25.990277 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c040d0d-ef6a-48c9-90c0-a81bf756094d tempest-ListServerFiltersTestJSON-375325419 tempest-ListServerFiltersTestJSON-375325419-project] 10.222.0.58 "GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1" status: 404 len: 111 microversion: 2.1 time: 0.084641 Aug 24 03:49:25.998160 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1829/3505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:25 2022] GET /compute/v2.1/servers/d362ddfc-9185-45a6-b23b-b2a8e4049bd1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:26.300631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:26.301440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:26.318568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.319070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.321287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.322939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.323442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.323914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.532304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:26.542999 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-835f3265-9f26-4437-b457-4a53c3215bdf tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.625023 Aug 24 03:49:26.543604 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1677/3506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:25 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:26.624423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d58e512b-2253-410d-a378-a1c3a56cb295 req-793d6cc2-ed04-4c4c-be50-57bcf230baf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7eca2fd-22fc-4140-b851-057050766706", "name": "network-vif-deleted", "tag": "2ca66ae5-64cb-4870-abe6-9f20a7249240"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:26.636581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d58e512b-2253-410d-a378-a1c3a56cb295 req-793d6cc2-ed04-4c4c-be50-57bcf230baf9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.637643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d58e512b-2253-410d-a378-a1c3a56cb295 req-793d6cc2-ed04-4c4c-be50-57bcf230baf9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.638326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d58e512b-2253-410d-a378-a1c3a56cb295 req-793d6cc2-ed04-4c4c-be50-57bcf230baf9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.663204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d58e512b-2253-410d-a378-a1c3a56cb295 req-793d6cc2-ed04-4c4c-be50-57bcf230baf9 service nova] Creating event network-vif-deleted:2ca66ae5-64cb-4870-abe6-9f20a7249240 for instance f7eca2fd-22fc-4140-b851-057050766706 on n-h2-846470-15 Aug 24 03:49:26.671240 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d58e512b-2253-410d-a378-a1c3a56cb295 req-793d6cc2-ed04-4c4c-be50-57bcf230baf9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052959 Aug 24 03:49:26.673152 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1678/3507] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:26.867997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:26.869019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] [instance: f7eca2fd-22fc-4140-b851-057050766706] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:26.883520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.884491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.885448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.887547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.890927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.891792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.921620 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] HTTP exception thrown: Instance f7eca2fd-22fc-4140-b851-057050766706 could not be found. Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Request method failure captured: Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 HTTP/1.1 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ-WLi4GpPb_euN65OA2hre53t2wysBBj2O9hs_UQ2WaFPugvtb4x4-_t6upNvSAjyIu5SGQwg9EjEc_iaUadWoIW8mZj48kwdk-se6wru_bJC78fkPEyrUP4t79fKPZquZfbGIWviUI-jdNVjKgSM5vCGrajKFAZRPCz69p56ld7rg Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 132aea84f10441f0bb7e83a28d42a493 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerAddressesTestJSON-1710964651 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_132aea84f10441f0bb7e83a28d42a493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/132aea84f10441f0bb7e83a28d42a493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/132aea84f10441f0bb7e83a28d42a493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/132aea84f10441f0bb7e83a28d42a493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerAddressesTestJSON-1710964651 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 132aea84f10441f0bb7e83a28d42a493 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1710964651 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerAddressesTestJSON-1710964651-project Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5d094306e1f5485ba58fa320e13100a6 Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerAddressesTestJSON-1710964651-project Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance f7eca2fd-22fc-4140-b851-057050766706 could not be found. Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'f7eca2fd-22fc-4140-b851-057050766706'} Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7eca2fd-22fc-4140-b851-057050766706 could not be found. Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7eca2fd-22fc-4140-b851-057050766706 could not be found. Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:26.924973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:26.930482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:26.930482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:26.930482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:26.930482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:26.930482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:26.930482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7eca2fd-22fc-4140-b851-057050766706 could not be found. Aug 24 03:49:26.930482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:26.937489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] Returning 404 to user: Instance f7eca2fd-22fc-4140-b851-057050766706 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:26.940977 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8df1e64c-ad19-4782-a082-69a2be3d1b7c tempest-ServerAddressesTestJSON-1710964651 tempest-ServerAddressesTestJSON-1710964651-project] 10.222.0.58 "GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706" status: 404 len: 111 microversion: 2.1 time: 0.077843 Aug 24 03:49:26.959018 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1679/3508] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:26 2022] GET /compute/v2.1/servers/f7eca2fd-22fc-4140-b851-057050766706 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:26.984633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:27.008296 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8290d000-3aba-4e29-9637-96271130ead6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 0.709234 Aug 24 03:49:27.014419 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1830/3509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:26 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:27.517260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:27.519873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:27.533428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.534153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.542456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.543643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.544504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.545509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.571759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:27.573758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:27.591377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.592811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.594605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.596344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.598337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.601862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.605589 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-837dc1f4-7303-4d70-b914-4172e2c885d8 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.092196 Aug 24 03:49:27.622235 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1680/3510] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:49:27 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:27.760031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:27.760610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:27.776480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.777007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.777454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.778185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.780910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.781404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.872187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c1a7525-9301-4d19-b66c-3c76cf86d604 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/08da4ca5-a0cb-44ce-b8f5-c877c27ed2c0" status: 200 len: 194 microversion: 2.1 time: 0.116856 Aug 24 03:49:27.873548 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1681/3511] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 24 03:49:27 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/08da4ca5-a0cb-44ce-b8f5-c877c27ed2c0 => generated 194 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:27.885469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:27.886131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:27.896183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.896684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.897640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.898451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.899497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.899497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.038188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lazy-loading 'services' on Instance uuid c716676e-7f28-467b-81a9-7fa48c4d622d {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:28.101036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:28.112651 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f12427a-07de-4a4c-953c-b3807ddcdcb2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.550194 Aug 24 03:49:28.113942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1831/3512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:27 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:28.119989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:28.121113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:28.149868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.157198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.158845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.159397 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3dc0435d-7451-4d25-9a5c-022938f70131 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/08da4ca5-a0cb-44ce-b8f5-c877c27ed2c0" status: 202 len: 0 microversion: 2.1 time: 0.278584 Aug 24 03:49:28.160972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.161274 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1682/3513] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 03:49:27 2022] DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/08da4ca5-a0cb-44ce-b8f5-c877c27ed2c0 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:49:28.161958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.162885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.579967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:28.591915 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-389b1e91-e2c4-47e6-8f6a-3ee89fb241c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 0.476767 Aug 24 03:49:28.606732 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1832/3514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:28 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:29.136958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:29.138681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:29.147790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.148768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.149505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.150710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.151776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.152439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.194200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-36bfdb9e-1ca4-4187-9a3b-217c687350fc req-b6547c19-0431-4d53-bc22-3361f554296f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e2a9ed-5413-43d2-84e6-5419baee9197", "tag": "b2803fa6-1b5f-48dd-9e0a-218af7d19c26"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:29.217029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-36bfdb9e-1ca4-4187-9a3b-217c687350fc req-b6547c19-0431-4d53-bc22-3361f554296f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.218328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-36bfdb9e-1ca4-4187-9a3b-217c687350fc req-b6547c19-0431-4d53-bc22-3361f554296f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.219008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-36bfdb9e-1ca4-4187-9a3b-217c687350fc req-b6547c19-0431-4d53-bc22-3361f554296f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.231839 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-36bfdb9e-1ca4-4187-9a3b-217c687350fc req-b6547c19-0431-4d53-bc22-3361f554296f service nova] Creating event network-changed:b2803fa6-1b5f-48dd-9e0a-218af7d19c26 for instance d8e2a9ed-5413-43d2-84e6-5419baee9197 on n-h2-846470-15 Aug 24 03:49:29.238785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-36bfdb9e-1ca4-4187-9a3b-217c687350fc req-b6547c19-0431-4d53-bc22-3361f554296f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052516 Aug 24 03:49:29.240285 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1833/3515] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:29.617615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:29.620585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:29.666532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.670944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.672624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.673957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.674979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.676548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.950022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:29.964396 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fded1ac9-f0a9-46ae-b763-c0d16713d736 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.833941 Aug 24 03:49:29.965207 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1683/3516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:29 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:30.569728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:30.591836 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-80097ca4-6348-4672-ba12-069df80b1ae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 0.981131 Aug 24 03:49:30.606390 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1834/3517] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:29 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:30.991766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:30.993324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:31.004514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:31.005487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:31.006309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:31.008694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:31.009518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:31.010275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:31.337494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d87c045a-27c4-4f01-85ba-46261fb1e1b0 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-462228162", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:31.342762 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d87c045a-27c4-4f01-85ba-46261fb1e1b0 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] HTTP exception thrown: min_count must be <= max_count Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d87c045a-27c4-4f01-85ba-46261fb1e1b0 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Request method failure captured: Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 183 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_KZISdmW0eeN6FVMh6fOFlc6PYpn17p4dvqe8o6deimxIkKUn6zxCOP3JQlLwag4286LdtN0aiT7M6JpSqIvbkMe4AYzgeMnN9wRGbmVoSPJ9FdUmyPz9mhpUGATr_FpwsUFA6X7WeKdJYUIIqsEglq09r1ZX4rURJ37G9M-ZWn4Y Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d0330bc7c1034ec588e873620f674421 Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-462228162", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: exception: min_count must be <= max_count Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-462228162', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 24 03:49:31.344426 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.349900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d87c045a-27c4-4f01-85ba-46261fb1e1b0 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Returning 400 to user: min_count must be <= max_count {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:31.354751 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d87c045a-27c4-4f01-85ba-46261fb1e1b0 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.259650 Aug 24 03:49:31.357468 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1835/3518] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:49:31 2022] POST /compute/v2.1/servers => generated 74 bytes in 263 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:31.446597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2e3c71ae-1a2f-403e-93e8-93bd3a01c414 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-566209204", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "max_count": 0}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2e3c71ae-1a2f-403e-93e8-93bd3a01c414 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Request method failure captured: Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 167 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_KZISdmW0eeN6FVMh6fOFlc6PYpn17p4dvqe8o6deimxIkKUn6zxCOP3JQlLwag4286LdtN0aiT7M6JpSqIvbkMe4AYzgeMnN9wRGbmVoSPJ9FdUmyPz9mhpUGATr_FpwsUFA6X7WeKdJYUIIqsEglq09r1ZX4rURJ37G9M-ZWn4Y Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d0330bc7c1034ec588e873620f674421 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-566209204", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "max_count": 0}} Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-566209204', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'max_count': 0}}} Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 0 Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:49:31.450991 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 03:49:31.456066 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.463477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2e3c71ae-1a2f-403e-93e8-93bd3a01c414 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:31.469445 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2e3c71ae-1a2f-403e-93e8-93bd3a01c414 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028702 Aug 24 03:49:31.470689 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1836/3519] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:49:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:49:31.561693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2be26faf-05af-4b68-9bf0-3a23efe3d297 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-942075998", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "max_count": 2.5}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2be26faf-05af-4b68-9bf0-3a23efe3d297 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Request method failure captured: Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 169 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_KZISdmW0eeN6FVMh6fOFlc6PYpn17p4dvqe8o6deimxIkKUn6zxCOP3JQlLwag4286LdtN0aiT7M6JpSqIvbkMe4AYzgeMnN9wRGbmVoSPJ9FdUmyPz9mhpUGATr_FpwsUFA6X7WeKdJYUIIqsEglq09r1ZX4rURJ37G9M-ZWn4Y Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d0330bc7c1034ec588e873620f674421 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-942075998", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "max_count": 2.5}} Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-942075998', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'max_count': 2.5}}} Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 2.5 Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:49:31.566722 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2be26faf-05af-4b68-9bf0-3a23efe3d297 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:31.573382 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2be26faf-05af-4b68-9bf0-3a23efe3d297 tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016709 Aug 24 03:49:31.574931 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1837/3520] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:49:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:49:31.607170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:31.609702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:31.618530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:31.619983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:31.631197 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-200cd4d1-db90-4ec6-bb0d-b68b89c6b935 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.645299 Aug 24 03:49:31.643687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:31.644513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:31.645215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:31.645701 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1684/3521] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:30 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:31.648786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:31.653127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:31.653127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:31.711087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e1cfc7eb-3ac1-42e8-827f-aefd82485f1f tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1114473280", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 0}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e1cfc7eb-3ac1-42e8-827f-aefd82485f1f tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Request method failure captured: Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 168 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_KZISdmW0eeN6FVMh6fOFlc6PYpn17p4dvqe8o6deimxIkKUn6zxCOP3JQlLwag4286LdtN0aiT7M6JpSqIvbkMe4AYzgeMnN9wRGbmVoSPJ9FdUmyPz9mhpUGATr_FpwsUFA6X7WeKdJYUIIqsEglq09r1ZX4rURJ37G9M-ZWn4Y Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d0330bc7c1034ec588e873620f674421 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1114473280", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 0}} Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1114473280', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'min_count': 0}}} Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 0 Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:49:31.715867 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 03:49:31.721486 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.725734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e1cfc7eb-3ac1-42e8-827f-aefd82485f1f tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:31.728773 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e1cfc7eb-3ac1-42e8-827f-aefd82485f1f tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022563 Aug 24 03:49:31.742157 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1685/3522] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:49:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:49:31.837687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90f20e97-60c9-4748-ae43-aef3dd4040aa tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1534038445", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 2.5}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90f20e97-60c9-4748-ae43-aef3dd4040aa tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Request method failure captured: Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 170 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_KZISdmW0eeN6FVMh6fOFlc6PYpn17p4dvqe8o6deimxIkKUn6zxCOP3JQlLwag4286LdtN0aiT7M6JpSqIvbkMe4AYzgeMnN9wRGbmVoSPJ9FdUmyPz9mhpUGATr_FpwsUFA6X7WeKdJYUIIqsEglq09r1ZX4rURJ37G9M-ZWn4Y Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df13e36bde70433e9f6f07e945a00a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: df13e36bde70433e9f6f07e945a00a22 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576359176 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d0330bc7c1034ec588e873620f674421 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576359176-project Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1534038445", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 2.5}} Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1534038445', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'min_count': 2.5}}} Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 2.5 Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:49:31.852386 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 03:49:31.857305 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:31.860331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90f20e97-60c9-4748-ae43-aef3dd4040aa tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:31.861863 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90f20e97-60c9-4748-ae43-aef3dd4040aa tempest-MultipleCreateNegativeTestJSON-1576359176 tempest-MultipleCreateNegativeTestJSON-1576359176-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029833 Aug 24 03:49:31.862458 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1686/3523] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:49:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:49:31.943072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:31.958692 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a14b8a36-4e6c-465a-b45e-ac4e46534006 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 0.345848 Aug 24 03:49:31.981457 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1838/3524] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:31 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:32.656584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:32.657293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:32.675904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.676421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.679186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.680165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.680645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.683797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.987896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:32.988524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:33.007782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.008431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.008889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.011382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.013061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.024118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.180459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:33.198803 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-70ef77a9-f81a-4e53-9646-76137953b9ba tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.548954 Aug 24 03:49:33.199245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1687/3525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:32 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:33.936777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:33.951227 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e15e3c2e-1f57-491e-b13e-bbd1482c603e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 0.970831 Aug 24 03:49:33.951877 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1839/3526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:32 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:34.133521 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:49:34.134182 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 03:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:49:34.224104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:34.224920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:34.242496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:34.244300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:34.250515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:34.251500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:34.252121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:34.252667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:34.978304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:34.979436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:34.993515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:35.022280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:35.026412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:35.028372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:35.029176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:35.032389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:35.032866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:35.035846 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de64deac-4f32-45ba-92b8-3c08e29e32c1 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.818063 Aug 24 03:49:35.043772 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1688/3527] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:34 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:35.368961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:35.379206 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0aabab88-aa24-4361-ada7-54765a2557b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 0.407243 Aug 24 03:49:35.383420 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1840/3528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:34 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:36.070267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.071540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:36.103626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.104164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.104616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.116866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.117708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.120760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.766952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:36.790551 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-14ed3c0f-fd3c-4f40-b1e9-27d2698c31bd tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.727174 Aug 24 03:49:36.799076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b76806ef-c521-4710-b958-65bf3adc0f81 tempest-ExtensionsTest-1608060451 tempest-ExtensionsTest-1608060451-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.801502 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b76806ef-c521-4710-b958-65bf3adc0f81 tempest-ExtensionsTest-1608060451 tempest-ExtensionsTest-1608060451-project] 10.222.0.58 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.629126 Aug 24 03:49:36.802239 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1841/3529] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 24 03:49:36 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:36.805060 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1689/3530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:36 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:36.814839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.815473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:36.819564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.820866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:36.830129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.830994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.831609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.833003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.833662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.835261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.847651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.856702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.857242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.858426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.859237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.863907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.882823 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5cf94e85-25d1-4d3f-8d80-84d170069b4b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/17ed975a-3d04-4c4f-a6db-af3ab53e7f9d" status: 200 len: 194 microversion: 2.1 time: 0.072828 Aug 24 03:49:36.884071 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1690/3531] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 24 03:49:36 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/17ed975a-3d04-4c4f-a6db-af3ab53e7f9d => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:36.897810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0da884d-d9b5-4072-afc5-7019554146b9 tempest-ExtensionsTest-1608060451 tempest-ExtensionsTest-1608060451-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.900988 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0da884d-d9b5-4072-afc5-7019554146b9 tempest-ExtensionsTest-1608060451 tempest-ExtensionsTest-1608060451-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007662 Aug 24 03:49:36.902483 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1691/3532] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 24 03:49:36 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:49:36.920104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.923218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:36.938756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.939943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.941686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.942653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.943656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.945915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:37.082457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lazy-loading 'services' on Instance uuid c716676e-7f28-467b-81a9-7fa48c4d622d {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:37.208137 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8505bef1-0844-46ea-be50-eb4dbdbaff8f tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/17ed975a-3d04-4c4f-a6db-af3ab53e7f9d" status: 202 len: 0 microversion: 2.1 time: 0.301707 Aug 24 03:49:37.212279 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1692/3533] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 03:49:36 2022] DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments/17ed975a-3d04-4c4f-a6db-af3ab53e7f9d => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:49:37.512707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:37.526079 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7dce87dd-30ad-4b57-8d2f-4baf1504aaa3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 0.721059 Aug 24 03:49:37.528089 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1842/3534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:36 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:37.822128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:37.822857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:37.837373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:37.842711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:37.843208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:37.846433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:37.847445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:37.848144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:38.262769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:38.289856 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98806396-af7e-47b2-84b9-0f244426b7a4 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.472250 Aug 24 03:49:38.299842 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1693/3535] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:37 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:38.549296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:38.550809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:38.566642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:38.574687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:38.577166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:38.580552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:38.581338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:38.584642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:38.619049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:39.336538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:39.337311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:39.349565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:39.354850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:39.357728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:39.360849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:39.362954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:39.365725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:39.691078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:39.701832 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e5354b61-6551-4a39-90c8-f8a5aab3a61b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 1.156585 Aug 24 03:49:39.706310 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1843/3536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:38 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:39.831626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:39.843428 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-56155eaf-254c-4ded-9fed-25171e6cb90d tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 0.511560 Aug 24 03:49:39.848592 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1694/3537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:39 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:40.214649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-dc587e43-7da7-41c9-a94e-008652afdc67 req-1fae5b94-3a83-4c2d-9863-5fedef0338cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e2a9ed-5413-43d2-84e6-5419baee9197", "name": "network-vif-plugged", "status": "completed", "tag": "b2803fa6-1b5f-48dd-9e0a-218af7d19c26"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:40.237939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dc587e43-7da7-41c9-a94e-008652afdc67 req-1fae5b94-3a83-4c2d-9863-5fedef0338cc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:40.238710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dc587e43-7da7-41c9-a94e-008652afdc67 req-1fae5b94-3a83-4c2d-9863-5fedef0338cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:40.240111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dc587e43-7da7-41c9-a94e-008652afdc67 req-1fae5b94-3a83-4c2d-9863-5fedef0338cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:40.282866 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-dc587e43-7da7-41c9-a94e-008652afdc67 req-1fae5b94-3a83-4c2d-9863-5fedef0338cc service nova] Creating event network-vif-plugged:b2803fa6-1b5f-48dd-9e0a-218af7d19c26 for instance d8e2a9ed-5413-43d2-84e6-5419baee9197 on n-h2-846470-15 Aug 24 03:49:40.293568 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-dc587e43-7da7-41c9-a94e-008652afdc67 req-1fae5b94-3a83-4c2d-9863-5fedef0338cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082938 Aug 24 03:49:40.304866 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1844/3538] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:40.726468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:40.727781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:40.767507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:40.767507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:40.767507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:40.767507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:40.767507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:40.769660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:40.870819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:40.873021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:40.895789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:40.900428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:40.903185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:40.908413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:40.912598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:40.913190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:41.183038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:41.212553 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 0.489925 Aug 24 03:49:41.219319 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1695/3539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:40 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:41.882618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:41.894651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:41.895159 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1325 microversion: 2.1 time: 1.029744 Aug 24 03:49:41.895800 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1845/3540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:40 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1325 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:41.897824 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003540 Aug 24 03:49:41.898552 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1696/3541] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 24 03:49:41 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 24 03:49:41.935807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:41.937716 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002890 Aug 24 03:49:41.948397 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1846/3542] 10.222.0.58 () {54 vars in 1035 bytes} [Wed Aug 24 03:49:41 2022] GET /compute/v2/ => generated 379 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 24 03:49:41.951592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:41.956295 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d497872a-2209-415d-a87b-89846c5202e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.005200 Aug 24 03:49:41.969497 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1697/3543] 10.222.0.58 () {54 vars in 1041 bytes} [Wed Aug 24 03:49:41 2022] GET /compute/v2.1/ => generated 388 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:41.972397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:41.974377 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f71ab929-ed82-41eb-a246-9c824a531737 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002434 Aug 24 03:49:41.975297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1847/3544] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 24 03:49:41 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 03:49:42.243562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:42.244455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:42.260400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:42.261034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:42.261709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:42.264852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:42.265676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:42.266460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:42.943720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:42.947427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:42.957516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=72 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:42.960818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:42.961687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:42.962379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:42.963800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:42.964516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:42.965320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:43.319293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:43.331878 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e61b99c6-b6a2-44b9-95e7-e897b633c7ff tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1476 microversion: 2.1 time: 1.094517 Aug 24 03:49:43.332810 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1698/3545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:42 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1476 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:43.516785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:43.531469 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-94c3cc17-430c-45b8-8cf5-a8a44d680db2 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1523 microversion: 2.1 time: 0.591465 Aug 24 03:49:43.533087 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1848/3546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:42 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1523 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:43.559108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:43.559690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:43.567302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:43.567834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:43.568275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:43.569038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:43.569495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:43.569926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:43.662812 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] HTTP exception thrown: Action 999 not found Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Request method failure captured: Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197/os-instance-actions/999 HTTP/1.1 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ-2VkDW3epBGx_-m6nMqZvqaPQQsBJICzvB2_Ve1GZJw9R2W5E3vKL1wYl4omi_4vh1NCay4NvDDj1xtPrSPCBG7jmYW50CnLahxyBlBLryrTTE4-RjvwUk41Hfa1TCKxc_wwHPpbhhdw22KRvHDfltbkxihmKgo6RQ1JH7JSTOXN0 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b4bc29828b484cbf820b514d4f5098b5 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b4bc29828b484cbf820b514d4f5098b5 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-InstanceActionsNegativeTestJSON-1123476973-project Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: e1ee8f9878c749b7ac27e36de77b4cf8 Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1123476973-project Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: exception: Action 999 not found Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': 'd8e2a9ed-5413-43d2-84e6-5419baee9197', 'id': '999'} Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 24 03:49:43.674549 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:43.685786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Returning 404 to user: Action 999 not found {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:43.685786 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-424fd5a1-3ae1-4bd0-9092-b823b443f6db tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.120900 Aug 24 03:49:43.685786 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1699/3547] 10.222.0.58 () {58 vars in 1308 bytes} [Wed Aug 24 03:49:43 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197/os-instance-actions/999 => generated 66 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:49:43.689377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77a7e2d6-636e-473a-9ca9-80e95899dbcb tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '.version_select at 0x7f10343c01f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:43.690647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-77a7e2d6-636e-473a-9ca9-80e95899dbcb tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:43.702208 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-77a7e2d6-636e-473a-9ca9-80e95899dbcb tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] HTTP exception thrown: Instance e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3 could not be found. Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77a7e2d6-636e-473a-9ca9-80e95899dbcb tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Request method failure captured: Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3/os-instance-actions HTTP/1.1 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ-2VkDW3epBGx_-m6nMqZvqaPQQsBJICzvB2_Ve1GZJw9R2W5E3vKL1wYl4omi_4vh1NCay4NvDDj1xtPrSPCBG7jmYW50CnLahxyBlBLryrTTE4-RjvwUk41Hfa1TCKxc_wwHPpbhhdw22KRvHDfltbkxihmKgo6RQ1JH7JSTOXN0 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: b4bc29828b484cbf820b514d4f5098b5 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: b4bc29828b484cbf820b514d4f5098b5 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-InstanceActionsNegativeTestJSON-1123476973-project Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: e1ee8f9878c749b7ac27e36de77b4cf8 Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1123476973-project Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3 could not be found. Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': 'e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3'} Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3 could not be found. Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:43.707631 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3 could not be found. Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3 could not be found. Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77a7e2d6-636e-473a-9ca9-80e95899dbcb tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Returning 404 to user: Instance e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:43.712694 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-77a7e2d6-636e-473a-9ca9-80e95899dbcb tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024583 Aug 24 03:49:43.721542 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1849/3548] 10.222.0.58 () {58 vars in 1296 bytes} [Wed Aug 24 03:49:43 2022] GET /compute/v2.1/servers/e07cefe9-19f1-4a98-94f0-cf6cc1dff8e3/os-instance-actions => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:43.729346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:43.729826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:43.741147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:43.741953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:43.742596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:43.743956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:43.748283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:43.749028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:43.839084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:44.034448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4e6ba77-5493-4728-9507-5f855e2993d6 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 204 len: 0 microversion: 2.1 time: 0.318245 Aug 24 03:49:44.045658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:44.046282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:44.055769 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1700/3549] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:43 2022] DELETE /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:44.065045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:44.072439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:44.073171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:44.078064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:44.078888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:44.079523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:44.355283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:44.356796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:44.379545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:44.380428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:44.385014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:44.386119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:44.386809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:44.387461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:44.697213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:44.710956 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4fa6f92-bcfc-499c-acde-6584380c8744 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1529 microversion: 2.1 time: 0.669087 Aug 24 03:49:44.720557 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1850/3550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:44 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1529 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:45.679035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:45.696607 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dde8bd50-47a1-4639-84e7-3f6a4c49e711 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1475 microversion: 2.1 time: 1.345424 Aug 24 03:49:45.699060 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1701/3551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:44 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1475 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:45.734794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:45.735871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:45.751786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:45.754352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:45.755096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:45.771080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:45.773072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:45.773323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:46.169113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-692a6fba-f7a7-4c07-9087-6c04f124ca61 req-0579fa3c-349b-44fe-9402-7b79a2c1d190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47cbf84-c598-4d84-b81a-8eca598e1f10", "name": "network-vif-unplugged", "status": "completed", "tag": "7f5412b6-161b-4e0a-959a-bc19d45e58f6"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:46.180330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.203626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-692a6fba-f7a7-4c07-9087-6c04f124ca61 req-0579fa3c-349b-44fe-9402-7b79a2c1d190 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:46.205809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-692a6fba-f7a7-4c07-9087-6c04f124ca61 req-0579fa3c-349b-44fe-9402-7b79a2c1d190 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:46.206276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-692a6fba-f7a7-4c07-9087-6c04f124ca61 req-0579fa3c-349b-44fe-9402-7b79a2c1d190 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:46.250096 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-692a6fba-f7a7-4c07-9087-6c04f124ca61 req-0579fa3c-349b-44fe-9402-7b79a2c1d190 service nova] Creating event network-vif-unplugged:7f5412b6-161b-4e0a-959a-bc19d45e58f6 for instance c47cbf84-c598-4d84-b81a-8eca598e1f10 on n-h2-846470-15 Aug 24 03:49:46.269637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-692a6fba-f7a7-4c07-9087-6c04f124ca61 req-0579fa3c-349b-44fe-9402-7b79a2c1d190 service nova] Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:49:46.287691 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-692a6fba-f7a7-4c07-9087-6c04f124ca61 req-0579fa3c-349b-44fe-9402-7b79a2c1d190 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125308 Aug 24 03:49:46.289793 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1702/3552] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:46.436487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:46.450438 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ee5df8c-f4bb-4b59-8086-ba7c70103029 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1529 microversion: 2.1 time: 0.720221 Aug 24 03:49:46.457593 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1851/3553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:45 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1529 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:46.721916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:46.722640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:46.753114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:46.753655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:46.754109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:46.755465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:46.758287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:46.758834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:47.478832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:47.479512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:47.501598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:47.502549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:47.504385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:47.505562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:47.508871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:47.509317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:47.786023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:47.802158 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c05425e-4e1d-4a08-a3e1-710f7680d676 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1487 microversion: 2.1 time: 0.327783 Aug 24 03:49:47.809859 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1852/3554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:47 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1487 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:47.984469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:47.999463 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e0397ced-85a0-4838-8b9c-10b7d9fce774 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1475 microversion: 2.1 time: 1.276614 Aug 24 03:49:48.015014 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1703/3555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:46 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1475 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:48.499258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6fdc9476-f3d9-4f3a-8903-39ad59478dc3 req-eb41ee76-193f-4fff-a73d-6a4776ab9814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e2a9ed-5413-43d2-84e6-5419baee9197", "name": "network-vif-deleted", "tag": "b2803fa6-1b5f-48dd-9e0a-218af7d19c26"}, {"name": "network-changed", "server_uuid": "c47cbf84-c598-4d84-b81a-8eca598e1f10", "tag": "7f5412b6-161b-4e0a-959a-bc19d45e58f6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:48.550877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6fdc9476-f3d9-4f3a-8903-39ad59478dc3 req-eb41ee76-193f-4fff-a73d-6a4776ab9814 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:48.551461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6fdc9476-f3d9-4f3a-8903-39ad59478dc3 req-eb41ee76-193f-4fff-a73d-6a4776ab9814 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:48.552053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6fdc9476-f3d9-4f3a-8903-39ad59478dc3 req-eb41ee76-193f-4fff-a73d-6a4776ab9814 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:48.618142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6fdc9476-f3d9-4f3a-8903-39ad59478dc3 req-eb41ee76-193f-4fff-a73d-6a4776ab9814 service nova] Creating event network-vif-deleted:b2803fa6-1b5f-48dd-9e0a-218af7d19c26 for instance d8e2a9ed-5413-43d2-84e6-5419baee9197 on n-h2-846470-15 Aug 24 03:49:48.622514 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6fdc9476-f3d9-4f3a-8903-39ad59478dc3 req-eb41ee76-193f-4fff-a73d-6a4776ab9814 service nova] Creating event network-changed:7f5412b6-161b-4e0a-959a-bc19d45e58f6 for instance c47cbf84-c598-4d84-b81a-8eca598e1f10 on n-h2-846470-15 Aug 24 03:49:48.640587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-6fdc9476-f3d9-4f3a-8903-39ad59478dc3 req-eb41ee76-193f-4fff-a73d-6a4776ab9814 service nova] Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:49:48.695484 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6fdc9476-f3d9-4f3a-8903-39ad59478dc3 req-eb41ee76-193f-4fff-a73d-6a4776ab9814 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.199039 Aug 24 03:49:48.697314 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1853/3556] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:48.825803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:48.826967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:48.853504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:48.854314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:48.856290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:48.861182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:48.864095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:48.867852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:48.925394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:49.009783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.012598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.015458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.016154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lazy-loading 'fault' on Instance uuid d8e2a9ed-5413-43d2-84e6-5419baee9197 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:49.033707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:49.034717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:49.062261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.063006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.063481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.065602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.066096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.066543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.166825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ee8f9878c749b7ac27e36de77b4cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bc29828b484cbf820b514d4f5098b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:49.177728 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab6fdc7a-b6d5-4ff6-a321-6cab76659ce7 tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 200 len: 1315 microversion: 2.1 time: 0.354183 Aug 24 03:49:49.179148 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1704/3557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:48 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:49.191462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:49.197482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:49.213921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.215518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.217296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.220251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.220771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.221225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.313838 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91397563-b610-4d49-acca-b2d14a5272eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130403 Aug 24 03:49:49.322357 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1705/3558] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:49:49 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:49:49.395704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:49.410059 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b761292-24ae-45f1-8112-6dec1facb1af tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1475 microversion: 2.1 time: 0.386886 Aug 24 03:49:49.410954 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1854/3559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:49 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1475 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:49.595043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:49.598424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:49.617132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.618204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.618988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.623087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.623916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.624610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.705583 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-12bd19d5-d274-42a2-b795-5623cd2547b9 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112591 Aug 24 03:49:49.719642 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1706/3560] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:49:49 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:49:49.843407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:49.844282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:49.857304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.859412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.861541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.863405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.864458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.865176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.932117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:49.932355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1029336664", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a410578b-d916-4218-bf01-482ee8be19b3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:50.063684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] validate_networks() for [('a410578b-d916-4218-bf01-482ee8be19b3', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:49:50.144042 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-145025ba-4060-4372-b715-8ea6b3a56986 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 204 len: 0 microversion: 2.1 time: 0.304288 Aug 24 03:49:50.146069 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1707/3561] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:49 2022] DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:50.157800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:50.163141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:50.180700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:50.181221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:50.181660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:50.182396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:50.182853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:50.183283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:50.737296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:50.795187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7cb3bb15-400f-441f-9e10-567e31d3853e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1673 microversion: 2.1 time: 0.641608 Aug 24 03:49:50.798306 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1708/3562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:50 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1673 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:50.810944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:50.812440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] [instance: d8e2a9ed-5413-43d2-84e6-5419baee9197] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:50.884433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:50.887938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:50.890494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:50.891559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:50.899078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:50.899850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:50.930182 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] HTTP exception thrown: Instance d8e2a9ed-5413-43d2-84e6-5419baee9197 could not be found. Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Request method failure captured: Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 HTTP/1.1 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ-2VkDW3epBGx_-m6nMqZvqaPQQsBJICzvB2_Ve1GZJw9R2W5E3vKL1wYl4omi_4vh1NCay4NvDDj1xtPrSPCBG7jmYW50CnLahxyBlBLryrTTE4-RjvwUk41Hfa1TCKxc_wwHPpbhhdw22KRvHDfltbkxihmKgo6RQ1JH7JSTOXN0 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b4bc29828b484cbf820b514d4f5098b5 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4bc29828b484cbf820b514d4f5098b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b4bc29828b484cbf820b514d4f5098b5 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1123476973 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-InstanceActionsNegativeTestJSON-1123476973-project Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: e1ee8f9878c749b7ac27e36de77b4cf8 Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1123476973-project Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance d8e2a9ed-5413-43d2-84e6-5419baee9197 could not be found. Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd8e2a9ed-5413-43d2-84e6-5419baee9197'} Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e2a9ed-5413-43d2-84e6-5419baee9197 could not be found. Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e2a9ed-5413-43d2-84e6-5419baee9197 could not be found. Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:50.931740 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e2a9ed-5413-43d2-84e6-5419baee9197 could not be found. Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:49:50.939391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] Returning 404 to user: Instance d8e2a9ed-5413-43d2-84e6-5419baee9197 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:50.941160 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-051f8c40-5cdd-42c1-97d8-0592c783515f tempest-InstanceActionsNegativeTestJSON-1123476973 tempest-InstanceActionsNegativeTestJSON-1123476973-project] 10.222.0.58 "GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197" status: 404 len: 111 microversion: 2.1 time: 0.137718 Aug 24 03:49:50.941160 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1709/3563] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:50 2022] GET /compute/v2.1/servers/d8e2a9ed-5413-43d2-84e6-5419baee9197 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:50.961130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:50.961693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:50.972086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:50.972592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:50.973047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:50.973765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:50.974268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:50.974649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.519005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:51.529392 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e246871-ac65-435d-8720-2b0aed289942 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1475 microversion: 2.1 time: 0.572627 Aug 24 03:49:51.546156 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1710/3564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:50 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1475 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:51.650308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:49:51.653398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:49:51.654262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:49:51.654884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:49:51.655850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:49:51.681745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:51.682558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:51.683311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.688678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:51.690517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:51.690974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.721233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:49:51.728011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:49:51.751215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:49:51.754740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:49:51.823101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:51.824221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:51.838480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:51.840704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:51.842876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.844338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:51.846243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:51.848057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.918850 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0f279d5-c87b-4425-9599-1ebe56221b83 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.211398 Aug 24 03:49:51.919636 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1855/3565] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:49:51.953191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b27fe36e-c3f1-4476-986f-fc26c2ba05fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:51.956448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b27fe36e-c3f1-4476-986f-fc26c2ba05fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:52.327880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b27fe36e-c3f1-4476-986f-fc26c2ba05fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:52.352174 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b27fe36e-c3f1-4476-986f-fc26c2ba05fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1193 microversion: 2.1 time: 0.424144 Aug 24 03:49:52.353223 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1856/3566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:51 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1193 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:52.559300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:52.564360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:52.575633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:52.580586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:52.581411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:52.582457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:52.591022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:52.592220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:52.669461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:52.689960 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-59aaaf8d-bc88-49fb-a5aa-11e650527265 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1673 microversion: 2.1 time: 0.871728 Aug 24 03:49:52.694427 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1711/3567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:51 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1673 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:53.090524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:53.105118 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7aa20e3-0da4-4d7f-90af-abf9e591399e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1473 microversion: 2.1 time: 0.555170 Aug 24 03:49:53.105948 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1857/3568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:52 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1473 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:53.384181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:53.385373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:53.414087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:53.414878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:53.415475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:53.416644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:53.417253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:53.419376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:53.728832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:53.731261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:53.743927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:53.748942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:53.750124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:53.751358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:53.753262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:53.755620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:54.213767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:54.231525 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b0ebc1d-45fa-4b5b-ba14-45d1e7575f74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1197 microversion: 2.1 time: 0.860335 Aug 24 03:49:54.252197 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1712/3569] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:53 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1197 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:54.268165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:54.272242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:54.287978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:54.291814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:54.294464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:54.295474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:54.301862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:54.302773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:54.954919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:54.966987 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e1198804-5be3-4f3f-8f0b-048bb75bd2ba tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1673 microversion: 2.1 time: 1.250767 Aug 24 03:49:54.976835 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1858/3570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:53 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1673 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:55.266356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:55.267182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:55.310996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:55.311941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:55.312750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:55.314029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:55.321821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:55.323714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:55.699148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:55.730474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e5bcc053-adaf-496a-a9c8-b0f3ae298274 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1253 microversion: 2.1 time: 0.474413 Aug 24 03:49:55.735379 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1859/3571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:55 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1253 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:55.930243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:55.938386 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8e019cd2-f32e-4b18-970c-fdeb7e3276ab tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1473 microversion: 2.1 time: 1.684649 Aug 24 03:49:55.938985 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1713/3572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:54 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1473 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:56.001067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:56.001705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:56.013361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:56.013855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:56.022016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:56.023819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:56.031965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:56.036372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:56.559255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:56.569249 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-08f1c5d0-422d-4126-a48e-a485ededfe5a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1606 microversion: 2.1 time: 0.574846 Aug 24 03:49:56.590298 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1860/3573] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:55 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1606 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:56.760400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:56.761372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:56.780629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:56.781663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:56.782306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:56.783340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:56.784623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:56.788509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:56.962216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:56.963071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:56.994293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:56.995043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:56.998820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:56.999766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.000934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.001637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.195719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:57.219003 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-36782e05-d586-4e9c-bdea-8f8447167126 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1251 microversion: 2.1 time: 0.464017 Aug 24 03:49:57.222382 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1714/3574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:56 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1251 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:57.616121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:57.616924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:57.625375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:57.643806 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0300d38-01e9-4d40-acfa-02aeeaffba46 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1470 microversion: 2.1 time: 0.685223 Aug 24 03:49:57.644662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.646328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.647376 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1861/3575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:56 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1470 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:57.649769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.671395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.675890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.678557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.690265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:57.691951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:57.728554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.731756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.732547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.734753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.738825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.741728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.900741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20ca097b-4ef0-4ad5-a0d3-4229defd5015 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10/action" status: 204 len: 0 microversion: 2.1 time: 0.232409 Aug 24 03:49:57.905551 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1862/3576] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:49:57 2022] POST /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10/action => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:57.920374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:57.925893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:57.941300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.942113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.942735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.943452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.955864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.956635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:58.383753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:58.392889 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eb5d2e53-9433-4bc1-b00b-6df4ce703440 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1606 microversion: 2.1 time: 0.783026 Aug 24 03:49:58.398521 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1715/3577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:57 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1606 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:58.407532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:58.412768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:58.441379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:58.442160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:58.445731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:58.446740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:58.447412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:58.448965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:58.713909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:58.721919 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9dfd075c-fe0b-4a01-911b-b94db628ce15 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1470 microversion: 2.1 time: 0.814608 Aug 24 03:49:58.722704 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1863/3578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:57 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1470 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:58.810387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:58.822824 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16c2a854-d025-407a-9fbc-fafde93c0821 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1251 microversion: 2.1 time: 0.422627 Aug 24 03:49:58.823425 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1716/3579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:58 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1251 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:59.419629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:59.420305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:59.434539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.435064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.435524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.436435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.436917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.437357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.533251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:59.752607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:59.756912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:59.789700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.790227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.790677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.791413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.795636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.796208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.959796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:59.971466 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-11aafe45-2b43-4349-ba48-a2ba758ae59e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1606 microversion: 2.1 time: 0.556327 Aug 24 03:49:59.984444 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1864/3580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:59 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1606 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:59.992924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:59.993569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:00.028085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.031287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.037187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:00.039119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.040946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.041673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:00.197166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:00.205450 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-19b3a941-7b39-49c9-a13f-27039a49aa33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1251 microversion: 2.1 time: 0.219772 Aug 24 03:50:00.206052 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1865/3581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:59 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1251 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:00.550858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1ebd5963-3c10-4b8b-8aad-13f9732ddf11 req-abaf7102-b849-45b9-8ced-813a1c779bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c716676e-7f28-467b-81a9-7fa48c4d622d", "name": "network-vif-deleted", "tag": "05d20c3f-ba12-4443-98d9-f14bb070a81d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:00.576173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ebd5963-3c10-4b8b-8aad-13f9732ddf11 req-abaf7102-b849-45b9-8ced-813a1c779bd0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.578194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ebd5963-3c10-4b8b-8aad-13f9732ddf11 req-abaf7102-b849-45b9-8ced-813a1c779bd0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.578837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ebd5963-3c10-4b8b-8aad-13f9732ddf11 req-abaf7102-b849-45b9-8ced-813a1c779bd0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:00.640933 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1ebd5963-3c10-4b8b-8aad-13f9732ddf11 req-abaf7102-b849-45b9-8ced-813a1c779bd0 service nova] Creating event network-vif-deleted:05d20c3f-ba12-4443-98d9-f14bb070a81d for instance c716676e-7f28-467b-81a9-7fa48c4d622d on n-h1-846470-15 Aug 24 03:50:00.653678 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1ebd5963-3c10-4b8b-8aad-13f9732ddf11 req-abaf7102-b849-45b9-8ced-813a1c779bd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106302 Aug 24 03:50:00.656485 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1866/3582] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:50:00.998097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:00.998816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:01.012097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:01.012966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:01.013630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:01.014593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:01.016445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:01.017119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:01.119413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:01.120384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:01.121090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:01.124452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lazy-loading 'fault' on Instance uuid c716676e-7f28-467b-81a9-7fa48c4d622d {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:50:01.358409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca968a4777ea4164be5ff3174d4291d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5a2a3c9cdc428d81a1ade5f5102e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:01.371386 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53b7388d-0d64-4bf1-aa2d-9b319850b18a tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 200 len: 1327 microversion: 2.1 time: 0.377464 Aug 24 03:50:01.373381 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1867/3583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:00 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 1327 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:01.378625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:01.379559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:01.388019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:01.388905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:01.389625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:01.390580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:01.391396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:01.392097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:01.559705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:01.571051 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-00a34162-0647-4ba8-8e4d-fed102e76ba9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1251 microversion: 2.1 time: 0.195714 Aug 24 03:50:01.586807 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1868/3584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:01 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1251 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:01.592377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7a1928ca-8f23-42df-b50e-6dc462feab43 req-abffebb2-994f-4de9-8570-b8e8f566d12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47cbf84-c598-4d84-b81a-8eca598e1f10", "name": "network-vif-plugged", "status": "completed", "tag": "7f5412b6-161b-4e0a-959a-bc19d45e58f6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:01.605010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7a1928ca-8f23-42df-b50e-6dc462feab43 req-abffebb2-994f-4de9-8570-b8e8f566d12c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:01.605929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7a1928ca-8f23-42df-b50e-6dc462feab43 req-abffebb2-994f-4de9-8570-b8e8f566d12c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:01.606633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7a1928ca-8f23-42df-b50e-6dc462feab43 req-abffebb2-994f-4de9-8570-b8e8f566d12c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:01.622434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7a1928ca-8f23-42df-b50e-6dc462feab43 req-abffebb2-994f-4de9-8570-b8e8f566d12c service nova] Creating event network-vif-plugged:7f5412b6-161b-4e0a-959a-bc19d45e58f6 for instance c47cbf84-c598-4d84-b81a-8eca598e1f10 on n-h2-846470-15 Aug 24 03:50:01.629881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-7a1928ca-8f23-42df-b50e-6dc462feab43 req-abffebb2-994f-4de9-8570-b8e8f566d12c service nova] Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:50:01.649649 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7a1928ca-8f23-42df-b50e-6dc462feab43 req-abffebb2-994f-4de9-8570-b8e8f566d12c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061034 Aug 24 03:50:01.652557 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1869/3585] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:02.161690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:02.170816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4da84aab-f156-4f72-9398-298558d326a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1470 microversion: 2.1 time: 2.430165 Aug 24 03:50:02.196063 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1717/3586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:59 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1470 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:02.395118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:02.398098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:02.418162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:02.419501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:02.421533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.422475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.425028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.425959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.428441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.429150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.469064 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] HTTP exception thrown: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Request method failure captured: Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d HTTP/1.1 Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ2nNzF92F7ozXo3ryS2w9e7wuuQoA9s2hb2S4t-WXhw0VSFq47NsDGRrC19fL_nNj21Axs5FVUa2Ke1dFFwv9KEdZYghgCrRtwmsgvIxRNG1lVAEWE-5nmdjithEOq86Zf2tmM9WVL5Zepa1hj5IbZnT6MZ8ia_L0KI74tFRa4jcko Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: ca968a4777ea4164be5ff3174d4291d5 Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c716676e-7f28-467b-81a9-7fa48c4d622d'} Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:02.471031 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.477038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.477038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:02.477038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:02.477038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:02.477038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:02.477038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:02.477038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.491181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Returning 404 to user: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:02.492351 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9bd82b23-a693-45a4-8d4a-a2f69a17816b tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 404 len: 111 microversion: 2.1 time: 0.101847 Aug 24 03:50:02.496069 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1870/3587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:02 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:02.502407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8019c90-e4d9-4cc6-aefa-00e05a74d4eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '.version_select at 0x7f102acc65e0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:02.589872 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8019c90-e4d9-4cc6-aefa-00e05a74d4eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-607230203" status: 202 len: 0 microversion: 2.1 time: 0.089706 Aug 24 03:50:02.593727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:02.594933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:02.595408 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1718/3588] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-607230203 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:50:02.610859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.611709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.612355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.616701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.617451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.617889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.789040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:02.797519 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-49093ece-2c62-4ea5-b8de-06f87ebe6802 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1251 microversion: 2.1 time: 0.207767 Aug 24 03:50:02.814834 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1871/3589] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:02 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1251 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:03.197529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:03.198429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:03.230920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:03.232032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:03.233557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:03.237945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:03.238920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:03.239547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:03.826295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:03.827478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:03.864297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:03.864797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:03.865245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:03.866337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:03.866895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:03.867590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:04.028466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:04.043185 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-44415d37-0b2f-4f3c-b1d9-1bafef5e4ea7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1470 microversion: 2.1 time: 0.850433 Aug 24 03:50:04.043376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:04.057144 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1719/3590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:03 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1470 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:04.063394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cba276fa-d557-47c0-ac02-e633af3530c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1251 microversion: 2.1 time: 0.244902 Aug 24 03:50:04.072686 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1872/3591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:03 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1251 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:05.102783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:05.115157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:05.141765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:05.142561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:05.143439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:05.144902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:05.147221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:05.150302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:05.603439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6cb6bc7-bebc-407a-939b-1a59f27876f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: .version_select at 0x7f102ad723a0>, body: {"keypair": {"name": "tempest-keypair-416247830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAN8KxsfSFknHoInyt5juwHv1sm/P+qb/Stpj0rLH92Ho/5T0SchALUjmkH4FMceXK7ZEmyN8W5p1MJ/U4UpTqllP4hKKp9bDq8wV8TNFH9qAlNYpukw7YNf5VIyeHe8A=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:05.651947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e6cb6bc7-bebc-407a-939b-1a59f27876f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:05.670993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e6cb6bc7-bebc-407a-939b-1a59f27876f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for user cf384a2eab3649a2ad4f5eec8d8c6b0a and project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:05.731029 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6cb6bc7-bebc-407a-939b-1a59f27876f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.039295 Aug 24 03:50:05.732548 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1720/3592] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:50:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:05.746530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:05.749731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:05.771124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:05.787551 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d656e043-a711-40d6-9ad1-b30944178189 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1470 microversion: 2.1 time: 0.695296 Aug 24 03:50:05.790842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:05.792714 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1873/3593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:05 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1470 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:05.793600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:05.794083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:05.795051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:05.803055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:05.805006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:06.824524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:06.826057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:06.843331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:06.846332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:06.847189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:06.851298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:06.853704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:06.855876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:07.143154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:07.151616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:07.158761 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b317aa3a-58f5-4ee7-a0eb-ab9baf16dbaa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 1.424393 Aug 24 03:50:07.161644 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1721/3594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:05 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:07.357397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:07.387319 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55745a54-3d7b-4b40-b533-fdeba36a4a19 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1470 microversion: 2.1 time: 0.564486 Aug 24 03:50:07.395040 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1874/3595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:06 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1470 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:08.187173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:08.188500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:08.226043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:08.226640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:08.227090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:08.227859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:08.228331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:08.228764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:08.415082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:08.416290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:08.425315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:08.431130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:08.431808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:08.432756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:08.433400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:08.435839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:08.946437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:08.958825 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20ae2db4-069f-4925-93ad-eb78af6367dd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1462 microversion: 2.1 time: 0.547754 Aug 24 03:50:08.963695 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1875/3596] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:08 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1462 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:08.991459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:08.992357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:09.010061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:09.010766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:09.012902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:09.016309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:09.017729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:09.019586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:09.401652 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3b1a49b9-8f03-4aec-b217-480cdb45bc9f tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1615 microversion: 2.1 time: 0.415751 Aug 24 03:50:09.406135 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1876/3597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:08 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1615 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:09.441643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7815606-1df6-4dfd-aa54-e7b4805a1781 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '.version_select at 0x7f10235ddca0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:09.449481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7815606-1df6-4dfd-aa54-e7b4805a1781 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:09.450061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:09.450872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7815606-1df6-4dfd-aa54-e7b4805a1781 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:09.451329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7815606-1df6-4dfd-aa54-e7b4805a1781 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:09.464838 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41e9b7d2-880b-4e01-8444-f36c036c128b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 1.286278 Aug 24 03:50:09.468088 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1722/3598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:08 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:09.473938 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7815606-1df6-4dfd-aa54-e7b4805a1781 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.039579 Aug 24 03:50:09.478862 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1877/3599] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:50:09 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:09.694468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-9602734", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:09.857294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:10.367622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-60612555", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dedb9b92-960d-40c5-ae39-a6e49a145a80"}], "security_groups": [{"name": "tempest-securitygroup--1060262052"}], "key_name": "tempest-keypair-416247830", "user_data": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:10.573781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] validate_networks() for [('dedb9b92-960d-40c5-ae39-a6e49a145a80', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:10.749360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:10.750818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:10.751632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:10.752535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:10.753191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:10.770834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:10.773206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:10.776190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:10.779278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:10.780104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:10.781219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:10.831743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:10.848077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for user 1121b62203674b82ae3c7cfcb3112eb5 and project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:10.877467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:10.881525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:10.937664 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b435b594-3cc2-4746-99a0-9f4739641855 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.248209 Aug 24 03:50:10.939283 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1723/3600] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:50:10.946755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:10.947721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:10.956416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:10.957174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:10.958167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:10.960359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:10.961298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:10.962315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:11.326174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:11.326882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:11.327557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:11.328170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:11.328772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:11.340537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:11.341274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:11.341937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:11.343136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:11.343811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:11.344406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:11.367777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:11.373656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for user cf384a2eab3649a2ad4f5eec8d8c6b0a and project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:11.387904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:11.390317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:11.477897 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e92ddc74-6050-4bd4-ac67-2f30b0cf0072 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.123976 Aug 24 03:50:11.479167 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1878/3601] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:50:11.484913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3ce7f3c-83ad-4052-a33e-1f18bffd77f5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:11.485809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3ce7f3c-83ad-4052-a33e-1f18bffd77f5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:11.608211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e3ce7f3c-83ad-4052-a33e-1f18bffd77f5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:11.616662 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3ce7f3c-83ad-4052-a33e-1f18bffd77f5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1210 microversion: 2.1 time: 0.135936 Aug 24 03:50:11.624037 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1879/3602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:11 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1210 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:11.643652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-848a4d40-52a4-4a6f-bc91-a5ff98416cc4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:11.644856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-848a4d40-52a4-4a6f-bc91-a5ff98416cc4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:11.682307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:11.818039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-848a4d40-52a4-4a6f-bc91-a5ff98416cc4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:11.832646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-848a4d40-52a4-4a6f-bc91-a5ff98416cc4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1239 microversion: 2.1 time: 0.201764 Aug 24 03:50:11.834071 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1880/3603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:11 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1239 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:12.282808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:12.310324 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0e65cb04-87a0-42b7-9f29-147977049c32 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 1.368492 Aug 24 03:50:12.311861 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1724/3604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:10 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:12.423890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ca7150ae-38df-46cb-b2ff-cfd44462a239 req-5fbe6415-331e-4c9d-9813-5e29ebfc5e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ed4f04-4bff-4442-9c22-c2c523efd262", "tag": "4cfbfa0f-4675-44bb-82d4-936d99a08a0e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:12.451752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ca7150ae-38df-46cb-b2ff-cfd44462a239 req-5fbe6415-331e-4c9d-9813-5e29ebfc5e1d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:12.458298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ca7150ae-38df-46cb-b2ff-cfd44462a239 req-5fbe6415-331e-4c9d-9813-5e29ebfc5e1d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:12.472457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ca7150ae-38df-46cb-b2ff-cfd44462a239 req-5fbe6415-331e-4c9d-9813-5e29ebfc5e1d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:12.512642 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ca7150ae-38df-46cb-b2ff-cfd44462a239 req-5fbe6415-331e-4c9d-9813-5e29ebfc5e1d service nova] Creating event network-changed:4cfbfa0f-4675-44bb-82d4-936d99a08a0e for instance 49ed4f04-4bff-4442-9c22-c2c523efd262 on n-h2-846470-15 Aug 24 03:50:12.541828 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ca7150ae-38df-46cb-b2ff-cfd44462a239 req-5fbe6415-331e-4c9d-9813-5e29ebfc5e1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121996 Aug 24 03:50:12.549870 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1881/3605] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:12.680931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:12.680931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:12.680931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:12.680931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:12.680931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:12.685026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:12.688576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:12.689226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:12.862467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:12.863115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:12.884163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:12.889307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:12.891789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:12.900541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:12.901059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:12.904743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:13.134267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:13.153309 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1921a7ca-25da-4c29-a22a-cdb1aff6ebf2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1243 microversion: 2.1 time: 0.299262 Aug 24 03:50:13.161173 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1882/3606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:12 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1243 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:13.350698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:13.354547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:13.380244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:13.382631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:13.383176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:13.384030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:13.386293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:13.389333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:14.015966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:14.027400 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-08468b38-2ecd-4c12-bfee-ce8da7291523 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1262 microversion: 2.1 time: 1.380047 Aug 24 03:50:14.032018 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1725/3607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:12 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1262 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:14.079570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:14.098386 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c853978f-3178-4671-bc6e-4cf34c05e14f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 0.766488 Aug 24 03:50:14.099003 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1883/3608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:13 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:14.183773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:14.184926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:14.205595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:14.206099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:14.206538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:14.207253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:14.207794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:14.208226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:14.663526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:14.680269 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a641e292-b404-483f-b496-f7001a9076b9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1299 microversion: 2.1 time: 0.502070 Aug 24 03:50:14.680898 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1726/3609] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:14 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1299 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:15.055766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:15.056590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:15.095305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:15.102442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:15.105478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:15.109079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:15.109673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:15.110136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:15.122778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:15.124715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:15.179986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:15.181239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:15.185723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:15.189049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:15.193336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:15.196460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:15.564160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:15.580715 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66d55545-0f55-4093-89e2-e063adfbd69b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1268 microversion: 2.1 time: 0.529921 Aug 24 03:50:15.589919 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1884/3610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:15 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1268 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:15.888685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1640901855", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "d840d162-cb41-4947-a586-d775a1f495ac"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:16.014117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] validate_networks() for [('d840d162-cb41-4947-a586-d775a1f495ac', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:16.932223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:16.933773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:16.935067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:16.935766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:16.936315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:16.953312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:16.954967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:16.955741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:16.956717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:16.957362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:16.958127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:16.984052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Getting quotas for project b55289c2d7dc4d6389d7a0fa304b6e32. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:16.990635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Getting quotas for user 95fd332c184842e6a58784da9ea76512 and project b55289c2d7dc4d6389d7a0fa304b6e32. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:17.006880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:17.012075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:17.151444 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b8492be-16df-43aa-9c5f-a777e12da804 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560100 Aug 24 03:50:17.152785 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1885/3611] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:50:17.161376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:17.162596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:17.171398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:17.172287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:17.172943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:17.173923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:17.174604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:17.175270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:17.336303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:17.338340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:17.361052 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-df49a348-b96f-4947-becd-656beebb2bd7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 2.245991 Aug 24 03:50:17.368011 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23a5111b-6c89-4e42-a5db-a34ae37f8161 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1297 microversion: 2.1 time: 0.211289 Aug 24 03:50:17.371975 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1886/3612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:17 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1297 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:17.378924 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1727/3613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:15 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:17.384986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:17.391655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d73a3cf6-d683-479a-960d-432741005443 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:17.392829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:17.408056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d73a3cf6-d683-479a-960d-432741005443 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:17.409908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:17.412618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:17.414841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:17.417607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:17.418349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:17.420942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:17.423012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:17.500511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:17.700731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:17.730272 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba6ceff9-ca5d-4982-a20d-72498f304424 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1268 microversion: 2.1 time: 0.351557 Aug 24 03:50:17.731065 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1887/3614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:17 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1268 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:17.934445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d73a3cf6-d683-479a-960d-432741005443 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:17.970542 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d73a3cf6-d683-479a-960d-432741005443 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1225 microversion: 2.1 time: 0.582301 Aug 24 03:50:17.975095 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1728/3615] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:17 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1225 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:18.383385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:18.384661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:18.395416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:18.396481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:18.405118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:18.408889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:18.410881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:18.417408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:18.419974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:18.420903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:18.421992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:18.425304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:18.427472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:18.432209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:18.434465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:18.435006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:18.651418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:18.688360 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ff68ea8-428d-4127-b81e-230e70886aa0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1297 microversion: 2.1 time: 0.298286 Aug 24 03:50:18.689873 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1729/3616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:18 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1297 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:18.756221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:18.760790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:18.790984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:18.792308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:18.795358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:18.799028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:18.802842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:18.805919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:18.956417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:18.971190 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a621a9f9-7c3c-4531-a2a3-38e800db4924 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 0.592489 Aug 24 03:50:18.990362 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1888/3617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:18 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:19.000575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:19.001460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:19.011708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:19.014724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:19.015369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:19.022833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:19.023582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:19.024214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:19.095185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:19.135152 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e1f76af-3050-4c73-972b-49b132b2a4b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1268 microversion: 2.1 time: 0.385794 Aug 24 03:50:19.136197 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1730/3618] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:18 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1268 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:19.145025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:19.154632 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10748e55-9421-4da5-b81b-bc9e6e74ded4 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1229 microversion: 2.1 time: 0.157825 Aug 24 03:50:19.168256 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1889/3619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:18 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:19.726684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:19.730186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:19.781658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:19.785644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:19.787200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:19.796036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:19.800913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:19.805970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:19.995842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:19.997771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:20.008402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:20.009246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:20.009860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:20.010804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:20.011445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:20.018408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:20.257164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:20.269436 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-694c1f29-7307-4f1d-923f-2a9ed699929c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 0.279730 Aug 24 03:50:20.278660 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1890/3620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:19 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:20.284028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:20.284648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:20.301213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:20.302248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:20.302992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:20.305717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:20.309467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:20.310184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:20.589835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:20.607583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-21801c9c-84c6-43dc-a2b6-98d4d495b599 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.327668 Aug 24 03:50:20.623073 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1891/3621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:20 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:20.637898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:20.638640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:20.674873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:20.675597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:20.677050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:20.678368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:20.679370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:20.680317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:20.733246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:20.755062 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b10e80ae-7fba-495a-a6bc-29dcc6b93ab0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 1.044217 Aug 24 03:50:20.757798 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1731/3622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:19 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:20.882404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:20.893146 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-806cdfb3-8615-4a68-9004-b91291162044 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1229 microversion: 2.1 time: 0.268745 Aug 24 03:50:20.897861 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1892/3623] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:20 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1229 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:21.291755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:21.292346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:21.295180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:21.315681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:21.316369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:21.317249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:21.319448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:21.324068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:21.324797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:21.631783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:21.632584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:21.645950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:21.646669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:21.647262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:21.648060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:21.648540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:21.648984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:21.922220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:21.938069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c723354f-76fd-4583-a710-b4c3f785e792 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.310647 Aug 24 03:50:21.954799 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1893/3624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:21 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:21.961218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:21.961972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:21.970581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:21.971495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:21.972145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:21.973336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:21.975350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:21.976340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:21.997382 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] HTTP exception thrown: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Request method failure captured: Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d HTTP/1.1 Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ2nNzF92F7ozXo3ryS2w9e7wuuQoA9s2hb2S4t-WXhw0VSFq47NsDGRrC19fL_nNj21Axs5FVUa2Ke1dFFwv9KEdZYghgCrRtwmsgvIxRNG1lVAEWE-5nmdjithEOq86Zf2tmM9WVL5Zepa1hj5IbZnT6MZ8ia_L0KI74tFRa4jcko Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: ca968a4777ea4164be5ff3174d4291d5 Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c716676e-7f28-467b-81a9-7fa48c4d622d'} Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:21.999531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:22.003476 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:22.006873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Returning 404 to user: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:22.008482 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d0c0e9d-f889-4baa-aedc-cbac39a3b40c tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 404 len: 111 microversion: 2.1 time: 0.051993 Aug 24 03:50:22.009648 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1894/3625] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:50:21 2022] DELETE /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:22.022749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:22.026189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:22.041962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.042471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.042940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:22.043896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.044163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.044606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:22.884795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:22.902427 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-25179e10-5490-4a1f-bdb8-d8a72a728907 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 1.613234 Aug 24 03:50:22.921316 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1732/3626] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:21 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:22.934030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:22.943591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:22.966352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.968740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.970781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:22.973403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.978397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.981274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.451936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:23.467026 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a6b9bc85-e8df-4883-a6fd-db00ac437eb0 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1283 microversion: 2.1 time: 0.542398 Aug 24 03:50:23.468112 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1733/3627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:22 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1283 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:23.473839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:23.479917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: c716676e-7f28-467b-81a9-7fa48c4d622d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:23.494546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:23.498046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:23.498625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.500930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:23.502044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:23.502608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.536746 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] HTTP exception thrown: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Request method failure captured: Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d HTTP/1.1 Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ2nNzF92F7ozXo3ryS2w9e7wuuQoA9s2hb2S4t-WXhw0VSFq47NsDGRrC19fL_nNj21Axs5FVUa2Ke1dFFwv9KEdZYghgCrRtwmsgvIxRNG1lVAEWE-5nmdjithEOq86Zf2tmM9WVL5Zepa1hj5IbZnT6MZ8ia_L0KI74tFRa4jcko Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ca968a4777ea4164be5ff3174d4291d5 Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'c716676e-7f28-467b-81a9-7fa48c4d622d'} Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:23.538996 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:23.542967 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:23.542967 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:23.542967 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:23.542967 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:23.542967 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:23.542967 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. Aug 24 03:50:23.542967 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:23.548785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Returning 404 to user: Instance c716676e-7f28-467b-81a9-7fa48c4d622d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:23.549951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d30e637a-961d-4bd1-a6f5-5f0f88f8fd37 tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d" status: 404 len: 111 microversion: 2.1 time: 0.080402 Aug 24 03:50:23.550554 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1734/3628] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:23 2022] GET /compute/v2.1/servers/c716676e-7f28-467b-81a9-7fa48c4d622d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:23.579314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:23.587447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:23.588124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:23.591750 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8cf22a2-03c2-4df4-84a4-e47ef805a37a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 1.580579 Aug 24 03:50:23.592306 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1895/3629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:22 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:23.611849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:23.612546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:23.613086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.613904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:23.614379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:23.614821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.928885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:23.929791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:23.954658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:23.955509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:23.956671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.957603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:23.958297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:23.968944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:24.728375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:24.744255 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d3c9a25-9524-4a0f-84bb-8673320bf630 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 1.192263 Aug 24 03:50:24.761979 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1735/3630] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:23 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:24.774320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:24.779751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:24.794493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:24.795276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:24.796847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:24.798387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:24.803185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:24.803962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.113890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:25.121250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:25.147037 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e3e488bd-2911-4fb3-922a-e1145288ced8 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1283 microversion: 2.1 time: 0.383629 Aug 24 03:50:25.148006 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1b1d03d-19a6-4260-9eed-0ddb4da858ad tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 1.223052 Aug 24 03:50:25.153731 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1896/3631] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:23 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:25.155511 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1736/3632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:24 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1283 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:25.166980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:25.168190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:25.192046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.196051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.197474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.198253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.198742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.199611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.236243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a96620c6-9738-4407-816c-096c41723c50 req-1148613f-5611-4692-a6b3-be9b4e5eb1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38807978-26d4-4c2b-b052-28f012675e23", "tag": "bd18e940-693e-4c89-a6be-6594e2b035c6"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:25.279947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a96620c6-9738-4407-816c-096c41723c50 req-1148613f-5611-4692-a6b3-be9b4e5eb1c9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.281777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a96620c6-9738-4407-816c-096c41723c50 req-1148613f-5611-4692-a6b3-be9b4e5eb1c9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.284300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a96620c6-9738-4407-816c-096c41723c50 req-1148613f-5611-4692-a6b3-be9b4e5eb1c9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.327213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a96620c6-9738-4407-816c-096c41723c50 req-1148613f-5611-4692-a6b3-be9b4e5eb1c9 service nova] Creating event network-changed:bd18e940-693e-4c89-a6be-6594e2b035c6 for instance 38807978-26d4-4c2b-b052-28f012675e23 on n-h1-846470-15 Aug 24 03:50:25.353265 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a96620c6-9738-4407-816c-096c41723c50 req-1148613f-5611-4692-a6b3-be9b4e5eb1c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121370 Aug 24 03:50:25.354587 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1737/3633] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:50:25.612322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0515e604-e2c8-4fbb-93f9-904d4d6996ea req-287b6cf9-fcaa-4aea-a3b8-8456963739aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ed4f04-4bff-4442-9c22-c2c523efd262", "name": "network-vif-plugged", "status": "completed", "tag": "4cfbfa0f-4675-44bb-82d4-936d99a08a0e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:25.657285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0515e604-e2c8-4fbb-93f9-904d4d6996ea req-287b6cf9-fcaa-4aea-a3b8-8456963739aa service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.658180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0515e604-e2c8-4fbb-93f9-904d4d6996ea req-287b6cf9-fcaa-4aea-a3b8-8456963739aa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.660034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0515e604-e2c8-4fbb-93f9-904d4d6996ea req-287b6cf9-fcaa-4aea-a3b8-8456963739aa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.706300 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0515e604-e2c8-4fbb-93f9-904d4d6996ea req-287b6cf9-fcaa-4aea-a3b8-8456963739aa service nova] Creating event network-vif-plugged:4cfbfa0f-4675-44bb-82d4-936d99a08a0e for instance 49ed4f04-4bff-4442-9c22-c2c523efd262 on n-h2-846470-15 Aug 24 03:50:25.722100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0515e604-e2c8-4fbb-93f9-904d4d6996ea req-287b6cf9-fcaa-4aea-a3b8-8456963739aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113899 Aug 24 03:50:25.723804 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1738/3634] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:50:25.777636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:25.780181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:25.831460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.832241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.835566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.837831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.845401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.846059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:26.001168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:26.017038 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-636ecf7c-c709-469e-8ba8-56e4fad7e061 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 0.861648 Aug 24 03:50:26.018032 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1897/3635] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:25 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:26.182472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:26.184457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:26.198561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:26.200685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:26.202702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:26.203736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:26.204450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:26.205090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:26.974487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:26.999390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=16 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:27.028681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:27.045192 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c52d976c-162b-4c4d-8976-f6b6b55b2535 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 0.868632 Aug 24 03:50:27.060518 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1898/3636] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:26 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:27.089107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:27.090887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:27.100277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.101297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.102121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.103160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.103949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.104661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.278958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:27.295167 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31407fc0-e90b-404c-96ce-2bd5bb02f69f tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1283 microversion: 2.1 time: 0.232735 Aug 24 03:50:27.297374 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1899/3637] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:27 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1283 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:27.304382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:27.305570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:27.317478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.319926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.320903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.321882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.322490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.323915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.419771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:27.443848 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c272fe3-6a68-485e-b0e6-c52d1ac28d12 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 1.677755 Aug 24 03:50:27.444448 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1739/3638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:25 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:27.482128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a63892f3-a868-4aab-ae5c-e85e58c7f3c5 req-b93eea81-9368-45b7-8b74-34e740ee588e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c16d8242-aae4-4be3-9f15-f083a4815337", "tag": "2d2a78ad-9ceb-4860-8a98-485998cd4f9b"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:27.513643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a63892f3-a868-4aab-ae5c-e85e58c7f3c5 req-b93eea81-9368-45b7-8b74-34e740ee588e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.516826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a63892f3-a868-4aab-ae5c-e85e58c7f3c5 req-b93eea81-9368-45b7-8b74-34e740ee588e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.517862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a63892f3-a868-4aab-ae5c-e85e58c7f3c5 req-b93eea81-9368-45b7-8b74-34e740ee588e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.567502 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a63892f3-a868-4aab-ae5c-e85e58c7f3c5 req-b93eea81-9368-45b7-8b74-34e740ee588e service nova] Creating event network-changed:2d2a78ad-9ceb-4860-8a98-485998cd4f9b for instance c16d8242-aae4-4be3-9f15-f083a4815337 on n-h1-846470-15 Aug 24 03:50:27.599205 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a63892f3-a868-4aab-ae5c-e85e58c7f3c5 req-b93eea81-9368-45b7-8b74-34e740ee588e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117287 Aug 24 03:50:27.601509 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1740/3639] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:27.928792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:27.941498 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2618e8ee-f364-4f49-a2a2-89632457b19a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 0.642657 Aug 24 03:50:27.960345 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1900/3640] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:27 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:28.068429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:28.069703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:28.072896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=12 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:28.110749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:28.112352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:28.113800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:28.115380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:28.120419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:28.121247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:28.318337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:28.320687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:28.339659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:28.353118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:28.356689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:28.357743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:28.360047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:28.360738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:28.921091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:28.934293 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2d932e16-8639-4ae3-85b1-477a3eb05556 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1325 microversion: 2.1 time: 0.619950 Aug 24 03:50:28.935143 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1901/3641] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:28 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1325 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:28.947712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:28.948835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:28.967346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:28.968043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:28.976471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:28.977407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:28.977926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:28.978391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:29.354162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:29.366189 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed273fe4-7a92-4443-ba35-fb3444724675 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.429014 Aug 24 03:50:29.389570 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1902/3642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:28 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:29.407800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:29.417767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:29.456487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:29.457014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:29.457472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:29.458278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:29.459016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:29.460111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:29.872383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:29.885278 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e517d94-1713-4053-8a60-71f23340ce8e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 0.486393 Aug 24 03:50:29.886145 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1903/3643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:29 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:29.957646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:29.957841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:29.970993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:29.972827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:29.973325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:29.974348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:29.974610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:29.978177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:30.031563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:30.307078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:30.327646 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af800d42-c2db-470a-b18a-3274bacc51d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1293 microversion: 2.1 time: 2.259438 Aug 24 03:50:30.358237 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1741/3644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:28 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1293 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:30.393505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:30.394851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:30.407578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:30.408760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:30.409424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:30.410543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:30.411212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:30.426704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:30.500638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:30.514224 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-61be36f3-938e-4359-ab08-a87f2f5f3e7e tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1325 microversion: 2.1 time: 0.561939 Aug 24 03:50:30.514846 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1904/3645] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:29 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1325 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:30.946219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:30.948357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:30.969015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:30.970129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:30.971493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:30.976292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:30.977206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:30.997414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.227932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:31.230868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:31.250641 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4ed6f93f-02e0-44d4-a3e4-35cd76705bda tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.863640 Aug 24 03:50:31.251272 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1742/3646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:30 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:31.342732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-551c518e-ec21-4606-b9b0-b259742b8e5d req-78a7a92d-f71a-454e-90c5-085619d94792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7396383-5f55-41e7-a74a-b6214fef481d", "tag": "d1fa2a89-875b-4cbf-b2de-a7aafaf55cf5"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:31.384430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-551c518e-ec21-4606-b9b0-b259742b8e5d req-78a7a92d-f71a-454e-90c5-085619d94792 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.385215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-551c518e-ec21-4606-b9b0-b259742b8e5d req-78a7a92d-f71a-454e-90c5-085619d94792 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.387185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-551c518e-ec21-4606-b9b0-b259742b8e5d req-78a7a92d-f71a-454e-90c5-085619d94792 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.421596 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-551c518e-ec21-4606-b9b0-b259742b8e5d req-78a7a92d-f71a-454e-90c5-085619d94792 service nova] Creating event network-changed:d1fa2a89-875b-4cbf-b2de-a7aafaf55cf5 for instance a7396383-5f55-41e7-a74a-b6214fef481d on n-h2-846470-15 Aug 24 03:50:31.435447 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-551c518e-ec21-4606-b9b0-b259742b8e5d req-78a7a92d-f71a-454e-90c5-085619d94792 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096968 Aug 24 03:50:31.450638 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1743/3647] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:50:31.472113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:31.478666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:31.510802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.513555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.522682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.527007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.527524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.528044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.592808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:31.607823 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de2ab91a-00d8-4ddb-be5d-290ead4ac8a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 0.696984 Aug 24 03:50:31.619250 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1905/3648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:30 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:31.624110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:31.634036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:31.649954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.650519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.650968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.654781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.655412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.655982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.983281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:32.007119 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9a5d4814-64ef-402d-a124-a009565e561d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1474 microversion: 2.1 time: 0.548089 Aug 24 03:50:32.008301 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1744/3649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:31 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1474 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:32.013197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:32.013693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:32.036118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.036660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.037284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.039607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.040112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.040673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.096361 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] HTTP exception thrown: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Request method failure captured: Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 HTTP/1.1 Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ2nNzF92F7ozXo3ryS2w9e7wuuQoA9s2hb2S4t-WXhw0VSFq47NsDGRrC19fL_nNj21Axs5FVUa2Ke1dFFwv9KEdZYghgCrRtwmsgvIxRNG1lVAEWE-5nmdjithEOq86Zf2tmM9WVL5Zepa1hj5IbZnT6MZ8ia_L0KI74tFRa4jcko Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ca968a4777ea4164be5ff3174d4291d5 Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '5650d75d-2bd5-425e-8265-de0c96bb9d09'} Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:32.106145 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.110068 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.115484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Returning 404 to user: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:32.120258 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7001f51a-4b48-42d5-aebe-95722d3cc7eb tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 404 len: 111 microversion: 2.1 time: 0.110814 Aug 24 03:50:32.123875 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1745/3650] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:50:32 2022] DELETE /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:32.139462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:32.146923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] [instance: 5650d75d-2bd5-425e-8265-de0c96bb9d09] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:32.173647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.175878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.176516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.177995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.182468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.185073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.243353 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] HTTP exception thrown: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Request method failure captured: Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 HTTP/1.1 Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ2nNzF92F7ozXo3ryS2w9e7wuuQoA9s2hb2S4t-WXhw0VSFq47NsDGRrC19fL_nNj21Axs5FVUa2Ke1dFFwv9KEdZYghgCrRtwmsgvIxRNG1lVAEWE-5nmdjithEOq86Zf2tmM9WVL5Zepa1hj5IbZnT6MZ8ia_L0KI74tFRa4jcko Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5a2a3c9cdc428d81a1ade5f5102e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: de5a2a3c9cdc428d81a1ade5f5102e6d Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016303239 Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ca968a4777ea4164be5ff3174d4291d5 Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeTestJSON-2016303239-project Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '5650d75d-2bd5-425e-8265-de0c96bb9d09'} Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:32.257415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] Returning 404 to user: Instance 5650d75d-2bd5-425e-8265-de0c96bb9d09 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:32.262279 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5760537-4a0c-439c-95e2-97f962b8d75e tempest-AttachVolumeTestJSON-2016303239 tempest-AttachVolumeTestJSON-2016303239-project] 10.222.0.58 "GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09" status: 404 len: 111 microversion: 2.1 time: 0.129644 Aug 24 03:50:32.266398 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1746/3651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:32 2022] GET /compute/v2.1/servers/5650d75d-2bd5-425e-8265-de0c96bb9d09 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:32.276043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:32.276940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:32.286698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.287454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.288341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.290290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.290956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.291549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.959255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:32.974979 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-120f0e55-ec5f-48c4-bb1b-22cc2e587f0e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.704687 Aug 24 03:50:32.975586 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1747/3652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:32 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:32.996044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-605656800", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:33.068882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:33.115177 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e5fe5c2-eeb0-4691-a53d-d3a7a1774530 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1325 microversion: 2.1 time: 1.493567 Aug 24 03:50:33.134178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1906/3653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:31 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1325 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:33.165352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:33.166435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:33.167815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] validate_networks() for [('a410578b-d916-4218-bf01-482ee8be19b3', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:33.180797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:33.184084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:33.184831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:33.186379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:33.188821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:33.189543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:33.643831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:33.663093 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f152fe4f-7fe1-41ab-9021-5e5524b892fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 0.527248 Aug 24 03:50:33.673659 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1907/3654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:33 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:34.183720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df383739-7b3d-4e39-9df9-38d9429104dd tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Action: 'create', calling method: .version_select at 0x7f10231f7c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:34.212082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-df383739-7b3d-4e39-9df9-38d9429104dd tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Getting quotas for project 62e86ba740094952b0a5bca2a6632bab. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:34.218549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-df383739-7b3d-4e39-9df9-38d9429104dd tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Getting quotas for user 1b353239658e4bb0b5ab00f3ac0dae9c and project 62e86ba740094952b0a5bca2a6632bab. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:34.278874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-df383739-7b3d-4e39-9df9-38d9429104dd tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Getting quotas for project 62e86ba740094952b0a5bca2a6632bab. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:34.285854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-df383739-7b3d-4e39-9df9-38d9429104dd tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Getting quotas for user 1b353239658e4bb0b5ab00f3ac0dae9c and project 62e86ba740094952b0a5bca2a6632bab. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:34.302460 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df383739-7b3d-4e39-9df9-38d9429104dd tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.314098 Aug 24 03:50:34.310340 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1908/3655] 10.222.0.58 () {62 vars in 1214 bytes} [Wed Aug 24 03:50:33 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:50:34.315268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:34.316066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:34.323572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.323986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.324538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.325583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.326053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.327008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.476588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:34.477758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:34.478857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:34.479571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:34.480333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:34.496480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.499696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.500307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.502085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.502878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.503683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.563469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:34.593015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:34.605299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:34.613086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:34.616420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9030a21b-7f1c-4591-8f34-f0f27026f91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:34.618001 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81a52874-7827-44a0-9689-c91eb40d8db1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.305660 Aug 24 03:50:34.619029 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1909/3656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:34 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:34.630397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:34.631279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:34.634691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:34.642122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.642681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.643056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.644416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.645260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.645341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.729912 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-82320d04-b5cd-4028-9373-34f0fc2fed27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738057 Aug 24 03:50:34.730617 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1748/3657] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:50:34.744593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d8d4e3d-3427-4e23-8d56-cfacf73cec60 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:34.782807 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d8d4e3d-3427-4e23-8d56-cfacf73cec60 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.044512 Aug 24 03:50:34.785526 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1749/3658] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 24 03:50:34 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:50:34.796734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:34.801669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:34.815629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.816085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.820418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.821460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.821947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.822386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.837602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:34.852139 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-672ccaff-0337-4593-b325-e50ee4d1b792 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1325 microversion: 2.1 time: 0.226326 Aug 24 03:50:34.853099 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1910/3659] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:34 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:34.867901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67a95bf3-f32b-4f76-b7ec-c804871cde33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:34.868407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67a95bf3-f32b-4f76-b7ec-c804871cde33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9030a21b-7f1c-4591-8f34-f0f27026f91b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:34.931639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67a95bf3-f32b-4f76-b7ec-c804871cde33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9030a21b-7f1c-4591-8f34-f0f27026f91b] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:50:35.563018 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.scheduler.client.report [None req-67a95bf3-f32b-4f76-b7ec-c804871cde33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Deleted allocations for instance 9030a21b-7f1c-4591-8f34-f0f27026f91b Aug 24 03:50:35.569046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.compute.api [None req-67a95bf3-f32b-4f76-b7ec-c804871cde33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9030a21b-7f1c-4591-8f34-f0f27026f91b] Instance Mapping does not exist while attempting local delete cleanup. Aug 24 03:50:35.570079 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67a95bf3-f32b-4f76-b7ec-c804871cde33 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b" status: 204 len: 0 microversion: 2.1 time: 0.716011 Aug 24 03:50:35.574849 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1911/3660] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:50:34 2022] DELETE /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:50:35.591993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae464806-1c75-4238-a845-7c633cfcd9af tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:35.608982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:35.623243 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e598270b-f33d-41cc-abc5-b6d220cc37e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 0.834904 Aug 24 03:50:35.624511 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1750/3661] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:34 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:35.641496 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae464806-1c75-4238-a845-7c633cfcd9af tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/a2fa17ba-7cd8-4045-b508-7935760ca089" status: 200 len: 235 microversion: 2.64 time: 0.064579 Aug 24 03:50:35.643573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa9b135a-a966-40da-b470-477aaf91214a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:35.648043 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1912/3662] 10.222.0.58 () {60 vars in 1304 bytes} [Wed Aug 24 03:50:35 2022] GET /compute/v2.1/os-server-groups/a2fa17ba-7cd8-4045-b508-7935760ca089 => generated 235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:50:35.653314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aa9b135a-a966-40da-b470-477aaf91214a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9030a21b-7f1c-4591-8f34-f0f27026f91b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:35.669065 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-aa9b135a-a966-40da-b470-477aaf91214a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa9b135a-a966-40da-b470-477aaf91214a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b HTTP/1.1 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9030a21b-7f1c-4591-8f34-f0f27026f91b'} Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:35.670943 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:35.674974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:35.674974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:35.674974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:35.674974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:50:35.674974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:35.680482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:35.681238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:35.683139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa9b135a-a966-40da-b470-477aaf91214a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:35.684091 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aa9b135a-a966-40da-b470-477aaf91214a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b" status: 404 len: 111 microversion: 2.1 time: 0.054079 Aug 24 03:50:35.689056 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1751/3663] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:35 2022] GET /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:35.761836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf0a2d96-55a1-4bd8-951a-82d888c86c46 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:35.769059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:35.770187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:35.775922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:35.778208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:35.782148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:35.786134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:35.899534 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf0a2d96-55a1-4bd8-951a-82d888c86c46 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/a2fa17ba-7cd8-4045-b508-7935760ca089" status: 204 len: 0 microversion: 2.64 time: 0.197205 Aug 24 03:50:35.901671 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1752/3664] 10.222.0.58 () {60 vars in 1307 bytes} [Wed Aug 24 03:50:35 2022] DELETE /compute/v2.1/os-server-groups/a2fa17ba-7cd8-4045-b508-7935760ca089 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:50:35.920660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:35.922540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:35.948489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:35.949056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:35.949518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:35.969082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:35.969753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:35.970248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:36.126077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:36.137855 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0235444-2668-4fcb-89ce-62d7414214bd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.488204 Aug 24 03:50:36.140433 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1913/3665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:35 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:36.146390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-177d8c91-fcb9-4e33-ad71-83df42d3e708 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:36.153741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-177d8c91-fcb9-4e33-ad71-83df42d3e708 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] HTTP exception thrown: Instance group a2fa17ba-7cd8-4045-b508-7935760ca089 could not be found. Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-177d8c91-fcb9-4e33-ad71-83df42d3e708 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Request method failure captured: Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-server-groups/a2fa17ba-7cd8-4045-b508-7935760ca089 HTTP/1.1 Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaAJHZWjEy-bMIjF5Ed1OIv0aXqSQJJz1pYSA1xanYQxm5M7guvge1VGxlfcLMhZmj8c50qrf2gXz7n6-LPYCNs-S6MugnOAb0NmJveixoP46psJtO7vNnFAoqaxuvB_WARby0nCFRbys8caUqBuhR3EP4x6d9BGaAciTpEJTiDY8TE Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.64 Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 62e86ba740094952b0a5bca2a6632bab Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerGroup264TestJSON-738909187 Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_62e86ba740094952b0a5bca2a6632bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/62e86ba740094952b0a5bca2a6632bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/62e86ba740094952b0a5bca2a6632bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/62e86ba740094952b0a5bca2a6632bab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerGroup264TestJSON-738909187 Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 62e86ba740094952b0a5bca2a6632bab Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerGroup264TestJSON-738909187 Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerGroup264TestJSON-738909187-project Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 1b353239658e4bb0b5ab00f3ac0dae9c Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerGroup264TestJSON-738909187-project Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance group a2fa17ba-7cd8-4045-b508-7935760ca089 could not be found. Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a2fa17ba-7cd8-4045-b508-7935760ca089'} Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a2fa17ba-7cd8-4045-b508-7935760ca089 could not be found. Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a2fa17ba-7cd8-4045-b508-7935760ca089 could not be found. Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:36.172226 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:36.176760 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:36.176760 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:36.176760 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:36.176760 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:36.176760 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a2fa17ba-7cd8-4045-b508-7935760ca089 could not be found. Aug 24 03:50:36.176760 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:36.179109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-177d8c91-fcb9-4e33-ad71-83df42d3e708 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] Returning 404 to user: Instance group a2fa17ba-7cd8-4045-b508-7935760ca089 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:36.181038 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-177d8c91-fcb9-4e33-ad71-83df42d3e708 tempest-ServerGroup264TestJSON-738909187 tempest-ServerGroup264TestJSON-738909187-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/a2fa17ba-7cd8-4045-b508-7935760ca089" status: 404 len: 117 microversion: 2.64 time: 0.038418 Aug 24 03:50:36.182320 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1914/3666] 10.222.0.58 () {60 vars in 1307 bytes} [Wed Aug 24 03:50:36 2022] DELETE /compute/v2.1/os-server-groups/a2fa17ba-7cd8-4045-b508-7935760ca089 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:50:36.210936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-694645531", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a410578b-d916-4218-bf01-482ee8be19b3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:36.363438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] validate_networks() for [('a410578b-d916-4218-bf01-482ee8be19b3', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:37.457140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:37.483797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-473809c0-740a-47c2-ad39-91e2f60b063d tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1325 microversion: 2.1 time: 1.573447 Aug 24 03:50:37.487853 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1753/3667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:35 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1325 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:37.518480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:37.518480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:37.537535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:37.540530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:37.542262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:37.544073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:37.547515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:37.550856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.244393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:38.244971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:38.245476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:38.245896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:38.246696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:38.263861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.264355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.264794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.265516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.272466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.273167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.342075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:38.355404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:38.401676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:38.409210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:38.568403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d55a33a7-7813-43ff-bd28-7eb8e8f3d723 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.380357 Aug 24 03:50:38.571072 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1915/3668] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:50:38.582326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:38.601106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:38.634473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.636357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.644969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.646645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.649472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.651249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:39.074327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:39.088878 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-036248f9-e0f5-4975-8486-e5ea539748de tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.514255 Aug 24 03:50:39.089843 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1916/3669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:38 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:39.383588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:39.400133 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ca7c790c-f9c7-4401-982a-1d7ed40d444a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 1.897797 Aug 24 03:50:39.401021 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1754/3670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:37 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:39.408835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:39.413949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:39.441966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:39.449600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:39.450675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:39.451460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:39.451976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:39.452414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:39.647534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-58f3e72d-9370-44be-963a-16c0d47ea2d7 req-6b83387a-409c-429b-ac10-3aee2bcf6e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16d8242-aae4-4be3-9f15-f083a4815337", "name": "network-vif-plugged", "status": "completed", "tag": "2d2a78ad-9ceb-4860-8a98-485998cd4f9b"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:39.673740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-58f3e72d-9370-44be-963a-16c0d47ea2d7 req-6b83387a-409c-429b-ac10-3aee2bcf6e43 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:39.675040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-58f3e72d-9370-44be-963a-16c0d47ea2d7 req-6b83387a-409c-429b-ac10-3aee2bcf6e43 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:39.677335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-58f3e72d-9370-44be-963a-16c0d47ea2d7 req-6b83387a-409c-429b-ac10-3aee2bcf6e43 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:39.708000 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-58f3e72d-9370-44be-963a-16c0d47ea2d7 req-6b83387a-409c-429b-ac10-3aee2bcf6e43 service nova] Creating event network-vif-plugged:2d2a78ad-9ceb-4860-8a98-485998cd4f9b for instance c16d8242-aae4-4be3-9f15-f083a4815337 on n-h1-846470-15 Aug 24 03:50:39.726866 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-58f3e72d-9370-44be-963a-16c0d47ea2d7 req-6b83387a-409c-429b-ac10-3aee2bcf6e43 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.631421 Aug 24 03:50:39.728528 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1917/3671] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:39.740374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-54b194cc-4171-4cb7-8626-409117b1bfde tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:39.742887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-54b194cc-4171-4cb7-8626-409117b1bfde tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:39.980543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54b194cc-4171-4cb7-8626-409117b1bfde tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:39.993416 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-54b194cc-4171-4cb7-8626-409117b1bfde tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1220 microversion: 2.1 time: 0.262865 Aug 24 03:50:39.994119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1918/3672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:39 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1220 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:40.119722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:40.124339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:40.131706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:40.132516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:40.133136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:40.134037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:40.134898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:40.135659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:40.323169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:40.367354 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffc425d0-6460-4012-a6ed-d5e0d9ac0112 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1325 microversion: 2.1 time: 0.961358 Aug 24 03:50:40.374577 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1755/3673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:39 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1325 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:40.426071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:40.427592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:40.435748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:40.440772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:40.444427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:40.444973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:40.445728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:40.447918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:40.448491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:40.449720 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cdf09abf-09ff-4022-a35f-a6f3c680d637 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.337592 Aug 24 03:50:40.450660 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1919/3674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:40 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:41.008102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:41.015696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:41.019162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:41.034496 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0cd6cc07-ba3e-4e6c-a310-763a2ba2eab9 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1365 microversion: 2.1 time: 0.615697 Aug 24 03:50:41.038589 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1756/3675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:40 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1365 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:41.051970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.052939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.053775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.054905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.055733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.056394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.230757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:41.243213 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10ccc00e-4fc2-49eb-b512-fbbebd6481bd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1272 microversion: 2.1 time: 0.232177 Aug 24 03:50:41.258206 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1920/3676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:41 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:41.396539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:41.397545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:41.409852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.411093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.411999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.412704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.413156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.416001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.478222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:41.479174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:41.499052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.499765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.500232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.500996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.501468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.501942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.915463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:41.926085 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5533afa7-3848-4830-a226-a26a568fdf63 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1325 microversion: 2.1 time: 0.533950 Aug 24 03:50:41.932153 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1757/3677] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:41 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1325 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:41.992983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a469afbb-3f73-411c-87a4-a6deaa61c579 req-9987bd81-edec-47b6-baac-1a9050bfcb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7396383-5f55-41e7-a74a-b6214fef481d", "name": "network-vif-plugged", "status": "completed", "tag": "d1fa2a89-875b-4cbf-b2de-a7aafaf55cf5"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:42.014071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a469afbb-3f73-411c-87a4-a6deaa61c579 req-9987bd81-edec-47b6-baac-1a9050bfcb7c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.019459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:42.030060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a469afbb-3f73-411c-87a4-a6deaa61c579 req-9987bd81-edec-47b6-baac-1a9050bfcb7c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.030407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a469afbb-3f73-411c-87a4-a6deaa61c579 req-9987bd81-edec-47b6-baac-1a9050bfcb7c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.041916 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86f602eb-4b8d-43ec-8757-35b4d02200f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.561454 Aug 24 03:50:42.043477 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1921/3678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:41 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:42.105963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:42.107018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:42.115026 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a469afbb-3f73-411c-87a4-a6deaa61c579 req-9987bd81-edec-47b6-baac-1a9050bfcb7c service nova] Creating event network-vif-plugged:d1fa2a89-875b-4cbf-b2de-a7aafaf55cf5 for instance a7396383-5f55-41e7-a74a-b6214fef481d on n-h2-846470-15 Aug 24 03:50:42.142910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.143456 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a469afbb-3f73-411c-87a4-a6deaa61c579 req-9987bd81-edec-47b6-baac-1a9050bfcb7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149917 Aug 24 03:50:42.143963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.144559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.145436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.146282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.151571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.153293 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1758/3679] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 03:50:42.267185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:42.269165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:42.292246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.293055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.296093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.298873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.299561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.301975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.475313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:42.487417 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a2f87cba-131f-429a-b8ef-aada5d4cf98c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1280 microversion: 2.1 time: 0.225743 Aug 24 03:50:42.492924 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1759/3680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:42 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1280 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:42.958949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:42.959981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:42.976889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.978271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.979380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.982259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.983418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.984284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.100140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:43.121021 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc760b3c-df01-4fa9-b9bc-35b5e0511260 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1555 microversion: 2.1 time: 1.050524 Aug 24 03:50:43.125124 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1922/3681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:42 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1555 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:43.153128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:43.154258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:43.161628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.162390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.163152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.164319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.165060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.165854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.651609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:43.700462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-33106430-6a4f-4bc9-b864-f59858431851 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1325 microversion: 2.1 time: 0.734805 Aug 24 03:50:43.716439 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1760/3682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:42 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1325 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:43.722337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:43.722865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:43.742347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.751633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.755880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.759479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.768252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.778023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.048132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:44.058455 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-64838acf-1dfb-4061-9c32-5cdab106c97f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.910726 Aug 24 03:50:44.072592 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1923/3683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:43 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:44.097101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:44.098378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:44.129131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.133676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.134356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.136697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.137195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.137662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.486696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:44.508020 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0b4cd00c-d9f9-4f54-9c28-6a9644f18a87 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1278 microversion: 2.1 time: 0.428958 Aug 24 03:50:44.510461 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1924/3684] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:44 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1278 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:44.522781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:44.534655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6eef9349-d15a-49eb-b5fc-2202dffde8ac req-9f970414-fbe1-415b-9dd0-eaa638a4223a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38807978-26d4-4c2b-b052-28f012675e23", "name": "network-vif-plugged", "status": "completed", "tag": "bd18e940-693e-4c89-a6be-6594e2b035c6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:44.572841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6eef9349-d15a-49eb-b5fc-2202dffde8ac req-9f970414-fbe1-415b-9dd0-eaa638a4223a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.573245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6eef9349-d15a-49eb-b5fc-2202dffde8ac req-9f970414-fbe1-415b-9dd0-eaa638a4223a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.573681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6eef9349-d15a-49eb-b5fc-2202dffde8ac req-9f970414-fbe1-415b-9dd0-eaa638a4223a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.606594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:44.608522 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6eef9349-d15a-49eb-b5fc-2202dffde8ac req-9f970414-fbe1-415b-9dd0-eaa638a4223a service nova] Creating event network-vif-plugged:bd18e940-693e-4c89-a6be-6594e2b035c6 for instance 38807978-26d4-4c2b-b052-28f012675e23 on n-h1-846470-15 Aug 24 03:50:44.623374 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6eef9349-d15a-49eb-b5fc-2202dffde8ac req-9f970414-fbe1-415b-9dd0-eaa638a4223a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106534 Aug 24 03:50:44.626614 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1925/3685] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:44.737912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:44.739964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:44.753847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.758447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.759245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.761335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.766094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.766949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.878943 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d59a88bd-fc14-4aeb-8641-b82bc2175128 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.173692 Aug 24 03:50:44.880042 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1761/3686] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:50:43 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-interface => generated 285 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:45.093682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:45.095527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:45.107252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.109365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.111094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.116082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.118906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.121637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.422007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:45.443580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ea4696a-db1f-4f14-ab21-649f47b4e1dd tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1522 microversion: 2.1 time: 0.718255 Aug 24 03:50:45.444944 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1926/3687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:44 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1522 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:45.468048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:45.469669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:45.477827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.478632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.479245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.480229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.480905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.481580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.516871 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] HTTP exception thrown: Instance is not a member of specified network Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Request method failure captured: Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d/ips/invalid HTTP/1.1 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_2wbaGNhZo745DJuS6BFYLLCiZaKBqafZJJlOC0GDKQB6LsQkRzoroNN8uKNlpgCyM4fNRoHKaI0D0D5UbjbbC3dromFTL85c8_fnidw78kzVuSZw9Y-988lbjKYdQcKNOOq-WTYF-o9QcdzfG5qM_jbpBVD9pbBCnKI6ro3S3LYE Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: b55289c2d7dc4d6389d7a0fa304b6e32 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: b55289c2d7dc4d6389d7a0fa304b6e32 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerAddressesNegativeTestJSON-970686601-project Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 95fd332c184842e6a58784da9ea76512 Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-970686601-project Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance is not a member of specified network Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': 'a7396383-5f55-41e7-a74a-b6214fef481d', 'id': 'invalid'} Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 24 03:50:45.522919 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:45.528555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:45.529860 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37b36f5c-29dd-4f2f-968d-c087924da6aa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.066080 Aug 24 03:50:45.531645 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1927/3688] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 03:50:45 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d/ips/invalid => generated 91 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:50:45.554393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:45.560711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:45.576789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.577445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.580905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.581893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.582824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.585361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.638346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:45.951493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:45.967280 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e0e71f5e-18b4-424c-b654-f2be838fe9bc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1310 microversion: 2.1 time: 0.884578 Aug 24 03:50:45.968244 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1762/3689] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:45 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1310 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:45.984616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0690a7b4-283a-4aaa-b983-6ed5cbf7c548 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:45.985231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0690a7b4-283a-4aaa-b983-6ed5cbf7c548 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Failed to fetch instance by id 999 {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 03:50:45.985757 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-0690a7b4-283a-4aaa-b983-6ed5cbf7c548 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] HTTP exception thrown: Instance 999 could not be found. Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0690a7b4-283a-4aaa-b983-6ed5cbf7c548 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Request method failure captured: Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_2wbaGNhZo745DJuS6BFYLLCiZaKBqafZJJlOC0GDKQB6LsQkRzoroNN8uKNlpgCyM4fNRoHKaI0D0D5UbjbbC3dromFTL85c8_fnidw78kzVuSZw9Y-988lbjKYdQcKNOOq-WTYF-o9QcdzfG5qM_jbpBVD9pbBCnKI6ro3S3LYE Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b55289c2d7dc4d6389d7a0fa304b6e32 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b55289c2d7dc4d6389d7a0fa304b6e32 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerAddressesNegativeTestJSON-970686601-project Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 95fd332c184842e6a58784da9ea76512 Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-970686601-project Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 999 could not be found. Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': '999'} Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 24 03:50:45.987862 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:50:45.996584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0690a7b4-283a-4aaa-b983-6ed5cbf7c548 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:45.996584 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0690a7b4-283a-4aaa-b983-6ed5cbf7c548 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020009 Aug 24 03:50:45.996584 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1763/3690] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:50:45 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:50:45.999545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:46.000098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:46.022000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.022903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.023514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.024304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.024776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.025215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.092572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:50:46.293093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:46.305529 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47301cde-f113-478f-9219-976c2b7df130 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.765050 Aug 24 03:50:46.321932 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1928/3691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:45 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:46.412227 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c2cc727-adad-4c5d-a303-118944d871af tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 204 len: 0 microversion: 2.1 time: 0.415645 Aug 24 03:50:46.415860 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1764/3692] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:50:45 2022] DELETE /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:50:46.423823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:46.424919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:46.435480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.436191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.439049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.452257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.453004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.453466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.732990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:46.749297 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a6fd7c3c-cf7e-459c-95aa-c076c16fa52b tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1528 microversion: 2.1 time: 0.329287 Aug 24 03:50:46.751594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1929/3693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:46 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1528 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:46.995887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:46.996891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:47.000174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:47.012032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.012832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.013440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.014428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.015201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.015906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.045015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:47.341067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:47.341843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:47.354314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.354893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.356049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.358159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.362810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.363537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.629184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:47.649310 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8180658-8ae5-410b-ad27-1ceab355b00a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1458 microversion: 2.1 time: 0.658654 Aug 24 03:50:47.665005 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1765/3694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:46 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1458 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:47.689434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:47.692942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:47.693646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:47.709067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.710584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.711094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.712734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.713218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.713711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.715117 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e985a6a-4919-46bb-a5f8-5fe1a1deb70f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.377839 Aug 24 03:50:47.720099 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1930/3695] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:47 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:47.776162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:47.779140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:47.844608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.845545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.850440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.851543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.854691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.859598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:48.133362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:48.154971 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f92387b6-2251-4d0c-89a6-fbbcbda18c7c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1528 microversion: 2.1 time: 0.386125 Aug 24 03:50:48.156634 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1931/3696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:47 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1528 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:48.337069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:48.351204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Old instance type m1.heat2, new instance type m1.heat {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 03:50:48.358792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:48.359218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:48.362717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:48.363249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:48.363711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:48.583118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:48.593544 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8246a086-4c9a-4af2-b8d8-37eea0257fe2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23/action" status: 202 len: 0 microversion: 2.1 time: 0.913607 Aug 24 03:50:48.594207 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1766/3697] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:50:47 2022] POST /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23/action => generated 0 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:50:48.606767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:48.608934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:48.624792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:48.631262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:48.632968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:48.634538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:48.635602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:48.637484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.106238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:49.114949 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16305cbe-437b-4a76-a0e0-e1ba84c819c8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1467 microversion: 2.1 time: 0.513124 Aug 24 03:50:49.121373 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1767/3698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:48 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1467 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:49.139369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:49.144423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:49.155249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.156028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.156611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.157480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.158328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.158904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.239370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1678d450-7c38-417d-bf5e-0c0a99c5b89a req-bd6eafaa-ac28-42e7-8c6a-6aea8424b2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c16d8242-aae4-4be3-9f15-f083a4815337", "tag": "2d2a78ad-9ceb-4860-8a98-485998cd4f9b"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:49.265986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1678d450-7c38-417d-bf5e-0c0a99c5b89a req-bd6eafaa-ac28-42e7-8c6a-6aea8424b2a0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.268006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1678d450-7c38-417d-bf5e-0c0a99c5b89a req-bd6eafaa-ac28-42e7-8c6a-6aea8424b2a0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.268626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1678d450-7c38-417d-bf5e-0c0a99c5b89a req-bd6eafaa-ac28-42e7-8c6a-6aea8424b2a0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.303929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1678d450-7c38-417d-bf5e-0c0a99c5b89a req-bd6eafaa-ac28-42e7-8c6a-6aea8424b2a0 service nova] Creating event network-changed:2d2a78ad-9ceb-4860-8a98-485998cd4f9b for instance c16d8242-aae4-4be3-9f15-f083a4815337 on n-h1-846470-15 Aug 24 03:50:49.325345 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1678d450-7c38-417d-bf5e-0c0a99c5b89a req-bd6eafaa-ac28-42e7-8c6a-6aea8424b2a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.747843 Aug 24 03:50:49.328395 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1932/3699] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:50:49.345119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:49.352595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:49.370239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.374887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.376282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.377438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.379603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.381101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.569715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:49.591638 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89514c3b-6dfc-4413-a35e-5bbf34514d19 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.455770 Aug 24 03:50:49.610977 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1768/3700] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:49 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:49.790634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:49.804235 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc4f8178-9345-48ef-85d1-f70d45aa7da3 tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1528 microversion: 2.1 time: 0.471425 Aug 24 03:50:49.804821 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1933/3701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:49 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1528 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:50.142721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:50.143878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:50.175726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.177190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.179040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.180009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.183706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.184489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.543288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:50.551538 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4bcff7dd-9837-4a27-a0f3-77992367f5f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1467 microversion: 2.1 time: 0.414052 Aug 24 03:50:50.565183 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1769/3702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:50 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1467 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:50.578492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=18 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:50.619739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:50.621162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:50.632358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.632863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.633490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.634198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.634828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.635256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.866715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:50.878852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bda2a306-0842-4e6e-ac9c-30004f65dbf1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.265272 Aug 24 03:50:50.879985 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1770/3703] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:50 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:50.885496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:50.886188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:50.893220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.894220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.894807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.895738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.896350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.897070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.938659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.939270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.939925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.940787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lazy-loading 'fault' on Instance uuid a7396383-5f55-41e7-a74a-b6214fef481d {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:50:50.996685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fd332c184842e6a58784da9ea76512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55289c2d7dc4d6389d7a0fa304b6e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:51.004889 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c1d661a-1a6e-42bf-a19e-065a80d3870c tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 200 len: 1315 microversion: 2.1 time: 0.123311 Aug 24 03:50:51.019045 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1771/3704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:50 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 1315 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:51.068446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20627d6f-a160-4904-a425-f1971593572a tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Action: 'create', calling method: .version_select at 0x7f1022f77550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1512015472", "metadata": {"Type": "work"}}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:51.361913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e76a06c4-9ef5-4c0f-93cc-be6e206eeb53 req-0141f099-0b60-4398-9396-563832ad656b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbef84a-c2d0-46b3-8604-2e7b2a82a716", "tag": "e7ac5a21-baad-4f12-8d3b-7ba321e70305"}, {"server_uuid": "a7396383-5f55-41e7-a74a-b6214fef481d", "name": "network-vif-deleted", "tag": "d1fa2a89-875b-4cbf-b2de-a7aafaf55cf5"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:51.389686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e76a06c4-9ef5-4c0f-93cc-be6e206eeb53 req-0141f099-0b60-4398-9396-563832ad656b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:51.393354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e76a06c4-9ef5-4c0f-93cc-be6e206eeb53 req-0141f099-0b60-4398-9396-563832ad656b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:51.393969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e76a06c4-9ef5-4c0f-93cc-be6e206eeb53 req-0141f099-0b60-4398-9396-563832ad656b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:51.432447 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e76a06c4-9ef5-4c0f-93cc-be6e206eeb53 req-0141f099-0b60-4398-9396-563832ad656b service nova] Creating event network-changed:e7ac5a21-baad-4f12-8d3b-7ba321e70305 for instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 on n-h1-846470-15 Aug 24 03:50:51.433065 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e76a06c4-9ef5-4c0f-93cc-be6e206eeb53 req-0141f099-0b60-4398-9396-563832ad656b service nova] Creating event network-vif-deleted:d1fa2a89-875b-4cbf-b2de-a7aafaf55cf5 for instance a7396383-5f55-41e7-a74a-b6214fef481d on n-h2-846470-15 Aug 24 03:50:51.462801 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e76a06c4-9ef5-4c0f-93cc-be6e206eeb53 req-0141f099-0b60-4398-9396-563832ad656b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.100437 Aug 24 03:50:51.465697 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1772/3705] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:51.597907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:51.598898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:51.638403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:51.646773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:51.649385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:51.655347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:51.659621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:51.660502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:51.700571 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20627d6f-a160-4904-a425-f1971593572a tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.120273 Aug 24 03:50:51.710439 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1934/3706] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 24 03:50:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1137 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 03:50:51.933554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-568626785", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": "none"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:52.014197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.024919 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90f02bfc-5f3f-4266-80bd-9f2f675fe534 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1467 microversion: 2.1 time: 0.446804 Aug 24 03:50:52.030138 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1773/3707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:51 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1467 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:52.037170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:52.037876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:52.038559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:52.039177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:52.039907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:52.043465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05415056-fe58-477d-bd3a-1e9c820e19f6 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f103424b040>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:52.052460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.053783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.054474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.055343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.055947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.056447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.138500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Getting quotas for project c99563c767324b068449d745a498ede8. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:52.164104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Getting quotas for user 5dcdaa5009344d278f511ca86ad92544 and project c99563c767324b068449d745a498ede8. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:52.189788 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05415056-fe58-477d-bd3a-1e9c820e19f6 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 200 len: 353 microversion: 2.1 time: 0.158387 Aug 24 03:50:52.190932 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1774/3708] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:50:52 2022] GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:52.192565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:52.196899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:52.201157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:52.202643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:52.210135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.213947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.214636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.216951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.217518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.220853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.284968 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-51ff11ef-f331-46fe-8b13-d53cffebed0a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.572912 Aug 24 03:50:52.285989 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1935/3709] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:50:52.297258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:52.297891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] [instance: a7396383-5f55-41e7-a74a-b6214fef481d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:52.312960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.312960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.313215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.313874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.314332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.314762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.351247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] HTTP exception thrown: Instance a7396383-5f55-41e7-a74a-b6214fef481d could not be found. Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Request method failure captured: Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d HTTP/1.1 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_2wbaGNhZo745DJuS6BFYLLCiZaKBqafZJJlOC0GDKQB6LsQkRzoroNN8uKNlpgCyM4fNRoHKaI0D0D5UbjbbC3dromFTL85c8_fnidw78kzVuSZw9Y-988lbjKYdQcKNOOq-WTYF-o9QcdzfG5qM_jbpBVD9pbBCnKI6ro3S3LYE Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: b55289c2d7dc4d6389d7a0fa304b6e32 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b55289c2d7dc4d6389d7a0fa304b6e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: b55289c2d7dc4d6389d7a0fa304b6e32 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-970686601 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerAddressesNegativeTestJSON-970686601-project Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 95fd332c184842e6a58784da9ea76512 Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-970686601-project Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance a7396383-5f55-41e7-a74a-b6214fef481d could not be found. Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a7396383-5f55-41e7-a74a-b6214fef481d'} Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7396383-5f55-41e7-a74a-b6214fef481d could not be found. Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7396383-5f55-41e7-a74a-b6214fef481d could not be found. Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:52.353585 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7396383-5f55-41e7-a74a-b6214fef481d could not be found. Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] Returning 404 to user: Instance a7396383-5f55-41e7-a74a-b6214fef481d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86eaff4d-ab80-4035-b3eb-da501cd1d4fa tempest-ServerAddressesNegativeTestJSON-970686601 tempest-ServerAddressesNegativeTestJSON-970686601-project] 10.222.0.58 "GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d" status: 404 len: 111 microversion: 2.1 time: 0.068258 Aug 24 03:50:52.357102 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1936/3710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:52 2022] GET /compute/v2.1/servers/a7396383-5f55-41e7-a74a-b6214fef481d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:52.371098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e313b69b-962a-464f-afd6-4693f42123f0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:52.372118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e313b69b-962a-464f-afd6-4693f42123f0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:52.473457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e313b69b-962a-464f-afd6-4693f42123f0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.489114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e313b69b-962a-464f-afd6-4693f42123f0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.493853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e313b69b-962a-464f-afd6-4693f42123f0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.495091 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e313b69b-962a-464f-afd6-4693f42123f0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1277 microversion: 2.54 time: 0.129701 Aug 24 03:50:52.498501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1937/3711] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:52 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:52.707562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.723088 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5768266-36c9-41bd-bd3f-6df505fcf731 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.530961 Aug 24 03:50:52.724407 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1775/3712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:52 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:53.059865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:53.081827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:53.158138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.164046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.175504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.178057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.180904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.182363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.203623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-755e5f7b-b2be-42e6-8be3-77cd7eb1761d tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f103443fd30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:53.332652 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-755e5f7b-b2be-42e6-8be3-77cd7eb1761d tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 200 len: 353 microversion: 2.1 time: 0.132983 Aug 24 03:50:53.333911 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1776/3713] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:50:53 2022] GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:53.524001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:53.524971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:53.538623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.545514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.546314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.547356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.548176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.548815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.690169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:53.707533 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-858629a8-0a83-4dfa-b0fe-e6c11721795b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1467 microversion: 2.1 time: 0.659350 Aug 24 03:50:53.708800 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1938/3714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:53 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1467 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:53.745783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:53.746844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:53.761650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.761866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.765743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.769322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.770722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.771583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.009807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:54.022077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:54.024197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:54.033318 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45af7eb3-c4ed-43d0-ae03-bb785c6b5fbd tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1281 microversion: 2.54 time: 0.506788 Aug 24 03:50:54.038406 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1777/3715] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:53 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1281 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:50:54.052226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:54.064392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bb060d5-2cfc-46a5-a956-4dcf7fa24aa9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.323047 Aug 24 03:50:54.066274 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1939/3716] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:53 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:54.347321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6970abe7-15db-4d88-9c11-5788a63e9a88 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f102a780310>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:54.424175 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6970abe7-15db-4d88-9c11-5788a63e9a88 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 200 len: 354 microversion: 2.1 time: 0.081058 Aug 24 03:50:54.424899 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1778/3717] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:50:54 2022] GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:54.438207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92665e04-c81a-441c-a49a-a33502aed725 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f1034411700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:54.547384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92665e04-c81a-441c-a49a-a33502aed725 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 200 len: 354 microversion: 2.1 time: 0.113616 Aug 24 03:50:54.548447 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1940/3718] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:50:54 2022] GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:54.565231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0d408979-9871-42ba-8a2c-96ef056d99b4 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f102afe51f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:54.698600 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0d408979-9871-42ba-8a2c-96ef056d99b4 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 202 len: 0 microversion: 2.1 time: 0.139902 Aug 24 03:50:54.699845 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1779/3719] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:50:54 2022] DELETE /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:50:54.710072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-85a29ece-a813-4f47-b04d-660f3bf5aede tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f10235519d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:54.739155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:54.745409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:54.791636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:54.796395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:54.797168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.798315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:54.804773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:54.805417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.876438 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-85a29ece-a813-4f47-b04d-660f3bf5aede tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 200 len: 353 microversion: 2.1 time: 0.171795 Aug 24 03:50:54.885316 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1941/3720] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:50:54 2022] GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:55.059686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:55.060782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:55.081180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:55.092910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.095626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.097999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.099097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.100722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.102084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.243301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.289993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.293250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.296301 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1e2c95f-7e61-4d46-9485-76dbbd139611 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1335 microversion: 2.54 time: 0.239331 Aug 24 03:50:55.300589 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1942/3721] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:55 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1335 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:55.316708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:55.318698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:55.340112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.342724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.343398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.346576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.347757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.349825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.726075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.742641 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c66b6802-470c-4dc8-9de1-55da43cc7132 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.439878 Aug 24 03:50:55.743709 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1943/3722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:55 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:55.892333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.892781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5041232-a471-4094-992f-5ce7e15e0113 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f1022db8790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:55.906327 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-75b7b21f-9dd4-412f-a4c2-a3180a4ac5f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1467 microversion: 2.1 time: 1.172694 Aug 24 03:50:55.909581 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1780/3723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:54 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1467 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:56.035380 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f5041232-a471-4094-992f-5ce7e15e0113 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 200 len: 353 microversion: 2.1 time: 0.148510 Aug 24 03:50:56.036030 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1944/3724] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:50:55 2022] GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:50:56.153487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1071279893", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "2e96f945-2654-409d-b10b-573e9e76374c"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:56.230298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] validate_networks() for [('2e96f945-2654-409d-b10b-573e9e76374c', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:56.308360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d241d272-dd0d-4023-bd1c-552836a9befb req-0857ebac-fbed-48ed-80fe-2913cacdb240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbef84a-c2d0-46b3-8604-2e7b2a82a716", "name": "network-vif-plugged", "status": "completed", "tag": "e7ac5a21-baad-4f12-8d3b-7ba321e70305"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:56.347611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d241d272-dd0d-4023-bd1c-552836a9befb req-0857ebac-fbed-48ed-80fe-2913cacdb240 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.348419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d241d272-dd0d-4023-bd1c-552836a9befb req-0857ebac-fbed-48ed-80fe-2913cacdb240 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.348937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d241d272-dd0d-4023-bd1c-552836a9befb req-0857ebac-fbed-48ed-80fe-2913cacdb240 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.365246 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d241d272-dd0d-4023-bd1c-552836a9befb req-0857ebac-fbed-48ed-80fe-2913cacdb240 service nova] Creating event network-vif-plugged:e7ac5a21-baad-4f12-8d3b-7ba321e70305 for instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 on n-h1-846470-15 Aug 24 03:50:56.373773 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d241d272-dd0d-4023-bd1c-552836a9befb req-0857ebac-fbed-48ed-80fe-2913cacdb240 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072350 Aug 24 03:50:56.374393 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1945/3725] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:50:56.381724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:56.382594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:56.392538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.393282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.393734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.394471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.394931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.395360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.527022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:56.539083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:56.541047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:56.542364 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48171702-81bd-426f-af70-fb78e7985df7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1335 microversion: 2.54 time: 0.166786 Aug 24 03:50:56.547884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1946/3726] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:56 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1335 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:56.774482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:56.775343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:56.782009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.782726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.783305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.784224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.784846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.785410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.958154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:56.969841 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-06d45902-dff2-42ca-bdcf-bc4cd3aa47f0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.198894 Aug 24 03:50:56.971014 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1947/3727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:56 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:56.975962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:56.976818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:56.984503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.985306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.985897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.987009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.987851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.988935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.184542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.194112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db1c99bf-f93b-4aa2-9dd4-7384d80abe7c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1467 microversion: 2.1 time: 0.221855 Aug 24 03:50:57.195019 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1948/3728] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:56 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1467 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:57.201620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90a2df3a-b7e6-4d08-9b0a-12f38545312b tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f10230a4280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:57.282377 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90a2df3a-b7e6-4d08-9b0a-12f38545312b tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 200 len: 353 microversion: 2.1 time: 0.085430 Aug 24 03:50:57.290444 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1949/3729] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:50:57 2022] GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:57.572043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:57.574709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:57.582909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:57.583964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:57.584789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:57.585210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:57.585628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:57.592019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:57.592724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:57.593345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.594046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:57.594500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:57.594926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.601614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:57.602112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:57.602545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.603438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:57.604134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:57.604562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.634507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Getting quotas for project 8b83990eded145b1b14abe95175a14bb. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:57.646827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Getting quotas for user bcb548a6ac054536bbd204c643da70e7 and project 8b83990eded145b1b14abe95175a14bb. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:57.664119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:57.667338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:57.718348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.744299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.751702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.754458 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2656b52e-56b7-42b9-a35a-539f01a46108 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.843166 Aug 24 03:50:57.756065 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1781/3730] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:50:57.756705 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-09c981a0-6de2-4b3f-b6f1-523d4f4fb451 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1335 microversion: 2.54 time: 0.193242 Aug 24 03:50:57.766597 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1950/3731] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:57 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1335 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:50:57.769864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37e0563d-007f-4234-818a-be4572a790d0 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:57.770576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-37e0563d-007f-4234-818a-be4572a790d0 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:57.890494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37e0563d-007f-4234-818a-be4572a790d0 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.904060 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37e0563d-007f-4234-818a-be4572a790d0 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1214 microversion: 2.1 time: 0.138321 Aug 24 03:50:57.908063 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1782/3732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:57 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:57.993356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:57.994571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:58.012054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.013723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.015322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.017910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.018697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.019202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.216067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:58.217269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:58.227448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.228575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.231215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.235308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:58.235794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.238586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.242012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.248272 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c0a60d73-6df2-4770-8a8f-8108a4b5e7b1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1320 microversion: 2.1 time: 0.261504 Aug 24 03:50:58.255475 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1951/3733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:57 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:58.298291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05632edc-de00-4b4d-b3a2-e713980347d4 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Calling method '.version_select at 0x7f1023706b80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:58.375238 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-05632edc-de00-4b4d-b3a2-e713980347d4 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] HTTP exception thrown: Volume a1e42b49-9164-4621-8972-6bcc2fece268 could not be found. Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05632edc-de00-4b4d-b3a2-e713980347d4 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Request method failure captured: Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 HTTP/1.1 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaAaSFGrP3het0t4U6NKWFKMhk5_JKm9hQ2rjA3euob9X4A8GU0ueiIeZRgOV-KoCy9t7HF9ldVAPmbyFDFVBSu4d9CAl-S-xdyz86CAUIwFDNXgZ_ynYPVW_FB2PHSReRYepVgQn2pVTmp3WiaMddj94Teda1QR0onrc5B93sudvCA Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: e9cffaf240fd42b480dda0c945f660f6 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesGetTestJSON-237970950 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9cffaf240fd42b480dda0c945f660f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9cffaf240fd42b480dda0c945f660f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9cffaf240fd42b480dda0c945f660f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9cffaf240fd42b480dda0c945f660f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesGetTestJSON-237970950 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: e9cffaf240fd42b480dda0c945f660f6 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesGetTestJSON-237970950 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesGetTestJSON-237970950-project Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 155cce1938084b8591ef29607abf2912 Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesGetTestJSON-237970950-project Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: exception: Volume a1e42b49-9164-4621-8972-6bcc2fece268 could not be found. Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a1e42b49-9164-4621-8972-6bcc2fece268'} Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a1e42b49-9164-4621-8972-6bcc2fece268 could not be found. (HTTP 404) (Request-ID: req-59c9233b-8e8e-454a-a984-3c2d2915e830) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:50:58.377797 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a1e42b49-9164-4621-8972-6bcc2fece268 could not be found. Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a1e42b49-9164-4621-8972-6bcc2fece268 could not be found. Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a1e42b49-9164-4621-8972-6bcc2fece268 could not be found. Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:50:58.382246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05632edc-de00-4b4d-b3a2-e713980347d4 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] Returning 404 to user: Volume a1e42b49-9164-4621-8972-6bcc2fece268 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:58.385972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05632edc-de00-4b4d-b3a2-e713980347d4 tempest-VolumesGetTestJSON-237970950 tempest-VolumesGetTestJSON-237970950-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268" status: 404 len: 109 microversion: 2.1 time: 0.090330 Aug 24 03:50:58.390080 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1952/3734] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:50:58 2022] GET /compute/v2.1/os-volumes/a1e42b49-9164-4621-8972-6bcc2fece268 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:50:58.604597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:58.618453 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-20ec0845-cc37-4fb8-a2d9-d0512a687884 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1467 microversion: 2.1 time: 0.407342 Aug 24 03:50:58.626120 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1783/3735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:58 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1467 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:58.813511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:58.814303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:58.830773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.841682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.849651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.856053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.857160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.860249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.931074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:58.932195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:58.945975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.968010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.968630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.969662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.970363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.972937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.021522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.036627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.040712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.042025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3b1d9ede-54ae-4d9a-8a40-cf91be12fb8e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1335 microversion: 2.54 time: 0.235264 Aug 24 03:50:59.069838 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1953/3736] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:58 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1335 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:59.241180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.254735 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fb2a7492-f1bc-4703-a556-c5dada8b76d8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1210 microversion: 2.1 time: 0.328846 Aug 24 03:50:59.256487 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1784/3737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:58 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1210 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:59.277579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:59.278194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:59.300033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.305349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.305349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.305349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.305349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.305349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.649371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:59.650079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:59.661883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.663299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.664263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.666660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.666934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:59.667696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.670126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.670773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.676825 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7575f071-d48c-4899-96d8-9cc4db14cca8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1502 microversion: 2.1 time: 0.403076 Aug 24 03:50:59.689626 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1954/3738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:59 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:59.714658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:59.715631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:59.728985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.733663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.734326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.735227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.740351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.741032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.260583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.277211 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bfb56163-29e7-460c-a92c-28ac8019ce9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.632345 Aug 24 03:51:00.282360 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1785/3739] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:59 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:00.293937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:00.294849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:00.305882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.306881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.307832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.309164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.310081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.310793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.393522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.405179 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b748c5a0-778c-4a6e-8a19-784927e03807 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1502 microversion: 2.1 time: 0.695321 Aug 24 03:51:00.405782 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1955/3740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:59 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1502 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:00.410530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.416018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:00.418150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:00.419361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:00.427236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.428470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.429096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.430261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.431011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.431903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.439717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.442177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.443897 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2d5a8c02-056f-4d0c-bac2-9f90f0b1a187 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1335 microversion: 2.54 time: 0.160303 Aug 24 03:51:00.445341 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1786/3741] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:00 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:00.452588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:00.453637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:00.500113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.501294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.501834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.502554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.503195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.503803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.556382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:51:00.568808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.579475 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-284bd35b-2249-4cf8-8730-84089fbbd408 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1266 microversion: 2.1 time: 0.172337 Aug 24 03:51:00.586765 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1956/3742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:00 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:00.756512 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04d11ddf-cab0-4321-874f-45ae5fd0b8ff tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 204 len: 0 microversion: 2.1 time: 0.307967 Aug 24 03:51:00.768646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:00.769264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:00.772778 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1787/3743] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:51:00 2022] DELETE /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:00.785913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.788310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.789591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.790650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.791440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.792661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.984415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.993557 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c65a015-17bd-42b1-88f5-4f39c60634c9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1508 microversion: 2.1 time: 0.230425 Aug 24 03:51:01.008638 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1957/3744] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:00 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:01.304856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:01.305844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:01.320977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.321555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.322289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.325085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.325563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.327847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.474928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:01.476348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:01.492900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.493405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.493852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.499187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.499779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.500248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.655520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.667941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.689577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.697092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.698943 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3104b91-9e68-45d5-97b8-6c79d3462089 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1356 microversion: 2.54 time: 0.229728 Aug 24 03:51:01.703886 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1958/3745] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:01 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:01.704789 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-161dd6ca-c2da-42d9-adb9-5bbe92975c31 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.405088 Aug 24 03:51:01.720907 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1788/3746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:01 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:01.724333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:01.724333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:01.737430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-60fc41f8-1051-4af3-94aa-9732ac106a6f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Action: 'create', calling method: .version_select at 0x7f102a695790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1503823622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8W73lDFzWpJPbE81az1tUT6l8L0vWuM0S1VDIpPOTHdrogEpqFEyV9hdiPHrg6ZRWra6XhUBhXQocISf2Q05R2P4XbP7aUHP60iGiCs9WnOWYyHGpUN0m1Cy713W7F6g=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:01.739066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.739688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.740754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.741782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.742255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.742796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.762377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-60fc41f8-1051-4af3-94aa-9732ac106a6f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Getting quotas for project c99563c767324b068449d745a498ede8. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:01.775967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-60fc41f8-1051-4af3-94aa-9732ac106a6f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Getting quotas for user 5dcdaa5009344d278f511ca86ad92544 and project c99563c767324b068449d745a498ede8. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:01.822539 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-60fc41f8-1051-4af3-94aa-9732ac106a6f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.089870 Aug 24 03:51:01.831153 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1789/3747] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 03:51:01 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:51:01.837916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1503823622", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:01.841039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:01.852190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.852694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.853176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.854092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.854616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.855152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.900061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.917761 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bfcf719f-edf4-4172-84ca-e3c13bcdcc2a tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1272 microversion: 2.1 time: 0.207134 Aug 24 03:51:01.918597 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1959/3748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:01 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:02.017817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:02.018460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:02.022348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:02.022782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:02.023260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:02.023688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:02.024244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:02.031436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.033719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.034362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.035141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.035617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.040150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.132825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:02.246071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:02.273343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.273947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.278267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.279223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.279740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.282929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.388914 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba2162a3-093f-483a-8a24-5a5c1613ec2a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "POST /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7/action" status: 202 len: 1139 microversion: 2.54 time: 0.556434 Aug 24 03:51:02.404380 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1790/3749] 10.222.0.58 () {62 vars in 1320 bytes} [Wed Aug 24 03:51:01 2022] POST /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7/action => generated 1139 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 03:51:02.410751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:02.412025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:02.417983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:02.431173 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a92d44a-235a-420a-bef8-86d9f56bf72e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1508 microversion: 2.1 time: 0.415841 Aug 24 03:51:02.436964 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1960/3750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:02 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:02.439680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.440355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.442088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.443142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.444753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.447058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.650822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:02.663641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:02.667935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:02.669295 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a019f1c-0a5c-4c1e-9d1d-5848cd13182e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.263091 Aug 24 03:51:02.698220 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1791/3751] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:02 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:02.736013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:02.736013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:02.746240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:02.760031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.761172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.762058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.765117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.768053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.768916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.948307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:02.949578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:02.967749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.969958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.971929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.974552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.975485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.976994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.089477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.107860 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c301650-74bb-4ec8-bf9b-6c5b4bfe4528 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.378937 Aug 24 03:51:03.130233 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1961/3752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:02 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:03.148121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.157732 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a30c250-ff8f-45bb-9443-b03457bbbbd9 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1272 microversion: 2.1 time: 0.214327 Aug 24 03:51:03.184884 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1792/3753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:02 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:03.463422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:03.464079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:03.472517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.473482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.474372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.475690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.476394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.477077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.681039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.700107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:03.701933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:03.711148 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-11e1e736-d111-440b-b89f-c5811b89444b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1508 microversion: 2.1 time: 0.248247 Aug 24 03:51:03.714526 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1962/3754] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:03 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:03.715180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.715972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.716645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.717562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.718443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.719035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.832284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.849260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.851213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.852656 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b79ff3e-5e6a-4096-9ae5-b75547e066e7 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.157459 Aug 24 03:51:03.854911 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1793/3755] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:03 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:04.134397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:04.136181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:04.149150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0156e213-fad2-47c2-9f9d-144bae70d5fd req-c6a3d551-ce91-4d80-b90f-85f5133e8ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbef84a-c2d0-46b3-8604-2e7b2a82a716", "name": "network-vif-deleted", "tag": "e7ac5a21-baad-4f12-8d3b-7ba321e70305"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:04.161629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.164729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.165538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.169754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.172685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.175297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.181321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0156e213-fad2-47c2-9f9d-144bae70d5fd req-c6a3d551-ce91-4d80-b90f-85f5133e8ca6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.185582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0156e213-fad2-47c2-9f9d-144bae70d5fd req-c6a3d551-ce91-4d80-b90f-85f5133e8ca6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.191237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0156e213-fad2-47c2-9f9d-144bae70d5fd req-c6a3d551-ce91-4d80-b90f-85f5133e8ca6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.229112 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0156e213-fad2-47c2-9f9d-144bae70d5fd req-c6a3d551-ce91-4d80-b90f-85f5133e8ca6 service nova] Creating event network-vif-deleted:e7ac5a21-baad-4f12-8d3b-7ba321e70305 for instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 on n-h1-846470-15 Aug 24 03:51:04.243774 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0156e213-fad2-47c2-9f9d-144bae70d5fd req-c6a3d551-ce91-4d80-b90f-85f5133e8ca6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098189 Aug 24 03:51:04.244959 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1794/3756] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:04.259611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:04.261778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:04.279318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.281393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.282021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.282947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.284229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.287327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.647591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:04.662782 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1965c3c-4e6e-49e3-a2f2-ef80604c3495 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.530391 Aug 24 03:51:04.666285 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1963/3757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:04 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:04.735941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:04.745018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:04.759333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.759926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.763465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.767946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.770059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.770937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.830579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.831368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.832754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.833724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lazy-loading 'fault' on Instance uuid 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:51:04.912243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:04.919558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:04.929821 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-50fe3aa1-7747-40a8-a70e-7fd0617a4f25 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 200 len: 1310 microversion: 2.1 time: 0.198591 Aug 24 03:51:04.937138 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1964/3758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:04 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 1310 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:04.938373 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a2162454-a968-4b72-a869-7e28a6fea58d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1314 microversion: 2.1 time: 0.688468 Aug 24 03:51:04.944111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:04.945119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:04.953679 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1795/3759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:04 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:04.956327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.966821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.967430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.974712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.975551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.976390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.170118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.188905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.197966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.199885 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c0dfa74-c181-429a-bd8f-671ce4a6c80a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.261164 Aug 24 03:51:05.201047 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1965/3760] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:04 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:05.695586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:05.696348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:05.715548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.718508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.719198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.720757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.721430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.722066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.738275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be9b399b-603d-44b9-824b-e0ff42506277 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f1022dbdf70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:05.821083 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be9b399b-603d-44b9-824b-e0ff42506277 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8e860eca-8384-45d7-8fb8-7aac906091ce" status: 200 len: 351 microversion: 2.1 time: 0.087956 Aug 24 03:51:05.829246 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1966/3761] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:51:05 2022] GET /compute/v2.1/os-volumes/8e860eca-8384-45d7-8fb8-7aac906091ce => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:05.966477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:05.968338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:05.998113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.999211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.000034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.001179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.002369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.004185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.122830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.134271 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d285416e-d0d3-46a8-a632-2ac129a2ebb4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.448273 Aug 24 03:51:06.136537 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1796/3762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:05 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:06.144014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:06.144855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:06.150354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:06.156059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.157354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.157849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.158567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.159025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.159456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.176040 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 HTTP/1.1 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '4bbef84a-c2d0-46b3-8604-2e7b2a82a716'} Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:06.179296 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c6eb88c6-89ca-4c12-9344-5dd9b6335ab1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 404 len: 111 microversion: 2.1 time: 0.042741 Aug 24 03:51:06.182904 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1797/3763] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:06 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:06.201306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-811b69f3-e817-4998-8a9d-220a22810f9a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: .version_select at 0x7f102a695a60>, body: {"keypair": {"name": "tempest-key-1370898899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeagC+EOi71C5l8mcwAu9A9tyqXB7y2PC6x7GhJqfqb+ynbInPjhbx2NAFjEEFdh+pjsa7U1oGsjGIXQsZx/p7H86Q6phcQRmH8uMnmbb0y/wowra49R6j+2wBNuCY5jQ=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:06.242378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-811b69f3-e817-4998-8a9d-220a22810f9a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:06.249804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-811b69f3-e817-4998-8a9d-220a22810f9a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:06.282664 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-811b69f3-e817-4998-8a9d-220a22810f9a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.085466 Aug 24 03:51:06.283447 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1798/3764] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:51:06 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:06.295438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:06.296007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:06.305773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.306521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.307396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.308251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.308756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.309363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.364486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.377060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3be8b96-6a4b-462d-843f-1504aa72c533 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1314 microversion: 2.1 time: 0.419367 Aug 24 03:51:06.380623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1967/3765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:05 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:06.394196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4b49fce-6ab6-40c7-8499-e3b74cf8e645 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '.version_select at 0x7f1022dbd820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:06.399302 n-d-846470-15 devstack@n-api.service[122536]: WARNING oslo_db.sqlalchemy.utils [None req-a4b49fce-6ab6-40c7-8499-e3b74cf8e645 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 03:51:06.418678 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4b49fce-6ab6-40c7-8499-e3b74cf8e645 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.036673 Aug 24 03:51:06.419525 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1968/3766] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:51:06 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:06.438089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c09321e9-e542-42ae-ac19-c1f45459d6c6 req-80663161-8200-4ab6-af75-071aefc4bc52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e20c0245-4056-4646-ac81-3b08c48df7ca", "tag": "39d9e272-c057-44cb-8495-a1379871ec58"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:06.463010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c09321e9-e542-42ae-ac19-c1f45459d6c6 req-80663161-8200-4ab6-af75-071aefc4bc52 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.463863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c09321e9-e542-42ae-ac19-c1f45459d6c6 req-80663161-8200-4ab6-af75-071aefc4bc52 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.465138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c09321e9-e542-42ae-ac19-c1f45459d6c6 req-80663161-8200-4ab6-af75-071aefc4bc52 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.499753 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c09321e9-e542-42ae-ac19-c1f45459d6c6 req-80663161-8200-4ab6-af75-071aefc4bc52 service nova] Creating event network-changed:39d9e272-c057-44cb-8495-a1379871ec58 for instance e20c0245-4056-4646-ac81-3b08c48df7ca on n-h2-846470-15 Aug 24 03:51:06.512133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.514253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c09321e9-e542-42ae-ac19-c1f45459d6c6 req-80663161-8200-4ab6-af75-071aefc4bc52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092795 Aug 24 03:51:06.519097 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1969/3767] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:06.529710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.535718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.538380 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91a3fd64-8e99-44f5-bddb-1d235b4203c0 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.252912 Aug 24 03:51:06.541553 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1799/3768] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:06 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:06.627383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1716781133", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-key-1370898899", "networks": [{"uuid": "a410578b-d916-4218-bf01-482ee8be19b3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:06.699674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] validate_networks() for [('a410578b-d916-4218-bf01-482ee8be19b3', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:07.158761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:07.160655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:07.181716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.182429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.182897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.183952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.184832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.185265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.457439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:07.480544 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-97625ffc-fe94-4b21-9bc5-452aa071f2a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.324653 Aug 24 03:51:07.481602 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1800/3769] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:07 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:07.504208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:07.505182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:07.525534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.526109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.526561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.527331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.527993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.528432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.619797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:07.881919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:07.882469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:07.882978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:07.883450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:07.883993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:07.897954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.899024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.900665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.901794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.902427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.903048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.926031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:07.933991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:07.950787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:07.953876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:08.021728 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c54dfd0-0b49-4cf3-9d70-f2fd6cdaae14 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.398139 Aug 24 03:51:08.023171 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1970/3770] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:51:08.030159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:08.031736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:08.043077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.044128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.044910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.045959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.046671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.047260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.169003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.191585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.197186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.199713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aea40273-c449-41a2-bdaf-3635b4a6c437 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.175320 Aug 24 03:51:08.201336 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1971/3771] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:08 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:08.216928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48f8658f-c594-4413-ad0d-6ac398169e46 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:08.217897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48f8658f-c594-4413-ad0d-6ac398169e46 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:08.225507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.236930 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d63dac2b-bd43-4210-b6f3-1e82d75eb6f8 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1314 microversion: 2.1 time: 0.736455 Aug 24 03:51:08.247283 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1801/3772] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:07 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:08.344301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48f8658f-c594-4413-ad0d-6ac398169e46 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.354179 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48f8658f-c594-4413-ad0d-6ac398169e46 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1229 microversion: 2.1 time: 0.150199 Aug 24 03:51:08.369190 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1972/3773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:08 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1229 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:08.504918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:08.506110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:08.521951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.524179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.530565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.532608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.534132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.535096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.695687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-04890fb7-7e43-4917-b6b3-cfab13a79cfb tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f10230d9d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:08.764463 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-04890fb7-7e43-4917-b6b3-cfab13a79cfb tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7eb12bf4-d8aa-4736-abc1-cf7d9747def6" status: 200 len: 351 microversion: 2.1 time: 0.077048 Aug 24 03:51:08.765126 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1973/3774] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:51:08 2022] GET /compute/v2.1/os-volumes/7eb12bf4-d8aa-4736-abc1-cf7d9747def6 => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:08.940230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.944591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:08.978883 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88aa4b94-e264-42e4-9328-d132b8858c7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.477011 Aug 24 03:51:08.980310 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1802/3775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:08 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:09.228507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:09.230514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:09.241372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.242544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.243236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.244295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.244987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.246404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.261195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:09.262442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:09.278056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.278886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.279770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.280859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.281477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.282056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.395498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.406638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.409660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.411348 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-726b3795-df73-46a7-b29e-719c1843c0e9 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.186939 Aug 24 03:51:09.412777 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1974/3776] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:09 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:09.422551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:09.423342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:09.432501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.433172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.433752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.434693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.435296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.436039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.524184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.535192 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-69b8a9f6-5708-42e2-b241-c8f57d0667d4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1281 microversion: 2.1 time: 0.120777 Aug 24 03:51:09.535883 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1975/3777] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:09 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:09.860550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.899607 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06545ec7-380b-4426-ba45-abcc279bcf7d tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1314 microversion: 2.1 time: 0.639381 Aug 24 03:51:09.901927 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1803/3778] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:09 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:10.003167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.004271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:10.021351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.022322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.025971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.026967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.028405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.030693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.092990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:10.322148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.326988 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74400403-51e8-40c8-a5c1-2f1d0ad10afc tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.330125 Aug 24 03:51:10.328292 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1976/3779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:09 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:10.442074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.446136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:10.471967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.476294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.478997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.480298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.481289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.481950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.592252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.597263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:10.626251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.627115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.637562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.654055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.654671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.655283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.750762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.768991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.773911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.778130 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6c0e734-451d-4eb8-89e4-e8c93953986f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.340838 Aug 24 03:51:10.786548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.795706 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1804/3780] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:10 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:10.797420 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eee7df21-2bc1-4475-8689-04925f722862 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1287 microversion: 2.1 time: 0.243215 Aug 24 03:51:10.797420 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1977/3781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:10 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1287 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:10.922609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.923241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:10.941985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.942530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.942982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.943711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.944347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.944930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.350299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:11.350928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:11.367042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.367606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.368096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.372443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.372962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.373416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.568893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:11.601461 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f69c27f9-3fb4-4c71-8bb7-561ad0134d5c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.255875 Aug 24 03:51:11.602406 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1978/3782] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:11 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:11.618966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9ea00a2-77e0-4bdb-9b4d-a7ce8bfc6f8f tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f1022e05b80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:11.714739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:11.727783 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9ea00a2-77e0-4bdb-9b4d-a7ce8bfc6f8f tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b3365632-ae48-4f7a-beb6-24a4e58fc593" status: 200 len: 351 microversion: 2.1 time: 0.124155 Aug 24 03:51:11.737366 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-70c3fd7b-9d15-4500-bd23-73092d00445c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1314 microversion: 2.1 time: 0.817656 Aug 24 03:51:11.738169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1805/3783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:10 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:11.738390 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1979/3784] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 03:51:11 2022] GET /compute/v2.1/os-volumes/b3365632-ae48-4f7a-beb6-24a4e58fc593 => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:11.757434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52e7147b-045e-40ff-8e27-f6849650a09f tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f102a69fdc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:11.803818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:11.804719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:11.811737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.812480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.813074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.814310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.814933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.815517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.994627 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52e7147b-045e-40ff-8e27-f6849650a09f tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.253307 Aug 24 03:51:11.995420 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1806/3785] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 24 03:51:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:11.997543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.004295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.007322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:12.015480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.016349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.017123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.018057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.018830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.019437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.021322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.022877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.024224 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f6accfc-a78f-441c-bc6b-25f12edbe424 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.225104 Aug 24 03:51:12.027584 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1980/3786] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:11 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:12.033375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-da66d025-5035-4390-a4ab-c3e108784623 req-434824a5-8d1e-45b8-8110-d84b8845a1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20c0245-4056-4646-ac81-3b08c48df7ca", "name": "network-vif-plugged", "status": "completed", "tag": "39d9e272-c057-44cb-8495-a1379871ec58"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:12.062725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-da66d025-5035-4390-a4ab-c3e108784623 req-434824a5-8d1e-45b8-8110-d84b8845a1ca service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.063600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-da66d025-5035-4390-a4ab-c3e108784623 req-434824a5-8d1e-45b8-8110-d84b8845a1ca service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.064460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-da66d025-5035-4390-a4ab-c3e108784623 req-434824a5-8d1e-45b8-8110-d84b8845a1ca service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.082577 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-da66d025-5035-4390-a4ab-c3e108784623 req-434824a5-8d1e-45b8-8110-d84b8845a1ca service nova] Creating event network-vif-plugged:39d9e272-c057-44cb-8495-a1379871ec58 for instance e20c0245-4056-4646-ac81-3b08c48df7ca on n-h2-846470-15 Aug 24 03:51:12.091969 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-da66d025-5035-4390-a4ab-c3e108784623 req-434824a5-8d1e-45b8-8110-d84b8845a1ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062163 Aug 24 03:51:12.095771 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1981/3787] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:12.102766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cea94832-cab0-4fd1-8846-f4d8f95fb8de tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f1022e05940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.239347 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cea94832-cab0-4fd1-8846-f4d8f95fb8de tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.141957 Aug 24 03:51:12.240319 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1982/3788] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 24 03:51:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:12.255199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db2944dc-5079-49f6-9283-b39b79d60d09 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f1022f77550>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.439220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db2944dc-5079-49f6-9283-b39b79d60d09 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.189260 Aug 24 03:51:12.439846 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1983/3789] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 24 03:51:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:12.453987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ca5c484-80de-46c0-9961-710de2bd0384 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f1022db84c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.519749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.540744 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-13b134b5-490b-4a3a-b292-c848f9f9e6b7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.539016 Aug 24 03:51:12.542051 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1807/3790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:11 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:12.623907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.624776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:12.644516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.648839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.652427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.654763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.657591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.658323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.693927 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ca5c484-80de-46c0-9961-710de2bd0384 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.244709 Aug 24 03:51:12.695276 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1984/3791] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 24 03:51:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:12.710381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0d93e4db-399c-4bc4-b81f-8370689ebc44 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f1022e05f70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.869034 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0d93e4db-399c-4bc4-b81f-8370689ebc44 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.164120 Aug 24 03:51:12.870219 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1985/3792] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 24 03:51:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:12.877675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.878342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:12.903335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.908862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.909306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.910275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.913230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.914431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.150263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.163361 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2fe1cd56-4613-4be2-8f15-2586890b9087 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.543951 Aug 24 03:51:13.165401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1808/3793] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:12 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:13.184440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4108a9f-0319-42d2-bec5-72e4fe776c39 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f102a556670>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:13.310467 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4108a9f-0319-42d2-bec5-72e4fe776c39 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.143368 Aug 24 03:51:13.311486 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1809/3794] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:51:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:13.324554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:13.325623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:13.331905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.342937 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4dedd47e-4ed5-42d6-abe8-db6d7c93e3fd tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1314 microversion: 2.1 time: 0.471421 Aug 24 03:51:13.343443 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1986/3795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:12 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:13.349273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b21878b-8651-476e-993c-cf81398a1f4d tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f10235a1160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:13.357801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.385567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.390611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.395134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.400821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.404007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.753231 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b21878b-8651-476e-993c-cf81398a1f4d tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.408323 Aug 24 03:51:13.753910 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1987/3796] 10.222.0.58 () {58 vars in 1188 bytes} [Wed Aug 24 03:51:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:13.769667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.775031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:13.775516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:13.783531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.784796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.785305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.786338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.787523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.790072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.790763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.791458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.796375 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fbe7271c-e371-4370-aeca-08b21edd480d tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.474027 Aug 24 03:51:13.797982 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1810/3797] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:13 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:13.810031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3b745ff2-3081-4d20-bd46-d9f4a51e5232 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] Calling method '.version_select at 0x7f102a556a60>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.008899 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3b745ff2-3081-4d20-bd46-d9f4a51e5232 tempest-VolumesTestJSON-1325206765 tempest-VolumesTestJSON-1325206765-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.209007 Aug 24 03:51:14.010700 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1811/3798] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 03:51:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:14.190939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.193988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.228323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.228945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.233506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.234702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.236301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.242589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.360249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.372792 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-12682428-fa6a-4deb-b55c-d9dec0399bdc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.604236 Aug 24 03:51:14.376810 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1988/3799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:13 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:14.387373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.396816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.408532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.409757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.410465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.411519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.415739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.416646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.920492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.940148 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1abb1a2-088a-4f10-9370-6d9eae5dbf48 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1498 microversion: 2.1 time: 0.557692 Aug 24 03:51:14.941764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1989/3800] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:14 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1498 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:14.949640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.950678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.979464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.987765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.988066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.988811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.990044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.992854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.997418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.003440 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bd514eba-024d-47b4-ba76-f85382197e16 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.819906 Aug 24 03:51:15.016220 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1812/3801] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:14 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:15.215628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-90a914a3-082e-4bbe-8d0c-d65cf7003db8 req-ba0b1a89-04c4-403d-89dd-e1780f6bac60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f10558b-2286-4651-a321-d50e4faec067", "tag": "c388bf85-c850-4f66-aa99-5cd6c3e4e434"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:15.245616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-90a914a3-082e-4bbe-8d0c-d65cf7003db8 req-ba0b1a89-04c4-403d-89dd-e1780f6bac60 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.248171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-90a914a3-082e-4bbe-8d0c-d65cf7003db8 req-ba0b1a89-04c4-403d-89dd-e1780f6bac60 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.252112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-90a914a3-082e-4bbe-8d0c-d65cf7003db8 req-ba0b1a89-04c4-403d-89dd-e1780f6bac60 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.295042 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-90a914a3-082e-4bbe-8d0c-d65cf7003db8 req-ba0b1a89-04c4-403d-89dd-e1780f6bac60 service nova] Creating event network-changed:c388bf85-c850-4f66-aa99-5cd6c3e4e434 for instance 9f10558b-2286-4651-a321-d50e4faec067 on n-h1-846470-15 Aug 24 03:51:15.299105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:15.327283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:15.331253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:15.332083 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-90a914a3-082e-4bbe-8d0c-d65cf7003db8 req-ba0b1a89-04c4-403d-89dd-e1780f6bac60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114655 Aug 24 03:51:15.335533 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1813/3802] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:15.338854 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63e2edea-decd-4ac3-82df-f14553f7befe tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.394644 Aug 24 03:51:15.345656 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1990/3803] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:14 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:15.401907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:15.402956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:15.420735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.429812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.430566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.432769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.434397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.436898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.941723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:15.959298 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c47d7ede-4996-4182-bfd5-3d47e8d6a8d7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.561924 Aug 24 03:51:15.992152 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1814/3804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:15 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:16.029903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:16.031105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:16.045784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.048023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.048863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.051451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.052656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.054989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.336168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.348421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-422da6a9-5eb8-4865-9468-d3e1a204748c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.323533 Aug 24 03:51:16.349310 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1991/3805] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:16 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:16.375109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:16.376174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:16.387126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=16 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:16.389150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.389417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.389864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.390586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.391047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.413120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.564081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.593385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.598436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.614746 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01881cd6-0101-4a05-9b2f-b8170458a383 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.236409 Aug 24 03:51:16.616211 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1815/3806] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:16 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:17.001383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:17.002547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:17.017472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.018592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.022078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.023081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.024011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.025690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.291300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.305706 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24523308-ed6f-4fb6-b5e0-73d6bbf5eb00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.309801 Aug 24 03:51:17.306233 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1992/3807] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:16 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:17.385198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:17.388995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:17.394152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e31ecbc3-8b34-47b8-829f-4c18a3b2046b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Action: 'create', calling method: .version_select at 0x7f102a695790>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-328757504", "policies": ["affinity"]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:17.399732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:17.408283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.410033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.411286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.412599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.413507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.414368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.424594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e31ecbc3-8b34-47b8-829f-4c18a3b2046b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:17.432173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e31ecbc3-8b34-47b8-829f-4c18a3b2046b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:17.515209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e31ecbc3-8b34-47b8-829f-4c18a3b2046b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:17.521881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e31ecbc3-8b34-47b8-829f-4c18a3b2046b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:17.548989 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e31ecbc3-8b34-47b8-829f-4c18a3b2046b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.436881 Aug 24 03:51:17.549820 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1816/3808] 10.222.0.58 () {60 vars in 1174 bytes} [Wed Aug 24 03:51:17 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:17.576621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0eb67c63-af22-4423-ae64-46e8cc9dc1cc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Action: 'create', calling method: .version_select at 0x7f10342f7310>, body: {"server_group": {"name": "tempest-server-group-1097382402", "policies": ["affinity"]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:17.627052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0eb67c63-af22-4423-ae64-46e8cc9dc1cc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:17.641908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0eb67c63-af22-4423-ae64-46e8cc9dc1cc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:17.662555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.673960 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-614c0c51-2f8a-4720-95b9-931582f94a81 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.296979 Aug 24 03:51:17.690751 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1993/3809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:17 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:17.704652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:17.705676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:17.725919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.728126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.729994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.732834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.734254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.736167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.743417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0eb67c63-af22-4423-ae64-46e8cc9dc1cc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:17.767080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0eb67c63-af22-4423-ae64-46e8cc9dc1cc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:17.811709 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0eb67c63-af22-4423-ae64-46e8cc9dc1cc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.254180 Aug 24 03:51:17.819736 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1817/3810] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 24 03:51:17 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:17.837284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3c28590-4d60-4034-808d-fd84c890f6fb tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Action: 'create', calling method: .version_select at 0x7f102a6bedc0>, body: {"server_group": {"name": "tempest-server-group-1097382402", "policies": ["affinity"]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:17.860081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:17.870791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c3c28590-4d60-4034-808d-fd84c890f6fb tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:17.876279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.881281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c3c28590-4d60-4034-808d-fd84c890f6fb tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:17.896494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.906574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.907979 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec404515-dc65-48ab-8638-3c903ac76a5f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.212096 Aug 24 03:51:17.908759 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1994/3811] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:17 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:17.960970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c3c28590-4d60-4034-808d-fd84c890f6fb tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:17.985525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c3c28590-4d60-4034-808d-fd84c890f6fb tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:18.021630 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c3c28590-4d60-4034-808d-fd84c890f6fb tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.189012 Aug 24 03:51:18.022632 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1818/3812] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 24 03:51:17 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:18.034963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-800fedca-58bc-4ee6-a2f2-5dc9b514bc8e tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.048769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:18.085364 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-800fedca-58bc-4ee6-a2f2-5dc9b514bc8e tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/8ae02470-8fbb-4662-b64c-2582ed7d7f57" status: 204 len: 0 microversion: 2.1 time: 0.050511 Aug 24 03:51:18.086237 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1995/3813] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:51:18 2022] DELETE /compute/v2.1/os-server-groups/8ae02470-8fbb-4662-b64c-2582ed7d7f57 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:18.094077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5431cf89-d821-43a6-bf7f-12383aa421e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.108203 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5431cf89-d821-43a6-bf7f-12383aa421e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.017864 Aug 24 03:51:18.120070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b173bda-82dd-4a27-9e2b-c67094fad541 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.123977 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1819/3814] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:18.154610 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b173bda-82dd-4a27-9e2b-c67094fad541 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/d0f09dab-4e71-4bf5-af13-09e8fd9a2b66" status: 204 len: 0 microversion: 2.1 time: 0.038593 Aug 24 03:51:18.158727 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1996/3815] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:51:18 2022] DELETE /compute/v2.1/os-server-groups/d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:51:18.165535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84b6ff52-e97d-4d93-8fe0-9a35622b7dab tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.177158 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84b6ff52-e97d-4d93-8fe0-9a35622b7dab tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.016778 Aug 24 03:51:18.178511 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1820/3816] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:18.190524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb897f57-d0e5-4f4b-9c15-fa605b51a0dc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Action: 'create', calling method: .version_select at 0x7f102311ae50>, body: {"server_group": {"name": "tempest-server-group-1495784584", "policies": ["affinity"]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:18.214987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-eb897f57-d0e5-4f4b-9c15-fa605b51a0dc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:18.222016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-eb897f57-d0e5-4f4b-9c15-fa605b51a0dc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:18.279598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-eb897f57-d0e5-4f4b-9c15-fa605b51a0dc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:18.286139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-eb897f57-d0e5-4f4b-9c15-fa605b51a0dc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:18.304793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb897f57-d0e5-4f4b-9c15-fa605b51a0dc tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.118563 Aug 24 03:51:18.316342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bacd4954-bbdd-4e56-bc8f-f07cd1116264 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.326327 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1997/3817] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 24 03:51:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:18.340953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.341828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:18.352054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.353595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.356045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.358524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.359551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.361640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.378251 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bacd4954-bbdd-4e56-bc8f-f07cd1116264 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/d6542379-30db-49e3-aba3-dd196f5db448" status: 204 len: 0 microversion: 2.1 time: 0.065848 Aug 24 03:51:18.382397 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1821/3818] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:51:18 2022] DELETE /compute/v2.1/os-server-groups/d6542379-30db-49e3-aba3-dd196f5db448 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:18.389485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9447512-9a9a-447f-91ac-3539aa4d28fe tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.415023 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f9447512-9a9a-447f-91ac-3539aa4d28fe tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031216 Aug 24 03:51:18.424402 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1822/3819] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:18.429972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-59f44f00-c2bf-4a77-9cd8-fec343030315 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Action: 'create', calling method: .version_select at 0x7f102a695790>, body: {"server_group": {"name": "tempest-server-group-152694235", "policies": ["anti-affinity"]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:18.461949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-59f44f00-c2bf-4a77-9cd8-fec343030315 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:18.471124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-59f44f00-c2bf-4a77-9cd8-fec343030315 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:18.525831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-59f44f00-c2bf-4a77-9cd8-fec343030315 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:18.533406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-59f44f00-c2bf-4a77-9cd8-fec343030315 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_groups'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:18.558430 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-59f44f00-c2bf-4a77-9cd8-fec343030315 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.132287 Aug 24 03:51:18.565262 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1823/3820] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 24 03:51:18 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:18.572504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e6920d6-a1cf-4c0c-b782-8977a19d5576 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.610628 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e6920d6-a1cf-4c0c-b782-8977a19d5576 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/868accbf-3f9a-48cf-9934-d626064ab0d1" status: 204 len: 0 microversion: 2.1 time: 0.042688 Aug 24 03:51:18.611616 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1824/3821] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:51:18 2022] DELETE /compute/v2.1/os-server-groups/868accbf-3f9a-48cf-9934-d626064ab0d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:18.621887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcb01cbb-4d29-46b7-be9b-5e27ef96dbac tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.639510 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dcb01cbb-4d29-46b7-be9b-5e27ef96dbac tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023140 Aug 24 03:51:18.654064 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1825/3822] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:18.702961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.703702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:18.716937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.717636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.718200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.721146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.723916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.724510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.761911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.775497 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6934d172-bc5d-4598-8c37-3f8c5d3f817f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.447725 Aug 24 03:51:18.778839 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1998/3823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:18.789570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-939147124", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "da02d620-8d6c-4db8-aa60-8fe1e72e92bc"}]}, "os:scheduler_hints": {"group": "015c8695-d4c8-4594-b7f6-61493a5dd3fc"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:18.925405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] validate_networks() for [('da02d620-8d6c-4db8-aa60-8fe1e72e92bc', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:18.946019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.956298 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9c7d4b83-ad3e-4495-b004-6047a2fd5812 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.258216 Aug 24 03:51:18.958236 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1826/3824] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:18.972575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.975554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:18.994716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.996973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.998361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.002611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.005872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.006547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.185759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.195609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.205233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.210216 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-108b406c-c969-4abe-b618-e96e80f541d5 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.248508 Aug 24 03:51:19.211038 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1827/3825] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:19.815717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:19.817219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:19.841502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.844832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.846886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.848627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.851374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.852011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.891651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:19.893318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:19.893978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:19.895224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:19.895924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:19.916604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.917361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.918135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.919075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.920660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.921275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.943113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:19.949755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:19.966178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:19.968160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:20.090488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:20.106992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:20.114874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.126392 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-172ad838-2d25-4171-a6e0-9f90f8b241cb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.331619 Aug 24 03:51:20.127552 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1828/3826] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:19 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:20.154084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.157838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.178116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.180822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.182954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.186569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.187408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.189410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.194774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:20.204447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Getting quotas for user 020c02804954453591e51157932d6c51 and project c7ce212b4f6f4c82a6ada0ade6b14d87. Resources: {'server_group_members'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:20.244167 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74b32c17-840d-4403-b1fe-6d7ee91cccc1 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463948 Aug 24 03:51:20.251201 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 1999/3827] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:51:20.256678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.257474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.264785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.265715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.266376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.267339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.268024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.268707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.381116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.392088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.394868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.396740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d4816298-3bf0-422a-9bdd-c17d75135036 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.144388 Aug 24 03:51:20.398048 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2000/3828] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:20.404598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b3169f8-d00a-4108-931c-fdd9aa5b6ba7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.406380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5b3169f8-d00a-4108-931c-fdd9aa5b6ba7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.500622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5b3169f8-d00a-4108-931c-fdd9aa5b6ba7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.509095 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b3169f8-d00a-4108-931c-fdd9aa5b6ba7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1212 microversion: 2.1 time: 0.109809 Aug 24 03:51:20.512368 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2001/3829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:20.517247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.518037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.532447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.532945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.533393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.534649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.536208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.536848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.569287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.583856 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-875b5320-d378-4733-85fe-86e9b64ab258 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1472 microversion: 2.1 time: 0.449883 Aug 24 03:51:20.584246 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1829/3830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:20.590516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:51:20.711239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:20.764353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:20.791240 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e9880222-acfb-49b4-be1d-9bd69630cdc3 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 204 len: 0 microversion: 2.1 time: 0.277414 Aug 24 03:51:20.798191 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2002/3831] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:51:20 2022] DELETE /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:20.827867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.829450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.883681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.884180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.884652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.885407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.885865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.886292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.156576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:21.161422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:21.192744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.192744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.193103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.193611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.194072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.194513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.531706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.535874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.543695 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4597b139-49e5-4667-b992-e34ede4d2c34 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1504 microversion: 2.1 time: 0.741185 Aug 24 03:51:21.544299 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1830/3832] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1504 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:21.549662 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-500c2574-c73a-42ff-9bdf-319ea6783af2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.398103 Aug 24 03:51:21.550801 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2003/3833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:21 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:21.555769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:21.556864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:21.570822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:21.571436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:21.575830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.576331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.578398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.579758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.581616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.590024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.601021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.605624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.606652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.610135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.610942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.613020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.742777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.760249 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1627bc8e-d5c5-461d-8e9c-6a74fd72fc29 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1216 microversion: 2.1 time: 0.207988 Aug 24 03:51:21.764102 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2004/3834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:21 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1216 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:21.776979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:21.776979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:21.782841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.783338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.784099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.784526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.784977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.786035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.786901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.801061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.803078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.804595 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-925cc655-0882-4b66-bc34-2dd348a16814 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.245142 Aug 24 03:51:21.806352 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1831/3835] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:21 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:22.014822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:22.027421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d36c13c-0eef-4cb3-9b31-cfe10a9e7f76 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1471 microversion: 2.1 time: 0.262143 Aug 24 03:51:22.045792 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2005/3836] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:21 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:22.567895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:22.568627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:22.581094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.581735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:22.582650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:22.584314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.586607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.590643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.591337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.592823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.604040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.608219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.610330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.615851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.618315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.624684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.984892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.003235 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a35bc932-fa03-49de-b5c0-8abb67aa21f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.432989 Aug 24 03:51:23.004527 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2006/3837] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:22 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:23.014675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:23.015296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:23.033116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.033702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.037958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.044124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.044980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.045604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.192110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.213535 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7d279ded-6a9c-4f41-bb0f-7adcb8dd755b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1264 microversion: 2.1 time: 0.207678 Aug 24 03:51:23.224433 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2007/3838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:23 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:23.245318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:23.245953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:23.272166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.278587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.280285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.283896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.285263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.285875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.537823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.550192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.552237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.553890 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c9a605a7-981f-484c-ad15-6ffbc073c7e6 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.329044 Aug 24 03:51:23.555290 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2008/3839] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:23 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:23.569222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-cdb85902-237f-4d54-a9bc-7c31d578508b req-a4354aa9-d6e1-4c3d-9887-9a2915eab1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38807978-26d4-4c2b-b052-28f012675e23", "name": "network-vif-unplugged", "status": "completed", "tag": "bd18e940-693e-4c89-a6be-6594e2b035c6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:23.589074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cdb85902-237f-4d54-a9bc-7c31d578508b req-a4354aa9-d6e1-4c3d-9887-9a2915eab1c3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.590990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cdb85902-237f-4d54-a9bc-7c31d578508b req-a4354aa9-d6e1-4c3d-9887-9a2915eab1c3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.592607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cdb85902-237f-4d54-a9bc-7c31d578508b req-a4354aa9-d6e1-4c3d-9887-9a2915eab1c3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.635931 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-cdb85902-237f-4d54-a9bc-7c31d578508b req-a4354aa9-d6e1-4c3d-9887-9a2915eab1c3 service nova] Creating event network-vif-unplugged:bd18e940-693e-4c89-a6be-6594e2b035c6 for instance 38807978-26d4-4c2b-b052-28f012675e23 on n-h2-846470-15 Aug 24 03:51:23.675474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-cdb85902-237f-4d54-a9bc-7c31d578508b req-a4354aa9-d6e1-4c3d-9887-9a2915eab1c3 service nova] Instance 38807978-26d4-4c2b-b052-28f012675e23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:51:23.716150 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-cdb85902-237f-4d54-a9bc-7c31d578508b req-a4354aa9-d6e1-4c3d-9887-9a2915eab1c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157451 Aug 24 03:51:23.720513 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2009/3840] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:23.756433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:23.757718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:23.779606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.780130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.780584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.781304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.781766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.782196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.870547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.888537 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-54bed482-345e-4c41-bf0a-94b135a1bbeb tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1504 microversion: 2.1 time: 1.324036 Aug 24 03:51:23.906915 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1832/3841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:22 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1504 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:23.927366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-dfe05f43-27d0-47a1-8074-27d67ce525fc req-f6f4218d-3560-459a-a2c9-8f6f1fddb3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f10558b-2286-4651-a321-d50e4faec067", "name": "network-vif-plugged", "status": "completed", "tag": "c388bf85-c850-4f66-aa99-5cd6c3e4e434"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:23.956758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dfe05f43-27d0-47a1-8074-27d67ce525fc req-f6f4218d-3560-459a-a2c9-8f6f1fddb3ef service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.958579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dfe05f43-27d0-47a1-8074-27d67ce525fc req-f6f4218d-3560-459a-a2c9-8f6f1fddb3ef service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.959260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dfe05f43-27d0-47a1-8074-27d67ce525fc req-f6f4218d-3560-459a-a2c9-8f6f1fddb3ef service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.970323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:23.995776 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-dfe05f43-27d0-47a1-8074-27d67ce525fc req-f6f4218d-3560-459a-a2c9-8f6f1fddb3ef service nova] Creating event network-vif-plugged:c388bf85-c850-4f66-aa99-5cd6c3e4e434 for instance 9f10558b-2286-4651-a321-d50e4faec067 on n-h1-846470-15 Aug 24 03:51:24.010411 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-dfe05f43-27d0-47a1-8074-27d67ce525fc req-f6f4218d-3560-459a-a2c9-8f6f1fddb3ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101804 Aug 24 03:51:24.011275 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1833/3842] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:24.036894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:24.037837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:24.052188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.053063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.056347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.057843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.058769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.059547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.151041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.161257 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-043fae63-e009-4acf-bdc8-8d7438f89667 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1471 microversion: 2.1 time: 0.437495 Aug 24 03:51:24.163217 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2010/3843] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:23 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:24.243488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:24.244436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:24.253598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.255975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.256616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.260466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.261125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.261735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.372986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.384776 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-464dd3e9-7ca3-4564-b133-7a23b4e5cba2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1270 microversion: 2.1 time: 0.145134 Aug 24 03:51:24.386502 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2011/3844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:24 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:24.579490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:24.580507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:24.603806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.604351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.604687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.605406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.605860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.609548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.738168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.752424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.763838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.766522 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-52ffcc50-75c3-4e9a-82df-c7b6962e379f tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.191621 Aug 24 03:51:24.768300 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2012/3845] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:24 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:24.925986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:24.926910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:24.936455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.941542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.942409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.943712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.944405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.945123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.179217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:25.190625 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab7dfc32-71e8-4aec-b073-cb21821976fe tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1504 microversion: 2.1 time: 0.268809 Aug 24 03:51:25.192206 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2013/3846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:24 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:25.201841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:25.206094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:25.213540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.214335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.214984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.215950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.216608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.217225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.360168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:25.363207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:25.375914 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b83a20ad-1de8-4aaa-9220-7ac8aa1e9a22 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 1.351489 Aug 24 03:51:25.378657 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c4932d70-f759-44c4-8dde-6a8d255962fd tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1471 microversion: 2.1 time: 0.184978 Aug 24 03:51:25.380171 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2014/3847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:25 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:25.389428 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1834/3848] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:24 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:25.409027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:25.409863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:25.420301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.421791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.422444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.425224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.426116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.426645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.538628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:25.557226 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-247d5d18-78e9-4aa0-9936-d01a713f54e7 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1270 microversion: 2.1 time: 0.153792 Aug 24 03:51:25.558216 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2015/3849] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:25 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:25.794293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:25.794915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:25.803328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.803629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.805574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.806531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.809527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.810213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.827091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e1180831-4492-4351-b9a9-4dadf783ce3d req-fe94c338-1cd2-42d9-9a0a-e4fbeb72b895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38807978-26d4-4c2b-b052-28f012675e23", "tag": "bd18e940-693e-4c89-a6be-6594e2b035c6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:25.858032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e1180831-4492-4351-b9a9-4dadf783ce3d req-fe94c338-1cd2-42d9-9a0a-e4fbeb72b895 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.863653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e1180831-4492-4351-b9a9-4dadf783ce3d req-fe94c338-1cd2-42d9-9a0a-e4fbeb72b895 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.865183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e1180831-4492-4351-b9a9-4dadf783ce3d req-fe94c338-1cd2-42d9-9a0a-e4fbeb72b895 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.906186 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e1180831-4492-4351-b9a9-4dadf783ce3d req-fe94c338-1cd2-42d9-9a0a-e4fbeb72b895 service nova] Creating event network-changed:bd18e940-693e-4c89-a6be-6594e2b035c6 for instance 38807978-26d4-4c2b-b052-28f012675e23 on n-h2-846470-15 Aug 24 03:51:25.927030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-e1180831-4492-4351-b9a9-4dadf783ce3d req-fe94c338-1cd2-42d9-9a0a-e4fbeb72b895 service nova] Instance 38807978-26d4-4c2b-b052-28f012675e23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:51:25.950345 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e1180831-4492-4351-b9a9-4dadf783ce3d req-fe94c338-1cd2-42d9-9a0a-e4fbeb72b895 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128129 Aug 24 03:51:25.951448 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2016/3850] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:25.979611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:25.995499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:25.997074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:25.998488 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d3756b3-7e60-4e59-95d8-fd8cbfa7f177 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.209790 Aug 24 03:51:25.999057 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1835/3851] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:25 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:26.214337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:26.216520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:26.238016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.239043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.239731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.240671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.241342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.242363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.291084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.291812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.292496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.293301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lazy-loading 'fault' on Instance uuid e20c0245-4056-4646-ac81-3b08c48df7ca {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:51:26.364562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb548a6ac054536bbd204c643da70e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83990eded145b1b14abe95175a14bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.377275 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42c2dce7-8422-4ef9-a64b-43113a5a29f2 tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 200 len: 1304 microversion: 2.1 time: 0.167349 Aug 24 03:51:26.392524 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2017/3852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:26 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:26.396623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:26.397242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:26.406644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.407716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:26.408379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:26.410478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.412072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.413086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.413779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.414436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.423454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.424040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.424492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.425240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.425825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.426280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.766456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.778838 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da939782-8c85-4d4a-893c-b77abf70d6d2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1471 microversion: 2.1 time: 0.376297 Aug 24 03:51:26.780181 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2018/3853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:26 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:26.785138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:26.785982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:26.794386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.797387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.798177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.799033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.799709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.800362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.093300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:27.103803 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b7be86ca-429b-4b46-a341-3421d746534e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1329 microversion: 2.1 time: 0.710801 Aug 24 03:51:27.119022 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1836/3854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:26 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1329 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:27.138941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:27.144789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:27.164120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.164762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.168458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.177690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.178915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.179859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.204054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:27.209281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:27.227205 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c07769a-1acc-40ac-ad4c-20894ce5d97b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.445239 Aug 24 03:51:27.229274 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2019/3855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:26 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:27.323029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:27.354661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:27.359701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:27.363847 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2543686d-c2fa-4b3c-8484-f59b31e14da8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.242891 Aug 24 03:51:27.373327 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1837/3856] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:27 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:27.400239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:27.401355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] [instance: e20c0245-4056-4646-ac81-3b08c48df7ca] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:27.417503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.418252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.418712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.420932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.421524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.421978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.443909 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] HTTP exception thrown: Instance e20c0245-4056-4646-ac81-3b08c48df7ca could not be found. Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Request method failure captured: Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca HTTP/1.1 Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaAcODE1eH19QpHMDCcEs7tsRSNDC_lBbfp3XktKPK2nIgv9nDWXnkni1rnjpfjITdKP-0UtC3RBxPHH_0acpADXYPzAaEcAtsB9cNC5NxxOCdJtsrEcM6Zi8TGs5_KRbOzXttovGiOjCyjilxPVvQxki79mNg9g23hun3q0C0UHeKg Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 8b83990eded145b1b14abe95175a14bb Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesActionsTest-1350625231 Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b83990eded145b1b14abe95175a14bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b83990eded145b1b14abe95175a14bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b83990eded145b1b14abe95175a14bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b83990eded145b1b14abe95175a14bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesActionsTest-1350625231 Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 8b83990eded145b1b14abe95175a14bb Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesActionsTest-1350625231 Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesActionsTest-1350625231-project Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: bcb548a6ac054536bbd204c643da70e7 Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesActionsTest-1350625231-project Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance e20c0245-4056-4646-ac81-3b08c48df7ca could not be found. Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'e20c0245-4056-4646-ac81-3b08c48df7ca'} Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e20c0245-4056-4646-ac81-3b08c48df7ca could not be found. Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e20c0245-4056-4646-ac81-3b08c48df7ca could not be found. Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:27.446120 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:27.450479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:27.450479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:27.450479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:27.450479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:51:27.450479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:51:27.450479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e20c0245-4056-4646-ac81-3b08c48df7ca could not be found. Aug 24 03:51:27.450479 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:27.452482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] Returning 404 to user: Instance e20c0245-4056-4646-ac81-3b08c48df7ca could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:51:27.453823 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9079c5b5-2f37-4c67-b472-d0784d0a4f0c tempest-VolumesActionsTest-1350625231 tempest-VolumesActionsTest-1350625231-project] 10.222.0.58 "GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca" status: 404 len: 111 microversion: 2.1 time: 0.058132 Aug 24 03:51:27.455069 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2020/3857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:27 2022] GET /compute/v2.1/servers/e20c0245-4056-4646-ac81-3b08c48df7ca => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:27.805313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:27.807000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:27.836627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.837349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.838034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.839145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.839908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.840578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.998548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-348eb85c-c1e6-4128-a66c-af8d37a8ce61 req-cb96aa79-3b98-420e-a548-05a6e3511470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e20c0245-4056-4646-ac81-3b08c48df7ca", "name": "network-vif-deleted", "tag": "39d9e272-c057-44cb-8495-a1379871ec58"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:28.033389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-348eb85c-c1e6-4128-a66c-af8d37a8ce61 req-cb96aa79-3b98-420e-a548-05a6e3511470 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.044846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-348eb85c-c1e6-4128-a66c-af8d37a8ce61 req-cb96aa79-3b98-420e-a548-05a6e3511470 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.045564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-348eb85c-c1e6-4128-a66c-af8d37a8ce61 req-cb96aa79-3b98-420e-a548-05a6e3511470 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.092749 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-348eb85c-c1e6-4128-a66c-af8d37a8ce61 req-cb96aa79-3b98-420e-a548-05a6e3511470 service nova] Creating event network-vif-deleted:39d9e272-c057-44cb-8495-a1379871ec58 for instance e20c0245-4056-4646-ac81-3b08c48df7ca on n-h2-846470-15 Aug 24 03:51:28.109623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-348eb85c-c1e6-4128-a66c-af8d37a8ce61 req-cb96aa79-3b98-420e-a548-05a6e3511470 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116703 Aug 24 03:51:28.114511 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2021/3858] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:28.131028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:28.135208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:28.145841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.146336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.146780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.147657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.148280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.148706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.395611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.416671 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f3bbfa8b-2758-4dc4-989e-8a1fb38ddcd3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1469 microversion: 2.1 time: 0.617602 Aug 24 03:51:28.427743 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1838/3859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:27 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1469 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:28.445204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:28.445868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:28.446305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.458777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:28.460822 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7980ecdf-6146-4d88-a349-52a36714480c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1510 microversion: 2.1 time: 0.337553 Aug 24 03:51:28.461985 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2022/3860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:28 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1510 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:28.476566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:28.477230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:28.484282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.485015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.485596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.486549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.486915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.487426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.487901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.488262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.488622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.489132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.489417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.489548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.550357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=32 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:28.629765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.644251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.645969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.651658 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cf3c8911-074b-4a31-a024-f696ff41d27b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.181024 Aug 24 03:51:28.656235 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2023/3861] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:28 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:28.667864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:28.668484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:28.679228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.679760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.680195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.684408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.685085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.685713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.802683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.816085 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69e147b2-a35d-4e81-83e1-4ccea05e0af8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.386837 Aug 24 03:51:28.827869 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1839/3862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:28 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:29.055856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.086247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-84c17bd8-78d1-4d04-8583-09a51c0236f5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1510 microversion: 2.1 time: 0.428637 Aug 24 03:51:29.099705 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2024/3863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:28 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1510 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:29.109890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.110513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.135983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.136796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.137384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.138332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.138990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.139797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.188578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:51:29.325606 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b0145c9-c1a2-462f-860b-06ac6d3204c6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 204 len: 0 microversion: 2.1 time: 0.220169 Aug 24 03:51:29.343789 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1840/3864] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:51:29 2022] DELETE /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:29.352847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.353529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.365980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.366489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.366926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.368328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.368993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.369423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.452854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.453892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.468423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.468928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.472391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.473614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.474012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.474575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.579057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.588787 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec84274e-f2dc-429f-9095-6820532ae2a7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1516 microversion: 2.1 time: 0.240587 Aug 24 03:51:29.589502 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2025/3865] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1516 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:29.691779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.693213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.701276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.701977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.702633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.703723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.704447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.704983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.785615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.798277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.800955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.803133 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-387095aa-8c0e-475c-90db-02a56090bd91 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.116072 Aug 24 03:51:29.803778 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2026/3866] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:29.849617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.851146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.867904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.868491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.869090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.869933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.871213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.872835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.911717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.924528 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-275f7a05-b11b-44c9-be45-c632c1d71b52 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1469 microversion: 2.1 time: 0.477776 Aug 24 03:51:29.925553 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1841/3867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1469 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:29.942149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:30.067341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:30.076860 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42f092e8-d46f-4405-b80e-209bc70bfd4d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.235185 Aug 24 03:51:30.077787 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2027/3868] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:30.156882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-df1d1dd7-11f9-450a-8d98-81c2c6204660 req-eca87f0f-f0bf-488e-80bf-4244abf4775e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0665005-cf59-492e-b7b5-74cef8a5358d", "tag": "7f5c8a2b-637d-4f62-a363-1dabe6db93c2"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:30.167183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-df1d1dd7-11f9-450a-8d98-81c2c6204660 req-eca87f0f-f0bf-488e-80bf-4244abf4775e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.167811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-df1d1dd7-11f9-450a-8d98-81c2c6204660 req-eca87f0f-f0bf-488e-80bf-4244abf4775e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.168535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-df1d1dd7-11f9-450a-8d98-81c2c6204660 req-eca87f0f-f0bf-488e-80bf-4244abf4775e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.197675 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-df1d1dd7-11f9-450a-8d98-81c2c6204660 req-eca87f0f-f0bf-488e-80bf-4244abf4775e service nova] Creating event network-changed:7f5c8a2b-637d-4f62-a363-1dabe6db93c2 for instance b0665005-cf59-492e-b7b5-74cef8a5358d on n-h2-846470-15 Aug 24 03:51:30.205084 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-df1d1dd7-11f9-450a-8d98-81c2c6204660 req-eca87f0f-f0bf-488e-80bf-4244abf4775e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054065 Aug 24 03:51:30.206373 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1842/3869] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:30.616267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:30.617550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:30.623730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=32 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:30.626166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.626852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.627425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.628502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.629295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.631095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.804924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:30.815127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2d87744c-5b8c-4597-aa5b-40ccd1ef352e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1516 microversion: 2.1 time: 0.202878 Aug 24 03:51:30.828161 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2028/3870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:30 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:30.845609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:30.846689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:30.896623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.897456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.901055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.904793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.907826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.908872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.956196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:30.957064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:30.976539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.978743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.982659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.983351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.983997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.984580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.994322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:31.005568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:31.008950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:31.010516 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07f8172a-6a34-4181-a11d-7be09b4b5ba3 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.181890 Aug 24 03:51:31.012349 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1843/3871] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:30 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:31.099249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:31.100057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:31.112898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.117515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.118538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.123256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.124242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.129168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.340904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:31.363491 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c1bc13e-0222-4851-b54b-1d5369b8d7f3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1469 microversion: 2.1 time: 0.412664 Aug 24 03:51:31.384234 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2029/3872] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:30 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1469 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:31.563536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:31.576478 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7b022aa7-ac9a-46f0-b23f-62f04e987621 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.481694 Aug 24 03:51:31.589935 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1844/3873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:31 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:31.842110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:31.843465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:31.858319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.861151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.863432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.865761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.867576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.871659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.024414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.038429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:32.039130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:32.052414 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d75a016-2aac-4681-991e-b716b59fbdbe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1474 microversion: 2.1 time: 0.216296 Aug 24 03:51:32.055069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.060163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.060351 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2030/3874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:31 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:32.060952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.061845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.070882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.086326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.338134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.355495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.357867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.359517 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ab256d1-6ed8-413f-8edd-0df75054a8b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1408 microversion: 2.54 time: 0.326489 Aug 24 03:51:32.376488 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1845/3875] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:32 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:32.413664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:32.414288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:32.428717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4480a961-fa62-4fe5-862c-1bd5a69b90b8 req-567812c3-3710-4530-87e4-454f891555cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f10558b-2286-4651-a321-d50e4faec067", "name": "network-vif-deleted", "tag": "c388bf85-c850-4f66-aa99-5cd6c3e4e434"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:32.456146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.456892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.457765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.458793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.460792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.464910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.507711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4480a961-fa62-4fe5-862c-1bd5a69b90b8 req-567812c3-3710-4530-87e4-454f891555cc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.514504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4480a961-fa62-4fe5-862c-1bd5a69b90b8 req-567812c3-3710-4530-87e4-454f891555cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.518954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4480a961-fa62-4fe5-862c-1bd5a69b90b8 req-567812c3-3710-4530-87e4-454f891555cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.555247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4480a961-fa62-4fe5-862c-1bd5a69b90b8 req-567812c3-3710-4530-87e4-454f891555cc service nova] Creating event network-vif-deleted:c388bf85-c850-4f66-aa99-5cd6c3e4e434 for instance 9f10558b-2286-4651-a321-d50e4faec067 on n-h1-846470-15 Aug 24 03:51:32.568252 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4480a961-fa62-4fe5-862c-1bd5a69b90b8 req-567812c3-3710-4530-87e4-454f891555cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145899 Aug 24 03:51:32.573192 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1846/3876] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:32.606573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:32.607411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:32.623790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.624290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.632835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.642357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.652238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.659848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.767096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.779080 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd63733c-ec45-4ff1-81df-419ecf3ac5b8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1469 microversion: 2.1 time: 0.388585 Aug 24 03:51:32.781616 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2031/3877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:32 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:32.996950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.009964 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19964e0f-f83b-4144-ab68-c340bacffc01 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.411132 Aug 24 03:51:33.011166 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1847/3878] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:32 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:33.082234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:33.083904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:33.105997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.108005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.110000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.111133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.111925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.112609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.241769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.243335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.246962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.248092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lazy-loading 'fault' on Instance uuid 9f10558b-2286-4651-a321-d50e4faec067 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:51:33.385344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.391984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:33.392540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:33.403971 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6180f164-3976-48ef-946d-6ab6129b65dd tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 200 len: 1319 microversion: 2.1 time: 0.326698 Aug 24 03:51:33.410755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.411445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.412151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.414278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.414757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.415189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.417034 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2032/3879] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:33 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:33.806357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:33.807117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:33.828625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.831489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.831982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.835697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.837407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.838126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.851783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.875751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.877988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.879654 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e85d5bc7-6c13-4304-a18f-59d3f3d3b431 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1414 microversion: 2.54 time: 0.492593 Aug 24 03:51:33.880604 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1848/3880] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:33 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1414 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:34.035360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:34.036209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:34.052175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.053024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.053839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.054703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.055308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.055903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.240832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:34.254578 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a31e9e98-c778-41d6-b5a7-d90e070eccf0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1466 microversion: 2.1 time: 0.453686 Aug 24 03:51:34.258906 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2033/3881] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:33 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1466 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:34.289465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:34.290148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:34.306183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.307085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.309141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.313273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.314203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.318665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.471477 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eccb47e9-0440-4f36-84e4-6c9ce4a87803 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23/action" status: 204 len: 0 microversion: 2.1 time: 0.187505 Aug 24 03:51:34.475748 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2034/3882] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:51:34 2022] POST /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23/action => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:51:34.522652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:34.526979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:34.542687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.547413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.548001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.548857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.549415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.555877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.588574 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 HTTP/1.1 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9f10558b-2286-4651-a321-d50e4faec067'} Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:34.597045 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:34.600620 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:34.600620 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:34.600620 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:34.600620 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:51:34.600620 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:51:34.600620 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:51:34.600620 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:34.603450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:51:34.604682 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c85a4b0c-85e8-4876-8019-859dc54a594c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 404 len: 111 microversion: 2.1 time: 0.096937 Aug 24 03:51:34.612944 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2035/3883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:34 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:34.618299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:34.623795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:34.640351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.641232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.642435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.644587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.651062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.651815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.965281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:34.980477 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff3b4190-2d2e-444a-90b5-a273162f53a2 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.949052 Aug 24 03:51:34.981312 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1849/3884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:34 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:35.010335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7113bb68-0e97-4bb8-aabf-35b363a6e2b8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '.version_select at 0x7f103433ac10>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:35.087682 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7113bb68-0e97-4bb8-aabf-35b363a6e2b8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-key-1370898899" status: 202 len: 0 microversion: 2.1 time: 0.105511 Aug 24 03:51:35.101306 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1850/3885] 10.222.0.58 () {58 vars in 1209 bytes} [Wed Aug 24 03:51:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1370898899 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:51:35.103146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.111058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-12a3b096-7851-4d5a-82c8-83c675192b66 req-beffc446-c108-482e-ba7e-32288edceaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38807978-26d4-4c2b-b052-28f012675e23", "name": "network-vif-plugged", "status": "completed", "tag": "bd18e940-693e-4c89-a6be-6594e2b035c6"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:35.135441 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc6f56e9-6f18-475f-814b-827f1aa400ae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1466 microversion: 2.1 time: 0.520918 Aug 24 03:51:35.150866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-12a3b096-7851-4d5a-82c8-83c675192b66 req-beffc446-c108-482e-ba7e-32288edceaf4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.151580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-12a3b096-7851-4d5a-82c8-83c675192b66 req-beffc446-c108-482e-ba7e-32288edceaf4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.152230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-12a3b096-7851-4d5a-82c8-83c675192b66 req-beffc446-c108-482e-ba7e-32288edceaf4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.160063 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2036/3886] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:34 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1466 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:35.166517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:35.170254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:35.175461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:35.192070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.192816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.194440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.198132 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-12a3b096-7851-4d5a-82c8-83c675192b66 req-beffc446-c108-482e-ba7e-32288edceaf4 service nova] Creating event network-vif-plugged:bd18e940-693e-4c89-a6be-6594e2b035c6 for instance 38807978-26d4-4c2b-b052-28f012675e23 on n-h2-846470-15 Aug 24 03:51:35.199350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.200645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.201443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.213666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:35.225132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-12a3b096-7851-4d5a-82c8-83c675192b66 req-beffc446-c108-482e-ba7e-32288edceaf4 service nova] Instance 38807978-26d4-4c2b-b052-28f012675e23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:51:35.288931 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-12a3b096-7851-4d5a-82c8-83c675192b66 req-beffc446-c108-482e-ba7e-32288edceaf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185993 Aug 24 03:51:35.289460 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1851/3887] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:35.342153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1055992831", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a410578b-d916-4218-bf01-482ee8be19b3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:35.468905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.496602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.517557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.527372 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b85680b-778a-46a7-a666-1b8589762d3a tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1414 microversion: 2.54 time: 0.361291 Aug 24 03:51:35.547187 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2037/3888] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:35 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1414 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:35.571953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] validate_networks() for [('a410578b-d916-4218-bf01-482ee8be19b3', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:36.031482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.032227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.042649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.043155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.043626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.044338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.044787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.045214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.413309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.422191 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b76d2f2-7007-4119-b659-9c409ee0734b tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.399771 Aug 24 03:51:36.423174 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2038/3889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:36.432387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.433229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.440019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.440696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.441323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.442564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.443184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.443805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.589928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:36.590463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:36.590571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:36.594343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:36.595007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:36.613351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.614326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.615022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.616496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.617547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.618141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.639648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.652871 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-409f846a-e420-4d47-be12-8b31c0c27693 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1466 microversion: 2.1 time: 0.228425 Aug 24 03:51:36.653644 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2039/3890] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1466 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:36.661670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:36.669095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:36.670489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.671326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.698855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:36.704725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:36.711104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.711938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.712594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.713572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.720549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.737594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.790246 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be6a4422-2dd8-4363-a609-9ff05ae47c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.455746 Aug 24 03:51:36.798695 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1852/3891] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:51:36.813246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-855329ea-22c3-49e3-8832-339bfa5211f3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.821214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-855329ea-22c3-49e3-8832-339bfa5211f3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.934218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.991961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.017054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.021443 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-acd9561f-b72e-47aa-9617-e46ca13ff51b tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1414 microversion: 2.54 time: 0.366082 Aug 24 03:51:37.022468 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2040/3892] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1414 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:37.340291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-855329ea-22c3-49e3-8832-339bfa5211f3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.349351 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-855329ea-22c3-49e3-8832-339bfa5211f3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1209 microversion: 2.1 time: 0.549093 Aug 24 03:51:37.352448 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1853/3893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1209 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:37.472975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:37.476405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:37.493991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.494524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.495031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.495871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.496325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.497262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.675927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:37.676624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:37.695989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.696500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.696943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.697675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.707996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.708458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.812933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.829091 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b1766f2-9026-4e4f-b2e8-d44323ec6b40 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.375330 Aug 24 03:51:37.830830 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2041/3894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:37 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:38.004111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:38.013553 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4f1beae7-a84b-45c2-9630-b9059a954c09 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1458 microversion: 2.1 time: 0.342079 Aug 24 03:51:38.014715 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1854/3895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:37 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1458 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:38.041916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:38.042864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:38.056283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.057107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.058527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.060042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.060732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.061634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.066691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:38.067655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:38.079810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.085653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.086499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.087349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.087929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.088671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.236792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:38.256133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:38.260936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:38.263471 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ab07fef-ca5d-464e-ab60-303413dd28ec tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1414 microversion: 2.54 time: 0.202548 Aug 24 03:51:38.264336 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1855/3896] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:38 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1414 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:38.328565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:38.340393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f64b4cf7-7f6b-431e-b34c-af101ce3572c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1458 microversion: 2.1 time: 0.307032 Aug 24 03:51:38.340987 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2042/3897] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:38 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1458 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:38.371278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d9994662-9fe6-431f-9a0c-f3705f675b27 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'create', calling method: .version_select at 0x7f102a16ea60>, body: {"keypair": {"name": "tempest-keypair-1898131552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvXDR9YyQBbVJzD97WAG5XZ3/WLHo2BPYsjot7PsbGzT1oUj95q2ZTXAp8NTC3KVB5t/0u7Gt7HsJ7INAndoNPUVd3o5JH/MLB6wTP7yCGsgGXSiNz1OGg9pATMha5mxg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:38.376691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:38.388258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:38.411486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.417408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.418249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.423984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.424636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.427150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d9994662-9fe6-431f-9a0c-f3705f675b27 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:38.427903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.439919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d9994662-9fe6-431f-9a0c-f3705f675b27 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for user 1121b62203674b82ae3c7cfcb3112eb5 and project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:38.504100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d9994662-9fe6-431f-9a0c-f3705f675b27 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137086 Aug 24 03:51:38.507127 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1856/3898] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:51:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:38.623752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:38.647480 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ae9a3b0-6943-4b4c-abac-88d9c6ae6206 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1261 microversion: 2.1 time: 0.274518 Aug 24 03:51:38.662490 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2043/3899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:38 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1261 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:38.853514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:38.854400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:38.870129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.875443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.876077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.881255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.882286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.882975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.287018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:39.287799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:39.294592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.304099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.304694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.305527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.306075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.306754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.403314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:39.417602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:39.419796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:39.422421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cfb2d2f5-5237-4e60-ad83-7738cb03fb7c tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1399 microversion: 2.54 time: 0.139369 Aug 24 03:51:39.455076 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2044/3900] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:39 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1399 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:39.470717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b92fe1b3-b547-4ead-bd86-1b22ce2c1bde tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '.version_select at 0x7f102273ddc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:39.527300 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b92fe1b3-b547-4ead-bd86-1b22ce2c1bde tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1503823622" status: 204 len: 0 microversion: 2.54 time: 0.070334 Aug 24 03:51:39.535379 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2045/3901] 10.222.0.58 () {60 vars in 1319 bytes} [Wed Aug 24 03:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1503823622 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:51:39.556384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:39.557047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:39.572668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.577602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.578644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.580041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.582798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.585100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.611332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:39.632712 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9abcc8be-43ed-417e-8afc-3e030809275d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.785923 Aug 24 03:51:39.634213 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1857/3902] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:38 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:39.670847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:39.671872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:39.672935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:51:39.689617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.692100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.692704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.695330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.698027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.699805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.862743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:39.901074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:39.907223 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de099937-9da4-450e-bcdd-6fa016cc93b8 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 204 len: 0 microversion: 2.54 time: 0.361315 Aug 24 03:51:39.912662 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2046/3903] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:51:39 2022] DELETE /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:51:39.915035 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1cc6be75-bc13-42d6-a5b3-017e960bdd71 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1267 microversion: 2.1 time: 0.249744 Aug 24 03:51:39.931609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:39.932791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:39.950396 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1858/3904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:39 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1267 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:39.950501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.950501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.950501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.950501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.950858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.951827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.110600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:40.126291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:40.130576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:40.135611 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7fc8fca7-6d02-4e4e-ac1c-4f306527dcf2 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1405 microversion: 2.54 time: 0.216767 Aug 24 03:51:40.153862 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2047/3905] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:39 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:40.678962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:40.681796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:40.702269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.705681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.706658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.709097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.710086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.710668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.960506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:40.961130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:40.978207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.978949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.979575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.980962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.981714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.982339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.059215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.073239 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-39fcff04-9e0c-447f-b4cd-e0e7ef135137 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1267 microversion: 2.1 time: 0.119035 Aug 24 03:51:41.088663 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2048/3906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:40 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:41.103579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.117290 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7330b174-7710-4605-bac9-b655db1e837f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.445698 Aug 24 03:51:41.121671 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1859/3907] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:40 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:41.160416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:41.160992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:41.179383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.179971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.180408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.181119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.181571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.181995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.460665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.498113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.503712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.521130 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4340cf4a-9442-4ea0-b981-04bfb5e1b27e tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1405 microversion: 2.54 time: 0.364195 Aug 24 03:51:41.539942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2049/3908] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:41 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1405 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:42.099393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:42.100488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:42.142886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.144286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.144605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:42.145871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.146884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:42.149265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.151590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.152056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.176505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.177459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.178257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.179447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.180281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.181007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.776211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:42.789820 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ec97138-00ae-4876-bd90-f5d571a53d54 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.650535 Aug 24 03:51:42.793034 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2050/3909] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:42 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:42.804948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:42.805808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:42.835274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.839429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.840682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.846383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.850025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.851572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.974921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:42.990871 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-95b3e100-ede7-4ea6-8154-166b18254228 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1309 microversion: 2.1 time: 0.895547 Aug 24 03:51:42.993629 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1860/3910] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:42 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1309 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:43.001224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:43.024759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:43.032937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:43.036885 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e6163502-20d9-435a-aa75-cb36241b6b05 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1405 microversion: 2.54 time: 0.242551 Aug 24 03:51:43.048962 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2051/3911] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:42 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:43.622129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c59f80b4-49f1-4f43-a45b-dbc5c65ebcad tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '.version_select at 0x7f10306621f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:43.626320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59f80b4-49f1-4f43-a45b-dbc5c65ebcad tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.627050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59f80b4-49f1-4f43-a45b-dbc5c65ebcad tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.627493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59f80b4-49f1-4f43-a45b-dbc5c65ebcad tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.649962 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c59f80b4-49f1-4f43-a45b-dbc5c65ebcad tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.031317 Aug 24 03:51:43.664288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1861/3912] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 03:51:43 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:43.679078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2bcbaf23-850b-43a1-8f37-bebfb2996e83 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:43.708734 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2bcbaf23-850b-43a1-8f37-bebfb2996e83 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034472 Aug 24 03:51:43.709569 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2052/3913] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:51:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:43.726726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c123aae6-2540-481b-9d6a-e680969b2b90 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-531410977", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:43.730063 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:51:43.730063 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 03:51:43.788194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c123aae6-2540-481b-9d6a-e680969b2b90 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.066493 Aug 24 03:51:43.804168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10557722-02f3-4f9d-894a-b5f37e4baedc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:43.814794 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1862/3914] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Aug 24 03:51:43 2022] POST /compute/v2.1/flavors => generated 498 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:43.844198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:43.845683 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10557722-02f3-4f9d-894a-b5f37e4baedc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048195 Aug 24 03:51:43.847451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:43.848509 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2053/3915] 10.222.0.58 () {58 vars in 1182 bytes} [Wed Aug 24 03:51:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:51:43.876119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.877959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.878667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.879931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.880657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.882387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.016040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:44.017845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:44.027225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.028251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.029168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.030768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.031626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.032563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.280760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:44.298564 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2bbbe9fd-a17a-405a-b2c9-65e0a87e7048 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.479483 Aug 24 03:51:44.301572 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1863/3916] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:43 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:44.315991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:44.321282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:44.349004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.350587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.351606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.352910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.353652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.354291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.359078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:44.372702 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0fe03502-bbeb-4af5-9cfc-7b27d027f55f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1309 microversion: 2.1 time: 0.359928 Aug 24 03:51:44.374694 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2054/3917] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:44 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:44.395636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1882519232", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "694c06e3-b99c-4e11-b580-57e90d157d66"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:44.476111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:44.512030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:44.522822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:44.524434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dcdaa5009344d278f511ca86ad92544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99563c767324b068449d745a498ede8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:44.525858 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3598ead3-2317-4c16-872c-6695c591f002 tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 200 len: 1405 microversion: 2.54 time: 0.223113 Aug 24 03:51:44.532025 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1864/3918] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:44 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:44.633542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b2bc6b7b-3ca3-4731-b8b5-a316d0d0ff91 req-c3200655-3e9a-4aef-8915-aa0bddcddb06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403e03d6-8c32-43df-9a20-f60f17b9c259", "tag": "677c8622-c5ef-4831-823e-72895d221bf3"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:44.659909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b2bc6b7b-3ca3-4731-b8b5-a316d0d0ff91 req-c3200655-3e9a-4aef-8915-aa0bddcddb06 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.660895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b2bc6b7b-3ca3-4731-b8b5-a316d0d0ff91 req-c3200655-3e9a-4aef-8915-aa0bddcddb06 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.661512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b2bc6b7b-3ca3-4731-b8b5-a316d0d0ff91 req-c3200655-3e9a-4aef-8915-aa0bddcddb06 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.682009 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b2bc6b7b-3ca3-4731-b8b5-a316d0d0ff91 req-c3200655-3e9a-4aef-8915-aa0bddcddb06 service nova] Creating event network-changed:677c8622-c5ef-4831-823e-72895d221bf3 for instance 403e03d6-8c32-43df-9a20-f60f17b9c259 on n-h1-846470-15 Aug 24 03:51:44.697553 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b2bc6b7b-3ca3-4731-b8b5-a316d0d0ff91 req-c3200655-3e9a-4aef-8915-aa0bddcddb06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069148 Aug 24 03:51:44.698269 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1865/3919] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:44.817606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:44.818158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:44.819255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:44.820029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:44.820595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:44.835109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.835609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.836093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.836998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.837733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.838319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.850897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:44.866452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:44.878692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for user 1121b62203674b82ae3c7cfcb3112eb5 and project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:44.897204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:44.900732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:44.969565 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6becda8f-44bd-489b-9462-d573fc821204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592474 Aug 24 03:51:44.970542 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2055/3920] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:51:44.982443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f93331d-c7ee-4947-814c-bd3a10fad7ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:44.983332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f93331d-c7ee-4947-814c-bd3a10fad7ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:45.077870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f93331d-c7ee-4947-814c-bd3a10fad7ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.089347 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f93331d-c7ee-4947-814c-bd3a10fad7ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1279 microversion: 2.1 time: 0.111638 Aug 24 03:51:45.091048 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1866/3921] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:44 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:45.325125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:45.325939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:45.335093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.348479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.349145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.352381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.352875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.353867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.400399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:45.401025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:45.420723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.421237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.421687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.422402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.422868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.423296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.640356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.649580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-543e0592-6e04-4175-8de9-a130a470d3d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.329511 Aug 24 03:51:45.664219 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2056/3922] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:45 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:45.664219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:45.664219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] [instance: 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:45.676179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.676679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.677128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.688938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.692961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.693526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.720246 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] HTTP exception thrown: Instance 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 could not be found. Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Request method failure captured: Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 HTTP/1.1 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaAbrdFAClPWJA9z4Uv0vRgiYbulr95Btsui7HeP4gh4eJRXruQXecLLot9aci3BwmvbO9ICGxnnW-VgeEyxkN8AjowepLtNYWQ6_mnxbgJUQUxZ7mShMCt9lgww1s-vZ24QDO2cbag4DYafERKD6X3RoerPx5CknQCXKdlARhAjT_I Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.54 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c99563c767324b068449d745a498ede8 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerShowV254Test-2048392536 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c99563c767324b068449d745a498ede8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c99563c767324b068449d745a498ede8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c99563c767324b068449d745a498ede8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c99563c767324b068449d745a498ede8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerShowV254Test-2048392536 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c99563c767324b068449d745a498ede8 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerShowV254Test-2048392536 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerShowV254Test-2048392536-project Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5dcdaa5009344d278f511ca86ad92544 Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerShowV254Test-2048392536-project Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 could not be found. Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7'} Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 could not be found. Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 could not be found. Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:45.721941 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 could not be found. Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] Returning 404 to user: Instance 9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:51:45.725766 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc5adba4-54ab-4d56-b4f6-0ff54c9cffab tempest-ServerShowV254Test-2048392536 tempest-ServerShowV254Test-2048392536-project] 10.222.0.58 "GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7" status: 404 len: 111 microversion: 2.54 time: 0.069845 Aug 24 03:51:45.728944 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2057/3923] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:45 2022] GET /compute/v2.1/servers/9bfc5d80-dd47-4e9e-8a55-b6ec1c1438d7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:51:46.110644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:46.112127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:46.121118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.121981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.122669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.123618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.124351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.125001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.238707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:46.260576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:46.270688 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c17a8413-43d1-4ea3-b0f3-7d1324393277 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1309 microversion: 2.1 time: 0.870019 Aug 24 03:51:46.272656 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bbd41a5e-ef36-4099-baa9-7baca6405f7f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1331 microversion: 2.1 time: 0.165839 Aug 24 03:51:46.273839 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1867/3924] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:45 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1309 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:46.277467 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2058/3925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:46 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:46.433586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6bc85d00-04b4-4dd1-98a8-8a6bf43dc299 req-ccf7fe16-d124-4c25-ab94-bcd2bcc73219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0665005-cf59-492e-b7b5-74cef8a5358d", "name": "network-vif-plugged", "status": "completed", "tag": "7f5c8a2b-637d-4f62-a363-1dabe6db93c2"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:46.455326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6bc85d00-04b4-4dd1-98a8-8a6bf43dc299 req-ccf7fe16-d124-4c25-ab94-bcd2bcc73219 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.455847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6bc85d00-04b4-4dd1-98a8-8a6bf43dc299 req-ccf7fe16-d124-4c25-ab94-bcd2bcc73219 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.459058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6bc85d00-04b4-4dd1-98a8-8a6bf43dc299 req-ccf7fe16-d124-4c25-ab94-bcd2bcc73219 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.500057 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6bc85d00-04b4-4dd1-98a8-8a6bf43dc299 req-ccf7fe16-d124-4c25-ab94-bcd2bcc73219 service nova] Creating event network-vif-plugged:7f5c8a2b-637d-4f62-a363-1dabe6db93c2 for instance b0665005-cf59-492e-b7b5-74cef8a5358d on n-h2-846470-15 Aug 24 03:51:46.513978 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6bc85d00-04b4-4dd1-98a8-8a6bf43dc299 req-ccf7fe16-d124-4c25-ab94-bcd2bcc73219 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086822 Aug 24 03:51:46.515179 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1868/3926] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:46.673949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:46.674801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:46.688652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.689156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.689600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.693771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.694478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.694928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.192115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:47.202050 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74a29836-96ef-45ce-b5fa-fb83cd357186 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.532393 Aug 24 03:51:47.208747 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2059/3927] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:46 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:47.291627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:47.299565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:47.305790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:47.313909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:47.316617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:47.323093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.324204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.324883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.328682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.329439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.330087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.333057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.337476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.340175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.341157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.341828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.342466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.493627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:47.517220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70a4a86d-594d-4325-b58c-132ddcc1c0c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1337 microversion: 2.1 time: 0.222542 Aug 24 03:51:47.517928 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2060/3928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:47 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1337 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:47.736154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:47.761382 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e323720-d9f9-4707-9bb9-059f0389c150 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1309 microversion: 2.1 time: 0.470447 Aug 24 03:51:47.772404 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1869/3929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:47 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1309 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:48.230000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:48.231020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:48.242133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.246469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.247087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.253470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.254546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.255012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.542932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:48.543551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:48.558726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.560152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.562333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.564030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.568852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.569874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.706383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:48.722615 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a01c73fc-eab8-44d1-9101-3be98151b1e8 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1312 microversion: 2.1 time: 0.496670 Aug 24 03:51:48.729927 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2061/3930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:48 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:48.786813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:48.788500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:48.804898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.805817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.808862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.810104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.812659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.813499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.311117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:49.336170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-560625f2-6edf-4658-98b9-65d549cc827e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1309 microversion: 2.1 time: 0.554558 Aug 24 03:51:49.348979 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2062/3931] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:48 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1309 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:49.758278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:49.759210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:49.775965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.776983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.777886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.779446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.780166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.784428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.799929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:49.815697 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-59da926d-3e98-4775-9829-3dc7bb39c2fe tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 1.276906 Aug 24 03:51:49.816307 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1870/3932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:48 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:50.041757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:50.054571 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-233e7888-7261-4c7b-a3db-df25da1439d6 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1497 microversion: 2.1 time: 0.307910 Aug 24 03:51:50.056108 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2063/3933] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:49 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1497 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:50.082180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a0b71a5-ddb8-479f-a8a1-6139a580f9da tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:50.089199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:50.122686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.server_groups [None req-1a0b71a5-ddb8-479f-a8a1-6139a580f9da tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Querying cell a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) for 1 instances {{(pid=122535) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 03:51:50.123780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0b71a5-ddb8-479f-a8a1-6139a580f9da tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.126254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0b71a5-ddb8-479f-a8a1-6139a580f9da tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.127441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0b71a5-ddb8-479f-a8a1-6139a580f9da tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.203769 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a0b71a5-ddb8-479f-a8a1-6139a580f9da tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/015c8695-d4c8-4594-b7f6-61493a5dd3fc" status: 200 len: 221 microversion: 2.1 time: 0.125387 Aug 24 03:51:50.204398 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1871/3934] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:51:50 2022] GET /compute/v2.1/os-server-groups/015c8695-d4c8-4594-b7f6-61493a5dd3fc => generated 221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:50.215524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:50.216749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:50.224627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.235486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.238846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.243466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.244247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.244917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.310460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:51:50.365375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:50.366796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:50.393139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.394074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.396766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.400749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.404440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.414838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.679984 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7622f2c-d7ca-43d3-bb03-7797780dff9d tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 204 len: 0 microversion: 2.1 time: 0.467011 Aug 24 03:51:50.684788 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2064/3935] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:51:50 2022] DELETE /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:50.697979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:50.699446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:50.719013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.719659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.720146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.721013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.721478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.724162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.061851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.072018 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0493bf0f-b5af-41a4-bbb5-1f63014a4a90 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1503 microversion: 2.1 time: 0.385255 Aug 24 03:51:51.084506 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2065/3936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:50 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:51.094036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:51.094699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:51.102677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.103178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.103621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.104722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.105490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.106101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.429567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.445364 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc422cdb-e2d9-467f-a86c-b5e62394c95f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.355125 Aug 24 03:51:51.460795 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2066/3937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:51 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:51.508849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.521545 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-17ac0683-a15a-4370-b122-e8256f8f1485 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1309 microversion: 2.1 time: 1.161402 Aug 24 03:51:51.522516 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1872/3938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:50 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1309 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:51.920590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32d9c7c2-0d2a-4662-9236-8b81906ecff1 tempest-ComputeTenantNetworksTest-1122188388 tempest-ComputeTenantNetworksTest-1122188388-project] Calling method '.version_select at 0x7f10227eb940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.098206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.099360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.114242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.115816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.116593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.117502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.120098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.121227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.520048 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32d9c7c2-0d2a-4662-9236-8b81906ecff1 tempest-ComputeTenantNetworksTest-1122188388 tempest-ComputeTenantNetworksTest-1122188388-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.057665 Aug 24 03:51:52.520906 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2067/3939] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 03:51:51 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:52.530140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2de68238-6c52-4ff4-8bc4-a99346be8b2f req-f04f4e5f-5271-4d5f-b69a-ff6a01bbfa55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:52.546350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2de68238-6c52-4ff4-8bc4-a99346be8b2f req-f04f4e5f-5271-4d5f-b69a-ff6a01bbfa55 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.555010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2de68238-6c52-4ff4-8bc4-a99346be8b2f req-f04f4e5f-5271-4d5f-b69a-ff6a01bbfa55 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.556300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2de68238-6c52-4ff4-8bc4-a99346be8b2f req-f04f4e5f-5271-4d5f-b69a-ff6a01bbfa55 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.579080 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2de68238-6c52-4ff4-8bc4-a99346be8b2f req-f04f4e5f-5271-4d5f-b69a-ff6a01bbfa55 service nova] Creating event network-changed:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h2-846470-15 Aug 24 03:51:52.591139 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2de68238-6c52-4ff4-8bc4-a99346be8b2f req-f04f4e5f-5271-4d5f-b69a-ff6a01bbfa55 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068565 Aug 24 03:51:52.596316 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2068/3940] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:52.631850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.632744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.639568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.640087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.644561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.649493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.650604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.651613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.851227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.888487 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4a03890-3819-4579-93fb-49eb9061a019 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1503 microversion: 2.1 time: 0.795689 Aug 24 03:51:52.896735 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1873/3941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1503 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:52.913799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b81ef06-84f0-4d1f-a79d-e50b9c8b7551 tempest-ComputeTenantNetworksTest-1122188388 tempest-ComputeTenantNetworksTest-1122188388-project] Calling method '.version_select at 0x7f102a6959d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.934240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.945851 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-258221ef-01b9-4195-9185-554d174044f9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.347920 Aug 24 03:51:52.946978 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2069/3942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:52.951964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.952870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.963451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.966186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.966764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.967599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.968179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.968688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.138937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:53.149710 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcf45fda-8651-4699-afe8-3305cc20d431 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1309 microversion: 2.1 time: 0.201261 Aug 24 03:51:53.150886 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2070/3943] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1309 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:53.239150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d90ccc6a-164a-49e9-b7ba-488554d08f06 req-fde744e8-8cb0-4c39-8a40-a38e618b1205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403e03d6-8c32-43df-9a20-f60f17b9c259", "name": "network-vif-plugged", "status": "completed", "tag": "677c8622-c5ef-4831-823e-72895d221bf3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:53.263996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d90ccc6a-164a-49e9-b7ba-488554d08f06 req-fde744e8-8cb0-4c39-8a40-a38e618b1205 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.265896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d90ccc6a-164a-49e9-b7ba-488554d08f06 req-fde744e8-8cb0-4c39-8a40-a38e618b1205 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.266461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d90ccc6a-164a-49e9-b7ba-488554d08f06 req-fde744e8-8cb0-4c39-8a40-a38e618b1205 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.296857 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d90ccc6a-164a-49e9-b7ba-488554d08f06 req-fde744e8-8cb0-4c39-8a40-a38e618b1205 service nova] Creating event network-vif-plugged:677c8622-c5ef-4831-823e-72895d221bf3 for instance 403e03d6-8c32-43df-9a20-f60f17b9c259 on n-h1-846470-15 Aug 24 03:51:53.318998 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d90ccc6a-164a-49e9-b7ba-488554d08f06 req-fde744e8-8cb0-4c39-8a40-a38e618b1205 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084053 Aug 24 03:51:53.322428 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2071/3944] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:53.405161 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1b81ef06-84f0-4d1f-a79d-e50b9c8b7551 tempest-ComputeTenantNetworksTest-1122188388 tempest-ComputeTenantNetworksTest-1122188388-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks/01c75cb7-2310-4615-ae8f-c834cc06693b" status: 200 len: 140 microversion: 2.1 time: 0.506933 Aug 24 03:51:53.422535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1874/3945] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/os-tenant-networks/01c75cb7-2310-4615-ae8f-c834cc06693b => generated 140 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:53.915771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:53.916528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:53.926568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.927219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.929286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.930898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.931393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.932769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.972189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:53.972892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:54.002598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.007332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.008145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.009797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.016199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.018440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.244872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:54.255816 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7387503a-5436-46ab-9a66-dc5d22bd1b4f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1503 microversion: 2.1 time: 0.344518 Aug 24 03:51:54.256443 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2072/3946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:53 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:54.265306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:54.273792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:54.281531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.282319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.283015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.284197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.284996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.285627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.643155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:54.647787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:54.688760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ab6ba48-e428-4721-a1b6-af6096d2520f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1309 microversion: 2.1 time: 0.405437 Aug 24 03:51:54.690354 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2073/3947] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:54 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:54.906823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:54.939049 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74b08e29-a9bb-44e4-a109-a0a3b0cdb0cb tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.971240 Aug 24 03:51:54.943078 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1875/3948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:53 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:55.298632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:55.323884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-867c33fc-7945-4e3e-ba51-0e0988fa5df4 req-bb2b7df9-e0a5-425b-a6a8-02b9aebb30d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0665005-cf59-492e-b7b5-74cef8a5358d", "name": "network-vif-deleted", "tag": "7f5c8a2b-637d-4f62-a363-1dabe6db93c2"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:55.327708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:55.354229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=14 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:55.355069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:55.357597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:55.391096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.393491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.395217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.396030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-867c33fc-7945-4e3e-ba51-0e0988fa5df4 req-bb2b7df9-e0a5-425b-a6a8-02b9aebb30d0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.401158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-867c33fc-7945-4e3e-ba51-0e0988fa5df4 req-bb2b7df9-e0a5-425b-a6a8-02b9aebb30d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.401521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.404222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.406065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-867c33fc-7945-4e3e-ba51-0e0988fa5df4 req-bb2b7df9-e0a5-425b-a6a8-02b9aebb30d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.407432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.423810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:55.447717 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-867c33fc-7945-4e3e-ba51-0e0988fa5df4 req-bb2b7df9-e0a5-425b-a6a8-02b9aebb30d0 service nova] Creating event network-vif-deleted:7f5c8a2b-637d-4f62-a363-1dabe6db93c2 for instance b0665005-cf59-492e-b7b5-74cef8a5358d on n-h2-846470-15 Aug 24 03:51:55.465647 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-867c33fc-7945-4e3e-ba51-0e0988fa5df4 req-bb2b7df9-e0a5-425b-a6a8-02b9aebb30d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154050 Aug 24 03:51:55.468192 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1876/3949] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:55.640666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:55.656581 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8bc40549-605c-4240-8907-2a4562ec74b0 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1461 microversion: 2.1 time: 0.363068 Aug 24 03:51:55.657809 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2074/3950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:55 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1461 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:55.726991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:55.728427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:55.746388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.750953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.753679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.756319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.759192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.759796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.972348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:55.974920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:56.005625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.007340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.011267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.015579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.018359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.018837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.081307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.093688 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-880350cf-0b35-479b-90cd-3f757c813c53 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1490 microversion: 2.1 time: 0.372249 Aug 24 03:51:56.101072 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1877/3951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:55 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1490 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:56.317759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1055992831", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a410578b-d916-4218-bf01-482ee8be19b3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:56.403088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] validate_networks() for [('a410578b-d916-4218-bf01-482ee8be19b3', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:56.448325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.463652 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60cd0af8-e503-4ed4-a9e0-788d39fcb97d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.502325 Aug 24 03:51:56.464440 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2075/3952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:55 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:56.683515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:56.684224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:56.706977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.710100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.710551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.711309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.711797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.712224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.962110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.975047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c25bc542-2ebc-4b05-91c7-7dbfcec36e36 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1461 microversion: 2.1 time: 0.295866 Aug 24 03:51:56.976227 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2076/3953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:56 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1461 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:57.501015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:57.502543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:57.527719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.528489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.529097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.534331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.535112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.535778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.624645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:57.626399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:57.627648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:57.628485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:57.629293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:57.666158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.667138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.667950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.668967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.673752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.674420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.710217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:57.720998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:57.782314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:57.786812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:57.878013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:57.917199 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-038e788c-d00e-4af0-9f97-a130eac56e23 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.431588 Aug 24 03:51:57.918597 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2077/3954] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:57 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:57.923569 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3207e403-be6a-4d17-887e-e4412baafd90 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.610693 Aug 24 03:51:57.925012 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1878/3955] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:51:57.939108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd9b86f6-b0a4-4649-9d46-a2b678412066 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:57.940607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd9b86f6-b0a4-4649-9d46-a2b678412066 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:58.003180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:58.004244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:58.041100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.056188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.061682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.064372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.068844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.070586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.138474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cd9b86f6-b0a4-4649-9d46-a2b678412066 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:58.155446 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd9b86f6-b0a4-4649-9d46-a2b678412066 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1209 microversion: 2.1 time: 0.222214 Aug 24 03:51:58.169450 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2078/3956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:57 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1209 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:58.595202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020c02804954453591e51157932d6c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ce212b4f6f4c82a6ada0ade6b14d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:58.606565 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e413ff07-2d89-40a3-bda8-ed2fc70fe604 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 200 len: 1297 microversion: 2.1 time: 0.608793 Aug 24 03:51:58.623874 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1879/3957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:57 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 1297 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:58.940003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:58.940627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:58.953102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.955425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.962589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.964001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.964963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.965731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.184304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94b36660-e0c5-4adf-ab64-b224ee1acc2c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.185009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94b36660-e0c5-4adf-ab64-b224ee1acc2c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:59.280575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:59.291158 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-22ded26a-42ca-4634-b56d-a5e3e8b0e703 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.355090 Aug 24 03:51:59.293681 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2079/3958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:58 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:59.639388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.640317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:59.658519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.659029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.659478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.661125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.661125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.661549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.690225 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] HTTP exception thrown: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Request method failure captured: Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d HTTP/1.1 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaA0iCeId4K-G19wjDNwO_rZbmVR52WfFzWd1z10aJokFBkw9-DdsNpcz-hL3Co36GgEvHIqTcpXO85MQBOM0VafpPnR1Mrh4_bgLJPu8X_qzKeJ2LqL2d3udl0qGer9zmB491f4eYHXs1hhmVAJ-a3Gq6Iv5p_jX79O8t0QhCVHewQ Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 020c02804954453591e51157932d6c51 Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'b0665005-cf59-492e-b7b5-74cef8a5358d'} Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:59.693114 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:59.697275 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:59.697275 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:59.697275 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:59.697275 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:51:59.697275 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:51:59.697275 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:51:59.697275 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:51:59.699247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Returning 404 to user: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:51:59.700612 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b356af6a-f2c5-41a4-8d86-fbd043d60c42 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 404 len: 111 microversion: 2.1 time: 0.066080 Aug 24 03:51:59.701751 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2080/3959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:59 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:51:59.722800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6eec82c8-873b-4a80-965c-033a0191850f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.791078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.compute.server_groups [None req-6eec82c8-873b-4a80-965c-033a0191850f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Querying cell a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) for 1 instances {{(pid=122536) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 03:51:59.795032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eec82c8-873b-4a80-965c-033a0191850f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.796389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eec82c8-873b-4a80-965c-033a0191850f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.798001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eec82c8-873b-4a80-965c-033a0191850f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.832044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94b36660-e0c5-4adf-ab64-b224ee1acc2c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:59.833745 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6eec82c8-873b-4a80-965c-033a0191850f tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.124176 Aug 24 03:51:59.834481 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2081/3960] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 03:51:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:59.848184 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94b36660-e0c5-4adf-ab64-b224ee1acc2c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1209 microversion: 2.1 time: 0.667080 Aug 24 03:51:59.848941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d44034e7-c5c9-40c8-af76-ac4d7238f751 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.851887 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1880/3961] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:59 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1209 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:59.881585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.compute.server_groups [None req-d44034e7-c5c9-40c8-af76-ac4d7238f751 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Querying cell a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) for 1 instances {{(pid=122536) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 03:51:59.882302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d44034e7-c5c9-40c8-af76-ac4d7238f751 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.882787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d44034e7-c5c9-40c8-af76-ac4d7238f751 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.883225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d44034e7-c5c9-40c8-af76-ac4d7238f751 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.900580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d44034e7-c5c9-40c8-af76-ac4d7238f751 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/015c8695-d4c8-4594-b7f6-61493a5dd3fc" status: 200 len: 183 microversion: 2.1 time: 0.058149 Aug 24 03:51:59.905273 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2082/3962] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 03:51:59 2022] GET /compute/v2.1/os-server-groups/015c8695-d4c8-4594-b7f6-61493a5dd3fc => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:59.917602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.918776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:59.944748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.946838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.947738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.953714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.954954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.955640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.002290 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] HTTP exception thrown: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Request method failure captured: Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d HTTP/1.1 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaA0iCeId4K-G19wjDNwO_rZbmVR52WfFzWd1z10aJokFBkw9-DdsNpcz-hL3Co36GgEvHIqTcpXO85MQBOM0VafpPnR1Mrh4_bgLJPu8X_qzKeJ2LqL2d3udl0qGer9zmB491f4eYHXs1hhmVAJ-a3Gq6Iv5p_jX79O8t0QhCVHewQ Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 020c02804954453591e51157932d6c51 Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'b0665005-cf59-492e-b7b5-74cef8a5358d'} Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:52:00.012828 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.016428 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.019160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Returning 404 to user: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.020469 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aebda76d-a7b4-4a7b-886b-4c0670670851 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 404 len: 111 microversion: 2.1 time: 0.107578 Aug 24 03:52:00.025721 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1881/3963] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:51:59 2022] DELETE /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:00.031430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.032071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] [instance: b0665005-cf59-492e-b7b5-74cef8a5358d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:00.035323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:00.049085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.050966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.055116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.056118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.056944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.057384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.126481 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] HTTP exception thrown: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Request method failure captured: Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d HTTP/1.1 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaA0iCeId4K-G19wjDNwO_rZbmVR52WfFzWd1z10aJokFBkw9-DdsNpcz-hL3Co36GgEvHIqTcpXO85MQBOM0VafpPnR1Mrh4_bgLJPu8X_qzKeJ2LqL2d3udl0qGer9zmB491f4eYHXs1hhmVAJ-a3Gq6Iv5p_jX79O8t0QhCVHewQ Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 020c02804954453591e51157932d6c51 Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'b0665005-cf59-492e-b7b5-74cef8a5358d'} Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.129781 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.134044 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.134044 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.134044 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.134044 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:00.134044 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:00.134044 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. Aug 24 03:52:00.134044 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.136802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Returning 404 to user: Instance b0665005-cf59-492e-b7b5-74cef8a5358d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.139793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cdbf8368-5c4d-48b2-8b5a-4a6ecf1b656c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d" status: 404 len: 111 microversion: 2.1 time: 0.113008 Aug 24 03:52:00.141120 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2083/3964] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:00 2022] GET /compute/v2.1/servers/b0665005-cf59-492e-b7b5-74cef8a5358d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:00.149922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5ef4137-9568-4f43-a600-5a4760e8061c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.157592 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e5ef4137-9568-4f43-a600-5a4760e8061c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] HTTP exception thrown: Instance group 868accbf-3f9a-48cf-9934-d626064ab0d1 could not be found. Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5ef4137-9568-4f43-a600-5a4760e8061c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Request method failure captured: Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-server-groups/868accbf-3f9a-48cf-9934-d626064ab0d1 HTTP/1.1 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaA0iCeId4K-G19wjDNwO_rZbmVR52WfFzWd1z10aJokFBkw9-DdsNpcz-hL3Co36GgEvHIqTcpXO85MQBOM0VafpPnR1Mrh4_bgLJPu8X_qzKeJ2LqL2d3udl0qGer9zmB491f4eYHXs1hhmVAJ-a3Gq6Iv5p_jX79O8t0QhCVHewQ Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 020c02804954453591e51157932d6c51 Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance group 868accbf-3f9a-48cf-9934-d626064ab0d1 could not be found. Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '868accbf-3f9a-48cf-9934-d626064ab0d1'} Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 868accbf-3f9a-48cf-9934-d626064ab0d1 could not be found. Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 868accbf-3f9a-48cf-9934-d626064ab0d1 could not be found. Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.160586 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.165616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.165616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.165616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:00.165616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:00.165616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 868accbf-3f9a-48cf-9934-d626064ab0d1 could not be found. Aug 24 03:52:00.165616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.165616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5ef4137-9568-4f43-a600-5a4760e8061c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Returning 404 to user: Instance group 868accbf-3f9a-48cf-9934-d626064ab0d1 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.165616 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5ef4137-9568-4f43-a600-5a4760e8061c tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/868accbf-3f9a-48cf-9934-d626064ab0d1" status: 404 len: 117 microversion: 2.1 time: 0.017056 Aug 24 03:52:00.173377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aeed7824-fa7c-477c-a502-879e8621ed87 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.175951 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1882/3965] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:52:00 2022] DELETE /compute/v2.1/os-server-groups/868accbf-3f9a-48cf-9934-d626064ab0d1 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:00.183193 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-aeed7824-fa7c-477c-a502-879e8621ed87 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] HTTP exception thrown: Instance group d6542379-30db-49e3-aba3-dd196f5db448 could not be found. Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aeed7824-fa7c-477c-a502-879e8621ed87 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Request method failure captured: Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-server-groups/d6542379-30db-49e3-aba3-dd196f5db448 HTTP/1.1 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaA0iCeId4K-G19wjDNwO_rZbmVR52WfFzWd1z10aJokFBkw9-DdsNpcz-hL3Co36GgEvHIqTcpXO85MQBOM0VafpPnR1Mrh4_bgLJPu8X_qzKeJ2LqL2d3udl0qGer9zmB491f4eYHXs1hhmVAJ-a3Gq6Iv5p_jX79O8t0QhCVHewQ Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 020c02804954453591e51157932d6c51 Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance group d6542379-30db-49e3-aba3-dd196f5db448 could not be found. Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd6542379-30db-49e3-aba3-dd196f5db448'} Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d6542379-30db-49e3-aba3-dd196f5db448 could not be found. Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d6542379-30db-49e3-aba3-dd196f5db448 could not be found. Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.185351 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.189396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.189396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.189396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:00.189396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:00.189396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d6542379-30db-49e3-aba3-dd196f5db448 could not be found. Aug 24 03:52:00.189396 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.189790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aeed7824-fa7c-477c-a502-879e8621ed87 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Returning 404 to user: Instance group d6542379-30db-49e3-aba3-dd196f5db448 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.190544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aeed7824-fa7c-477c-a502-879e8621ed87 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/d6542379-30db-49e3-aba3-dd196f5db448" status: 404 len: 117 microversion: 2.1 time: 0.022893 Aug 24 03:52:00.195102 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2084/3966] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:52:00 2022] DELETE /compute/v2.1/os-server-groups/d6542379-30db-49e3-aba3-dd196f5db448 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:52:00.202257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-190e8a10-1a63-43f7-898d-611e969b9b69 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.215384 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-190e8a10-1a63-43f7-898d-611e969b9b69 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] HTTP exception thrown: Instance group d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 could not be found. Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-190e8a10-1a63-43f7-898d-611e969b9b69 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Request method failure captured: Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-server-groups/d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 HTTP/1.1 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaA0iCeId4K-G19wjDNwO_rZbmVR52WfFzWd1z10aJokFBkw9-DdsNpcz-hL3Co36GgEvHIqTcpXO85MQBOM0VafpPnR1Mrh4_bgLJPu8X_qzKeJ2LqL2d3udl0qGer9zmB491f4eYHXs1hhmVAJ-a3Gq6Iv5p_jX79O8t0QhCVHewQ Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 020c02804954453591e51157932d6c51 Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance group d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 could not be found. Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd0f09dab-4e71-4bf5-af13-09e8fd9a2b66'} Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 could not be found. Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 could not be found. Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.218127 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.221988 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.221988 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.221988 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:00.221988 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:00.221988 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 could not be found. Aug 24 03:52:00.221988 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.224200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-190e8a10-1a63-43f7-898d-611e969b9b69 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Returning 404 to user: Instance group d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.225464 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-190e8a10-1a63-43f7-898d-611e969b9b69 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/d0f09dab-4e71-4bf5-af13-09e8fd9a2b66" status: 404 len: 117 microversion: 2.1 time: 0.028636 Aug 24 03:52:00.229616 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1883/3967] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:52:00 2022] DELETE /compute/v2.1/os-server-groups/d0f09dab-4e71-4bf5-af13-09e8fd9a2b66 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:00.239184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-060c3213-5719-462a-82aa-7c7402dcd796 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.254278 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-060c3213-5719-462a-82aa-7c7402dcd796 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] HTTP exception thrown: Instance group 8ae02470-8fbb-4662-b64c-2582ed7d7f57 could not be found. Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-060c3213-5719-462a-82aa-7c7402dcd796 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Request method failure captured: Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-server-groups/8ae02470-8fbb-4662-b64c-2582ed7d7f57 HTTP/1.1 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaA0iCeId4K-G19wjDNwO_rZbmVR52WfFzWd1z10aJokFBkw9-DdsNpcz-hL3Co36GgEvHIqTcpXO85MQBOM0VafpPnR1Mrh4_bgLJPu8X_qzKeJ2LqL2d3udl0qGer9zmB491f4eYHXs1hhmVAJ-a3Gq6Iv5p_jX79O8t0QhCVHewQ Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7ce212b4f6f4c82a6ada0ade6b14d87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7ce212b4f6f4c82a6ada0ade6b14d87 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerGroupTestJSON-1954565803 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 020c02804954453591e51157932d6c51 Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerGroupTestJSON-1954565803-project Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance group 8ae02470-8fbb-4662-b64c-2582ed7d7f57 could not be found. Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8ae02470-8fbb-4662-b64c-2582ed7d7f57'} Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8ae02470-8fbb-4662-b64c-2582ed7d7f57 could not be found. Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8ae02470-8fbb-4662-b64c-2582ed7d7f57 could not be found. Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.256613 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8ae02470-8fbb-4662-b64c-2582ed7d7f57 could not be found. Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-060c3213-5719-462a-82aa-7c7402dcd796 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Returning 404 to user: Instance group 8ae02470-8fbb-4662-b64c-2582ed7d7f57 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-060c3213-5719-462a-82aa-7c7402dcd796 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/8ae02470-8fbb-4662-b64c-2582ed7d7f57" status: 404 len: 117 microversion: 2.1 time: 0.027569 Aug 24 03:52:00.260661 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2085/3968] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:52:00 2022] DELETE /compute/v2.1/os-server-groups/8ae02470-8fbb-4662-b64c-2582ed7d7f57 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:52:00.270243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69576d29-e21c-4259-b33f-444c6252ee61 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.316543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.317349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:00.330249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.330989 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69576d29-e21c-4259-b33f-444c6252ee61 tempest-ServerGroupTestJSON-1954565803 tempest-ServerGroupTestJSON-1954565803-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/015c8695-d4c8-4594-b7f6-61493a5dd3fc" status: 204 len: 0 microversion: 2.1 time: 0.067471 Aug 24 03:52:00.332199 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1884/3969] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 24 03:52:00 2022] DELETE /compute/v2.1/os-server-groups/015c8695-d4c8-4594-b7f6-61493a5dd3fc => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:52:00.332359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.333379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.334194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.335399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.342607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.586712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:00.596320 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be3dddfe-bb73-4fe3-b7f9-de5ae551b86d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.287067 Aug 24 03:52:00.596937 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2086/3970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:00 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:00.879269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.879933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:00.913397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.915367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.922580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.946807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.947319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.947837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.011074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6a61b20b-9a7e-4e8d-beb3-cd8810b2f671 req-32e3abb1-0b08-4115-b179-9ebc5f1cdf42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "name": "network-vif-plugged", "status": "completed", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:01.052776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a61b20b-9a7e-4e8d-beb3-cd8810b2f671 req-32e3abb1-0b08-4115-b179-9ebc5f1cdf42 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:01.053419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a61b20b-9a7e-4e8d-beb3-cd8810b2f671 req-32e3abb1-0b08-4115-b179-9ebc5f1cdf42 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:01.053498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a61b20b-9a7e-4e8d-beb3-cd8810b2f671 req-32e3abb1-0b08-4115-b179-9ebc5f1cdf42 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.110261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6a61b20b-9a7e-4e8d-beb3-cd8810b2f671 req-32e3abb1-0b08-4115-b179-9ebc5f1cdf42 service nova] Creating event network-vif-plugged:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h2-846470-15 Aug 24 03:52:01.145939 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6a61b20b-9a7e-4e8d-beb3-cd8810b2f671 req-32e3abb1-0b08-4115-b179-9ebc5f1cdf42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137667 Aug 24 03:52:01.148819 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2087/3971] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:01.358141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:01.369897 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-302de890-d266-4dff-97e3-9d8bf820d3eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1269 microversion: 2.1 time: 0.496068 Aug 24 03:52:01.373032 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1885/3972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:00 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1269 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:01.619882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:01.620600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:01.635288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:01.637945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:01.638739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.639498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:01.640025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:01.644642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:02.139498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:02.158381 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-634bf3a0-8b8e-4fcc-a68d-411d34f354fa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.543498 Aug 24 03:52:02.160903 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2088/3973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:01 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:02.396846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:02.397551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:02.412297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:02.412997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:02.416124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:02.416990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:02.417560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:02.418084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:02.745764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:02.758524 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4021de44-1161-4e2e-968b-92ada29adf36 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1267 microversion: 2.1 time: 0.365892 Aug 24 03:52:02.791693 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1886/3974] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:02 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:03.183125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:03.184017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:03.205069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.211961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.237177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.240895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.249296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.250108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.653583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:03.673129 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e280d4f-bedd-465f-9ba0-b07ee5a206e3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1379 microversion: 2.1 time: 0.493714 Aug 24 03:52:03.678211 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2089/3975] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:03 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1379 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:03.802646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:03.804073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:03.823940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.842409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.845128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.846321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.862843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.868982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.664547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:04.685511 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-64d6b9ba-de1f-42d6-a70e-225c1bbf88f7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1309 microversion: 2.1 time: 0.887665 Aug 24 03:52:04.701111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:04.701111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:04.701777 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1887/3976] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:03 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1309 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:04.724360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.728085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.728568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.730528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.731047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.731521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.960199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:04.973119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37ad700f-d916-4923-ad36-ad1c600bf8f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1528 microversion: 2.1 time: 0.280426 Aug 24 03:52:04.981839 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2090/3977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:04 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1528 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:04.998787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:04.999920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:05.010267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.011244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.012329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.013180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.013741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.014262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.494324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:05.511571 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8331e68-617a-4f28-a730-2fa090011a14 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1528 microversion: 2.1 time: 0.517516 Aug 24 03:52:05.513455 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1888/3978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:04 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1528 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:05.535048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f915aedf-874d-4544-95ff-9aa419266461 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.537037 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:52:05.537037 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:52:05.561689 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f915aedf-874d-4544-95ff-9aa419266461 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/694c06e3-b99c-4e11-b580-57e90d157d66" status: 202 len: 0 microversion: 2.1 time: 0.032379 Aug 24 03:52:05.562620 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2091/3979] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:52:05 2022] DELETE /compute/v2.1/flavors/694c06e3-b99c-4e11-b580-57e90d157d66 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:52:05.570933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e3d310df-dff2-42d2-8187-62a43b75b9e4 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.618458 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e3d310df-dff2-42d2-8187-62a43b75b9e4 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051127 Aug 24 03:52:05.619321 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1889/3980] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:52:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:05.647617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:05.651614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:05.660765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.661516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.663034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.664212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.667278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.669755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.714303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.715297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:05.730895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.732653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.733395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.736531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.737240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.738664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:06.380319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:06.389738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Old instance type tempest-test_resize_flavor_-531410977, new instance type m1.heat {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 03:52:06.424104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:06.425047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:06.426009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:06.428751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:06.430000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:06.759046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7f0748a-86ef-4a35-a05e-780314ce3680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b/action" status: 202 len: 0 microversion: 2.1 time: 1.120466 Aug 24 03:52:06.767949 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2092/3981] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:52:05 2022] POST /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:52:06.789776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c59d8ffb-751e-4b0a-b420-bf8b394bf525 req-2b662978-0af4-40da-a969-9e09f8740b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be410689-94b6-41c1-b2a4-68f991e61cb2", "tag": "b6ccdd48-5c41-4256-8b7b-89a65161b52d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:06.853439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c59d8ffb-751e-4b0a-b420-bf8b394bf525 req-2b662978-0af4-40da-a969-9e09f8740b2a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:06.854004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c59d8ffb-751e-4b0a-b420-bf8b394bf525 req-2b662978-0af4-40da-a969-9e09f8740b2a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:06.861101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c59d8ffb-751e-4b0a-b420-bf8b394bf525 req-2b662978-0af4-40da-a969-9e09f8740b2a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:06.911548 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c59d8ffb-751e-4b0a-b420-bf8b394bf525 req-2b662978-0af4-40da-a969-9e09f8740b2a service nova] Creating event network-changed:b6ccdd48-5c41-4256-8b7b-89a65161b52d for instance be410689-94b6-41c1-b2a4-68f991e61cb2 on n-h2-846470-15 Aug 24 03:52:06.927237 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c59d8ffb-751e-4b0a-b420-bf8b394bf525 req-2b662978-0af4-40da-a969-9e09f8740b2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155057 Aug 24 03:52:06.946635 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2093/3982] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:06.968563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:06.969339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:07.002541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:07.003190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:07.008891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.012990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:07.013695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:07.014852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.363926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:07.390581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01da33f5-98b4-4974-9e6c-dbc7d2380198 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1309 microversion: 2.1 time: 1.685865 Aug 24 03:52:07.391194 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1890/3983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:05 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1309 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:08.017459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:08.087629 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb804dbd-cb7a-4f67-a60e-ec2ff0d8f93a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1537 microversion: 2.1 time: 1.139594 Aug 24 03:52:08.094294 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2094/3984] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:06 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1537 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:08.445529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:08.465098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:08.512051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:08.528164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.529689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.531837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.534074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.537581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.538233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.949783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:08.967051 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d093ecef-c247-4ed3-bd86-92fc22672de7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1309 microversion: 2.1 time: 0.555749 Aug 24 03:52:08.981870 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1891/3985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:08 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1309 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:09.122895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:09.127541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:09.133524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:09.149356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:09.149859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:09.150287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.151008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:09.156455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:09.157179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.940204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:09.953064 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-381ad912-d1f5-462c-b4b6-9e86592b0641 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1537 microversion: 2.1 time: 0.833824 Aug 24 03:52:09.955645 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2095/3986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:09 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1537 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:09.993534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:09.995164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:10.004544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:10.016296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.017285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.018432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.020520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.021102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.022711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.364396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:10.383393 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f749378a-476d-4862-92e6-57a25278ba06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1309 microversion: 2.1 time: 0.396990 Aug 24 03:52:10.397247 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1892/3987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:09 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:10.977829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:10.978435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:10.996813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.998227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.999434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.002229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.002827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.005113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.404479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:11.405293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:11.423166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.424807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.425604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.428637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.429441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.431029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.478777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:11.491063 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b7f5506-6f11-4c86-b70d-bca9b6e639d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1537 microversion: 2.1 time: 0.517769 Aug 24 03:52:11.492017 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2096/3988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:10 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1537 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:12.119376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:12.132377 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-56151c6e-c9de-49cf-99e3-8a80604acba7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1309 microversion: 2.1 time: 0.731657 Aug 24 03:52:12.133026 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1893/3989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:11 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1309 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:12.515014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:12.517387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:12.535549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.536526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.551405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.554936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.559028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.561041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.578780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:12.867878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:12.877659 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99111755-ef2c-49b0-bc35-07bbe46165db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1537 microversion: 2.1 time: 0.368981 Aug 24 03:52:12.883982 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2097/3990] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:12 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1537 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:13.155572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:13.156984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:13.172947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.173935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.174568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.176640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.177560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.182952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.354454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e2b71252-55ee-4b39-8186-681845780f8e req-d573b105-04ee-4982-9642-3a01c9acabef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be410689-94b6-41c1-b2a4-68f991e61cb2", "name": "network-vif-plugged", "status": "completed", "tag": "b6ccdd48-5c41-4256-8b7b-89a65161b52d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:13.374188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2b71252-55ee-4b39-8186-681845780f8e req-d573b105-04ee-4982-9642-3a01c9acabef service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.374689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2b71252-55ee-4b39-8186-681845780f8e req-d573b105-04ee-4982-9642-3a01c9acabef service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.377936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2b71252-55ee-4b39-8186-681845780f8e req-d573b105-04ee-4982-9642-3a01c9acabef service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.421259 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e2b71252-55ee-4b39-8186-681845780f8e req-d573b105-04ee-4982-9642-3a01c9acabef service nova] Creating event network-vif-plugged:b6ccdd48-5c41-4256-8b7b-89a65161b52d for instance be410689-94b6-41c1-b2a4-68f991e61cb2 on n-h2-846470-15 Aug 24 03:52:13.432462 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e2b71252-55ee-4b39-8186-681845780f8e req-d573b105-04ee-4982-9642-3a01c9acabef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081911 Aug 24 03:52:13.433596 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2098/3991] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:13.907500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:13.909200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:13.920931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.922063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.923165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.924364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.924982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.925600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:14.062014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:14.091934 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45f357f8-d580-4152-8c92-a9bfc8bcef6e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1309 microversion: 2.1 time: 0.941215 Aug 24 03:52:14.098858 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1894/3992] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:13 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1309 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:14.434420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:14.446702 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ee7996d1-dd03-4067-923f-8d15f097efa4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1537 microversion: 2.1 time: 0.547736 Aug 24 03:52:14.447574 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2099/3993] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:13 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1537 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:15.120965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:15.121822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:15.136224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.137357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.138493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.139909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.140869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.143592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.441439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:15.452731 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7b08309b-67eb-4ffb-a80d-e3d935857993 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1309 microversion: 2.1 time: 0.337174 Aug 24 03:52:15.453349 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1895/3994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:15 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1309 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:15.484917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:15.485668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:15.504173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.505806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.507060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.509797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.510502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.511398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.640204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:15.640840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:15.662023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.663335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.665521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.667965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.672496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.672943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.732863 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-158b7e4e-edf1-4332-937a-19d778a471fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/ips" status: 200 len: 149 microversion: 2.1 time: 0.094401 Aug 24 03:52:15.736271 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1896/3995] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:52:15 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/ips => generated 149 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:15.851764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:15.868706 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2df87c6e-059a-4654-a34d-5cbf49617736 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.389529 Aug 24 03:52:15.872169 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2100/3996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:15 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:16.478218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:16.478837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:16.491554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.495423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.496171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.497099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.499105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.499807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.772925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:16.784004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19bce2c9-2f6f-413f-abc4-bab936f69aea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1490 microversion: 2.1 time: 0.309982 Aug 24 03:52:16.786108 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1897/3997] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:16 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1490 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:16.808299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:16.808946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:16.844458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.844994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.845439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.846189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.846648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.847070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.897188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:16.897924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:16.907095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.908930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.909894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.912370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.914153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.916477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.062399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:17.076677 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8df74e04-523e-441c-9c73-952225cc0e00 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1490 microversion: 2.1 time: 0.273794 Aug 24 03:52:17.078049 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2101/3998] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:16 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1490 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:17.099259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:17.102793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:17.123868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.125395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.128943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.130789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.131458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.133336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.172482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:17.182274 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e39cda13-7295-434f-a4e7-2b84b7c658b6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.290114 Aug 24 03:52:17.199103 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1898/3999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:16 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:17.403557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:17.412973 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f6fb23ad-47cf-4246-b149-3e47370a0540 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1490 microversion: 2.1 time: 0.319242 Aug 24 03:52:17.429902 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2102/4000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:17 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1490 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:17.438344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:17.440230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:17.447530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.453199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.453918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.454958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.455831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.456487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.489399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:52:17.537824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:17.625548 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae97d5a6-d810-4e56-8723-5f093cb4c616 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 204 len: 0 microversion: 2.1 time: 0.191862 Aug 24 03:52:17.626672 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1899/4001] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:52:17 2022] DELETE /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:52:17.637652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:17.638428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:17.648620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.652730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.665097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.667121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.667695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.668194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.855549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:17.865195 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bb918a4-1cc3-442a-8c97-cd7b21bf83d8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1496 microversion: 2.1 time: 0.232471 Aug 24 03:52:17.865959 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2103/4002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:17 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1496 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:18.210833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:18.212048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:18.225958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.226654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.227104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.227863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.228353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.228745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.490251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:18.503463 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-577ba416-2e04-4988-ad35-94a8be3c6822 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.298346 Aug 24 03:52:18.506265 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1900/4003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:18 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:18.562009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fa3c647-f2e4-428a-a857-f14492255ee9"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:18.565255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:18.586694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.587749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.588664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.589737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.605245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.609015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.886701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:18.887733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:18.900191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.900701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.901169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.901889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.902353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.902785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.191258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:19.208327 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-48be5557-64b0-4cb2-a485-aba14123e881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1496 microversion: 2.1 time: 0.325251 Aug 24 03:52:19.219705 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1901/4004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:18 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1496 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:19.229250 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c71f814c-21d3-4084-8cc7-068d2c7755b4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671287 Aug 24 03:52:19.241109 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2104/4005] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:52:18 2022] POST /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:19.527967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:19.528400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:19.558686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.561354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.566447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.569083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.575688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.578480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.184644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.195647 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af68b56b-31d8-4a45-8834-4740d3d7e4ca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.672864 Aug 24 03:52:20.213925 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1902/4006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:19 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:20.236127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:20.238808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:20.250856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.252087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.252977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.254677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.256151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.257080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.586105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.605215 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dee5c277-4472-42f4-bb0f-3810acc797c0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1496 microversion: 2.1 time: 0.370631 Aug 24 03:52:20.609036 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2105/4007] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:20 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1496 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:20.778193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-99d6f279-80f1-4c79-aa16-bb826e5ebc5c req-8786f51c-bd35-4766-b481-e38015b38343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be410689-94b6-41c1-b2a4-68f991e61cb2", "name": "network-vif-deleted", "tag": "b6ccdd48-5c41-4256-8b7b-89a65161b52d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:20.817793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:20.840822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99d6f279-80f1-4c79-aa16-bb826e5ebc5c req-8786f51c-bd35-4766-b481-e38015b38343 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.842270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99d6f279-80f1-4c79-aa16-bb826e5ebc5c req-8786f51c-bd35-4766-b481-e38015b38343 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.845572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99d6f279-80f1-4c79-aa16-bb826e5ebc5c req-8786f51c-bd35-4766-b481-e38015b38343 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.223338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:21.224006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:21.241138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.241976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.246417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.247286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.253404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.253981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.541896 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-99d6f279-80f1-4c79-aa16-bb826e5ebc5c req-8786f51c-bd35-4766-b481-e38015b38343 service nova] Creating event network-vif-deleted:b6ccdd48-5c41-4256-8b7b-89a65161b52d for instance be410689-94b6-41c1-b2a4-68f991e61cb2 on n-h2-846470-15 Aug 24 03:52:21.549207 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-99d6f279-80f1-4c79-aa16-bb826e5ebc5c req-8786f51c-bd35-4766-b481-e38015b38343 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.776315 Aug 24 03:52:21.550991 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1903/4008] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:21.629938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:21.631379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:21.662104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.664012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.665079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.667331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.669755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.670614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.785230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.786468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.788445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.789098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lazy-loading 'fault' on Instance uuid be410689-94b6-41c1-b2a4-68f991e61cb2 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:21.817098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:21.858100 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bfba986e-474d-4588-aaa6-7d416dfd7d47 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.637950 Aug 24 03:52:21.862378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2106/4009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:21 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:21.923190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:21.964462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5acbb76-b041-438a-85b0-5956c704b959 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 200 len: 1299 microversion: 2.1 time: 0.338604 Aug 24 03:52:21.979776 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1904/4010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:21 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 1299 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:22.885957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:22.886778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:22.901102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:22.901597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:22.902038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:22.902758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:22.903218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:22.903645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:22.991470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:22.992133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:23.012499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.012999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.017929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.028215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.028759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.029203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.097674 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 HTTP/1.1 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'be410689-94b6-41c1-b2a4-68f991e61cb2'} Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:23.104616 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-85fbd200-dee3-4aeb-9fb6-cee8b2322b5a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 404 len: 111 microversion: 2.1 time: 0.120560 Aug 24 03:52:23.109083 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1905/4011] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:22 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:52:23.128966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:23.129565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:23.149279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.149653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.151148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.155745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.156909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.158490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.241079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:52:23.499520 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26a567e3-3a33-47ba-956f-2722d869b971 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 204 len: 0 microversion: 2.1 time: 0.386098 Aug 24 03:52:23.502432 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1906/4012] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:52:23 2022] DELETE /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:52:23.513987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:23.515606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:23.535231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.539359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.540227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.544928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.545646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.546267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.700639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:23.720190 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93f579c7-333a-4045-9ef9-694d5304e937 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.838276 Aug 24 03:52:23.721432 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2107/4013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:22 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:23.980075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:23.992426 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72946778-3fee-4f0f-abe0-d979f9bb85ae tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1496 microversion: 2.1 time: 0.485621 Aug 24 03:52:24.001417 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1907/4014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:23 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1496 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:24.745046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:24.746064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:24.780838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.781406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.783877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.786210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.791256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.792708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:25.028514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:25.030080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:25.060304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:25.062503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:25.066770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:25.074403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:25.075131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:25.076076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:25.287760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:25.299451 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc7285a5-37c6-4578-8307-94722f29c163 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.560729 Aug 24 03:52:25.300784 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2108/4015] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:24 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:26.325086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:26.326636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:26.342113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.342909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.343580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.344563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.346559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.347762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.661380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.681530 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59dd3749-15d1-4336-82ca-fe0b86610d28 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.361584 Aug 24 03:52:26.699104 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2109/4016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:26 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:26.861989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.875059 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-589814b3-1d6d-4343-9eed-b9e252954881 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1496 microversion: 2.1 time: 1.857722 Aug 24 03:52:26.884480 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1908/4017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:25 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1496 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:27.522319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d45ba4ce-f015-4b8a-973f-681f91bcd4ba req-6955a4ee-efdb-4933-bff3-c506bcdbee21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403e03d6-8c32-43df-9a20-f60f17b9c259", "name": "network-vif-deleted", "tag": "677c8622-c5ef-4831-823e-72895d221bf3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:27.563410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d45ba4ce-f015-4b8a-973f-681f91bcd4ba req-6955a4ee-efdb-4933-bff3-c506bcdbee21 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.567587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d45ba4ce-f015-4b8a-973f-681f91bcd4ba req-6955a4ee-efdb-4933-bff3-c506bcdbee21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.573932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d45ba4ce-f015-4b8a-973f-681f91bcd4ba req-6955a4ee-efdb-4933-bff3-c506bcdbee21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.647002 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d45ba4ce-f015-4b8a-973f-681f91bcd4ba req-6955a4ee-efdb-4933-bff3-c506bcdbee21 service nova] Creating event network-vif-deleted:677c8622-c5ef-4831-823e-72895d221bf3 for instance 403e03d6-8c32-43df-9a20-f60f17b9c259 on n-h1-846470-15 Aug 24 03:52:27.672552 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d45ba4ce-f015-4b8a-973f-681f91bcd4ba req-6955a4ee-efdb-4933-bff3-c506bcdbee21 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156213 Aug 24 03:52:27.673296 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2110/4018] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:27.705962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:27.707560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:27.749850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.750848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.756433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.757962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.759935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.760860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.908935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:27.909802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:27.941334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.945633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.949512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.954813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.955629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.957724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.103319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.103943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.104399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.106584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lazy-loading 'fault' on Instance uuid 403e03d6-8c32-43df-9a20-f60f17b9c259 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:28.223466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.251828 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4e6290f-07da-4ed5-ab49-46e3af63debf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 200 len: 1299 microversion: 2.1 time: 0.350120 Aug 24 03:52:28.272995 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2111/4019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:27 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 1299 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:28.281654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.294756 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba0d628f-475e-459c-851b-5c2b5424e6ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.593400 Aug 24 03:52:28.312937 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1909/4020] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:27 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:29.279444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:29.280952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:29.303310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.304654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.310325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.312352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.313183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.313848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.323371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:29.324857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:29.349234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.360559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.361405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.362219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.362781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.363229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.372228 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 HTTP/1.1 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '403e03d6-8c32-43df-9a20-f60f17b9c259'} Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:29.384436 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:29.388490 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:29.388490 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:29.388490 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:29.388490 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:29.388490 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:29.388490 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:52:29.388490 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:52:29.388490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:29.389120 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b2482494-f899-426a-bec0-3957e959759e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 404 len: 111 microversion: 2.1 time: 0.111650 Aug 24 03:52:29.406533 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2112/4021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:29 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:29.655142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1545014422", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a410578b-d916-4218-bf01-482ee8be19b3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:29.822976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] validate_networks() for [('a410578b-d916-4218-bf01-482ee8be19b3', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:30.182292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:30.216666 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b39f489-0267-4177-bd30-11e615684705 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.897632 Aug 24 03:52:30.221995 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1910/4022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:29 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:31.031735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:31.032620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:31.040676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:31.041538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:31.043811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:31.065011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:31.095493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.102319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.103796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.104870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.105574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.106250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.141354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:31.153931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:31.185673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:31.196541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:31.243614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:31.246814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:31.265304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.272259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.272750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.273546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.274035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.274467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.338000 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16005b61-5f4a-4d6e-848b-2e01d83017bc tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679209 Aug 24 03:52:31.340038 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2113/4023] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:52:31.357233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7cf83170-da24-44c7-b1db-1c92e750750f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:31.362190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7cf83170-da24-44c7-b1db-1c92e750750f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:31.487871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7cf83170-da24-44c7-b1db-1c92e750750f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:31.496389 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7cf83170-da24-44c7-b1db-1c92e750750f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1209 microversion: 2.1 time: 0.148340 Aug 24 03:52:31.500917 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2114/4024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:31 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1209 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:31.733360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:31.745414 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01ac77c7-1269-4efd-9553-1871abb7e1e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.505457 Aug 24 03:52:31.746927 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1911/4025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:31 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:32.394432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1465847266", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "2771e253-0c26-4386-88aa-5dc32722eae3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:32.506982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] validate_networks() for [('2771e253-0c26-4386-88aa-5dc32722eae3', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:32.519576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:32.521123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:32.537085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.538544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.539164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.540096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.542364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.543034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.677419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.688979 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50ed040e-75d7-434b-8eb5-25317307a42d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1213 microversion: 2.1 time: 0.173985 Aug 24 03:52:32.691734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1912/4026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:32 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1213 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:32.767844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:32.768474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:32.787251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.787251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.787251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.787251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.787251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.787610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.184517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.224194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6185530e-31eb-46e7-a55b-f5e4dd7de4d9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.460563 Aug 24 03:52:33.231482 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1913/4027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:32 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.582962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:33.584269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:33.585297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:33.585900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:33.586557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:33.603054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.605271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.607168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.608411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.611060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.614261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.658665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Getting quotas for project 4a3e54dc077b4b1fbed34153acae6aaf. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:33.668865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Getting quotas for user d89053fb5bde48c2b30542cb2fda740f and project 4a3e54dc077b4b1fbed34153acae6aaf. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:33.716185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.716841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.718929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:33.723356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:33.753732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.755703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.760772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.768543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.770618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.771354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.833372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:33.849733 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce14abda-c0db-40ca-8fdb-4ab8de6a1bdd tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.776055 Aug 24 03:52:33.852497 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2115/4028] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:52:33.868053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47f87368-ba54-45f7-9a12-45d967eb2bdc tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.868981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-47f87368-ba54-45f7-9a12-45d967eb2bdc tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.002808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47f87368-ba54-45f7-9a12-45d967eb2bdc tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.011630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47f87368-ba54-45f7-9a12-45d967eb2bdc tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.014145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47f87368-ba54-45f7-9a12-45d967eb2bdc tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.015324 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47f87368-ba54-45f7-9a12-45d967eb2bdc tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1262 microversion: 2.26 time: 0.155608 Aug 24 03:52:34.020763 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2116/4029] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:34.256327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.256947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.259553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.269821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ed95dd5d-1525-47e7-89f1-6c266d755908 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1269 microversion: 2.1 time: 0.557850 Aug 24 03:52:34.271433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.272154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.272771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.273844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.274466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.275052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.280457 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1914/4030] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1269 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:34.329615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:34.696221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.711489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af888a3d-16c0-4756-b068-368815d1a2f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.459219 Aug 24 03:52:34.712620 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2117/4031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:35.088401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.089108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.126637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.132646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.133145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.146458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.147979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.148451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.306964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.308047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.322954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.323638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.324280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.325176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.332506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.333944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.358261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.376610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.382599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.386742 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-282809ab-4c5f-41bb-9a5a-1e1a84253e45 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1266 microversion: 2.26 time: 0.319972 Aug 24 03:52:35.388052 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1915/4032] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:35.525223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.537251 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8d7576bc-aa24-443e-a7bf-f07f8724aa15 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1267 microversion: 2.1 time: 0.232873 Aug 24 03:52:35.537750 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2118/4033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:35.734686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.735508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.748575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.749399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.750370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.752477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.753426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.754432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.087911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.098459 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-754ba409-6eb8-4010-adf3-06420080c174 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.368352 Aug 24 03:52:36.104506 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1916/4034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:36.425021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.426179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.437647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.438138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.453175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.454259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.454752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.455352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.564728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.565962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.584708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.603246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.606831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.608053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.608995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.610572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.697876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.711830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.713845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.715227 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-841a6db2-58d0-44df-8d2a-f5791b853e0b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1322 microversion: 2.26 time: 0.295037 Aug 24 03:52:36.716324 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2119/4035] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:37.128581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.135820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.171293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.178089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.178986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.181789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.181789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.181789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.291047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.306635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ce96d6a2-7ba4-436b-a001-67d0cba8370b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.745703 Aug 24 03:52:37.307248 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1917/4036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:37.482436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.495361 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1b0f6b15-85c1-4cfc-a8c5-3f93ebd48da9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1542 microversion: 2.1 time: 0.374355 Aug 24 03:52:37.499559 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2120/4037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1542 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:37.739993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.741734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.764200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.768208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.772760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.776274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.779748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.781414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.150769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.162125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.163850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.165183 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f1372ad-2d12-4d45-9cb0-dc3c103cf5e0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1320 microversion: 2.26 time: 0.430492 Aug 24 03:52:38.171716 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1918/4038] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:38.328114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:38.329027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:38.337077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.353680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.354137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.354959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.355423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.356008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.538870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:38.540388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:38.550656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.551428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.552461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.553446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.554394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.555055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.993570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.012738 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-835e716e-aa7d-4bfd-902b-68a9ebcc50d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.688499 Aug 24 03:52:39.016062 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2121/4039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:38 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:39.193842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.194716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.204518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.206507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.207308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.209523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.211178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.212626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.424033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.439239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.442351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.444258 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-747cd698-cd3e-4f3a-acbc-e3ee04566d46 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1320 microversion: 2.26 time: 0.257421 Aug 24 03:52:39.445448 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2122/4040] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:39.618801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.628583 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49abbec8-738f-4444-a2d2-b4e822fb5612 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1541 microversion: 2.1 time: 1.094874 Aug 24 03:52:39.645550 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1919/4041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:38 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1541 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:40.024036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d8f192f6-18f7-4576-8fd7-8a708760b17e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: .version_select at 0x7f10220bc0d0>, body: {"keypair": {"name": "tempest-keypair-931415141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPgScLXjhmnyZi62nmw2NglMGbAUCRup0LLOBYysd5Nt/0nag1MoFR9asKCQpg7i5C7nk0FfHZAAvKTiRuY5ZyjL91qnJdechumyaGXXlaXXxQrQZdRi6nMu2RNYzMwHw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:40.037308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.038197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.049734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.052306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.055107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.058670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.078444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.078670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.101203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-d8f192f6-18f7-4576-8fd7-8a708760b17e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:40.115494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-d8f192f6-18f7-4576-8fd7-8a708760b17e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for user cf384a2eab3649a2ad4f5eec8d8c6b0a and project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:40.227719 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d8f192f6-18f7-4576-8fd7-8a708760b17e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.204989 Aug 24 03:52:40.229431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2123/4042] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:52:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:40.290191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-cc06e6cf-1db9-48fd-8a5c-12ad2cdb76de req-5ff3eb6c-8763-4465-835d-565dd9b5ffc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06570cff-52f4-4543-8cc7-8a613c981f3b", "tag": "743b6ed9-69e0-4c54-b257-53c10caa5d2e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:40.357009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cc06e6cf-1db9-48fd-8a5c-12ad2cdb76de req-5ff3eb6c-8763-4465-835d-565dd9b5ffc8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.357953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cc06e6cf-1db9-48fd-8a5c-12ad2cdb76de req-5ff3eb6c-8763-4465-835d-565dd9b5ffc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.358719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cc06e6cf-1db9-48fd-8a5c-12ad2cdb76de req-5ff3eb6c-8763-4465-835d-565dd9b5ffc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.426849 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-cc06e6cf-1db9-48fd-8a5c-12ad2cdb76de req-5ff3eb6c-8763-4465-835d-565dd9b5ffc8 service nova] Creating event network-changed:743b6ed9-69e0-4c54-b257-53c10caa5d2e for instance 06570cff-52f4-4543-8cc7-8a613c981f3b on n-h1-846470-15 Aug 24 03:52:40.438474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-cc06e6cf-1db9-48fd-8a5c-12ad2cdb76de req-5ff3eb6c-8763-4465-835d-565dd9b5ffc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156991 Aug 24 03:52:40.447078 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2124/4043] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:40.477792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.482133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.513292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.514051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.519529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.522527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.532773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.533446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.152490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.173367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-30bc47e6-cb7e-436b-9f85-7af4041aaa77 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 1.135144 Aug 24 03:52:41.175117 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1920/4044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:41.207869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:41.209673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:41.239542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.240429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.241250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.243308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.245505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.246275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.316943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.334594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.351146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.360603 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31109d31-94aa-4c8b-ba24-86bc0bc420db tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 0.894914 Aug 24 03:52:41.361611 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2125/4045] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:41.861358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.875422 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ec4fe6ae-6cc1-4359-b1fe-0791eb4f13c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1541 microversion: 2.1 time: 0.698249 Aug 24 03:52:41.876410 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1921/4046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:41 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1541 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:42.196483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.197941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.219218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.220612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.221584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.222570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.223342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.223972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.390875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.392274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.414063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.414063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.414063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.414063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.414063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.414063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.738495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.748806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.762546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.763836 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7256e09f-92ce-423b-94bf-78604c9a8856 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 0.377259 Aug 24 03:52:42.765786 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1922/4047] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:42.783605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-012c1815-c618-44f4-8d7e-395dca89df92 req-cbdd801a-975b-4d3a-a198-fa3b460381fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "name": "network-vif-unplugged", "status": "completed", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:42.848726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-012c1815-c618-44f4-8d7e-395dca89df92 req-cbdd801a-975b-4d3a-a198-fa3b460381fb service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.849221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-012c1815-c618-44f4-8d7e-395dca89df92 req-cbdd801a-975b-4d3a-a198-fa3b460381fb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.876148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-012c1815-c618-44f4-8d7e-395dca89df92 req-cbdd801a-975b-4d3a-a198-fa3b460381fb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.933156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-012c1815-c618-44f4-8d7e-395dca89df92 req-cbdd801a-975b-4d3a-a198-fa3b460381fb service nova] Creating event network-vif-unplugged:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h1-846470-15 Aug 24 03:52:42.952950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-012c1815-c618-44f4-8d7e-395dca89df92 req-cbdd801a-975b-4d3a-a198-fa3b460381fb service nova] Instance 324f2dc7-031f-4cdf-854a-7461685dca7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:52:42.991014 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-012c1815-c618-44f4-8d7e-395dca89df92 req-cbdd801a-975b-4d3a-a198-fa3b460381fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.223877 Aug 24 03:52:43.003243 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1923/4048] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:43.015921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:43.016650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:43.033271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.033745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.033869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.036030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.038045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.039052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.039514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.044706 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9541afa8-b77b-4461-a016-780ad3a4259c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.852301 Aug 24 03:52:43.048258 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2126/4049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:43.731996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.749798 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ae4b313-4aad-431a-9402-146dbe8aeec5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1541 microversion: 2.1 time: 0.742632 Aug 24 03:52:43.753275 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1924/4050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:43 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1541 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:43.798353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:43.799502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:43.815602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:43.837664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.838596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.839380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.840611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.841409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.842195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.079319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.080322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.100839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.104004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.107338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.109667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.112897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.115515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.284780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.294540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.300365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.304312 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a25f6f45-eb69-4505-8616-e657f4b47c91 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 0.511749 Aug 24 03:52:44.307233 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2127/4051] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:43 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:44.455302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.471718 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1b521e6b-3733-4c8e-9e4d-f8e7b27e1cd4 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.403599 Aug 24 03:52:44.473688 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1925/4052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:44.771392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.772086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.795721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.796442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.796984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.797730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.808707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.809365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.111162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6ccb27d0-2b8a-4d94-8438-f9eb2c08fc06 req-09c6bd0a-b63b-4d95-ab79-74d3ec8fe30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}, {"name": "network-changed", "server_uuid": "8e3e36fa-38f0-415b-a698-c3bc6595b421", "tag": "4f546c49-3318-467d-8058-c26fb09e4b74"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:45.134398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ccb27d0-2b8a-4d94-8438-f9eb2c08fc06 req-09c6bd0a-b63b-4d95-ab79-74d3ec8fe30d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.134956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ccb27d0-2b8a-4d94-8438-f9eb2c08fc06 req-09c6bd0a-b63b-4d95-ab79-74d3ec8fe30d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.135458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ccb27d0-2b8a-4d94-8438-f9eb2c08fc06 req-09c6bd0a-b63b-4d95-ab79-74d3ec8fe30d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.173237 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6ccb27d0-2b8a-4d94-8438-f9eb2c08fc06 req-09c6bd0a-b63b-4d95-ab79-74d3ec8fe30d service nova] Creating event network-changed:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h1-846470-15 Aug 24 03:52:45.176748 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6ccb27d0-2b8a-4d94-8438-f9eb2c08fc06 req-09c6bd0a-b63b-4d95-ab79-74d3ec8fe30d service nova] Creating event network-changed:4f546c49-3318-467d-8058-c26fb09e4b74 for instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 on n-h1-846470-15 Aug 24 03:52:45.191061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-6ccb27d0-2b8a-4d94-8438-f9eb2c08fc06 req-09c6bd0a-b63b-4d95-ab79-74d3ec8fe30d service nova] Instance 324f2dc7-031f-4cdf-854a-7461685dca7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:52:45.226115 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6ccb27d0-2b8a-4d94-8438-f9eb2c08fc06 req-09c6bd0a-b63b-4d95-ab79-74d3ec8fe30d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.120515 Aug 24 03:52:45.230877 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1926/4053] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:45.245043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.259809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8125eb2c-ef6d-48c3-be79-f2949e98761e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1541 microversion: 2.1 time: 0.493027 Aug 24 03:52:45.261211 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2128/4054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1541 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:45.330341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.331380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.345682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.346467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.351558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.353852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.354699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.355293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.497364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.499365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.511419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.512778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.515639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.518730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.521030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.522069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.796553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.806472 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c92cc4fd-4e9a-47e5-8a4a-4162e4d58c06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.315093 Aug 24 03:52:45.825155 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2129/4055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:45.836670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-157912148", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dedb9b92-960d-40c5-ae39-a6e49a145a80"}], "security_groups": [{"name": "tempest-securitygroup--1259610039"}], "key_name": "tempest-keypair-931415141", "user_data": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:46.176649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] validate_networks() for [('dedb9b92-960d-40c5-ae39-a6e49a145a80', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:47.146281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:47.146955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:47.147433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:47.147969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:47.148448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:47.193126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.194604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.195057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.195841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.196306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.196739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.243370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:47.260220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for user cf384a2eab3649a2ad4f5eec8d8c6b0a and project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:47.295873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:47.301482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:47.453859 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a879ae9b-8065-4443-b619-90d3f4c240ea tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.627414 Aug 24 03:52:47.454526 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2130/4056] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:52:47.457321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.476912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.484626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.485117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.485473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.502150 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-43b856ef-3fe4-438d-9a43-8206e0ea4d94 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 2.162514 Aug 24 03:52:47.510657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.512278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.512900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.516467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.516630 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1927/4057] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:47.520108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.528188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.530525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.537556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.549338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.550427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.554093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.555227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.555957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.556624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.818006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.828236 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7fed1b63-9008-407b-ba31-3db6da29ed9c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1541 microversion: 2.1 time: 0.372452 Aug 24 03:52:47.828869 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2131/4058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1541 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:47.834631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aec39aad-dd48-449a-b206-dbf18870ebe0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.835589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aec39aad-dd48-449a-b206-dbf18870ebe0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.942351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aec39aad-dd48-449a-b206-dbf18870ebe0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.953443 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aec39aad-dd48-449a-b206-dbf18870ebe0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1240 microversion: 2.1 time: 0.121977 Aug 24 03:52:47.970138 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2132/4059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1240 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:48.533607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.537268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.556160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.558793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.560869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.561978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.563307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.564576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.567276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.584164 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4329e7bb-80df-437e-bc58-a1fd0ea47079 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 1.065990 Aug 24 03:52:48.588916 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1928/4060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:48.830791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.848446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.850194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.852357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.852933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.857842 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44bb3683-14f4-420f-8b20-468eeb0f8151 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 0.325355 Aug 24 03:52:48.860025 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2133/4061] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:48.870093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.871052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.871795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.872743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.873421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.874091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.985164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.985880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.993634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:48.996507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.996995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.997448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.998777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.999243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.999928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.125685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.153644 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-870ebfe4-2eb9-4456-a00a-3fae0c42dee0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1292 microversion: 2.1 time: 0.174427 Aug 24 03:52:49.163726 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2134/4062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:49.610286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.611061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.620181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.627203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.631348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.632287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.635604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.637958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.712841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.742976 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a037d07-06fc-46ec-9ee5-940085e091ec tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1541 microversion: 2.1 time: 0.897194 Aug 24 03:52:49.743572 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1929/4063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1541 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:49.773053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bc67aede-ba24-4cf4-abb7-e5b23295b632 req-b4c8d042-bdcd-47de-8889-2a591cd0aa8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06570cff-52f4-4543-8cc7-8a613c981f3b", "name": "network-vif-plugged", "status": "completed", "tag": "743b6ed9-69e0-4c54-b257-53c10caa5d2e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:49.826914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bc67aede-ba24-4cf4-abb7-e5b23295b632 req-b4c8d042-bdcd-47de-8889-2a591cd0aa8b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.831516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bc67aede-ba24-4cf4-abb7-e5b23295b632 req-b4c8d042-bdcd-47de-8889-2a591cd0aa8b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.832402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bc67aede-ba24-4cf4-abb7-e5b23295b632 req-b4c8d042-bdcd-47de-8889-2a591cd0aa8b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.876763 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bc67aede-ba24-4cf4-abb7-e5b23295b632 req-b4c8d042-bdcd-47de-8889-2a591cd0aa8b service nova] Creating event network-vif-plugged:743b6ed9-69e0-4c54-b257-53c10caa5d2e for instance 06570cff-52f4-4543-8cc7-8a613c981f3b on n-h1-846470-15 Aug 24 03:52:49.890602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bc67aede-ba24-4cf4-abb7-e5b23295b632 req-b4c8d042-bdcd-47de-8889-2a591cd0aa8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127781 Aug 24 03:52:49.904259 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1930/4064] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:49.915478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.918507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.943212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.943916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.944603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.946307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.949502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.951586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.290399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.303112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8257efb-59f6-480a-b455-88351dd98b1b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.696742 Aug 24 03:52:50.305806 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2135/4065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:50.317732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.318373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.336782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.337542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.338165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.339162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.339842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.340535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.463846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.479609 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcb04704-5a4c-44c8-bd7f-4a9c6e97db26 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1298 microversion: 2.1 time: 0.172165 Aug 24 03:52:50.484672 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2136/4066] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:50.765621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.767390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.780012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.780995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.781663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.782612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.783230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.784456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.805682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:51.136788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.156356 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ccf6c8b-3dbc-40b3-b06d-81b4ab66288b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1541 microversion: 2.1 time: 0.393786 Aug 24 03:52:51.162264 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2137/4067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1541 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:51.294452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.304016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.328420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.329627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.335988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.338367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7892e6a7-f756-4e29-be6d-4bc15a43ed7e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 1.432045 Aug 24 03:52:51.342507 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1931/4068] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:51.362774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.366155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.368323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.371235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.388979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.391326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.508741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.509796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.526937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.527371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.529074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.530889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.535967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.536939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.594299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:51.736859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.741117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.750404 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-28058383-8f56-4c3e-b228-8eabf784dde7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1298 microversion: 2.1 time: 0.247169 Aug 24 03:52:51.751003 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1932/4069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1298 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:51.752819 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0af0e1c9-c52f-4793-8e3f-bbb7d089884c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.429915 Aug 24 03:52:51.754110 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2138/4070] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:52.186432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.187190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.190854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:52.202486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.202986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.203418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.204504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.215366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.216022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.366237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.367464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.395990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.396816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.399994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.400987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.401626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.403126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.706748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.721605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.723383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.735143 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-22fdb1ad-8190-40d9-8672-53c6973d9892 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 0.373488 Aug 24 03:52:52.736424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2139/4071] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:52.789263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.791271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.799521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.800142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.800589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.801517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.802049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.802493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.828037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.840618 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-20a5dde7-80fe-4577-ac3d-eea2935e0b70 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1473 microversion: 2.1 time: 0.657907 Aug 24 03:52:52.843597 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1933/4072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1473 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:52.856162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.869021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.883341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.883881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.884327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.885059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.885517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.896450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.163270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.184158 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e303b859-e114-46a2-8d3b-ea60293cd253 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 0.411899 Aug 24 03:52:53.188465 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2140/4073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:53.250727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.286033 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90b48828-8770-48da-9dfe-7be587d8b91c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.437563 Aug 24 03:52:53.292012 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1934/4074] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:53.763355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.766241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.795473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.802840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.803545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.836005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.837922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.839229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.869923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.870699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.889299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.891241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.897674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.898895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.900009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.906002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.295877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.313919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.318158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.320839 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6339d057-e4a9-4013-ab86-37fa1e29290c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 0.565154 Aug 24 03:52:54.351138 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2141/4075] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:54.368874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.369514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.402151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.404077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.406283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.407797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.409757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.412627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.433168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.447218 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-974bf966-48fe-4676-9966-7a22d4555680 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1473 microversion: 2.1 time: 0.584600 Aug 24 03:52:54.462239 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1935/4076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1473 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.468594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.469291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.477662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.478598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.479320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.480401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.481187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.481875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.694222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.716825 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1feda6a-b97f-4f49-9986-1d7addb5cb08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 0.364360 Aug 24 03:52:54.717967 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2142/4077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.855090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.864951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2cd0242-aae9-45c4-b758-08020df27a7d tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.401601 Aug 24 03:52:54.869875 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1936/4078] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.939062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-441738f6-c1fa-4eae-a1c6-f674c584b99b req-f6737ca1-137a-4d35-ae88-683b6bb9fad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180c32a3-8b5e-41e5-bcf7-1940851e3804", "tag": "801dfd6b-d0b4-4033-8af0-1a33d32fffcb"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:54.968402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-441738f6-c1fa-4eae-a1c6-f674c584b99b req-f6737ca1-137a-4d35-ae88-683b6bb9fad0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.969071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-441738f6-c1fa-4eae-a1c6-f674c584b99b req-f6737ca1-137a-4d35-ae88-683b6bb9fad0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.969827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-441738f6-c1fa-4eae-a1c6-f674c584b99b req-f6737ca1-137a-4d35-ae88-683b6bb9fad0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.986237 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-441738f6-c1fa-4eae-a1c6-f674c584b99b req-f6737ca1-137a-4d35-ae88-683b6bb9fad0 service nova] Creating event network-changed:801dfd6b-d0b4-4033-8af0-1a33d32fffcb for instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 on n-h2-846470-15 Aug 24 03:52:54.993955 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-441738f6-c1fa-4eae-a1c6-f674c584b99b req-f6737ca1-137a-4d35-ae88-683b6bb9fad0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064093 Aug 24 03:52:54.995445 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2143/4079] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:55.349243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.349865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.396383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.397537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.399809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.405087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.408495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.410069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.470189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.470972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.499452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.502315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.505613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.506608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.507401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.508008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.793480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.812475 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-27b70017-2628-4d38-843e-9a2166d58e6b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1473 microversion: 2.1 time: 0.346664 Aug 24 03:52:55.814742 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2144/4080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1473 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:55.823246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.825150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.843356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.845506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.846242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.848706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.849726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.851326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.145874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.158557 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99aa5a7a-9047-4ced-aef6-709ec02b36c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 0.339209 Aug 24 03:52:56.175360 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2145/4081] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:56.180386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:56.181011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:56.195884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.200435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.202208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.203011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.205495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.206211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.373004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.393001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.395114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.401332 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-996e98c4-f5a1-475c-84af-cd81f86e305e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 1.057450 Aug 24 03:52:56.420528 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1937/4082] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:56.434060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6c067a77-3226-443c-9d21-8ba0238fe5fe req-d0fbd953-3e95-41d8-afa5-6fba3fc76500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3e36fa-38f0-415b-a698-c3bc6595b421", "name": "network-vif-plugged", "status": "completed", "tag": "4f546c49-3318-467d-8058-c26fb09e4b74"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:56.445573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c067a77-3226-443c-9d21-8ba0238fe5fe req-d0fbd953-3e95-41d8-afa5-6fba3fc76500 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.446371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c067a77-3226-443c-9d21-8ba0238fe5fe req-d0fbd953-3e95-41d8-afa5-6fba3fc76500 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.447094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c067a77-3226-443c-9d21-8ba0238fe5fe req-d0fbd953-3e95-41d8-afa5-6fba3fc76500 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.473146 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6c067a77-3226-443c-9d21-8ba0238fe5fe req-d0fbd953-3e95-41d8-afa5-6fba3fc76500 service nova] Creating event network-vif-plugged:4f546c49-3318-467d-8058-c26fb09e4b74 for instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 on n-h1-846470-15 Aug 24 03:52:56.486610 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6c067a77-3226-443c-9d21-8ba0238fe5fe req-d0fbd953-3e95-41d8-afa5-6fba3fc76500 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063763 Aug 24 03:52:56.493840 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1938/4083] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:56.561912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.573805 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f48e060e-441b-484f-b1f4-a9a7531e0c8f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1309 microversion: 2.1 time: 0.397207 Aug 24 03:52:56.576633 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2146/4084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:56 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1309 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:56.846623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:56.847484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:56.855713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.858688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.860410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.861276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.865822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.866376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.087930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.101535 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a39dc928-a8b2-4cca-891c-0f016dacbd7d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1470 microversion: 2.1 time: 0.259687 Aug 24 03:52:57.103020 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1939/4085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:56 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:57.125116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:57.125801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.134868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.135760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.136429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.138166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.138609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.139207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.185852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.186819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.186819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.187481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.188151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.188786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.194276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.196576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.217331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.217832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.218272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.222939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.223439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.223916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.225449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:57.231374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for user 1121b62203674b82ae3c7cfcb3112eb5 and project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:57.405114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.423230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ead157b-effd-4a5e-b828-2a2393f8ca4b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 0.245400 Aug 24 03:52:57.423453 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1017a9b-1c87-4c81-bc1f-88d1e89f86b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b/action" status: 202 len: 0 microversion: 2.1 time: 0.301841 Aug 24 03:52:57.424962 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2147/4086] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:52:57 2022] POST /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:52:57.426108 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1940/4087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:57.437214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.438103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.442077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.443780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.446236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.446730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.447154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.448789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.450021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.450610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.457667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.459145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.459632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.461171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.461632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.462058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.655427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.666944 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fdd0c527-6b2b-4a3d-a370-f5bba6d3cb6e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.237458 Aug 24 03:52:57.670826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.680927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.682514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.684215 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0cf877fc-6aba-4572-b456-5fd955e2b3f4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1362 microversion: 2.26 time: 0.252572 Aug 24 03:52:57.684630 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1941/4088] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:57.686824 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2148/4089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:57.704823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.705487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.717637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.718133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.719004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.719914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.720533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.721141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.905391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.915594 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ff275657-561d-4754-aada-8cb2f75a1027 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1491 microversion: 2.1 time: 0.227421 Aug 24 03:52:57.917337 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2149/4090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1491 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:57.939465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:57.943519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.950536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.951267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.952031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.953171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.953861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.954555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.064338 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3d9843a3-04e8-47cc-8abe-3699b3824932 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "PUT /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1086 microversion: 2.1 time: 0.127712 Aug 24 03:52:58.079212 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1942/4091] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:52:57 2022] PUT /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1086 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:58.086627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.087396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.105026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=28 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:58.107186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.108073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.108968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.109898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.110514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.111100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.458016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.458947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.460742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.470253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8b34a5c9-659e-4fa0-8ac8-b770e0422f50 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1512 microversion: 2.1 time: 0.390662 Aug 24 03:52:58.476114 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2150/4092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:58.494891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.496395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.496890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.497490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.500473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.500725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.501658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.504346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.526685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.527293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.530111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.537400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.538251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.539018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.889946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.902807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:58.914713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63d2aea8-db1f-4669-b8ac-310528604d67 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1512 microversion: 2.1 time: 0.419156 Aug 24 03:52:58.931840 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2151/4093] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:58.938135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.941665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.967118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.970083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.972555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.974431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.975355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.977194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.295237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.324507 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58fa6b9a-1b05-4ebe-bbf6-4ef3ed42f041 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.390984 Aug 24 03:52:59.325125 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2152/4094] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:59.332253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.336113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.348508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.349012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.349508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.350151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.350611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.351031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.449352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.460752 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5967017c-fa7b-4460-bfc1-c77287ce411c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 1.006564 Aug 24 03:52:59.483790 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1943/4095] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:59.490001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5660bb65-f610-4bcf-bc39-63c900bc9e5b req-7ab383fb-e85c-4224-bba2-acb95405f033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "name": "network-vif-plugged", "status": "completed", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:59.521866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5660bb65-f610-4bcf-bc39-63c900bc9e5b req-7ab383fb-e85c-4224-bba2-acb95405f033 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.522439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5660bb65-f610-4bcf-bc39-63c900bc9e5b req-7ab383fb-e85c-4224-bba2-acb95405f033 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.522880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5660bb65-f610-4bcf-bc39-63c900bc9e5b req-7ab383fb-e85c-4224-bba2-acb95405f033 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.571562 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5660bb65-f610-4bcf-bc39-63c900bc9e5b req-7ab383fb-e85c-4224-bba2-acb95405f033 service nova] Creating event network-vif-plugged:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h1-846470-15 Aug 24 03:52:59.597116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-5660bb65-f610-4bcf-bc39-63c900bc9e5b req-7ab383fb-e85c-4224-bba2-acb95405f033 service nova] Instance 324f2dc7-031f-4cdf-854a-7461685dca7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:52:59.617940 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5660bb65-f610-4bcf-bc39-63c900bc9e5b req-7ab383fb-e85c-4224-bba2-acb95405f033 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144030 Aug 24 03:52:59.618902 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1944/4096] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:59.627186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.627562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.638915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.639711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.640379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.641089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.644614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.645506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.701095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:52:59.773381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.793998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.798396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.803561 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a686323-c245-4e7d-9e1e-d13e71958ec0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1546 microversion: 2.26 time: 0.476396 Aug 24 03:52:59.805457 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2153/4097] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:59 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1546 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:59.849508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f102204c4c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.881094 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-677b93bd-e206-4422-8242-5b3c120285da tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 204 len: 0 microversion: 2.1 time: 0.260302 Aug 24 03:52:59.883492 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1945/4098] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:52:59 2022] DELETE /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:52:59.891509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.892167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.892698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.893448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.897023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.897885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.900712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.901578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.902252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.903282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.903952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.904566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.904964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.905530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.906154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.907112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.907776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.908541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.964486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.965787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.966886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.994042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.994267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.994901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.032549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:00.053211 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-484770c5-522a-4c13-9e2e-6d0c93c3f103 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-2024698504" status: 201 len: 0 microversion: 2.26 time: 0.225229 Aug 24 03:53:00.058744 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2154/4099] 10.222.0.58 () {62 vars in 1380 bytes} [Wed Aug 24 03:52:59 2022] PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-2024698504 => generated 0 bytes in 229 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 24 03:53:00.071219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5673a5f5-7bfd-4b24-b93b-109550f19986 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f10220189d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.080277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5673a5f5-7bfd-4b24-b93b-109550f19986 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.080918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5673a5f5-7bfd-4b24-b93b-109550f19986 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.082352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5673a5f5-7bfd-4b24-b93b-109550f19986 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.095097 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5673a5f5-7bfd-4b24-b93b-109550f19986 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-2024698504" status: 204 len: 0 microversion: 2.26 time: 0.032159 Aug 24 03:53:00.102594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2155/4100] 10.222.0.58 () {60 vars in 1361 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-2024698504 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:53:00.112225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f102204cc10>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.122132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.122929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.123454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.124650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.133672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.134252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.134881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.136835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.137445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.138654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.177170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.177837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.178631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.203149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:00.227555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3ef8dbe-710a-4d56-86b9-14d928c7c421 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 204 len: 0 microversion: 2.26 time: 0.122934 Aug 24 03:53:00.232184 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2156/4101] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 24 03:53:00 2022] DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:53:00.245609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:00.258361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af3c4c19-5509-4794-a3f5-f9157e21906a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f102279c8b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.264152 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bcbfac3b-9ab8-4de6-a998-2a58bc53dacf tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1518 microversion: 2.1 time: 0.374745 Aug 24 03:53:00.264757 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1946/4102] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:59 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1518 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:00.283778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3c4c19-5509-4794-a3f5-f9157e21906a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.288532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3c4c19-5509-4794-a3f5-f9157e21906a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.289157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3c4c19-5509-4794-a3f5-f9157e21906a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.334149 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af3c4c19-5509-4794-a3f5-f9157e21906a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 200 len: 12 microversion: 2.26 time: 0.094970 Aug 24 03:53:00.336078 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2157/4103] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 12 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:00.347610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f102a6be1f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.368207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.369782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.377434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.379427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.383019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.386306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.388340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.389102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.391107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.392863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.395761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.396475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.404079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.404222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.404917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.405759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.407219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.407914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.479921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.490707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.491928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.515185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:00.538453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.538954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.539390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.615390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:00.673875 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-85682a60-c102-4b4b-93dc-23fa322af30f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-1357073607" status: 201 len: 0 microversion: 2.26 time: 0.331278 Aug 24 03:53:00.684857 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1947/4104] 10.222.0.58 () {62 vars in 1380 bytes} [Wed Aug 24 03:53:00 2022] PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-1357073607 => generated 0 bytes in 338 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 24 03:53:00.689401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.694133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.706929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.707953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.708618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.710716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.711448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.712635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.753244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:00.767360 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-36f3d49d-6648-4884-836f-e7378e907089 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.411221 Aug 24 03:53:00.768889 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2158/4105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:00.798948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7fe4f44-6a6c-4237-b157-004831be05d6 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f10220bc9d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.829220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7fe4f44-6a6c-4237-b157-004831be05d6 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.829991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7fe4f44-6a6c-4237-b157-004831be05d6 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.831515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7fe4f44-6a6c-4237-b157-004831be05d6 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.864278 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7fe4f44-6a6c-4237-b157-004831be05d6 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 200 len: 36 microversion: 2.26 time: 0.091057 Aug 24 03:53:00.865176 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2159/4106] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 36 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:00.881487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f10227eba60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.902513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.903994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.904780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.905438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.916423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.917941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.919412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.920421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.923483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.924490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.989742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.991692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.992212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.041292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:01.057874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:01.061757 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c4323d25-4523-4915-b508-b84c04c78b15 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-1357073607" status: 204 len: 0 microversion: 2.26 time: 0.187138 Aug 24 03:53:01.063390 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2160/4107] 10.222.0.58 () {60 vars in 1364 bytes} [Wed Aug 24 03:53:00 2022] DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-1357073607 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:53:01.077884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9daa9960-3b28-4dc2-9891-5502bf5f1a32 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f10220bc160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:01.083872 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-36616b41-f0dc-42cb-95cf-229588e187c2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 0.403877 Aug 24 03:53:01.085335 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1948/4108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:01.098339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9daa9960-3b28-4dc2-9891-5502bf5f1a32 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.098826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9daa9960-3b28-4dc2-9891-5502bf5f1a32 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.099260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9daa9960-3b28-4dc2-9891-5502bf5f1a32 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.110219 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9daa9960-3b28-4dc2-9891-5502bf5f1a32 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 200 len: 12 microversion: 2.26 time: 0.041497 Aug 24 03:53:01.118606 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2161/4109] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:53:01 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:01.126803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f102a17d820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:01.145174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.145676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.146115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.148502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:01.167449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.167999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.168446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.169168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.169662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.170090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.213845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.214921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.215280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.233609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:01.292064 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3dc83b72-0182-4989-aead-e4949c405f8d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 204 len: 0 microversion: 2.26 time: 0.169819 Aug 24 03:53:01.298800 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1949/4110] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 24 03:53:01 2022] DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:53:01.311796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f1022000670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:01.337505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:01.340887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:01.371791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.371791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.372177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.374836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.376259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.377345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.378765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:01.385982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.386916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.387861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.401304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.404165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.405563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.409960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.412695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.417065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.574912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.583578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.585557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.613588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.615529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.617127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.679185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:01.717103 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f4efe21-d529-4839-9d3b-14f886a03d28 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-803257454" status: 201 len: 0 microversion: 2.26 time: 0.413583 Aug 24 03:53:01.720637 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2162/4111] 10.222.0.58 () {62 vars in 1377 bytes} [Wed Aug 24 03:53:01 2022] PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-803257454 => generated 0 bytes in 421 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 24 03:53:01.737509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f1021fc9280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:01.764597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.769539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.771642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.773660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:01.790989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.794112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.795138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.798746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.800637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.803150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.892108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.893336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.897585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.955281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:01.962321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:01.964895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.016655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:02.030477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:02.110915 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5479fac7-47c4-4f4a-bff1-b30dc807d6f5 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-709214935" status: 201 len: 0 microversion: 2.26 time: 0.380196 Aug 24 03:53:02.115652 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2163/4112] 10.222.0.58 () {62 vars in 1377 bytes} [Wed Aug 24 03:53:01 2022] PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-709214935 => generated 0 bytes in 389 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 24 03:53:02.136583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.137807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:02.163839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.164802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.166765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.167770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.168414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.169141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.211922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.220753 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90166e22-8d40-4926-ba8b-c09f86a7094e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1518 microversion: 2.1 time: 0.911690 Aug 24 03:53:02.235895 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1950/4113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:01 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1518 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:02.249181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.250532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:02.289725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.296946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.297555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.307163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.308222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.308997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.538820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.554276 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f707dda7-c6db-46e6-84a9-61ac86d9da67 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.432874 Aug 24 03:53:02.564208 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2164/4114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:02 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:02.578382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f10220bc0d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.606284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.606772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.607385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.608112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:02.631477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.632235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.632817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.633918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.634534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.635113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.685754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.698589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.699315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.729614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:02.757677 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1cae5bf8-3879-4df0-802a-e169aaf9113b tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 204 len: 0 microversion: 2.26 time: 0.192414 Aug 24 03:53:02.763770 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2165/4115] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 24 03:53:02 2022] DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:53:02.772557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec367781-d68c-4345-a244-d3dc5217b5be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f1021fc9dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.789268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec367781-d68c-4345-a244-d3dc5217b5be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.790018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec367781-d68c-4345-a244-d3dc5217b5be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.791858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec367781-d68c-4345-a244-d3dc5217b5be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.815154 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec367781-d68c-4345-a244-d3dc5217b5be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 200 len: 12 microversion: 2.26 time: 0.047097 Aug 24 03:53:02.820875 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2166/4116] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:53:02 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:02.826293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f1021fd84c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.836079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.852701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.853155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.853837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:02.860806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.861550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.862358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.863239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.864989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.869253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.924952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.925904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.927657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.952735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:02.969393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d004b995-c59f-4e8d-9e04-5f9015af37d0 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 204 len: 0 microversion: 2.26 time: 0.147290 Aug 24 03:53:02.973188 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2167/4117] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 24 03:53:02 2022] DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:53:02.981740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f1022000dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.995542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.996231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.996683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.997155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.000896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:03.006218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.006716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.007247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.008285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.008876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.009390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.046735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.047228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.047697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.066695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.066695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.066695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.125461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:03.163228 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc563211-73fe-4802-b1fa-a96c4f4a16b4 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-773763600" status: 201 len: 0 microversion: 2.26 time: 0.186534 Aug 24 03:53:03.164303 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2168/4118] 10.222.0.58 () {62 vars in 1377 bytes} [Wed Aug 24 03:53:02 2022] PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-773763600 => generated 0 bytes in 188 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 24 03:53:03.165821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.175471 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7cd4d5aa-0550-48ba-8673-6a7da43823c1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 0.941407 Aug 24 03:53:03.177079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f1021fc95e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.184891 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1951/4119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:02 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:03.213848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.216613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.217438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.218296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.243904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.244760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.245136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.245613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.246458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.246748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.252052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.252770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.262529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.263475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.264184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.265123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.265806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.269196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.318549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.322668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.323287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.348894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.349379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.352032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.408244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:03.430586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f69b6a7c-f21c-480c-8629-a10d4bf0897e tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-932462998" status: 201 len: 0 microversion: 2.26 time: 0.257756 Aug 24 03:53:03.437025 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2169/4120] 10.222.0.58 () {62 vars in 1377 bytes} [Wed Aug 24 03:53:03 2022] PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags/tempest-tag-932462998 => generated 0 bytes in 265 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 24 03:53:03.443326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Action: 'update_all', calling method: .version_select at 0x7f1021fc9790>, body: {"tags": ["tempest-tag-1949478619", "tempest-tag-306066605"]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:03.458601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.459193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.460284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.460778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.468098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.468687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.469801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.470543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.471073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.471738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.519358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.520759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.522033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.552188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:03.576305 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c71667a5-fb7b-47ea-b2d6-84b280506f7c tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 200 len: 61 microversion: 2.26 time: 0.137843 Aug 24 03:53:03.586820 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2170/4121] 10.222.0.58 () {62 vars in 1312 bytes} [Wed Aug 24 03:53:03 2022] PUT /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 61 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:03.593194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.594137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.601943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.602613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.603254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.604189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.604813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.605436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.853694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.866401 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10382a45-6017-48e4-a4e4-b9b3448eba5e tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.277943 Aug 24 03:53:03.867979 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2171/4122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:03 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:03.889265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb4699b7-b4c0-4708-aec0-f894826e794f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f10220009d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.924106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4699b7-b4c0-4708-aec0-f894826e794f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.925663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4699b7-b4c0-4708-aec0-f894826e794f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.926526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb4699b7-b4c0-4708-aec0-f894826e794f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.949772 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb4699b7-b4c0-4708-aec0-f894826e794f tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 200 len: 61 microversion: 2.26 time: 0.079653 Aug 24 03:53:03.951101 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2172/4123] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 24 03:53:03 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 61 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:03.963534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '.version_select at 0x7f1021ffc160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.972427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.973307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.973759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.974243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.998580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.999251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.999749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.000462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.001543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.001990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.031789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.032370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.032822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.056805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'flavor' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:04.099179 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dbcda14c-589d-461d-bca4-8519cf5b34be tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags" status: 204 len: 0 microversion: 2.26 time: 0.141811 Aug 24 03:53:04.100132 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2173/4124] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 24 03:53:03 2022] DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421/tags => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:53:04.112634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-55735c60-2a02-4022-b916-5b9e5519a8ea req-abc91383-08b9-4547-8bad-aa11d5faf3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c32a3-8b5e-41e5-bcf7-1940851e3804", "name": "network-vif-plugged", "status": "completed", "tag": "801dfd6b-d0b4-4033-8af0-1a33d32fffcb"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:04.144250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-55735c60-2a02-4022-b916-5b9e5519a8ea req-abc91383-08b9-4547-8bad-aa11d5faf3e4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.150156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-55735c60-2a02-4022-b916-5b9e5519a8ea req-abc91383-08b9-4547-8bad-aa11d5faf3e4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.150919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-55735c60-2a02-4022-b916-5b9e5519a8ea req-abc91383-08b9-4547-8bad-aa11d5faf3e4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.182963 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-55735c60-2a02-4022-b916-5b9e5519a8ea req-abc91383-08b9-4547-8bad-aa11d5faf3e4 service nova] Creating event network-vif-plugged:801dfd6b-d0b4-4033-8af0-1a33d32fffcb for instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 on n-h2-846470-15 Aug 24 03:53:04.197186 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-55735c60-2a02-4022-b916-5b9e5519a8ea req-abc91383-08b9-4547-8bad-aa11d5faf3e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094913 Aug 24 03:53:04.199090 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2174/4125] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:04.219339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.224114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:04.224958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.245740 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aa01ce62-3aeb-4ea0-95de-b254101190f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1518 microversion: 2.1 time: 1.005115 Aug 24 03:53:04.250195 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1952/4126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:03 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1518 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:04.252163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.256905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.257604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.258378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.267391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.268024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.271306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.274746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.299135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.301747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.302434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.306889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.307584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.308851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.349740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:04.385493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:53:04.680676 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-270bd8e1-c274-48c5-9d84-c75f6353587d tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 204 len: 0 microversion: 2.26 time: 0.477603 Aug 24 03:53:04.682215 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2175/4127] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:53:04 2022] DELETE /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:53:04.697274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-921dee3a-2459-49db-9791-72696b825e16 req-8050d711-42f4-4ff1-a3a3-b4a074855c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06570cff-52f4-4543-8cc7-8a613c981f3b", "name": "network-vif-deleted", "tag": "743b6ed9-69e0-4c54-b257-53c10caa5d2e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:04.739970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-921dee3a-2459-49db-9791-72696b825e16 req-8050d711-42f4-4ff1-a3a3-b4a074855c17 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.740472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-921dee3a-2459-49db-9791-72696b825e16 req-8050d711-42f4-4ff1-a3a3-b4a074855c17 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.740913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-921dee3a-2459-49db-9791-72696b825e16 req-8050d711-42f4-4ff1-a3a3-b4a074855c17 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.810142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-921dee3a-2459-49db-9791-72696b825e16 req-8050d711-42f4-4ff1-a3a3-b4a074855c17 service nova] Creating event network-vif-deleted:743b6ed9-69e0-4c54-b257-53c10caa5d2e for instance 06570cff-52f4-4543-8cc7-8a613c981f3b on n-h1-846470-15 Aug 24 03:53:04.830863 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-921dee3a-2459-49db-9791-72696b825e16 req-8050d711-42f4-4ff1-a3a3-b4a074855c17 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147076 Aug 24 03:53:04.836128 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2176/4128] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:04.854668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.859350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.873884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.875702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.877919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.878695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:04.879538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.881657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.886148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.888720 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-60e521bc-c57d-4813-8e75-ac16b98e13b8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 0.637054 Aug 24 03:53:04.900311 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1953/4129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:04.910693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.911349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.917925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.918423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.918869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.919581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.920291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.920913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:05.136590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.147990 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-857fa5e8-89b8-4c31-aa62-753b94a045f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.246166 Aug 24 03:53:05.148927 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1954/4130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:05.257988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.273193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:05.274573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:05.288895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:05.289998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.291919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.292807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:05.293726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:05.296151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:05.296870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:05.297811 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e4cfdbaf-f637-42e9-bc7b-c1eebc235e18 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1552 microversion: 2.26 time: 0.456783 Aug 24 03:53:05.298960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:05.304781 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2177/4131] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1552 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:05.373426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.383089 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-812bedc7-a975-4174-8898-dfa3a7d96d76 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1476 microversion: 2.1 time: 0.116590 Aug 24 03:53:05.396376 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1955/4132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:05 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1476 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:05.914729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:05.915621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:05.927090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:05.930668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:05.933277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:05.934305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:05.935033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:05.935714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.177035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:06.177956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:06.198855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.203205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.203882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.205143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.206375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.211231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.231265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.247270 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-505da96e-ce88-4b4e-addc-d29ecd37bfaa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1366 microversion: 2.1 time: 0.338326 Aug 24 03:53:06.257975 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2178/4133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:05 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:06.325623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:06.326336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:06.341656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.342304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.348034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.349129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.352447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.355618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.620910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.629513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.632011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.633731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.634998 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0edafa1e-f18b-4978-ab26-70865d3ecc79 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1552 microversion: 2.26 time: 0.313448 Aug 24 03:53:06.640011 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a9fbcfa7-5045-4eaa-b849-9f7941c32c40 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.470319 Aug 24 03:53:06.640688 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1956/4134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:06 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:06.648629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:06.650505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:06.652459 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2179/4135] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:06 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1552 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:53:06.670262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.670770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.671333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.671970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.672636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.673252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.805952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.824754 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d86a827e-1854-446f-adf2-9b20df07ac93 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1315 microversion: 2.1 time: 0.181562 Aug 24 03:53:06.831785 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1957/4136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:06 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:07.281287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:07.283312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.286683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=5 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:07.298305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.304431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.306489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.308544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.310737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.311570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.546291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:07.556707 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3e5d1f95-5063-4fbe-b022-e411acdc0a08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1556 microversion: 2.1 time: 0.280333 Aug 24 03:53:07.558143 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2180/4137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1556 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:07.595993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:07.597341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.614064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.614739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.615778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.617904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.618383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.618822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.672552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:07.673848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.683321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.684384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.685059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.686654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.687453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.688123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.822184 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d60d8058-feba-455c-847e-8a36102fd8fa tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.233330 Aug 24 03:53:07.823114 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1958/4138] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:07.829157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:07.830258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.846808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.847555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.853676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.856719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.857367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.860918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.104836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:08.116696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e23b4337-3ee3-4d2a-bfaf-85023ba3e8b9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.454446 Aug 24 03:53:08.117633 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2181/4139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:08.122490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:08.125923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:08.140016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.143782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.144639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.147920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.156674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.157509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.227175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.232189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.232189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.232485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lazy-loading 'fault' on Instance uuid 06570cff-52f4-4543-8cc7-8a613c981f3b {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:08.325724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:08.338270 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58f47249-8fa2-4b15-af34-fec1927e2e95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 200 len: 1320 microversion: 2.1 time: 0.219153 Aug 24 03:53:08.339195 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2182/4140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:08 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:08.795394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9fdf842b-d20b-4264-abbd-d01f67be0292 req-31e48a00-7698-458c-b3bd-6149141efa0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3e36fa-38f0-415b-a698-c3bc6595b421", "name": "network-vif-deleted", "tag": "4f546c49-3318-467d-8058-c26fb09e4b74"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:08.828543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:08.829288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9fdf842b-d20b-4264-abbd-d01f67be0292 req-31e48a00-7698-458c-b3bd-6149141efa0f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.830925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9fdf842b-d20b-4264-abbd-d01f67be0292 req-31e48a00-7698-458c-b3bd-6149141efa0f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.835419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9fdf842b-d20b-4264-abbd-d01f67be0292 req-31e48a00-7698-458c-b3bd-6149141efa0f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.847071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:08.860767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:08.865605 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27985228-d787-4420-b990-8cd763dc5c97 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1552 microversion: 2.26 time: 1.041398 Aug 24 03:53:08.887580 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1959/4141] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1552 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:08.897730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9fdf842b-d20b-4264-abbd-d01f67be0292 req-31e48a00-7698-458c-b3bd-6149141efa0f service nova] Creating event network-vif-deleted:4f546c49-3318-467d-8058-c26fb09e4b74 for instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 on n-h1-846470-15 Aug 24 03:53:08.934404 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9fdf842b-d20b-4264-abbd-d01f67be0292 req-31e48a00-7698-458c-b3bd-6149141efa0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140675 Aug 24 03:53:08.942891 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2183/4142] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:09.150221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:09.151027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:09.177178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.179382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.180155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.183889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.185255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.188605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.370924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:09.371744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:09.408113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.411402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.412738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.414198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.414198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.414949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.480065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b HTTP/1.1 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '06570cff-52f4-4543-8cc7-8a613c981f3b'} Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:09.487988 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-230e8a61-ff31-49c1-9b9d-70aa8a5e9f88 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 404 len: 111 microversion: 2.1 time: 0.128413 Aug 24 03:53:09.498107 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2184/4143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:09 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:53:09.569588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:09.581288 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d133105-88a9-4393-8dac-8a4c36e39506 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1469 microversion: 2.1 time: 0.446278 Aug 24 03:53:09.586494 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1960/4144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:09 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1469 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:09.821527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1022062694", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a410578b-d916-4218-bf01-482ee8be19b3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:09.900535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:09.901498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:09.914649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.915156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.915597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.916351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.916816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.923643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.931959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] validate_networks() for [('a410578b-d916-4218-bf01-482ee8be19b3', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:53:10.007709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:10.008217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:10.008841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.013449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lazy-loading 'fault' on Instance uuid 8e3e36fa-38f0-415b-a698-c3bc6595b421 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:10.134453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.158560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.168350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89053fb5bde48c2b30542cb2fda740f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3e54dc077b4b1fbed34153acae6aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.177152 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d8ffbaf-a477-488f-acd1-9d802cc25ce3 tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 200 len: 1352 microversion: 2.26 time: 0.277248 Aug 24 03:53:10.179289 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1961/4145] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:09 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 1352 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:53:10.870616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2c770963-a468-42ec-bd7a-3b065558586f req-48bba9f3-0354-4ca4-b44f-64265ae85452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180c32a3-8b5e-41e5-bcf7-1940851e3804", "tag": "801dfd6b-d0b4-4033-8af0-1a33d32fffcb"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:10.916228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2c770963-a468-42ec-bd7a-3b065558586f req-48bba9f3-0354-4ca4-b44f-64265ae85452 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:10.920390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2c770963-a468-42ec-bd7a-3b065558586f req-48bba9f3-0354-4ca4-b44f-64265ae85452 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:10.921985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2c770963-a468-42ec-bd7a-3b065558586f req-48bba9f3-0354-4ca4-b44f-64265ae85452 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.995116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:11.013748 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2c770963-a468-42ec-bd7a-3b065558586f req-48bba9f3-0354-4ca4-b44f-64265ae85452 service nova] Creating event network-changed:801dfd6b-d0b4-4033-8af0-1a33d32fffcb for instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 on n-h2-846470-15 Aug 24 03:53:11.057708 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2c770963-a468-42ec-bd7a-3b065558586f req-48bba9f3-0354-4ca4-b44f-64265ae85452 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.596308 Aug 24 03:53:11.061931 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1962/4146] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:11.088519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:11.089245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:11.125437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.129027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.129667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.130891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.131394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.134006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.572727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:53:11.573637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:53:11.574920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:53:11.575402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:53:11.575948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:53:11.600564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.605182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.605809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.608713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.615229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.615796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.674534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:53:11.690754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Getting quotas for user 0b8d8d611eca416ab165ce4bba901ac5 and project a9b3e378efe04ae99615d3181be6f9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:53:11.727472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:53:11.734122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:53:11.846253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07bed3ea-6d93-4542-908b-a6075f7a7a95 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.031034 Aug 24 03:53:11.853309 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2185/4147] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:53:11.855381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:11.858662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] [instance: 8e3e36fa-38f0-415b-a698-c3bc6595b421] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:11.873413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.875505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.878030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.880390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.880933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.881417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.946677 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] HTTP exception thrown: Instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 could not be found. Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Request method failure captured: Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 HTTP/1.1 Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaB_BwpnP9ZrqPq7YTY1phtFwW8_SsxFuvXVwf69BlCVCxPeZKlqjccIhHDH-H2ZVyl27xdnRjeC4l3cNf_f1czXIjSit3YbDGFHcFe2ktDItpd40tcvdclHZcSVLoaCMaL6Kz3QLBPSL-jnXZetoCerI8rf-pgSfyAFIUqVTQXFR9o Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.26 Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 4a3e54dc077b4b1fbed34153acae6aaf Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerTagsTestJSON-1995319856 Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4a3e54dc077b4b1fbed34153acae6aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4a3e54dc077b4b1fbed34153acae6aaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a3e54dc077b4b1fbed34153acae6aaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4a3e54dc077b4b1fbed34153acae6aaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerTagsTestJSON-1995319856 Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 4a3e54dc077b4b1fbed34153acae6aaf Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerTagsTestJSON-1995319856 Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerTagsTestJSON-1995319856-project Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d89053fb5bde48c2b30542cb2fda740f Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerTagsTestJSON-1995319856-project Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 could not be found. Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8e3e36fa-38f0-415b-a698-c3bc6595b421'} Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 could not be found. Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 could not be found. Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:11.948311 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 could not be found. Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] Returning 404 to user: Instance 8e3e36fa-38f0-415b-a698-c3bc6595b421 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:11.952212 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce27282e-e42e-44a2-819e-bd9163ea140a tempest-ServerTagsTestJSON-1995319856 tempest-ServerTagsTestJSON-1995319856-project] 10.222.0.58 "GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421" status: 404 len: 111 microversion: 2.26 time: 0.101445 Aug 24 03:53:11.958268 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2186/4148] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:11 2022] GET /compute/v2.1/servers/8e3e36fa-38f0-415b-a698-c3bc6595b421 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:53:11.985859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ea44670-7f93-4022-8158-19dea4e74f12 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:11.986746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ea44670-7f93-4022-8158-19dea4e74f12 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:12.174846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:12.188885 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7f3833b7-aeb0-4278-9ed9-fa11b779e099 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1535 microversion: 2.1 time: 1.104852 Aug 24 03:53:12.202465 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1963/4149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:11 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1535 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:12.425845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ea44670-7f93-4022-8158-19dea4e74f12 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:12.439260 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ea44670-7f93-4022-8158-19dea4e74f12 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1209 microversion: 2.1 time: 0.473283 Aug 24 03:53:12.440207 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2187/4150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:11 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1209 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:12.538622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5eed5003-ef4d-48a5-8234-a53ffe41be66 req-3ada9fb7-7e3e-4acb-b113-7d6a878bc55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "name": "network-vif-unplugged", "status": "completed", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:12.588199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5eed5003-ef4d-48a5-8234-a53ffe41be66 req-3ada9fb7-7e3e-4acb-b113-7d6a878bc55d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:12.589149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5eed5003-ef4d-48a5-8234-a53ffe41be66 req-3ada9fb7-7e3e-4acb-b113-7d6a878bc55d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:12.589776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5eed5003-ef4d-48a5-8234-a53ffe41be66 req-3ada9fb7-7e3e-4acb-b113-7d6a878bc55d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:12.632252 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5eed5003-ef4d-48a5-8234-a53ffe41be66 req-3ada9fb7-7e3e-4acb-b113-7d6a878bc55d service nova] Creating event network-vif-unplugged:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h2-846470-15 Aug 24 03:53:12.645942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-5eed5003-ef4d-48a5-8234-a53ffe41be66 req-3ada9fb7-7e3e-4acb-b113-7d6a878bc55d service nova] Instance 324f2dc7-031f-4cdf-854a-7461685dca7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:53:12.682657 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5eed5003-ef4d-48a5-8234-a53ffe41be66 req-3ada9fb7-7e3e-4acb-b113-7d6a878bc55d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148137 Aug 24 03:53:12.686516 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1964/4151] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:13.215824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:13.216444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:13.229432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.229939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.230383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.231245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.231916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.232534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.465175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:13.466559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:13.483352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.489395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.490028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.490958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.491594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.492243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.694693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:13.731854 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-376e98e3-f4b1-4b45-8b18-d5530edcc659 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1535 microversion: 2.1 time: 0.514964 Aug 24 03:53:13.747059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2188/4152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:13 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1535 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:13.842899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:13.857640 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-77cca57b-0c98-49e1-999a-d3bde617fcdb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1261 microversion: 2.1 time: 0.400339 Aug 24 03:53:13.858709 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1965/4153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:13 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1261 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:14.754810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:14.755349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:14.768996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.772533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.774241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.779085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.788152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.788708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.886041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:14.887145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:14.900329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.900957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.901416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.902151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.906454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.910854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.124686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:15.140314 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90785c3a-e030-46aa-8db4-eed1506ddb64 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1267 microversion: 2.1 time: 0.261728 Aug 24 03:53:15.142473 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1966/4154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:14 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:15.155418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ea9f879b-f6f3-4f1a-a008-70d938e6df95 req-9268d891-786b-4fd8-8cd7-86d254de6c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:15.179880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ea9f879b-f6f3-4f1a-a008-70d938e6df95 req-9268d891-786b-4fd8-8cd7-86d254de6c43 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.180376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ea9f879b-f6f3-4f1a-a008-70d938e6df95 req-9268d891-786b-4fd8-8cd7-86d254de6c43 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.180818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ea9f879b-f6f3-4f1a-a008-70d938e6df95 req-9268d891-786b-4fd8-8cd7-86d254de6c43 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.197658 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ea9f879b-f6f3-4f1a-a008-70d938e6df95 req-9268d891-786b-4fd8-8cd7-86d254de6c43 service nova] Creating event network-changed:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h2-846470-15 Aug 24 03:53:15.209826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-ea9f879b-f6f3-4f1a-a008-70d938e6df95 req-9268d891-786b-4fd8-8cd7-86d254de6c43 service nova] Instance 324f2dc7-031f-4cdf-854a-7461685dca7b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:53:15.243142 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ea9f879b-f6f3-4f1a-a008-70d938e6df95 req-9268d891-786b-4fd8-8cd7-86d254de6c43 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093994 Aug 24 03:53:15.243898 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1967/4155] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:15.387457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:15.397660 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a37e5e91-c0de-4141-831a-95ad916f2372 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1535 microversion: 2.1 time: 0.647079 Aug 24 03:53:15.405375 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2189/4156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:14 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1535 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:16.166374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:16.167258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:16.179834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.195393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.196664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.198567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.201938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.203353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.426227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:16.426828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:16.441837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.442985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.445258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.447139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.448045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.450486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.468655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:16.485591 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a64cbc4c-b3f0-4eba-b4e0-8d41e7fe8691 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1267 microversion: 2.1 time: 0.324929 Aug 24 03:53:16.503351 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1968/4157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:16 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:16.962882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:16.976686 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1bbf94cc-7625-47dc-b61e-2c9c6016ed99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1535 microversion: 2.1 time: 0.554784 Aug 24 03:53:16.982957 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2190/4158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:16 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1535 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:17.514200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:17.515421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:17.530950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.533559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.534408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.536304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.536929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.540139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.015048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:18.016409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:18.031055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.038177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.038909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.040267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.040842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.041814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.396985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:18.416236 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c76ad78-d04c-419a-b581-80318ab00ec6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.906487 Aug 24 03:53:18.416842 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1969/4159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:17 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:18.723363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:18.736849 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-88c3e7bb-cbce-4971-a017-c61cee4ff255 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1535 microversion: 2.1 time: 0.728019 Aug 24 03:53:18.744498 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2191/4160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:18 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1535 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:19.444146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:19.445946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:19.464898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.466581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.467975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.470201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.472225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.474682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.771263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:19.778338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:19.790052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.792240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.793967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.794939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.798813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.802990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.200029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.212819 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cba01da6-75cd-4779-bace-75b50a5488f6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1535 microversion: 2.1 time: 0.444958 Aug 24 03:53:20.214312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2192/4161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:19 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1535 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:20.440708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.450386 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a53142f-6f32-463f-a4bd-a3761815e4f1 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 1.015150 Aug 24 03:53:20.453893 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1970/4162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:19 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:20.878202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5f70e71d-b9ba-4aa8-b35f-5b7b46c3b128 req-790cf991-1fdb-4e4b-92c8-63d729d98135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd", "tag": "a91c553d-4b84-4e85-955b-f8aee4a841b4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:20.905275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5f70e71d-b9ba-4aa8-b35f-5b7b46c3b128 req-790cf991-1fdb-4e4b-92c8-63d729d98135 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.907762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5f70e71d-b9ba-4aa8-b35f-5b7b46c3b128 req-790cf991-1fdb-4e4b-92c8-63d729d98135 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.908875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5f70e71d-b9ba-4aa8-b35f-5b7b46c3b128 req-790cf991-1fdb-4e4b-92c8-63d729d98135 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.935981 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5f70e71d-b9ba-4aa8-b35f-5b7b46c3b128 req-790cf991-1fdb-4e4b-92c8-63d729d98135 service nova] Creating event network-changed:a91c553d-4b84-4e85-955b-f8aee4a841b4 for instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd on n-h1-846470-15 Aug 24 03:53:20.942209 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5f70e71d-b9ba-4aa8-b35f-5b7b46c3b128 req-790cf991-1fdb-4e4b-92c8-63d729d98135 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069774 Aug 24 03:53:20.943477 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2193/4163] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:21.236412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.237477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.251508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.252045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.252618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.254969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.256644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.257088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.485414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.493275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.522666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.523225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.526049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.528153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.531470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.533687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.648377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:21.852796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:21.861253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:21.870856 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-da7d441d-05f1-4a17-aeed-28740f859d2f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1535 microversion: 2.1 time: 0.638543 Aug 24 03:53:21.871988 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1971/4164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:21 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1535 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:21.883100 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c962662-88f9-4ce4-8de1-4b2d35120b99 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.413976 Aug 24 03:53:21.886260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2194/4165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:21 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:22.893785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:22.895149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:22.899491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:22.907925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:22.909467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:22.914398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:22.941124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.942657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.943368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.944028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.944763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.945232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.945668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.953097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.953574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.954326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.954786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.955460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.033043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:23.330230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.342733 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91860a54-f343-4df6-b456-c6e6e4497c8c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1528 microversion: 2.1 time: 0.453591 Aug 24 03:53:23.343728 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1972/4166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:22 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1528 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:23.368874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:23.369504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:23.383372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.384482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.384993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.386025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.386872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.387622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.504233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.512567 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7164566b-d317-4402-8e17-3d54a68db4a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.608369 Aug 24 03:53:23.513733 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2195/4167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:22 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:23.766241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.787856 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-96f46cac-ebb0-427f-994c-162fcc2c6b0b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1528 microversion: 2.1 time: 0.422767 Aug 24 03:53:23.803194 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1973/4168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:23 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1528 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:23.820899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce0a36b9-57bf-4ccf-9444-f4e9d13a5056 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:23.821776 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:53:23.821776 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 03:53:23.833061 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ce0a36b9-57bf-4ccf-9444-f4e9d13a5056 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] HTTP exception thrown: Flavor 694c06e3-b99c-4e11-b580-57e90d157d66 could not be found. Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce0a36b9-57bf-4ccf-9444-f4e9d13a5056 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Request method failure captured: Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/flavors/694c06e3-b99c-4e11-b580-57e90d157d66 HTTP/1.1 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ-WzIWvvNSMMdfTrKfKSEF1ARjY4K3Hek9Vki2iRTWMf_u8HRrLwkHMlznV5qDL_3oPVA5Zn5xrZAuHxq2G04CalLllRO0CpXkIu4wjJUcqYjCe62SVq6YyLLu6-MqHli5jgxs_kkocD6N64hKLEAFaDajdLsRHUkusGt7_xJDAJc0 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: e4dda06fc5fd4b9b850d7ee32d6faaad Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-MigrationsAdminTest-1769895743 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4dda06fc5fd4b9b850d7ee32d6faaad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4dda06fc5fd4b9b850d7ee32d6faaad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4dda06fc5fd4b9b850d7ee32d6faaad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4dda06fc5fd4b9b850d7ee32d6faaad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-MigrationsAdminTest-1769895743 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: e4dda06fc5fd4b9b850d7ee32d6faaad Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-MigrationsAdminTest-1769895743 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-MigrationsAdminTest-1769895743-project-admin Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: a2df41be4453484cae6f9c2edf037086 Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-MigrationsAdminTest-1769895743-project-admin Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: exception: Flavor 694c06e3-b99c-4e11-b580-57e90d157d66 could not be found. Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '694c06e3-b99c-4e11-b580-57e90d157d66'} Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 694c06e3-b99c-4e11-b580-57e90d157d66 could not be found. Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 694c06e3-b99c-4e11-b580-57e90d157d66 could not be found. Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:23.842337 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:23.846347 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:23.846347 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:23.846347 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:23.846347 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:23.846347 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:23.846347 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:23.846347 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 694c06e3-b99c-4e11-b580-57e90d157d66 could not be found. Aug 24 03:53:23.846347 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:53:23.855065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce0a36b9-57bf-4ccf-9444-f4e9d13a5056 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Returning 404 to user: Flavor 694c06e3-b99c-4e11-b580-57e90d157d66 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:23.857986 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce0a36b9-57bf-4ccf-9444-f4e9d13a5056 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/694c06e3-b99c-4e11-b580-57e90d157d66" status: 404 len: 109 microversion: 2.1 time: 0.053255 Aug 24 03:53:23.869581 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2196/4169] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:53:23 2022] DELETE /compute/v2.1/flavors/694c06e3-b99c-4e11-b580-57e90d157d66 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:24.152019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1725474056", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:24.303407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-dc0ae410-97d8-42e4-bc98-8c550f11f891 req-517eef01-dbd8-4f11-a4cd-8988c3a863f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "name": "network-vif-plugged", "status": "completed", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:24.343264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dc0ae410-97d8-42e4-bc98-8c550f11f891 req-517eef01-dbd8-4f11-a4cd-8988c3a863f9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.346408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dc0ae410-97d8-42e4-bc98-8c550f11f891 req-517eef01-dbd8-4f11-a4cd-8988c3a863f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.347318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-dc0ae410-97d8-42e4-bc98-8c550f11f891 req-517eef01-dbd8-4f11-a4cd-8988c3a863f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.351701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:53:24.384227 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-dc0ae410-97d8-42e4-bc98-8c550f11f891 req-517eef01-dbd8-4f11-a4cd-8988c3a863f9 service nova] Creating event network-vif-plugged:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h2-846470-15 Aug 24 03:53:24.398785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-dc0ae410-97d8-42e4-bc98-8c550f11f891 req-517eef01-dbd8-4f11-a4cd-8988c3a863f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100481 Aug 24 03:53:24.403458 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2197/4170] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:24.541298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:24.544857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:24.577191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.578203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.578933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.580097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.581354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.582191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.044913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:25.072442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d870b3e4-59ea-4cd2-b13e-5578dc08cb59 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.541811 Aug 24 03:53:25.073751 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2198/4171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:24 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:25.265500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:53:25.266015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:53:25.266396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:53:25.266812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:53:25.268412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:53:25.294375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.294882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.295342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.296120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.296591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.297033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.353684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:53:25.372385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Getting quotas for user 1121b62203674b82ae3c7cfcb3112eb5 and project bae5f7d73df84e3d8f38db05b3fe17a9. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:53:25.396259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:53:25.399637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:53:25.478138 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eeef989f-3b3d-4ade-8152-9673c19c90c1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330295 Aug 24 03:53:25.482413 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1974/4172] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:53:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:53:25.494666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4959483b-bcd4-4c72-b947-c0886e6c1860 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:25.495254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4959483b-bcd4-4c72-b947-c0886e6c1860 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:25.710903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4959483b-bcd4-4c72-b947-c0886e6c1860 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:25.720407 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4959483b-bcd4-4c72-b947-c0886e6c1860 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1213 microversion: 2.1 time: 0.231048 Aug 24 03:53:25.725073 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2199/4173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:25 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:26.094298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:26.094937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:26.119441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.123092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.130855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.132105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.138801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.142488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.750614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2fc67f92-c859-4645-8b89-e59698314c3f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:26.760502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2fc67f92-c859-4645-8b89-e59698314c3f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:27.076532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2fc67f92-c859-4645-8b89-e59698314c3f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:27.122443 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2fc67f92-c859-4645-8b89-e59698314c3f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1213 microversion: 2.1 time: 0.377345 Aug 24 03:53:27.126674 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2200/4174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:26 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1213 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:27.262146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:27.283717 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-049844b9-ad32-47d4-baf0-65710901f30c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 1.193137 Aug 24 03:53:27.290837 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1975/4175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:26 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:28.148773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.150679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.168125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:28.176439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.177134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.177733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.183129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.184497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.186587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.312592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.314020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.337770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.341539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.342702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.343921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.344594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.345387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.835621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:28.849381 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2e878b99-af44-41b5-b6a5-fca695f4c342 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1273 microversion: 2.1 time: 0.706753 Aug 24 03:53:28.849982 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2201/4176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:28 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1273 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:28.900097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:28.912883 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cd6628cc-e466-441d-87a5-e3aaa6b63a62 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.606885 Aug 24 03:53:28.913502 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1976/4177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:28 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:29.875408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:29.876772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:29.893875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.894610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.895239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.896168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.899293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.900146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.935470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:29.936732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:29.956778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.957427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.957879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.958635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.959100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.959534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.681260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:30.701028 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67e5b806-79e8-4c43-bef4-cf7d90d56f99 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 0.832645 Aug 24 03:53:30.701910 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2202/4178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:29 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:30.819534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:30.836929 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a069f8b6-4d93-49d1-ae31-19f8d065ecf9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.906394 Aug 24 03:53:30.839618 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1977/4179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:29 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:31.724623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:31.726116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:31.735740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.740820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.741490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.742277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.749705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.752263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.870316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:31.871440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:31.880081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.888706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.890446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.892760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.896379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.899448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.441134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:32.454534 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc5fd620-1f65-4399-8a99-132965557d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 0.732065 Aug 24 03:53:32.457942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2203/4180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:31 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:32.640559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:32.650988 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-828ca536-ca09-449b-857b-f243590c79b0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.787354 Aug 24 03:53:32.651598 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1978/4181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:31 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:32.733408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-fe5add57-da65-4f6f-8481-62ce1e82894b req-cef6beda-4988-462e-b8c4-c1290630850c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd", "name": "network-vif-plugged", "status": "completed", "tag": "a91c553d-4b84-4e85-955b-f8aee4a841b4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:32.766941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fe5add57-da65-4f6f-8481-62ce1e82894b req-cef6beda-4988-462e-b8c4-c1290630850c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.768446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fe5add57-da65-4f6f-8481-62ce1e82894b req-cef6beda-4988-462e-b8c4-c1290630850c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.774219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fe5add57-da65-4f6f-8481-62ce1e82894b req-cef6beda-4988-462e-b8c4-c1290630850c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.820406 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fe5add57-da65-4f6f-8481-62ce1e82894b req-cef6beda-4988-462e-b8c4-c1290630850c service nova] Creating event network-vif-plugged:a91c553d-4b84-4e85-955b-f8aee4a841b4 for instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd on n-h1-846470-15 Aug 24 03:53:32.834052 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-fe5add57-da65-4f6f-8481-62ce1e82894b req-cef6beda-4988-462e-b8c4-c1290630850c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105041 Aug 24 03:53:32.841723 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2204/4182] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:32.918065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fc0594dd-d467-4256-a60c-b4344877aa9a req-fde6f03f-cc80-4e8c-ae43-64e2af4a26fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:32.957702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fc0594dd-d467-4256-a60c-b4344877aa9a req-fde6f03f-cc80-4e8c-ae43-64e2af4a26fd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.958206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fc0594dd-d467-4256-a60c-b4344877aa9a req-fde6f03f-cc80-4e8c-ae43-64e2af4a26fd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.958659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fc0594dd-d467-4256-a60c-b4344877aa9a req-fde6f03f-cc80-4e8c-ae43-64e2af4a26fd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.016921 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fc0594dd-d467-4256-a60c-b4344877aa9a req-fde6f03f-cc80-4e8c-ae43-64e2af4a26fd service nova] Creating event network-changed:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h1-846470-15 Aug 24 03:53:33.026611 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fc0594dd-d467-4256-a60c-b4344877aa9a req-fde6f03f-cc80-4e8c-ae43-64e2af4a26fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115769 Aug 24 03:53:33.031944 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1979/4183] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:33.480233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.483405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:33.509102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.509625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.515433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.516581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.517272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.523724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.675526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.677773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:33.714569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.716385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.723102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.727190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.730983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.737049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.430875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:34.449480 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91d9c9dc-d43e-4212-a5c5-20f3bfa0587d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 0.974358 Aug 24 03:53:34.456813 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2205/4184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:33 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:34.548269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:34.572697 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94734afc-f9ac-4f16-8dc2-9e22e39e0878 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.901888 Aug 24 03:53:34.576492 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1980/4185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:33 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:35.475957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:35.476729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:35.491113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.491703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.492179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.503274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.506959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.507723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.609654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:35.610946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:35.614928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:35.616060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:35.628293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.629265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.629926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.630933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.631614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.632345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.662454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:36.205460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:36.216446 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d66d3e0a-ce17-4fc3-928d-cef1a50aaca5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1309 microversion: 2.1 time: 0.619135 Aug 24 03:53:36.234856 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1981/4186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:35 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1309 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:36.471391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:36.493139 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e1d1a687-64c8-45a8-8fcb-d60413b7f96f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 1.020963 Aug 24 03:53:36.493803 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2206/4187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:35 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:37.242172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:37.243695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:37.259797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.260683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.261425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.267329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.268413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.269038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.515846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:37.516614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:37.529392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:37.586160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.591368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.593756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.595128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.595771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.602365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.710426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:37.718831 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b6d9e2d8-bb02-469b-a70f-d7c96fd77fb2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1490 microversion: 2.1 time: 0.480683 Aug 24 03:53:37.742434 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1982/4188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:37 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1490 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:37.748650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-239046641"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:37.781364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:37.792873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.793455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.804734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.805429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.806171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.806840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.074377 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5bc0219a-8086-475e-8165-57755755ee06 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "PUT /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1074 microversion: 2.1 time: 0.330482 Aug 24 03:53:38.078390 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1983/4189] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:53:37 2022] PUT /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1074 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:38.097054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.098388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.109639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.111940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.113660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.115042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.116867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.118617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.191656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:38.214067 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e68cae2-e1bb-4526-a50e-841cb6bb510f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 0.699711 Aug 24 03:53:38.214733 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2207/4190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:37 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:38.545758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:38.576635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7c85cd58-de7a-4480-9d32-172c8eeff292 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1500 microversion: 2.1 time: 0.483438 Aug 24 03:53:38.588221 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1984/4191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:38 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1500 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:38.601127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.602301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.610278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.611032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.611832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.613050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.613681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.614279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.046900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:39.062964 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2dbe955e-9350-4ee1-9f17-5d58142b288b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1500 microversion: 2.1 time: 0.462277 Aug 24 03:53:39.065802 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2208/4192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:38 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1500 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:39.097762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2c12140-d03e-452c-9a88-06e1dcf7d27b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:39.110183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2c12140-d03e-452c-9a88-06e1dcf7d27b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.112898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2c12140-d03e-452c-9a88-06e1dcf7d27b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.115045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2c12140-d03e-452c-9a88-06e1dcf7d27b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.189527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2c12140-d03e-452c-9a88-06e1dcf7d27b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Going to try to stop instance {{(pid=122535) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:53:39.244342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:39.245221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:39.258050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.261438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.264032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.265616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.266512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.267213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.346630 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2c12140-d03e-452c-9a88-06e1dcf7d27b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "POST /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd/action" status: 202 len: 0 microversion: 2.1 time: 0.252019 Aug 24 03:53:39.348821 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1985/4193] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:53:39 2022] POST /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:39.373133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:39.376758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:39.393261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.395572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.396090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.396854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.397313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.399892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.781684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:39.804518 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0745c1e6-ce07-43c8-af0e-f2806f8b7ae6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.449803 Aug 24 03:53:39.806826 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1986/4194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:39 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:40.373051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:40.385214 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f09bfeae-c8ec-4ac4-bc13-94d3143bd6b2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 1.147142 Aug 24 03:53:40.386924 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2209/4195] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:39 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:40.394838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1946886548", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:40.507511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] validate_networks() for [('30db1ab3-f4e6-44fc-9e86-51a37d221ee3', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:53:40.831139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:40.831923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:40.848270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:40.848760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:40.849203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:40.850087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:40.850725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:40.852032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.140713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:41.150165 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ccd37cca-621b-4521-970f-36ba284de3f9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.323038 Aug 24 03:53:41.150768 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2210/4196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:40 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:41.232574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:53:41.233231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:53:41.233966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:53:41.234810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:53:41.235441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:53:41.248303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.248899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.249390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.250195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.250743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.251247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.271630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Getting quotas for project 9b1a588d986b44a2a321f79764a8f765. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:53:41.278131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Getting quotas for user 5954bba87fcf4e76b41d51c2388651c5 and project 9b1a588d986b44a2a321f79764a8f765. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:53:41.326154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:53:41.330460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:53:41.440485 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eee58384-f186-4160-a934-17438d73c78b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.474210 Aug 24 03:53:41.447218 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1987/4197] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:53:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:53:41.455876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ecb570d-03ba-42c1-bc39-92bee7743dd0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:41.456660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ecb570d-03ba-42c1-bc39-92bee7743dd0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:41.506175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:41.507176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:41.528512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.529938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.531200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.532158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.532703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.535861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.579407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3ecb570d-03ba-42c1-bc39-92bee7743dd0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:41.603343 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ecb570d-03ba-42c1-bc39-92bee7743dd0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1217 microversion: 2.1 time: 0.149894 Aug 24 03:53:41.639740 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2211/4198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:41 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:41.809752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:41.825912 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91158889-47e8-4bc5-bedc-561d8acfb03a tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 0.335576 Aug 24 03:53:41.833756 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1988/4199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:41 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:42.182870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:42.183891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:42.196549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.198762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.199734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.201172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.202006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.206611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.465379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:42.493349 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc0b5c16-731a-4510-940f-244334ce3fe9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.309440 Aug 24 03:53:42.494284 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2212/4200] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:42 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:42.630516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:42.632551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:42.656204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.657074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.661270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.662495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.663089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.664492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.777261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:42.793375 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37862fe9-8fc1-4804-abf6-0968a975f187 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1269 microversion: 2.1 time: 0.167911 Aug 24 03:53:42.794527 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1989/4201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:42 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:42.855932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:42.856773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:42.868225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.869180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.869865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.870705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.871264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.871802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.136890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:43.145787 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d4d00db-dace-4460-9c21-2fa1cdb795a7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 0.294865 Aug 24 03:53:43.151408 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2213/4202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:42 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:43.264839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4ea5b09e-239e-47b2-84a4-d089d622629a req-c4b17f56-cbc6-4030-8423-5cdef8a154db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "name": "network-vif-plugged", "status": "completed", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:43.281791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4ea5b09e-239e-47b2-84a4-d089d622629a req-c4b17f56-cbc6-4030-8423-5cdef8a154db service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.282272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4ea5b09e-239e-47b2-84a4-d089d622629a req-c4b17f56-cbc6-4030-8423-5cdef8a154db service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.282696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4ea5b09e-239e-47b2-84a4-d089d622629a req-c4b17f56-cbc6-4030-8423-5cdef8a154db service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.303425 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4ea5b09e-239e-47b2-84a4-d089d622629a req-c4b17f56-cbc6-4030-8423-5cdef8a154db service nova] Creating event network-vif-plugged:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h1-846470-15 Aug 24 03:53:43.311618 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4ea5b09e-239e-47b2-84a4-d089d622629a req-c4b17f56-cbc6-4030-8423-5cdef8a154db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050628 Aug 24 03:53:43.312541 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1990/4203] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:43.527383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:43.528638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:43.555096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.559519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.561789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.564415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.573393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.574717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.819220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:43.822252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:43.856560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.858955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.859717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.860860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.861715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.862364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.958640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:43.977572 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2574f0ec-3554-4e76-991c-04d867069343 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.454634 Aug 24 03:53:43.985693 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2214/4204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:43 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:44.172051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:44.173662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:44.185830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.189670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.190856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.194042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.194748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.195714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.235383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:44.250635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8c6ef52e-3f70-496f-bc98-0c75a889d5ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1277 microversion: 2.1 time: 0.439061 Aug 24 03:53:44.251282 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1991/4205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:43 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1277 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:45.007016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:45.007829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:45.029481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.030324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.030894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.034256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.036015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.036585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.213924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:45.224377 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef8f2de7-6ffb-4b2e-936f-446cd84b9204 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1313 microversion: 2.1 time: 1.055116 Aug 24 03:53:45.225138 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2215/4206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:44 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1313 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:45.282928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:45.284085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:45.294380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.294883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.295325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.296177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.296532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.296958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.395812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:45.410994 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a470ad89-bbc6-4140-8eff-26c250a21d34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1275 microversion: 2.1 time: 0.130987 Aug 24 03:53:45.412781 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2216/4207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:45 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1275 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:45.498552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:45.509020 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aabc8929-aa7f-49b7-a23a-4940f6dbcd4b tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.505866 Aug 24 03:53:45.523106 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1992/4208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:45 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:46.248553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:46.250240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:46.264021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.266323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.267864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.269289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.269980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.270854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.277444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:46.434510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:46.435815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:46.450838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.452366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.453145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.454567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.455396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.456756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.526066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:46.548203 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a4ceb3f-ab3a-4240-9e3e-13aae89634f1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1463 microversion: 2.1 time: 0.299910 Aug 24 03:53:46.549185 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2217/4209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:46 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1463 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:46.558228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:46.558844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:46.568166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.575855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.580324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.582167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.583632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.585980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.763471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:46.774082 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a07812f6-76be-46f5-b3a3-dacd61c07252 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.221415 Aug 24 03:53:46.789049 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2218/4210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:46 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:46.795789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:46.796699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:46.830822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.831062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.832013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.832892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.833725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.834551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.953791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:46.968729 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-77332ae2-e49e-4ba8-a3a7-52f34d0f4497 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.534185 Aug 24 03:53:46.969984 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1993/4211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:46 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:47.089988 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af39e436-8f75-4458-b28e-65caeb7f1af0 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1616 microversion: 2.1 time: 0.298652 Aug 24 03:53:47.107354 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2219/4212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:46 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1616 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:47.113238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:47.114031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:47.125769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.125769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.126244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.127163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.127769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.128188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.311119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a2df41be4453484cae6f9c2edf037086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4dda06fc5fd4b9b850d7ee32d6faaad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:47.311805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] flavor_id is None. Assuming migration. {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 03:53:47.312384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 03:53:47.740192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-60f1e8da-4413-4cf0-8046-3fe5e82cec55 req-25a50338-bf31-43e1-aa83-c386f371ed31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b", "tag": "7ecd8efe-e9af-4340-8d71-bf379a496626"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:47.777281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-60f1e8da-4413-4cf0-8046-3fe5e82cec55 req-25a50338-bf31-43e1-aa83-c386f371ed31 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.779655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-60f1e8da-4413-4cf0-8046-3fe5e82cec55 req-25a50338-bf31-43e1-aa83-c386f371ed31 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.780979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-60f1e8da-4413-4cf0-8046-3fe5e82cec55 req-25a50338-bf31-43e1-aa83-c386f371ed31 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.808296 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-60f1e8da-4413-4cf0-8046-3fe5e82cec55 req-25a50338-bf31-43e1-aa83-c386f371ed31 service nova] Creating event network-changed:7ecd8efe-e9af-4340-8d71-bf379a496626 for instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b on n-h2-846470-15 Aug 24 03:53:47.830856 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-60f1e8da-4413-4cf0-8046-3fe5e82cec55 req-25a50338-bf31-43e1-aa83-c386f371ed31 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096884 Aug 24 03:53:47.831766 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2220/4213] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:47.838460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:47.839377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:47.860170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.860960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.862153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.863531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.864305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.865009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.153901 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-00eef9cf-e113-43e2-a1bd-6eb796ff77c8 tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02/action" status: 202 len: 0 microversion: 2.1 time: 1.044634 Aug 24 03:53:48.160049 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1994/4214] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:53:47 2022] POST /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02/action => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:48.171134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:48.172500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:48.187830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.193248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.195570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.198397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.199911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.200752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.480064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:48.497707 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8222593c-e4f8-4f0d-bda8-2a5990d010fe tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.661295 Aug 24 03:53:48.501267 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2221/4215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:47 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:48.521575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:48.525174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:48.541502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.542013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.542459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.546989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.547744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.548208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.625521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:48.646590 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6b058c8-afba-4297-952c-08c52f3ab260 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.482137 Aug 24 03:53:48.647830 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1995/4216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:48 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:48.970038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:48.989589 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1d11355-f475-4b02-8c28-9db025384d4c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1472 microversion: 2.1 time: 0.486561 Aug 24 03:53:48.990242 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2222/4217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:48 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:49.529077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:49.529734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:49.544558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.545310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.545969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.549800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.552376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.552376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.560705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:49.670851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:49.673022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:49.680717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.682204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.683323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.684321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.685242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.685912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.824483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:49.835522 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0306970f-7c9a-4a26-a077-73eba6ba3e35 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.313199 Aug 24 03:53:49.837845 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1996/4218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:49 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:50.024412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:50.025558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:50.036831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.037905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.053105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.053888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.054397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.054836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.081164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:50.094125 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e370ac0-c4b4-4ee3-b62c-980d8d6c3be1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.426947 Aug 24 03:53:50.110186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2223/4219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:49 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:50.377931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:50.390120 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac9f5020-ea54-4add-9b1e-fbd1f1ec9db4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1472 microversion: 2.1 time: 0.382935 Aug 24 03:53:50.393296 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1997/4220] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:50 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1472 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:50.866400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:50.867501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:50.891645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.897001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.898762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.900459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.903311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.904094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.116284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:51.117213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:51.128976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.129476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.129916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.136151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.136741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.138206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.261487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:51.305038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:51.341748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:51.360452 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-157d2a45-4cd8-44b5-a893-c93460ce34c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.498860 Aug 24 03:53:51.361628 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2224/4221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:50 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:51.416029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:51.417688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:51.432108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.432605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.433038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.433815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.434194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.434619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.495328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:51.522328 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69d3f8b5-5061-4ef9-8ac9-5c8d893c5670 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.404898 Aug 24 03:53:51.531731 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1998/4222] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:51 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:51.585717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:52.383517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:52.384172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:52.392283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.393028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.393483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.394212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.394686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.405708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.754488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:52.768155 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-82fe6642-1649-46d0-8823-3433941da86c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.388609 Aug 24 03:53:52.774319 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 1999/4223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:52 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:52.790464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:52.791754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:52.813122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.813776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.815498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.816402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.818248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.820074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.981253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:53.002112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15f00e5b-00f4-40bb-ae3c-ff0722084391 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1472 microversion: 2.1 time: 1.590194 Aug 24 03:53:53.003377 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2225/4224] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:51 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1472 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:53.308701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:53.330491 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f1f8e129-576b-4e3a-9a90-6efb39fd2909 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.544883 Aug 24 03:53:53.332289 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2000/4225] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:52 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:53.800104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:53.800830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:53.809822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:53.810324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:53.810774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:53.811499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:53.824322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:53.826907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.038142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:54.039312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:54.058159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:54.072554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.073432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.075914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.076950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.079364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.081429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.560167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:54.579911 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-06912243-8db3-4d5b-98d9-cde0957de42e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.784523 Aug 24 03:53:54.596075 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2226/4226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:53 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:54.608479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:54.615025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:54.624791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.635433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.636212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.637788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.638469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.639068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.219778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:55.238816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b792f69f-0956-4619-9c51-e5e0de78a8a0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1472 microversion: 2.1 time: 1.210911 Aug 24 03:53:55.240268 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2001/4227] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:54 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1472 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:55.349112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:55.362905 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d653412b-bcd9-44d3-bc60-7b4b02b9471b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.763013 Aug 24 03:53:55.378801 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2227/4228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:54 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:55.606769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:55.607990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:55.651172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.653261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.660532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.667329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.669299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.673255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.174491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:56.201605 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16b5d1f9-cfeb-4ca2-ba93-309e961e2d2e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.603661 Aug 24 03:53:56.211645 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2002/4229] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:55 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:56.278563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:56.279188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:56.320511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.321208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.321798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.322985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.323468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.323962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.384580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:56.385205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:56.393629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.394140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.394586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.395314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.395810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.396249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.774471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:56.789739 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-569ba78c-224f-4ba0-be11-e7b6e1837a16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.408634 Aug 24 03:53:56.792893 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2003/4230] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:56 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:56.819303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:56.827915 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0db556c-d4b8-4e2c-aa88-7077d1df07ce tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.555067 Aug 24 03:53:56.830604 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2228/4231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:56 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:57.234710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:57.235835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:57.253725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.256110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.258635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.260809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.263060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.263745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.560824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:57.570433 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ded615d0-4f32-4f63-b8fb-ba1d2b255bd0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.340955 Aug 24 03:53:57.576204 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2004/4232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:57 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:57.813102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:57.813830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:57.834485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.837485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.838045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.838709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.839144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.842759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.854407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:57.855592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:57.867477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.869736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.871926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.874645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.883931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.885134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.185774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:58.194339 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-275d4f5f-9bd5-4b78-9e80-a7032040e273 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.344367 Aug 24 03:53:58.220902 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2005/4233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:57 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:58.429882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:58.449918 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ec828f3-27bc-47b3-9702-93e82e61707c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.638772 Aug 24 03:53:58.464119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2229/4234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:57 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:58.600705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:58.601318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:58.618510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.621010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.623140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.623140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.623292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.623803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.229442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:59.231232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:59.241664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=59 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:59.245769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.246586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.248142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.250221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.251339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.252342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.357170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:59.366515 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad3269ed-c2b2-4fdf-b561-8a5f8606dfc8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.770418 Aug 24 03:53:59.369015 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2006/4235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:58 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:59.376830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fe435ded-e858-4a4a-b970-519ef2ffa09a req-335ce65a-0647-4b98-92c2-bca41df432a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b", "name": "network-vif-plugged", "status": "completed", "tag": "7ecd8efe-e9af-4340-8d71-bf379a496626"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:59.390711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe435ded-e858-4a4a-b970-519ef2ffa09a req-335ce65a-0647-4b98-92c2-bca41df432a5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.391791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe435ded-e858-4a4a-b970-519ef2ffa09a req-335ce65a-0647-4b98-92c2-bca41df432a5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.393732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fe435ded-e858-4a4a-b970-519ef2ffa09a req-335ce65a-0647-4b98-92c2-bca41df432a5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.409283 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fe435ded-e858-4a4a-b970-519ef2ffa09a req-335ce65a-0647-4b98-92c2-bca41df432a5 service nova] Creating event network-vif-plugged:7ecd8efe-e9af-4340-8d71-bf379a496626 for instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b on n-h2-846470-15 Aug 24 03:53:59.446712 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fe435ded-e858-4a4a-b970-519ef2ffa09a req-335ce65a-0647-4b98-92c2-bca41df432a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073124 Aug 24 03:53:59.450605 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2007/4236] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:59.473286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:59.484520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:59.510349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.510789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.511235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.512012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.519103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.519774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.748240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:59.757991 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-19e52b0b-1d6a-45a9-a427-077134146a5f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.533693 Aug 24 03:53:59.772058 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2230/4237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:59 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:59.964152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-617ec959-3c30-4fe5-9998-711bf8034cae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'create', calling method: .version_select at 0x7f1021eff5e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-868391116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPQ3G+gFcAngK/kFX6ejzMlTvaYAwf9WX0MkhoUZeOznfCnPKs1vJG/ISgAd7GrbJX7qfvk83KXvFkzUSwQBNsLoZZwhxnE3QmHMGtbfeAta5hpGxRbmAUracp1EcIKug=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:59.998175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-617ec959-3c30-4fe5-9998-711bf8034cae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:00.011314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-617ec959-3c30-4fe5-9998-711bf8034cae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for user 5c7f4a326b7a4b598ca962847679ac13 and project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:00.074936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:00.087938 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-617ec959-3c30-4fe5-9998-711bf8034cae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.110960 Aug 24 03:54:00.087938 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2231/4238] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:53:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:00.100023 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4cb0be9c-9a22-4770-bdd4-966df5206479 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.631125 Aug 24 03:54:00.100650 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2008/4239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:59 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:00.397442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:00.398409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:00.420055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.420560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.424020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.427922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.431076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.431989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.789890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:00.790224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:00.806596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.807440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.808180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.809077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.810061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.810835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.853045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:00.871428 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81394e3f-44c8-418b-8b1f-f4d62b2b9d74 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.485168 Aug 24 03:54:00.896684 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2232/4240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:00 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:01.139695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:01.141701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:01.167426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.172111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.174470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.177502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.178613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.180826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.618337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:01.635323 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc6058dd-be54-4314-97ef-425cc337b6a8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.858337 Aug 24 03:54:01.636485 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2009/4241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:00 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:01.842291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:01.862730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e13408f0-8adb-48c0-b158-e58a0d07fdfe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1317 microversion: 2.1 time: 0.745875 Aug 24 03:54:01.863243 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2233/4242] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:01 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:01.910179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:01.910519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:01.918974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.919745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.920371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.921471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.922153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.922731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.421776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:02.438291 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b03c2a73-c28e-4f4f-be86-0e5855667674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.531495 Aug 24 03:54:02.441903 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2010/4243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:01 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:02.657468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:02.659361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:02.686555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.688372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.689135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.690675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.691437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.692279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.891991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:02.895126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:02.914116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.916294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.916749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.921181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.921705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.925429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.104880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:03.160288 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b3aa5240-f992-4e75-83d6-186229e59cca tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.488890 Aug 24 03:54:03.160988 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2234/4244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:02 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:03.462502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:03.463383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:03.473809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.474316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.474765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.475589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.476082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.476513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.484014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:03.504280 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f79e9f7-9a3f-43d4-a917-12c93e03e424 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.624782 Aug 24 03:54:03.510425 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2011/4245] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:02 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:03.516288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:03.610236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-256262669", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "df61065b-ef89-47fd-bb38-513a99f1c174"}], "key_name": "tempest-TestNetworkBasicOps-868391116", "security_groups": [{"name": "tempest-secgroup-smoke-981768505"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:03.835158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:03.850324 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3dccab6c-e8e4-4a29-9e23-fb74c9279c56 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.386027 Aug 24 03:54:03.851347 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2235/4246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:03 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:03.863863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1197596200", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:03.928921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] validate_networks() for [('df61065b-ef89-47fd-bb38-513a99f1c174', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:54:03.950581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] validate_networks() for [('30db1ab3-f4e6-44fc-9e86-51a37d221ee3', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:54:04.582141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:54:04.583244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:54:04.584489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:54:04.585150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:54:04.586030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:54:04.600378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.601154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.601888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.603041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.603657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.604262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.630684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Getting quotas for project 9b1a588d986b44a2a321f79764a8f765. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:04.638333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Getting quotas for user 5954bba87fcf4e76b41d51c2388651c5 and project 9b1a588d986b44a2a321f79764a8f765. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:04.657265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:54:04.659971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:54:04.762038 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1642c130-22a2-4c0d-9dad-d3bdcf5e21ea tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909218 Aug 24 03:54:04.763029 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2236/4247] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:54:04.768182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:04.769118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:04.778113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.779065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.780136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.781570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.782373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.783104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.061265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:05.076621 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-18d37845-19d7-423d-a472-84dda6e70405 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.312345 Aug 24 03:54:05.077382 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2237/4248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:04 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:05.083802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-41be7773-488f-4fd0-afa1-21dfdddc00ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:05.084887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-41be7773-488f-4fd0-afa1-21dfdddc00ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:05.199457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-41be7773-488f-4fd0-afa1-21dfdddc00ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:05.229533 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-41be7773-488f-4fd0-afa1-21dfdddc00ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1217 microversion: 2.1 time: 0.147888 Aug 24 03:54:05.230166 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2238/4249] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:05 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:05.237697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:05.238530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:05.250884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:05.252410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:05.253149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.254181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:05.254797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:05.255468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.359641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:54:05.360788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:54:05.362623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:54:05.363281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:54:05.364051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:54:05.388980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:05.389453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:05.389896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.390815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:05.394455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:05.395056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.442125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:05.448423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for user 5c7f4a326b7a4b598ca962847679ac13 and project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:05.480818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:54:05.487316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:54:05.557754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:05.572717 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-73e8bf14-bce0-4a1d-94ac-11c0484279a5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.340012 Aug 24 03:54:05.573796 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2239/4250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:05 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:05.591919 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41a88ce4-fa50-4e37-9986-d19327184b91 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.985584 Aug 24 03:54:05.593825 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2012/4251] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:54:05.608003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96022c94-7178-443e-8e63-d7d336c9bd00 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:05.608613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96022c94-7178-443e-8e63-d7d336c9bd00 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:05.708297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96022c94-7178-443e-8e63-d7d336c9bd00 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:05.723778 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96022c94-7178-443e-8e63-d7d336c9bd00 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1247 microversion: 2.1 time: 0.120226 Aug 24 03:54:05.729568 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2240/4252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:05 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1247 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:06.107532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:06.108580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:06.127533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.128358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.130609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.131538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.133944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.134822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.266300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:06.266959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:06.290035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.290557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.291092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.291922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.292163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.298787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.412542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:06.425309 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ec170d8-4aa6-466f-b0c2-425d15344bb9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.324752 Aug 24 03:54:06.425971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:06.441721 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2013/4253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:06 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:06.475234 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-566269c0-585b-4b5b-a6df-b29193429bb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1269 microversion: 2.1 time: 0.213780 Aug 24 03:54:06.479371 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2241/4254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:06 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1269 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:06.594387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:06.595418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:06.608678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.613163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.613632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.616170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.619417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.619949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.633495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:06.747058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:06.747744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:06.766506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.773005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.774686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.778235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.778961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.781585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.049297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:07.075190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:07.106033 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b2f72ae3-db68-4c42-b35b-76c1588b7efa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.515186 Aug 24 03:54:07.132546 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2014/4255] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:06 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:07.138524 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dd453acb-4f06-4766-bf99-934744eaf39e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1243 microversion: 2.1 time: 0.394997 Aug 24 03:54:07.143647 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2242/4256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:06 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1243 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:07.458423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:07.461652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:07.506683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:07.507203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:07.514265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.517451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.518334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.521595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.524542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.528370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.528976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.529404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.530129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.530594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.531052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.533113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.726136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:07.737912 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eafc0edf-36ea-4cea-9155-20ed56a5322d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1275 microversion: 2.1 time: 0.236205 Aug 24 03:54:07.738523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2243/4257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:07 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:08.145851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.147335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.155925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.157009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.157636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.158555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.159182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.159871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.413263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:08.413423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:08.422626 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a0f62e4-000f-421a-88fc-c5e299484e3c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.973957 Aug 24 03:54:08.424451 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-000539d7-c871-4588-9751-1533e8f55c1e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.284791 Aug 24 03:54:08.435978 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2015/4258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:07 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:08.441300 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2244/4259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:08 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:08.441527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.441527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.453447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.454248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.455765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.456694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.457127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.457712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.642427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:08.656711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c2bea19-1601-406b-a6ac-617d052d1938 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1305 microversion: 2.1 time: 0.229840 Aug 24 03:54:08.657758 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2016/4260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:08 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1305 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:08.764219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.765158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.772961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.773820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.774450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.775713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.776504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.777095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.848388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:08.857173 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c379d0e2-7b13-4ae5-a8d7-d176b8c22c49 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1275 microversion: 2.1 time: 0.096916 Aug 24 03:54:08.857929 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2245/4261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:08 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:09.451968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:09.451968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:09.453328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:09.454809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:09.463620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.467188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.468563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.469528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.470281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.470703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.472602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.475433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.475969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.476641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.477979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.481356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.818332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:09.829010 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-80321c14-e372-4285-8c64-80ecd76437b1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.383612 Aug 24 03:54:09.829672 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2246/4262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:09 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:09.844300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:09.845530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:09.853567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.854345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.855141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.856154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.856813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.857700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.965610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:09.975353 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-637b528b-dcde-47e1-ae87-0b7e1b636d10 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1305 microversion: 2.1 time: 0.144598 Aug 24 03:54:09.976551 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2247/4263] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:09 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:09.981795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:09.982434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:09.995480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.996325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.996947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.998003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.998643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.999313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:10.170515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:10.182706 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5e022d0-30c9-4978-95c3-3ef5672c0c61 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1510 microversion: 2.1 time: 0.739862 Aug 24 03:54:10.185224 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2017/4264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:09 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1510 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:10.220649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:10.229517 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8998646-9738-4e52-b855-3657e292fdbf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.251728 Aug 24 03:54:10.230680 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2248/4265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:09 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:10.856000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:10.856623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:10.872255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:10.872760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:10.873728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:10.874649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:10.875276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:10.875908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:10.999613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:11.000891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:11.023275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.024069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.024901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.025869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.026959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.027553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.269285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:11.280540 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3b0cc748-b5ec-4870-80ec-231607305144 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.428360 Aug 24 03:54:11.288131 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2018/4266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:10 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:11.293671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:11.303055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:11.319389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.320395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.326520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.327577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.330626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.334647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.723714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:11.735595 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5a56354-f824-4267-88ad-05ae4ffaf824 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1487 microversion: 2.1 time: 0.445784 Aug 24 03:54:11.738743 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2019/4267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:11 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1487 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:11.761649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:11.773337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:11.780438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.781005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.781458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.782190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.786371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.786794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.925016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:11.934105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-555f262e-d52e-44d6-9fe9-9d602f65a013 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 0.938433 Aug 24 03:54:11.951510 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2249/4268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:10 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:11.957425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1299933039"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:11.960259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:11.967373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.968129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.968756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:11.969635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:11.970320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:11.971435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.091865 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4cae9cc5-294b-47b5-8f63-f51d1f9856e9 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "PUT /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1061 microversion: 2.1 time: 0.138951 Aug 24 03:54:12.093260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2250/4269] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:54:11 2022] PUT /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1061 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:12.102077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c41e6a31-c922-4059-a7b5-50c0d92e15e6 req-c877681d-638b-4995-93c5-cbc6ff28acab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307e338d-b5fd-4bee-af5d-4b4025316da5", "tag": "343f4e14-c02a-4923-a1ee-dad53fb34226"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:12.145084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c41e6a31-c922-4059-a7b5-50c0d92e15e6 req-c877681d-638b-4995-93c5-cbc6ff28acab service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.145594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c41e6a31-c922-4059-a7b5-50c0d92e15e6 req-c877681d-638b-4995-93c5-cbc6ff28acab service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.146035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c41e6a31-c922-4059-a7b5-50c0d92e15e6 req-c877681d-638b-4995-93c5-cbc6ff28acab service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.165570 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c41e6a31-c922-4059-a7b5-50c0d92e15e6 req-c877681d-638b-4995-93c5-cbc6ff28acab service nova] Creating event network-changed:343f4e14-c02a-4923-a1ee-dad53fb34226 for instance 307e338d-b5fd-4bee-af5d-4b4025316da5 on n-h2-846470-15 Aug 24 03:54:12.172996 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c41e6a31-c922-4059-a7b5-50c0d92e15e6 req-c877681d-638b-4995-93c5-cbc6ff28acab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075574 Aug 24 03:54:12.176474 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2251/4270] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:12.186504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.187540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.195272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.196050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.196823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.197546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.198316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.198913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.352060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:12.362135 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ce5c4f1-52cf-454a-a721-a452bf697451 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.621753 Aug 24 03:54:12.365676 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2020/4271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:11 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:12.375722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.380383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.396561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.399527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.404694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.405904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.406585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.407206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.467403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:12.483429 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8fdf3e8f-8c87-4a01-b4ba-69f0f34723e7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1488 microversion: 2.1 time: 0.303192 Aug 24 03:54:12.488828 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2252/4272] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:12 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1488 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:12.511271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.511935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.520004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.529877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.530336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.531140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.531692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.532180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.699133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:12.709952 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f103fdc6-1330-4886-a145-f54a44026b27 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1488 microversion: 2.1 time: 0.203391 Aug 24 03:54:12.710854 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2253/4273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:12 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1488 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:12.734740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.735991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.754328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.757370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.757779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.758538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.759015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.759451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.806268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:54:12.812782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:12.914280 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6a09df4d-ebb4-4938-a94b-119a7fbba3e2 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 204 len: 0 microversion: 2.1 time: 0.185484 Aug 24 03:54:12.920538 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2254/4274] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:12 2022] DELETE /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:54:12.928131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.929442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.938325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.939342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.939991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.944355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.944959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.945632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.177660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.198197 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a48dce3-6836-4fcc-8bf8-5ea512449cf6 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.830235 Aug 24 03:54:13.199493 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2021/4275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:12 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:13.205704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:13.206680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:13.217517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.218394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.219071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.225248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.226854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.227633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.246584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.264878 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df5d2ac4-9739-4741-9c25-11651d20998a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1494 microversion: 2.1 time: 0.342358 Aug 24 03:54:13.265894 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2255/4276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:12 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1494 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:13.387701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:13.388773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:13.402228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.404931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.405594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.406602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.412587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.413460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.659308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.668691 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9a788166-c647-49fe-a5fe-ac6c6ace87e6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.285590 Aug 24 03:54:13.669084 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2256/4277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:13 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:13.783406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.797431 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02b6ed85-3f59-43db-a577-ec3f39528c92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 0.596012 Aug 24 03:54:13.800016 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2022/4278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:13 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:14.226103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:14.226509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:14.236735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.238446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.239199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.240248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.240969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.241907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.249310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-72f69467-cb67-4ac0-96dc-ab5009ad0c3c req-8342e12d-c73e-4ea3-8a07-e864a78d4199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef86c7ec-f3e1-4c56-9205-740d31e89076", "tag": "ed6512db-5da4-45c9-a92b-5fbca5daa197"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:14.271935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-72f69467-cb67-4ac0-96dc-ab5009ad0c3c req-8342e12d-c73e-4ea3-8a07-e864a78d4199 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.276108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-72f69467-cb67-4ac0-96dc-ab5009ad0c3c req-8342e12d-c73e-4ea3-8a07-e864a78d4199 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.276617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-72f69467-cb67-4ac0-96dc-ab5009ad0c3c req-8342e12d-c73e-4ea3-8a07-e864a78d4199 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.312934 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-72f69467-cb67-4ac0-96dc-ab5009ad0c3c req-8342e12d-c73e-4ea3-8a07-e864a78d4199 service nova] Creating event network-changed:ed6512db-5da4-45c9-a92b-5fbca5daa197 for instance ef86c7ec-f3e1-4c56-9205-740d31e89076 on n-h1-846470-15 Aug 24 03:54:14.320172 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-72f69467-cb67-4ac0-96dc-ab5009ad0c3c req-8342e12d-c73e-4ea3-8a07-e864a78d4199 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074186 Aug 24 03:54:14.333036 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2023/4279] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:14.339365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:14.340134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:14.360534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.361887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.362368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.363125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.363601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.364065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.484701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:14.494211 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-511ac05d-7b37-4c41-8fa0-357b088272a3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.273385 Aug 24 03:54:14.500603 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2257/4280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:14 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:14.706612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:14.707792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:14.716862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:14.722238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.723642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.725114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.728318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.730916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.733379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.926457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:14.936247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b68043a4-464a-434b-b2c8-c82ebe4bc0c7 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1494 microversion: 2.1 time: 0.601213 Aug 24 03:54:14.938052 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2024/4281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:14 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1494 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:14.943872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:14.944748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:14.952243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.953003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.953599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.954576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.956159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.956881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.013124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:15.023422 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-454625e4-56c5-40f7-9358-eb033bfa9246 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.328293 Aug 24 03:54:15.030569 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2258/4282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:14 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:15.413589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:15.457761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:15.467394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:15.473146 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-66aa6ca5-e0f0-4748-9dee-8627e75a9b2d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 0.533783 Aug 24 03:54:15.473795 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2025/4283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:14 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:15.516160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:15.517057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:15.524920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.538037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.540387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.542290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.542927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.544328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.720301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=14 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:15.953290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:15.962199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:15.962971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:15.965929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3f91710b-3c42-4f14-a4e7-9bdda2442b06 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.453828 Aug 24 03:54:15.967961 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2259/4284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:15 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:15.978581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.979287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.979889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.980721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.985041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.985941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.045694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:16.046577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:16.055806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.056583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.060435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.061634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.066613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.067217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.182891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.199595 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0befa6d-7d40-47c7-9b2a-aeeff601ec20 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1452 microversion: 2.1 time: 0.241662 Aug 24 03:54:16.200380 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2026/4285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:15 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:16.313385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.322715 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a71fdd67-267e-410f-b57e-5eba9ed19812 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.281719 Aug 24 03:54:16.324784 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2260/4286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:16 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:16.370373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e1854be1-7c25-4d1c-b164-e94119574772 req-67ffbdc9-179f-46fb-bf69-5e32377299b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd", "name": "network-vif-deleted", "tag": "a91c553d-4b84-4e85-955b-f8aee4a841b4"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:16.388205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e1854be1-7c25-4d1c-b164-e94119574772 req-67ffbdc9-179f-46fb-bf69-5e32377299b8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.388782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e1854be1-7c25-4d1c-b164-e94119574772 req-67ffbdc9-179f-46fb-bf69-5e32377299b8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.389114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e1854be1-7c25-4d1c-b164-e94119574772 req-67ffbdc9-179f-46fb-bf69-5e32377299b8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.406645 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e1854be1-7c25-4d1c-b164-e94119574772 req-67ffbdc9-179f-46fb-bf69-5e32377299b8 service nova] Creating event network-vif-deleted:a91c553d-4b84-4e85-955b-f8aee4a841b4 for instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd on n-h1-846470-15 Aug 24 03:54:16.413991 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e1854be1-7c25-4d1c-b164-e94119574772 req-67ffbdc9-179f-46fb-bf69-5e32377299b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050463 Aug 24 03:54:16.416130 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2027/4287] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:16.495720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:16.497237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:16.510151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.513385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.516060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.519693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.523973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.525107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.844247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.856374 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-524c3482-f0f9-44d3-a1ef-847b0fc6bb92 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 0.365232 Aug 24 03:54:16.857566 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2261/4288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:16 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:17.000504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:17.004836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:17.025799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.026311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.026759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.027490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.027975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.029055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.222808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:17.223879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:17.234135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.235627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.236583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.237649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.238630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.239237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.349844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:17.364033 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-192351cb-b80c-4dde-a17d-b793021407d6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1452 microversion: 2.1 time: 0.145730 Aug 24 03:54:17.365021 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2262/4289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:17 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:17.370107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:17.371147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:17.373599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:17.387435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.388490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.389085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.390312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.392114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.393506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.622794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:17.638648 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1662055-add1-4281-ab6e-eafc601b5687 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.272130 Aug 24 03:54:17.639948 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2263/4290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:17 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:17.864317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:17.879768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:17.880768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:17.882109 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a182aca-288c-4937-878e-d4f465156376 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.890752 Aug 24 03:54:17.882725 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2028/4291] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:16 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:17.900247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.901192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.901809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.902532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.902988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.903421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.153999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:18.171564 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-79a47b78-4f97-461b-8871-974bd2643fca tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 0.297588 Aug 24 03:54:18.189280 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2264/4292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:17 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:18.391524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:18.392490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:18.414321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.416081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.419219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.421913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.423729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.427106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.543951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.546178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.549198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.552866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lazy-loading 'fault' on Instance uuid d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:18.648498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:18.662280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:18.662903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:18.668294 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb795d30-3034-492b-aaad-df44a5c1843c tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 200 len: 1310 microversion: 2.1 time: 0.281077 Aug 24 03:54:18.673958 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2029/4293] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:18 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 1310 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:18.685990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.686760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.687495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.689484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.690162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.690755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.912463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:18.914001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:18.930025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.930548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.930993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.931737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.934578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.937452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.036198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:19.109555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab1cc6fe-85a5-4bfb-91e2-996acff80fcf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.448970 Aug 24 03:54:19.112069 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2265/4294] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:18 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:19.197970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:19.198922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:19.224177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.224879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.225452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.226326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.226928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.227463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.561007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:19.572878 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb7162c5-7858-4627-9b0b-b54fe1325665 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 0.379541 Aug 24 03:54:19.584797 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2266/4295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:19 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:19.692701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:19.694269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:19.705615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.706128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.706701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.707434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.707925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.712470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.730642 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd HTTP/1.1 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd3fe5ac4-7365-4f1e-b6b0-23a0b190abcd'} Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:19.733967 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.739132 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.739132 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:19.739132 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:19.739132 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:19.739132 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:19.739132 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.739132 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.743257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:19.746671 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d07a0728-a80d-49c8-a3c8-ae7c7a4d29ac tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 404 len: 111 microversion: 2.1 time: 0.057309 Aug 24 03:54:19.747906 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2267/4296] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:19 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:19.765536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:19.766904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:19.779919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.780473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.781249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.782650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.783417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.784193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.801612 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd HTTP/1.1 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd3fe5ac4-7365-4f1e-b6b0-23a0b190abcd'} Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:19.804136 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.809562 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.813624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:19.814196 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-84425825-bac7-4b64-9e3e-dac157cd7496 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 404 len: 111 microversion: 2.1 time: 0.053500 Aug 24 03:54:19.815926 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2268/4297] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:19 2022] DELETE /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:54:19.824483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:19.825105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:19.847398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.848103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.848546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.849572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.850895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.851876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.878678 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd HTTP/1.1 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd3fe5ac4-7365-4f1e-b6b0-23a0b190abcd'} Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:19.880596 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.885624 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.885624 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:19.885624 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:19.885624 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:19.885624 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:19.885624 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. Aug 24 03:54:19.885624 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.885624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:19.886308 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bd4ac83-5899-40ad-b81a-6d3e15888041 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd" status: 404 len: 111 microversion: 2.1 time: 0.064750 Aug 24 03:54:19.888510 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2269/4298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:19 2022] GET /compute/v2.1/servers/d3fe5ac4-7365-4f1e-b6b0-23a0b190abcd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:54:19.897891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:19.903096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:19.912998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.913753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.914526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.915269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.915832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.916257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.951891 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b HTTP/1.1 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '06570cff-52f4-4543-8cc7-8a613c981f3b'} Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:19.953824 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-557b55a1-a774-4545-bd80-0539917105eb tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 404 len: 111 microversion: 2.1 time: 0.063060 Aug 24 03:54:19.960987 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2270/4299] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:19 2022] DELETE /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:19.966788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:19.967370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 06570cff-52f4-4543-8cc7-8a613c981f3b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:19.985217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.985750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.986425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:19.987230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:19.987718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:19.996670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.046111 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b HTTP/1.1 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '06570cff-52f4-4543-8cc7-8a613c981f3b'} Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.050425 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.054393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.054393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.054393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.054393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.054393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.054393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. Aug 24 03:54:20.054393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.054393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 06570cff-52f4-4543-8cc7-8a613c981f3b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.055805 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe64bfbd-04d9-46dd-8108-ef0a84f87d73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b" status: 404 len: 111 microversion: 2.1 time: 0.091228 Aug 24 03:54:20.098092 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2271/4300] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:19 2022] GET /compute/v2.1/servers/06570cff-52f4-4543-8cc7-8a613c981f3b => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:20.113600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.114674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.119436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:20.123127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.123903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.124702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.125667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.126460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.127521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.133365 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-afc67759-4e42-46e9-9e99-b6cdca62fae5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 1.227044 Aug 24 03:54:20.137166 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2030/4301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:18 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:20.145290 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 HTTP/1.1 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'be410689-94b6-41c1-b2a4-68f991e61cb2'} Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.147244 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.151628 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.154122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.154774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.155406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.155731 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-68236db9-f7a8-44cd-9584-0c02382d5c73 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 404 len: 111 microversion: 2.1 time: 0.050942 Aug 24 03:54:20.156770 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2272/4302] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:20 2022] DELETE /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:20.177250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.177769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.178222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.179026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.179496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.179955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.180426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.182004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: be410689-94b6-41c1-b2a4-68f991e61cb2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.193725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.194402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.195093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.196287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.196995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.201312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.222739 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 HTTP/1.1 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'be410689-94b6-41c1-b2a4-68f991e61cb2'} Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.225477 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.231792 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.231792 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.231792 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.231792 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.231792 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.231792 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. Aug 24 03:54:20.231792 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.238677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance be410689-94b6-41c1-b2a4-68f991e61cb2 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.241384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a0ed906-f493-4874-b6fa-c44895339856 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2" status: 404 len: 111 microversion: 2.1 time: 0.079800 Aug 24 03:54:20.245858 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2273/4303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/be410689-94b6-41c1-b2a4-68f991e61cb2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:20.263005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.264311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.282801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.283729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.284285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.292354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.304984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.305671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.328121 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 HTTP/1.1 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '403e03d6-8c32-43df-9a20-f60f17b9c259'} Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.331178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.336320 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f323077f-e92c-4e01-be60-fd27790697b3 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 404 len: 111 microversion: 2.1 time: 0.082282 Aug 24 03:54:20.337864 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2274/4304] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:20 2022] DELETE /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:20.346113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.347167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 403e03d6-8c32-43df-9a20-f60f17b9c259] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.355590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.362030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.363311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.365018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.365567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.366038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.389618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:20.390892 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 HTTP/1.1 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '403e03d6-8c32-43df-9a20-f60f17b9c259'} Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.393440 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 403e03d6-8c32-43df-9a20-f60f17b9c259 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.397467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-282df0c0-349c-4e9e-8f20-f8208c2e1587 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259" status: 404 len: 111 microversion: 2.1 time: 0.055960 Aug 24 03:54:20.399993 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2275/4305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/403e03d6-8c32-43df-9a20-f60f17b9c259 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:20.408522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.409453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.421674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.423157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.424605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.425689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.426441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.426979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.462023 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 HTTP/1.1 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9f10558b-2286-4651-a321-d50e4faec067'} Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.465646 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.472502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.477379 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c88e5135-eadb-4bc4-a094-3914eb3470aa tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 404 len: 111 microversion: 2.1 time: 0.074030 Aug 24 03:54:20.477379 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2276/4306] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:20 2022] DELETE /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:20.487395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.488514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9f10558b-2286-4651-a321-d50e4faec067] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.498559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.500128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.501584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.504152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.504152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.504998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.546902 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 HTTP/1.1 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9f10558b-2286-4651-a321-d50e4faec067'} Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.551972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 9f10558b-2286-4651-a321-d50e4faec067 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bb3f7940-e82c-458b-a6bf-5b41c0fc3bb5 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067" status: 404 len: 111 microversion: 2.1 time: 0.072140 Aug 24 03:54:20.555952 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2277/4307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/9f10558b-2286-4651-a321-d50e4faec067 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:54:20.570984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.571601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.590724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.591745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.592396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.593159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.593638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.594070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.631107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 HTTP/1.1 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '4bbef84a-c2d0-46b3-8604-2e7b2a82a716'} Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.640696 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.645996 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76d7858a-728f-4973-b30d-10b3fd29e0e8 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 404 len: 111 microversion: 2.1 time: 0.084146 Aug 24 03:54:20.648399 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2278/4308] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:20 2022] DELETE /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:20.658346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.658890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.673678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.674182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.674625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.680740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.681677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.682138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.929942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:20.939783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:20.943992 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0f0615a4-25e1-4df8-80d2-045fb5d00e3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.803029 Aug 24 03:54:20.944807 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2031/4309] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:20.949700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:20.950637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 4bbef84a-c2d0-46b3-8604-2e7b2a82a716] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:20.961154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.961886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.962513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.963361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:20.963969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:20.964526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:20.982909 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 HTTP/1.1 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '4bbef84a-c2d0-46b3-8604-2e7b2a82a716'} Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:20.985663 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 4bbef84a-c2d0-46b3-8604-2e7b2a82a716 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8263407-d0f9-4e52-9543-12a32c4d6674 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716" status: 404 len: 111 microversion: 2.1 time: 0.041168 Aug 24 03:54:20.989836 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2032/4310] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/4bbef84a-c2d0-46b3-8604-2e7b2a82a716 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:21.000600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69f790bf-b83e-4d21-8151-2bb1b465e999 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:21.001497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69f790bf-b83e-4d21-8151-2bb1b465e999 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9030a21b-7f1c-4591-8f34-f0f27026f91b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:21.008519 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-69f790bf-b83e-4d21-8151-2bb1b465e999 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69f790bf-b83e-4d21-8151-2bb1b465e999 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b HTTP/1.1 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9030a21b-7f1c-4591-8f34-f0f27026f91b'} Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:21.011024 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69f790bf-b83e-4d21-8151-2bb1b465e999 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69f790bf-b83e-4d21-8151-2bb1b465e999 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b" status: 404 len: 111 microversion: 2.1 time: 0.017935 Aug 24 03:54:21.016686 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2033/4311] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:20 2022] DELETE /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:21.024762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-517b8643-9057-4a6f-9841-2e74dd2d95a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:21.025620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-517b8643-9057-4a6f-9841-2e74dd2d95a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 9030a21b-7f1c-4591-8f34-f0f27026f91b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:21.036824 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-517b8643-9057-4a6f-9841-2e74dd2d95a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-517b8643-9057-4a6f-9841-2e74dd2d95a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b HTTP/1.1 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9030a21b-7f1c-4591-8f34-f0f27026f91b'} Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:21.044829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:21.049438 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:21.049438 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:21.049438 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:21.049438 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. Aug 24 03:54:21.049438 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:21.049438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-517b8643-9057-4a6f-9841-2e74dd2d95a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 9030a21b-7f1c-4591-8f34-f0f27026f91b could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:21.049438 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-517b8643-9057-4a6f-9841-2e74dd2d95a6 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b" status: 404 len: 111 microversion: 2.1 time: 0.027295 Aug 24 03:54:21.049438 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2034/4312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:21 2022] GET /compute/v2.1/servers/9030a21b-7f1c-4591-8f34-f0f27026f91b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:21.057284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:21.057942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:21.086777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.087598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.088422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.089684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.090529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.091174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.151801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:21.162569 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-775de47f-eb19-4322-a1a4-8ebcff792718 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 0.513829 Aug 24 03:54:21.166224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:54:21.168859 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2279/4313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:20 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:21.186822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:21.187626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:21.205950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.206583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.208607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.209584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.212951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.213804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.350389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-413b5acc-f547-459e-aace-eb78f738eaea tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 204 len: 0 microversion: 2.1 time: 0.295733 Aug 24 03:54:21.352655 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2035/4314] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:21 2022] DELETE /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:54:21.364342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:21.365397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:21.383563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.384187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.384697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.386217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:21.386773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:21.387864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:21.739273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:21.765912 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-710f3a79-8eea-49b0-8f61-c208069a1aa0 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1480 microversion: 2.1 time: 0.408027 Aug 24 03:54:21.768786 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2036/4315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:21 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1480 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:21.828185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:21.840866 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70feb7d6-db41-4d5a-a5fa-b309d4cd731b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.667691 Aug 24 03:54:21.842500 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2280/4316] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:21 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:21.968127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:21.968866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:22.002416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:22.003716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:22.004476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:22.006855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:22.008116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:22.008735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:22.192420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:22.193976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:22.206871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:22.210149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:22.211097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:22.217970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:22.217970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:22.225561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:22.339991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:22.350230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5dc26581-dc33-4c3c-8315-096b016f5842 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.386014 Aug 24 03:54:22.367252 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2037/4317] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:21 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:22.692706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:22.709068 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7dc45f9b-8656-4b93-bb02-3f17c40c5b61 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 0.516803 Aug 24 03:54:22.709765 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2281/4318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:22 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:22.797104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:22.798129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:22.821954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:22.826847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:22.833062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:22.834234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:22.842488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:22.843219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:22.875315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:22.875315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:22.881464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:22.881966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:22.882412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:22.895912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:22.896624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:22.901474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.330722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:23.341559 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec0be38f-971b-40cf-9fc2-8dae3ddb8bb0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1477 microversion: 2.1 time: 0.482859 Aug 24 03:54:23.356216 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2282/4319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:22 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1477 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:23.364070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ba87c4b7-0924-42eb-b65b-b91d88cec933 req-ef040ec7-8345-4d52-a9bf-7b5038e89584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307e338d-b5fd-4bee-af5d-4b4025316da5", "name": "network-vif-plugged", "status": "completed", "tag": "343f4e14-c02a-4923-a1ee-dad53fb34226"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:23.384816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ba87c4b7-0924-42eb-b65b-b91d88cec933 req-ef040ec7-8345-4d52-a9bf-7b5038e89584 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.388546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ba87c4b7-0924-42eb-b65b-b91d88cec933 req-ef040ec7-8345-4d52-a9bf-7b5038e89584 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.389308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ba87c4b7-0924-42eb-b65b-b91d88cec933 req-ef040ec7-8345-4d52-a9bf-7b5038e89584 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.414399 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ba87c4b7-0924-42eb-b65b-b91d88cec933 req-ef040ec7-8345-4d52-a9bf-7b5038e89584 service nova] Creating event network-vif-plugged:343f4e14-c02a-4923-a1ee-dad53fb34226 for instance 307e338d-b5fd-4bee-af5d-4b4025316da5 on n-h2-846470-15 Aug 24 03:54:23.429991 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ba87c4b7-0924-42eb-b65b-b91d88cec933 req-ef040ec7-8345-4d52-a9bf-7b5038e89584 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070998 Aug 24 03:54:23.430522 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2283/4320] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:23.447704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:23.448856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:23.469343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.471117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.471778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.472688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.473320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.473931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.814404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:23.826089 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72a8a80f-ff07-4f50-ba66-34a43030939e tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1480 microversion: 2.1 time: 1.041100 Aug 24 03:54:23.833079 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2038/4321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:22 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1480 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:23.847931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:23.848566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:23.865807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:23.875485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.876025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.876581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.877458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:23.877926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:23.878362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:23.987989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:24.008861 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-79971a38-de89-4de8-93f2-4bdad397d405 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.576772 Aug 24 03:54:24.009484 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2284/4322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:23 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:24.390297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:24.396180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:24.415814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:24.416910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:24.420571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:24.421760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:24.423235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:24.424883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:24.673900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:24.682365 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e30cea90-9d16-4d19-a9c8-e61fa90087d7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1476 microversion: 2.1 time: 0.313814 Aug 24 03:54:24.696681 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2285/4323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:24 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:24.853111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:24.854431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:24.863224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:24.863747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:24.864691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:24.866587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:24.867166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:24.868052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.118460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:25.127653 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b39ed015-9e93-425d-8da4-4ade6d37708f tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1480 microversion: 2.1 time: 0.280357 Aug 24 03:54:25.142670 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2286/4324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:24 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1480 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:25.148077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:25.149087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:25.156000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.156897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.157729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.158885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.159600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.160318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.175360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:25.199259 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06c2b5ef-6195-4cf8-ba3d-2cbd76ede02d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 1.364106 Aug 24 03:54:25.201194 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2039/4325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:23 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:25.416236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:25.432943 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-463b394d-6903-4864-89c3-e10e8b7b0da8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.288419 Aug 24 03:54:25.435819 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2287/4326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:25 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:25.452526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-505f9b3b-5a11-405b-9188-9fc21ed1aed6 req-1e57c8d6-d46f-4e65-90e7-97bcc6b8c2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef86c7ec-f3e1-4c56-9205-740d31e89076", "name": "network-vif-plugged", "status": "completed", "tag": "ed6512db-5da4-45c9-a92b-5fbca5daa197"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:25.476079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-505f9b3b-5a11-405b-9188-9fc21ed1aed6 req-1e57c8d6-d46f-4e65-90e7-97bcc6b8c2d1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.476569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-505f9b3b-5a11-405b-9188-9fc21ed1aed6 req-1e57c8d6-d46f-4e65-90e7-97bcc6b8c2d1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.477224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-505f9b3b-5a11-405b-9188-9fc21ed1aed6 req-1e57c8d6-d46f-4e65-90e7-97bcc6b8c2d1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.497497 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-505f9b3b-5a11-405b-9188-9fc21ed1aed6 req-1e57c8d6-d46f-4e65-90e7-97bcc6b8c2d1 service nova] Creating event network-vif-plugged:ed6512db-5da4-45c9-a92b-5fbca5daa197 for instance ef86c7ec-f3e1-4c56-9205-740d31e89076 on n-h1-846470-15 Aug 24 03:54:25.505298 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-505f9b3b-5a11-405b-9188-9fc21ed1aed6 req-1e57c8d6-d46f-4e65-90e7-97bcc6b8c2d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056323 Aug 24 03:54:25.506749 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2040/4327] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:25.722938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:25.724470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:25.738675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.740877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.742197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.743984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.746857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.747703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.752868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a100ead5-2bb5-42d6-818f-64bd7a63e7de req-6f52e012-6e80-4d15-a44f-3902e0be4884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "name": "network-vif-unplugged", "status": "completed", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:25.781295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a100ead5-2bb5-42d6-818f-64bd7a63e7de req-6f52e012-6e80-4d15-a44f-3902e0be4884 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:25.782001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a100ead5-2bb5-42d6-818f-64bd7a63e7de req-6f52e012-6e80-4d15-a44f-3902e0be4884 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:25.782708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a100ead5-2bb5-42d6-818f-64bd7a63e7de req-6f52e012-6e80-4d15-a44f-3902e0be4884 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:25.809492 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a100ead5-2bb5-42d6-818f-64bd7a63e7de req-6f52e012-6e80-4d15-a44f-3902e0be4884 service nova] Creating event network-vif-unplugged:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h2-846470-15 Aug 24 03:54:25.833726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-a100ead5-2bb5-42d6-818f-64bd7a63e7de req-6f52e012-6e80-4d15-a44f-3902e0be4884 service nova] Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:54:25.849413 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a100ead5-2bb5-42d6-818f-64bd7a63e7de req-6f52e012-6e80-4d15-a44f-3902e0be4884 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100715 Aug 24 03:54:25.851500 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2041/4328] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:26.068140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:26.082602 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-09fc4458-372f-4b7b-aacd-04a87bde7cef tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1476 microversion: 2.1 time: 0.379824 Aug 24 03:54:26.085031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2288/4329] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:25 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:26.167088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:26.169332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:26.191706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.197402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.200200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.201792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.203784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.204624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.236354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:26.237890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:26.255994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.258282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.261588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.264045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.265687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.267349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.443581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:26.457402 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7ceb671d-c3d8-436f-80ea-8b8cc23f551a tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1438 microversion: 2.1 time: 0.310403 Aug 24 03:54:26.472981 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2042/4330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:26 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1438 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:26.478547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:26.479444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:26.495707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.496812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.499885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:26.501393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:26.502823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:26.505147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.201559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:27.212602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26d68a4b-7a87-4435-bbd7-fc866975522c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1317 microversion: 2.1 time: 0.750602 Aug 24 03:54:27.215864 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2043/4331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:26 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:27.230384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:27.231408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:27.247365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.248148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.248778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.249703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.250320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.250905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.584000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:27.584493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:27.604862 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d3ec5723-67a7-4f88-b2b1-c5be20c31ae9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1476 microversion: 2.1 time: 0.387798 Aug 24 03:54:27.606447 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-766a324b-8c25-4c61-87c9-fbb98245a63a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1372 microversion: 2.1 time: 1.374248 Aug 24 03:54:27.606766 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2044/4332] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:27 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1476 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:27.623026 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2289/4333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:26 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1372 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:27.628312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:27.629033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:27.640791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.641601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.643629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.644686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.645615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.646307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.688256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.689820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.690588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.691973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lazy-loading 'fault' on Instance uuid 49ed4f04-4bff-4442-9c22-c2c523efd262 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:27.780200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8d8d611eca416ab165ce4bba901ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b3e378efe04ae99615d3181be6f9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:27.795060 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-abed9423-3d0a-44ea-a1b4-1f637b8ab495 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 200 len: 1283 microversion: 2.1 time: 0.186832 Aug 24 03:54:27.796479 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2045/4334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:27 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 1283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:27.869865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-0c79941b-1651-4581-9b29-cb03d86a8512 req-e0d69f9f-325b-4b44-bb2d-40f210bff03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ed4f04-4bff-4442-9c22-c2c523efd262", "name": "network-vif-deleted", "tag": "4cfbfa0f-4675-44bb-82d4-936d99a08a0e"}, {"name": "network-changed", "server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:27.882543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0c79941b-1651-4581-9b29-cb03d86a8512 req-e0d69f9f-325b-4b44-bb2d-40f210bff03c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:27.883410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0c79941b-1651-4581-9b29-cb03d86a8512 req-e0d69f9f-325b-4b44-bb2d-40f210bff03c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:27.884109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0c79941b-1651-4581-9b29-cb03d86a8512 req-e0d69f9f-325b-4b44-bb2d-40f210bff03c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:27.900897 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-0c79941b-1651-4581-9b29-cb03d86a8512 req-e0d69f9f-325b-4b44-bb2d-40f210bff03c service nova] Creating event network-vif-deleted:4cfbfa0f-4675-44bb-82d4-936d99a08a0e for instance 49ed4f04-4bff-4442-9c22-c2c523efd262 on n-h2-846470-15 Aug 24 03:54:27.901392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-0c79941b-1651-4581-9b29-cb03d86a8512 req-e0d69f9f-325b-4b44-bb2d-40f210bff03c service nova] Creating event network-changed:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h2-846470-15 Aug 24 03:54:27.909303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-0c79941b-1651-4581-9b29-cb03d86a8512 req-e0d69f9f-325b-4b44-bb2d-40f210bff03c service nova] Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:54:27.924573 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-0c79941b-1651-4581-9b29-cb03d86a8512 req-e0d69f9f-325b-4b44-bb2d-40f210bff03c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057770 Aug 24 03:54:27.925469 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2290/4335] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:28.242279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:28.243080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:28.251587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:28.252522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:28.252973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:28.253709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:28.254389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:28.254825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:28.632198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:28.634330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:28.643964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:28.644737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:28.645662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:28.646949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:28.647973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:28.648955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:28.863441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:28.890140 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c3361186-79b1-4ab5-a672-a3a5fb6538b7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1506 microversion: 2.1 time: 0.653645 Aug 24 03:54:28.891753 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2046/4336] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:28 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:28.947401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:28.948566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:28.962396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:28.963188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:28.963857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:28.964835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:28.965542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:28.966527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.095394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:29.107164 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ebfd93af-c1b0-4a82-b467-98a6ab41d3ad tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1474 microversion: 2.1 time: 0.484038 Aug 24 03:54:29.108120 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2291/4337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:28 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:29.113446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:29.114553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] [instance: 49ed4f04-4bff-4442-9c22-c2c523efd262] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:29.120956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:29.121789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:29.122463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.123402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:29.124129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:29.124791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.142583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] HTTP exception thrown: Instance 49ed4f04-4bff-4442-9c22-c2c523efd262 could not be found. Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Request method failure captured: Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 HTTP/1.1 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_dGyHv7Q5KnmDnfLIYlkDkPnisIjGAWd3vAHsUvkdlM86-ly0hKxkHFu0OSOuk6cicLwe5WrgX471pkw6iGjq_OGk3KMi7gVZ3Fj6_gfsoGFHH9gw8XmqUYCq67sTH4QnYBmA7qlSAvYW5OpeUSHwZbyTcUxEIPhgEyrkXkaYI3l0 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9b3e378efe04ae99615d3181be6f9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersTestJSON-2116395263 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a9b3e378efe04ae99615d3181be6f9a6 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersTestJSON-2116395263 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0b8d8d611eca416ab165ce4bba901ac5 Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersTestJSON-2116395263-project Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 49ed4f04-4bff-4442-9c22-c2c523efd262 could not be found. Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '49ed4f04-4bff-4442-9c22-c2c523efd262'} Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ed4f04-4bff-4442-9c22-c2c523efd262 could not be found. Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ed4f04-4bff-4442-9c22-c2c523efd262 could not be found. Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:29.144817 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:29.149017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:29.149017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:29.149017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:29.149017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:29.149017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:29.149017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ed4f04-4bff-4442-9c22-c2c523efd262 could not be found. Aug 24 03:54:29.149017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:29.152206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] Returning 404 to user: Instance 49ed4f04-4bff-4442-9c22-c2c523efd262 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:29.153721 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aadea9f6-2dcf-4746-8a23-84dee98a2246 tempest-ServersTestJSON-2116395263 tempest-ServersTestJSON-2116395263-project] 10.222.0.58 "GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262" status: 404 len: 111 microversion: 2.1 time: 0.044356 Aug 24 03:54:29.154522 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2292/4338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:29 2022] GET /compute/v2.1/servers/49ed4f04-4bff-4442-9c22-c2c523efd262 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:29.160962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:29.162073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:29.169761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:29.170563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:29.171216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.172317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:29.173062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:29.173723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.218278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:54:29.324214 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c981976c-2f52-4e75-a493-509ff39eee5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 204 len: 0 microversion: 2.1 time: 0.166489 Aug 24 03:54:29.325031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2293/4339] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:29 2022] DELETE /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:54:29.334943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:29.336490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:29.345577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:29.346312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:29.346844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.347763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:29.348370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:29.348943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:29.389403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:29.623733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:29.642296 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1cb353a8-d7c4-4572-bd73-cd80e8ca7cc2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1512 microversion: 2.1 time: 0.311789 Aug 24 03:54:29.656928 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2294/4340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:29 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:30.135249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:30.143503 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-86d559ad-ab12-4345-a35f-6110f208b519 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1544 microversion: 2.1 time: 1.249642 Aug 24 03:54:30.143811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:30.144129 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2047/4341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:28 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1544 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:30.144606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:30.158764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.159377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.159939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.160749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.161396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.161933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.166932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:30.167833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:30.174312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.175056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.175658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.176823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.177473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.178172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.603740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:30.619230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5e1edd6-212d-450c-8bf1-c7d89a93f901 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1544 microversion: 2.1 time: 0.456078 Aug 24 03:54:30.637630 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2048/4342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:30 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1544 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:30.665074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:30.665694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:30.674631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.675534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.676731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.677717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:30.678978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:30.679403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:30.680298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:30.687335 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-711c03c4-53bb-45de-9b96-efd0e02baef9 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1474 microversion: 2.1 time: 0.547501 Aug 24 03:54:30.693727 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2295/4343] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:30 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1474 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:31.149586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:31.162058 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94f7111c-6d82-4e83-9b04-ac20e9bbfcc0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1512 microversion: 2.1 time: 0.500710 Aug 24 03:54:31.162664 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2049/4344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:30 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:31.721862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:31.722481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:31.733594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:31.738872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:31.739113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:31.744063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:31.744652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:31.745098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:32.182986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:32.183573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:32.193837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:32.194345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:32.197830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:32.198743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:32.201268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:32.201760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:32.206904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:32.462299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:32.472932 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60a34931-518e-48e3-9995-0eee8c7b53f8 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1474 microversion: 2.1 time: 0.755598 Aug 24 03:54:32.474064 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2296/4345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:31 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1474 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:32.905093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:32.922734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41301d27-1f8b-45e9-a551-cd200e5ab49f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1512 microversion: 2.1 time: 0.743674 Aug 24 03:54:32.923602 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2050/4346] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:32 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:33.497547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:33.498195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:33.511601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:33.512338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:33.512724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:33.519040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:33.519754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:33.520289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:33.945035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:33.945640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:33.952747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:33.953511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:33.954153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:33.955079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:33.955802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:33.956392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:34.320190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:34.343763 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c880d563-f84d-4202-b0c6-062b2cf2b496 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1474 microversion: 2.1 time: 0.850469 Aug 24 03:54:34.363283 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2297/4347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:33 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1474 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:35.253526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:35.310621 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-917beebb-14e5-44c4-8e2c-bd39d6997662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1512 microversion: 2.1 time: 1.369385 Aug 24 03:54:35.311897 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2051/4348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:33 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1512 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:35.371320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:35.372631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:35.383830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:35.385363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:35.388097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:35.390424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:35.393028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:35.393714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.028000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.029105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.046808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.048721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.049854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.054028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.060157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.060801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.104163 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dedb4843-2917-4da6-89ec-3ba9d8c0351e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804/ips" status: 200 len: 150 microversion: 2.1 time: 0.083225 Aug 24 03:54:36.105117 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2052/4349] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:36.127397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fa3c647-f2e4-428a-a857-f14492255ee9"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:36.131221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.139418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.140328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.140977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.141753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.142210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.142638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.185288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:36.203658 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d97b5f7-3bf5-4808-8bce-29ba83c93cfa tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1471 microversion: 2.1 time: 0.836426 Aug 24 03:54:36.205472 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2298/4350] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:35 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1471 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:36.245518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:36.246325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.285110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.285630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.288294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.290331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.290816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.291256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.351691 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Invalid volume: volume 3fa3c647-f2e4-428a-a857-f14492255ee9 is already attached to instances: c16d8242-aae4-4be3-9f15-f083a4815337 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804/os-volume_attachments HTTP/1.1 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 74 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: {"volumeAttachment": {"volumeId": "3fa3c647-f2e4-428a-a857-f14492255ee9"}} Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid volume: volume 3fa3c647-f2e4-428a-a857-f14492255ee9 is already attached to instances: c16d8242-aae4-4be3-9f15-f083a4815337 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': '180c32a3-8b5e-41e5-bcf7-1940851e3804', 'body': {'volumeAttachment': {'volumeId': '3fa3c647-f2e4-428a-a857-f14492255ee9'}}} Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3fa3c647-f2e4-428a-a857-f14492255ee9 is already attached to instances: c16d8242-aae4-4be3-9f15-f083a4815337 Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:36.363042 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3fa3c647-f2e4-428a-a857-f14492255ee9 is already attached to instances: c16d8242-aae4-4be3-9f15-f083a4815337 Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3fa3c647-f2e4-428a-a857-f14492255ee9 is already attached to instances: c16d8242-aae4-4be3-9f15-f083a4815337 Aug 24 03:54:36.367301 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:36.371181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 400 to user: Invalid volume: volume 3fa3c647-f2e4-428a-a857-f14492255ee9 is already attached to instances: c16d8242-aae4-4be3-9f15-f083a4815337 {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:36.372766 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-571bd894-0990-432d-a4e2-98e65d6f479f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.252392 Aug 24 03:54:36.377628 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2053/4351] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:54:36 2022] POST /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804/os-volume_attachments => generated 174 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:54:36.383605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.384667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.392130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.393557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.395053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.396149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.396884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.397529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.648288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:36.665653 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-35bd2dd1-1fab-4ba4-9d22-b73b33f2dff0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1470 microversion: 2.1 time: 0.286285 Aug 24 03:54:36.666418 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2054/4352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1470 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:36.681314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.682024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.690225 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-062bdfa8-e1e2-4ccf-bae2-f92c392a5560 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "POST /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02/action" status: 202 len: 0 microversion: 2.1 time: 0.440787 Aug 24 03:54:36.695029 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2299/4353] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:54:36 2022] POST /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:54:36.696527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.704351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.705212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.706222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.707490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.708152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.726779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a996d88d-d363-4275-967a-fa6d31e7e7ce req-cb77696b-4758-4d93-9f31-f4817f2b6fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307e338d-b5fd-4bee-af5d-4b4025316da5", "name": "network-vif-deleted", "tag": "343f4e14-c02a-4923-a1ee-dad53fb34226"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:36.755127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a996d88d-d363-4275-967a-fa6d31e7e7ce req-cb77696b-4758-4d93-9f31-f4817f2b6fd5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.766040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a996d88d-d363-4275-967a-fa6d31e7e7ce req-cb77696b-4758-4d93-9f31-f4817f2b6fd5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.766977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a996d88d-d363-4275-967a-fa6d31e7e7ce req-cb77696b-4758-4d93-9f31-f4817f2b6fd5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.779757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:54:36.815508 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a996d88d-d363-4275-967a-fa6d31e7e7ce req-cb77696b-4758-4d93-9f31-f4817f2b6fd5 service nova] Creating event network-vif-deleted:343f4e14-c02a-4923-a1ee-dad53fb34226 for instance 307e338d-b5fd-4bee-af5d-4b4025316da5 on n-h2-846470-15 Aug 24 03:54:36.823436 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a996d88d-d363-4275-967a-fa6d31e7e7ce req-cb77696b-4758-4d93-9f31-f4817f2b6fd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123029 Aug 24 03:54:36.824445 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2300/4354] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:36.831645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.832943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.843503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.844316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.845441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.846493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.847357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.849038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.977206 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8c8fc97-486f-4cc9-bcf8-d63e4d67a869 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 204 len: 0 microversion: 2.1 time: 0.291207 Aug 24 03:54:36.977790 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2055/4355] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:36 2022] DELETE /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:54:36.996118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.996825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:37.016535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.017119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.018609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.024933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.025670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.026415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.383282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:37.428995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65a34153-f803-4a19-80c1-502028d04eae tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.602913 Aug 24 03:54:37.434814 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2301/4356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:37.491386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:37.500308 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5002b88b-ecf9-47e7-a5a5-122f4691bdab tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1681 microversion: 2.1 time: 0.511146 Aug 24 03:54:37.518891 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2056/4357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1681 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:37.524271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d2fd4380-8331-42af-ba90-3bc7a35d8ee4 req-5d8f8b72-8d12-43ab-b3b1-3154bf0a5ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef86c7ec-f3e1-4c56-9205-740d31e89076", "tag": "ed6512db-5da4-45c9-a92b-5fbca5daa197"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:37.553446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d2fd4380-8331-42af-ba90-3bc7a35d8ee4 req-5d8f8b72-8d12-43ab-b3b1-3154bf0a5ae5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.555879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d2fd4380-8331-42af-ba90-3bc7a35d8ee4 req-5d8f8b72-8d12-43ab-b3b1-3154bf0a5ae5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.561230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d2fd4380-8331-42af-ba90-3bc7a35d8ee4 req-5d8f8b72-8d12-43ab-b3b1-3154bf0a5ae5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.586701 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d2fd4380-8331-42af-ba90-3bc7a35d8ee4 req-5d8f8b72-8d12-43ab-b3b1-3154bf0a5ae5 service nova] Creating event network-changed:ed6512db-5da4-45c9-a92b-5fbca5daa197 for instance ef86c7ec-f3e1-4c56-9205-740d31e89076 on n-h1-846470-15 Aug 24 03:54:37.602283 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d2fd4380-8331-42af-ba90-3bc7a35d8ee4 req-5d8f8b72-8d12-43ab-b3b1-3154bf0a5ae5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081543 Aug 24 03:54:37.612631 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2057/4358] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:37.618198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ea18cfd0-3054-463d-8521-89fcbd782a49 req-91125093-f935-4a6e-8966-115ae3083ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "name": "network-vif-plugged", "status": "completed", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:37.663873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ea18cfd0-3054-463d-8521-89fcbd782a49 req-91125093-f935-4a6e-8966-115ae3083ce3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.664420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ea18cfd0-3054-463d-8521-89fcbd782a49 req-91125093-f935-4a6e-8966-115ae3083ce3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.666605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ea18cfd0-3054-463d-8521-89fcbd782a49 req-91125093-f935-4a6e-8966-115ae3083ce3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.698039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ea18cfd0-3054-463d-8521-89fcbd782a49 req-91125093-f935-4a6e-8966-115ae3083ce3 service nova] Creating event network-vif-plugged:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h2-846470-15 Aug 24 03:54:37.716291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-ea18cfd0-3054-463d-8521-89fcbd782a49 req-91125093-f935-4a6e-8966-115ae3083ce3 service nova] Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:54:37.740937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-237210628", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "70f8589d-8968-4fce-8b6a-9aaf11892e31"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:37.756947 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ea18cfd0-3054-463d-8521-89fcbd782a49 req-91125093-f935-4a6e-8966-115ae3083ce3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142649 Aug 24 03:54:37.759078 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2058/4359] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:37.792808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:37.795140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:37.808968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.809816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.820557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.821775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.822766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.823419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.879243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.880040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.880650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.882359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lazy-loading 'fault' on Instance uuid 307e338d-b5fd-4bee-af5d-4b4025316da5 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:38.051637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] validate_networks() for [('70f8589d-8968-4fce-8b6a-9aaf11892e31', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:54:38.115732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:38.133482 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9412052c-d0d5-488e-b02a-696fd305b052 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 200 len: 1307 microversion: 2.1 time: 0.370531 Aug 24 03:54:38.135460 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2059/4360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:37 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:38.451804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:38.452430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:38.472029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.472592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.472991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:38.473764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.474237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.474680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:38.965268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:54:38.966351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:54:38.967603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:54:38.968323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:54:38.969069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:54:38.983801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.984492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.985139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:38.986574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.987235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.987900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.012779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Getting quotas for project 49c39778c45e4bb89209770def13b66c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:39.020100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Getting quotas for user e373e046ca0646069d82a172162dfaa2 and project 49c39778c45e4bb89209770def13b66c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:39.038013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:54:39.040330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:54:39.074536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:39.098951 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc2820ff-d5b2-4835-8241-60b8276f6384 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662233 Aug 24 03:54:39.105839 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2302/4361] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:54:39.114422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:39.125205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:39.134335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.136382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.137051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.138042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.138771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.139528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.513905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:39.527521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e82d7d3b-e872-4081-9157-226cdbf2b4ee tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1681 microversion: 2.1 time: 0.420186 Aug 24 03:54:39.528627 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2303/4362] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:39 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1681 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:39.533692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05fc11cd-9f70-4cc8-9c75-04fabf8b017a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:39.534615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05fc11cd-9f70-4cc8-9c75-04fabf8b017a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:39.770328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05fc11cd-9f70-4cc8-9c75-04fabf8b017a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:39.782766 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05fc11cd-9f70-4cc8-9c75-04fabf8b017a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1214 microversion: 2.1 time: 0.252183 Aug 24 03:54:39.783349 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2304/4363] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:39 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:39.807410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:39.808313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:39.819654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.822947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.823717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.825242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.825968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.826567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.846730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 HTTP/1.1 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '307e338d-b5fd-4bee-af5d-4b4025316da5'} Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:39.848713 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:39.853815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:39.853815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:39.853815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:39.853815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:39.853815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:39.853815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:54:39.853815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:39.856107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:39.857207 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9c029d54-bf1d-40b5-8d4e-5f4f0195be53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 404 len: 111 microversion: 2.1 time: 0.072632 Aug 24 03:54:39.858314 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2305/4364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:39 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:39.869528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:39.871060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:39.879374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.880281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.881101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.882065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:39.882747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.883445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.312980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.325933 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-83e9bc03-84d5-4d44-81dc-0896435a30e5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 1.878915 Aug 24 03:54:40.327247 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2060/4365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:38 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:40.551413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:40.552067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:40.560991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.561494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.571042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.571858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.572535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.572981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.881605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.902802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8e448102-884a-4929-9184-5a4d93d1fe34 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.038729 Aug 24 03:54:40.904813 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2306/4366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:39 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:40.916377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:40.917548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.919892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:40.938253 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8adc2e3f-497b-4cf9-9495-07d77d6a971f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1681 microversion: 2.1 time: 0.390442 Aug 24 03:54:40.940611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2061/4367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:40 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1681 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:40.955776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.956645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.962083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.973142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.974576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.979949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.134463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a97e9f43-4f8d-42b2-bbaa-ab8c50fa6b80 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a97e9f43-4f8d-42b2-bbaa-ab8c50fa6b80 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 163 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": 12345, "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 12345 Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:54:41.140022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 03:54:41.145316 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:41.147293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a97e9f43-4f8d-42b2-bbaa-ab8c50fa6b80 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:41.148672 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a97e9f43-4f8d-42b2-bbaa-ab8c50fa6b80 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.018864 Aug 24 03:54:41.149844 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2062/4368] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:41 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:54:41.159083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:41.159083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:41.169337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.169847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.170330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.171359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.173237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.173906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.232856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.245861 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d43e0e35-129f-47f9-93a7-626ab4d51cc6 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1266 microversion: 2.1 time: 0.335819 Aug 24 03:54:41.247725 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2307/4369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:40 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:41.356542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:41.360232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:41.411504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.412250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.412767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.413616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.416291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.419699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.655913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.670722 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a20aaea2-3619-407e-ae7d-eb65edbda4d7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.516658 Aug 24 03:54:41.684960 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2063/4370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:41 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:41.693105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:41.694077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:41.701632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.702810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.703485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.705138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.705896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.706550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.803284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.811862 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b2bbfed-0cd4-47ef-a6f0-59e1fddddd5d tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.465343 Aug 24 03:54:41.812880 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2308/4371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:41 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:41.964959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:41.965518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:41.975876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.976317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.980168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.980952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.981437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.981876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:42.077639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:42.098906 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-70502d73-f2ca-449b-83f7-bd78bbd658f8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.400893 Aug 24 03:54:42.101408 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2064/4372] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:41 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:42.113463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6d75652a-fb03-464d-820f-bbd23a963529 req-7c01dcc9-c15b-4bdf-9f7a-7b30a1010a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c32a3-8b5e-41e5-bcf7-1940851e3804", "name": "network-vif-deleted", "tag": "801dfd6b-d0b4-4033-8af0-1a33d32fffcb"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:42.136365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6d75652a-fb03-464d-820f-bbd23a963529 req-7c01dcc9-c15b-4bdf-9f7a-7b30a1010a47 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.137614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6d75652a-fb03-464d-820f-bbd23a963529 req-7c01dcc9-c15b-4bdf-9f7a-7b30a1010a47 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.138343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6d75652a-fb03-464d-820f-bbd23a963529 req-7c01dcc9-c15b-4bdf-9f7a-7b30a1010a47 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:42.173331 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6d75652a-fb03-464d-820f-bbd23a963529 req-7c01dcc9-c15b-4bdf-9f7a-7b30a1010a47 service nova] Creating event network-vif-deleted:801dfd6b-d0b4-4033-8af0-1a33d32fffcb for instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 on n-h2-846470-15 Aug 24 03:54:42.182228 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6d75652a-fb03-464d-820f-bbd23a963529 req-7c01dcc9-c15b-4bdf-9f7a-7b30a1010a47 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076799 Aug 24 03:54:42.184797 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2065/4373] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:42.270038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:42.270998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:42.289018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.291311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.294165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:42.295282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.296620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.298464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:42.437694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:42.449832 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90d62614-455c-4a49-b2c6-76116d812a24 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1272 microversion: 2.1 time: 0.185580 Aug 24 03:54:42.465446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2066/4374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:42 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:42.683555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:42.709043 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ddd9247-1a14-45ec-91f7-75ead18752a7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1613 microversion: 2.1 time: 0.747350 Aug 24 03:54:42.736538 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2309/4375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:41 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1613 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:42.855563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:42.856945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:42.876242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.876998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.877497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:42.878353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.882466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.883078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.475189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:43.476452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:43.498155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:43.498797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:43.499343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.500327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:43.503116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:43.505488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.550826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.561901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:43.567449 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6bedcbc-86eb-46b0-b4ad-5961aa561f4f tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.733267 Aug 24 03:54:43.568341 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2067/4376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:42 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:43.706146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.716412 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4ae1f511-c186-41a5-813a-c589a1a9e1ff tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1272 microversion: 2.1 time: 0.246059 Aug 24 03:54:43.721539 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2310/4377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:43 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:43.740120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:43.741824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:43.752822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:43.754794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:43.755587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.756604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:43.757503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:43.758309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.838869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:43.840845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:43.842587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.847527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lazy-loading 'fault' on Instance uuid 180c32a3-8b5e-41e5-bcf7-1940851e3804 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:44.598858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:44.600152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:44.630552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.633802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.634655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.636520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.643032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.643522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.305746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.314826 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0f3a52a3-33ef-4d82-87f4-ab083b4b9a58 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 200 len: 1330 microversion: 2.1 time: 1.582705 Aug 24 03:54:45.322095 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2068/4378] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:43 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 1330 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:45.342950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:45.343979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:45.352442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.353233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.353851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.354790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.356326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.357029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.371971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.383968 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37d62675-de98-4299-be39-c81b847b1ace tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.798190 Aug 24 03:54:45.395014 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2311/4379] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:44 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:45.852751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.864868 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3e7f559c-db1b-4a02-9626-26798e406fc0 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 0.527592 Aug 24 03:54:45.865459 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2069/4380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:45 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:46.006979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76f7b02c-919f-4193-8ca2-f0f98d01d963 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] Calling method '.version_select at 0x7f1021fbe3a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.264888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-356e2a5b-40a3-4780-b971-aa39f2f92984 req-78e65d8c-f064-4d5f-9548-669cc2c81009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "name": "network-vif-unplugged", "status": "completed", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:46.289216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-356e2a5b-40a3-4780-b971-aa39f2f92984 req-78e65d8c-f064-4d5f-9548-669cc2c81009 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.289704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-356e2a5b-40a3-4780-b971-aa39f2f92984 req-78e65d8c-f064-4d5f-9548-669cc2c81009 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.290129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-356e2a5b-40a3-4780-b971-aa39f2f92984 req-78e65d8c-f064-4d5f-9548-669cc2c81009 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.321001 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-356e2a5b-40a3-4780-b971-aa39f2f92984 req-78e65d8c-f064-4d5f-9548-669cc2c81009 service nova] Creating event network-vif-unplugged:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h1-846470-15 Aug 24 03:54:46.341593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-356e2a5b-40a3-4780-b971-aa39f2f92984 req-78e65d8c-f064-4d5f-9548-669cc2c81009 service nova] Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:54:46.371753 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-356e2a5b-40a3-4780-b971-aa39f2f92984 req-78e65d8c-f064-4d5f-9548-669cc2c81009 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111489 Aug 24 03:54:46.372611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2070/4381] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:46.379322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.383355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:46.402337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.405841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.407634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.411364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.412948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.415139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.431646 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 HTTP/1.1 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '180c32a3-8b5e-41e5-bcf7-1940851e3804'} Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:46.434342 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:46.439144 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:46.439144 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:46.439144 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:46.439144 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:46.439144 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:46.439144 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 03:54:46.439144 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:46.440565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:46.441590 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-93f4b89f-7a7d-45a8-bdc7-d08c91414eeb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 404 len: 111 microversion: 2.1 time: 0.067667 Aug 24 03:54:46.442541 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2071/4382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:46 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:46.450169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.451043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:46.461201 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76f7b02c-919f-4193-8ca2-f0f98d01d963 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c/defaults" status: 200 len: 371 microversion: 2.1 time: 1.027954 Aug 24 03:54:46.461604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.462299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.462762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.463276 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2312/4383] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:54:45 2022] GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c/defaults => generated 371 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:46.463600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.464145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.464587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.469329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d3889e8-9882-4e83-9d42-1f95e84e944f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '.version_select at 0x7f1021ff9430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.525941 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d3889e8-9882-4e83-9d42-1f95e84e944f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931415141" status: 202 len: 0 microversion: 2.1 time: 0.061044 Aug 24 03:54:46.527022 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2313/4384] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931415141 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:54:46.535779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ccf5eb86-818d-48f5-9efc-2f7b507a9359 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] Calling method '.version_select at 0x7f1021ff91f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.887272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:46.900038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f9046a68-f3ad-4ad2-837d-fd7d8a02b724 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.456103 Aug 24 03:54:46.919705 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2072/4385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:46 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:46.925248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e682bacd-0c8d-4549-8294-e9cdd5a13aa9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-413421357", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7b1aeb9e-5108-4840-adcc-0d0191909e21", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:47.041243 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e682bacd-0c8d-4549-8294-e9cdd5a13aa9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Block Device 7b1aeb9e-5108-4840-adcc-0d0191909e21 is not bootable. Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e682bacd-0c8d-4549-8294-e9cdd5a13aa9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 357 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-413421357", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7b1aeb9e-5108-4840-adcc-0d0191909e21", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: exception: Block Device 7b1aeb9e-5108-4840-adcc-0d0191909e21 is not bootable. Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-413421357', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '7b1aeb9e-5108-4840-adcc-0d0191909e21'}], 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1659, in _create_instance Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 7b1aeb9e-5108-4840-adcc-0d0191909e21 is not bootable. Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:47.056020 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 7b1aeb9e-5108-4840-adcc-0d0191909e21 is not bootable. Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 7b1aeb9e-5108-4840-adcc-0d0191909e21 is not bootable. Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e682bacd-0c8d-4549-8294-e9cdd5a13aa9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Block Device 7b1aeb9e-5108-4840-adcc-0d0191909e21 is not bootable. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:47.060206 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e682bacd-0c8d-4549-8294-e9cdd5a13aa9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.136970 Aug 24 03:54:47.062334 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2073/4386] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:46 2022] POST /compute/v2.1/servers => generated 110 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:54:47.085839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:47.086540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:47.104403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ccf5eb86-818d-48f5-9efc-2f7b507a9359 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c" status: 200 len: 371 microversion: 2.1 time: 0.576070 Aug 24 03:54:47.105006 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2314/4387] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:54:46 2022] GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c => generated 371 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:47.127030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:47.127651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:47.134010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.134520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.134973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.135737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.136214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.136658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.168201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.169895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.170353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.171124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.171572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.175073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.242314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:47.537096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:47.551966 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-555727ac-d412-4d40-888a-48e0c74c7721 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.427829 Aug 24 03:54:47.565144 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2315/4388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:47 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:47.577845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-13b7b4ca-a737-4fed-ba91-b0b059454790 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] Calling method '.version_select at 0x7f1021ff9e50>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:47.656064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:47.667569 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-39ef61c2-c151-4809-b4cc-12a1f4961d61 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 0.603604 Aug 24 03:54:47.668546 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2074/4389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:47 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:47.676717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:47.678209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:47.689630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.690777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.691781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.692868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.693900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.694605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.976923 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-13b7b4ca-a737-4fed-ba91-b0b059454790 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.410307 Aug 24 03:54:47.991084 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2316/4390] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 03:54:47 2022] GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c/defaults => generated 371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:47.996520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:47.997420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:48.006330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.006900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.007342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.008136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.008563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.008994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.192938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:48.212969 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0e11471-eb18-4d88-a131-c44a1d2be614 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.220120 Aug 24 03:54:48.214256 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2317/4391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:47 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:48.235808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:48.236416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:48.244011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.244997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.245496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.246580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.247041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.247734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.327443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:48.341605 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c0bd3e05-ce68-4d50-a4bf-c04704049ae5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.670417 Aug 24 03:54:48.342801 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2075/4392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:47 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:48.374090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd748963-79fe-471d-b403-53500f1e2622 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] Calling method '.version_select at 0x7f102b500790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:48.375591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lazy-loading 'services' on Instance uuid c16d8242-aae4-4be3-9f15-f083a4815337 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:48.521380 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ebd903a-eda9-47a5-a9a4-91467cc1a16a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments/3fa3c647-f2e4-428a-a857-f14492255ee9" status: 202 len: 0 microversion: 2.1 time: 0.293733 Aug 24 03:54:48.525336 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2318/4393] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 03:54:48 2022] DELETE /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments/3fa3c647-f2e4-428a-a857-f14492255ee9 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:54:48.540044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9dd14251-5c20-45ce-b9d8-e05d5d5d844c req-79919b6f-8ea5-48bf-8f23-8d0bc711e23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}, {"name": "network-changed", "server_uuid": "9a3efe5c-3f6c-4e92-887e-2c216fefa5b0", "tag": "6fe99947-159a-49ee-a1b1-89bf6b7fc98f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:48.571265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9dd14251-5c20-45ce-b9d8-e05d5d5d844c req-79919b6f-8ea5-48bf-8f23-8d0bc711e23d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.573567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9dd14251-5c20-45ce-b9d8-e05d5d5d844c req-79919b6f-8ea5-48bf-8f23-8d0bc711e23d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.576971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9dd14251-5c20-45ce-b9d8-e05d5d5d844c req-79919b6f-8ea5-48bf-8f23-8d0bc711e23d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.651281 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9dd14251-5c20-45ce-b9d8-e05d5d5d844c req-79919b6f-8ea5-48bf-8f23-8d0bc711e23d service nova] Creating event network-changed:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h1-846470-15 Aug 24 03:54:48.651905 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9dd14251-5c20-45ce-b9d8-e05d5d5d844c req-79919b6f-8ea5-48bf-8f23-8d0bc711e23d service nova] Creating event network-changed:6fe99947-159a-49ee-a1b1-89bf6b7fc98f for instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 on n-h2-846470-15 Aug 24 03:54:48.667846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-9dd14251-5c20-45ce-b9d8-e05d5d5d844c req-79919b6f-8ea5-48bf-8f23-8d0bc711e23d service nova] Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:54:48.716319 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9dd14251-5c20-45ce-b9d8-e05d5d5d844c req-79919b6f-8ea5-48bf-8f23-8d0bc711e23d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.183533 Aug 24 03:54:48.719276 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2319/4394] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:48.733160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:48.753484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:48.774749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.780325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.781699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.783212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.784952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.785493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.810437 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd748963-79fe-471d-b403-53500f1e2622 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c" status: 200 len: 371 microversion: 2.1 time: 0.465754 Aug 24 03:54:48.811049 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2076/4395] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 03:54:48 2022] GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c => generated 371 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:48.823519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:48.824662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:48.837803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.838445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.838949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.839911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:48.840943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:48.841628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:48.872142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de91ea65-a145-4e98-b0f5-c6c04a273ffc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149171 Aug 24 03:54:48.876744 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2320/4396] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:48 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:48.886601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-519091c0-f8d4-46c0-a305-15eda263aa81 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] Calling method '.version_select at 0x7f1021fc9700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:49.004437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:49.032262 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-519091c0-f8d4-46c0-a305-15eda263aa81 tempest-QuotasTestJSON-133115232 tempest-QuotasTestJSON-133115232-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c?user_id=33de556970be40b5946748078b5516aa" status: 200 len: 371 microversion: 2.1 time: 0.153172 Aug 24 03:54:49.033191 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2321/4397] 10.222.0.58 () {58 vars in 1323 bytes} [Wed Aug 24 03:54:48 2022] GET /compute/v2.1/os-quota-sets/79ec8377619b4c129ea3d5c89566785c?user_id=33de556970be40b5946748078b5516aa => generated 371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:49.241612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:49.242332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:49.264603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.265187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.265781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.277248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.277887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.280254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.382842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:49.396022 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-730e6ca2-7734-4a16-b5b0-7248aaea838a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 0.583595 Aug 24 03:54:49.407613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2077/4398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:48 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:49.609783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:49.618946 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d0282c4-cb60-4d3b-b709-12189481df63 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.385690 Aug 24 03:54:49.625908 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2322/4399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:49 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:49.889492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:49.892767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:49.907956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.910793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.911471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.912604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:49.913300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:49.913951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:49.956279 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-62e904a7-24ac-439a-81ef-2c026e53f5cc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071038 Aug 24 03:54:49.957467 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2078/4400] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:49 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:50.433195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:50.434810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:50.453491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.454330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.455384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.456922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.457723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.458424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.648528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:50.649158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:50.669959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.674082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.674584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.676085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.676783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.677071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.735552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:50.748314 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e44444d-eb4e-43a4-9bf7-e5c5ded452e4 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 0.321368 Aug 24 03:54:50.752528 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2323/4401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:50 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:50.969653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:50.972111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:50.979784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.980661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.982500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:50.983525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:50.984250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:50.984924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.035419 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f7c25496-98ee-416b-8471-0ab2c4b4373d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069793 Aug 24 03:54:51.041015 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2324/4402] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:50 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:51.471228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c43737e2-9206-4a82-b7d9-b7924a2cc640 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1220451136", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "destination_type": "local"}, {"source_type": "volume", "uuid": "6734f758-8679-4fdd-afd2-c3fc4eeb88da", "destination_type": "invalid"}], "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c43737e2-9206-4a82-b7d9-b7924a2cc640 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 495 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1220451136", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "destination_type": "local"}, {"source_type": "volume", "uuid": "6734f758-8679-4fdd-afd2-c3fc4eeb88da", "destination_type": "invalid"}], "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1220451136', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6734f758-8679-4fdd-afd2-c3fc4eeb88da', 'destination_type': 'invalid'}], 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:51.477258 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 03:54:51.481144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:51.485895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c43737e2-9206-4a82-b7d9-b7924a2cc640 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:51.487031 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c43737e2-9206-4a82-b7d9-b7924a2cc640 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020738 Aug 24 03:54:51.491768 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2325/4403] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:51 2022] POST /compute/v2.1/servers => generated 155 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:54:51.497042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:51.498235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:51.511376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.512780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.513494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.515050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.515855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.516572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.563572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:51.581581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-25a365c2-a0d9-451d-b8ec-77fbccdec9e1 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.937420 Aug 24 03:54:51.582396 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2079/4404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:50 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:51.714720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:51.727214 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-949c7211-49f4-4bc8-a1fb-6a846a0ec910 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.233593 Aug 24 03:54:51.742380 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2326/4405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:51 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:51.759738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:51.760496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:51.771245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.771773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.772401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.773462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.774184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.774858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.778297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:51.779136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:51.797202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.800294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.801492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:51.803310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:51.805144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:51.806295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.022401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.034112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-43cf88e5-37c5-4262-a702-a58598e4801d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 0.260991 Aug 24 03:54:52.035059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2327/4406] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:51 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:52.051871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:52.054014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:52.060389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.061144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.061578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.062455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.063215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.063916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.100527 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3c331b3-8dde-409d-8d9b-fce9be1adcba tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056139 Aug 24 03:54:52.101785 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2328/4407] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:52 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:52.252444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.273252 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8526b3ee-8a71-48c1-af28-c4fedadd4410 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.523022 Aug 24 03:54:52.276059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2080/4408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:51 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:52.583412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b938cca-17c4-4fea-9a7b-8ffb9dc30491 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-677497314", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b938cca-17c4-4fea-9a7b-8ffb9dc30491 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 491 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-677497314", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-677497314', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:52.590876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 03:54:52.594956 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:52.604343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b938cca-17c4-4fea-9a7b-8ffb9dc30491 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:52.604343 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b938cca-17c4-4fea-9a7b-8ffb9dc30491 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.025542 Aug 24 03:54:52.604343 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2329/4409] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:52 2022] POST /compute/v2.1/servers => generated 624 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:54:52.609774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:52.610402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:52.634822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.635319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.635782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.636499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.644343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:52.645175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:52.647578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.648868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.668295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.669213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.669662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.670406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.670882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.671298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.561369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.572152 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6dbba2f-315e-4e12-b78b-cfb06fb326e2 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1470 microversion: 2.1 time: 0.966639 Aug 24 03:54:53.584417 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2081/4410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:52 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1470 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:53.604786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:53.605671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:53.631594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.632394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.632577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.638632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.639386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.640048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.641008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.654122 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-641c9f4e-a115-4489-83ab-651cec8e9752 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.038370 Aug 24 03:54:53.659973 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2330/4411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:52 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:53.669354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:53.680119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:53.690100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.695891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.696655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.697592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.698236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.701599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.786235 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24748f86-84f4-4e0b-a00f-ac264e705cd4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124732 Aug 24 03:54:53.792621 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2331/4412] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:53 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:53.802107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:53.803067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:53.809779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.815235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.815734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.816651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.817314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.817925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.346200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:54.358745 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d13dccc-a0c5-41bf-a242-01080a2378c1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.564364 Aug 24 03:54:54.361320 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2332/4413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:53 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:54.456777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f443c314-45d1-498d-8d68-bd75c88a7f62 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f443c314-45d1-498d-8d68-bd75c88a7f62 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 416 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:54.465178 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f443c314-45d1-498d-8d68-bd75c88a7f62 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f443c314-45d1-498d-8d68-bd75c88a7f62 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.014323 Aug 24 03:54:54.473580 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2333/4414] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:54 2022] POST /compute/v2.1/servers => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:54:54.483946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:54.484579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:54.509748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.510698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.511466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.512927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.514569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.515501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.882114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:54.900113 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ebd98ff-4a05-4a1c-9a90-be0812c3e812 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 1.314135 Aug 24 03:54:54.906834 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2082/4415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:53 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:54.926191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:54.927207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:54.939447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:54.959081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.960077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.961274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.962210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.962828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.963492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.128410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.146135 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66dbe369-abbf-4332-a529-792d3935228f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.671812 Aug 24 03:54:55.152260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2334/4416] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:54 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:55.172232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:55.181241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:55.206467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.207044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.207492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.214139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.214936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.215555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.279036 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-679e1a0e-cd20-4b6d-91b4-b3078e9b499e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125069 Aug 24 03:54:55.280266 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2335/4417] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:55 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:55.286558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:55.288087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:55.312273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.313351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.315045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.324941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.325827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.326729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.831741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.835358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:55.857536 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20529ef8-1fb5-4100-96b1-15e433529865 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.575452 Aug 24 03:54:55.860734 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2336/4418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:55 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:55.929670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:55.930207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:55.940206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.940716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.943191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.944052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.944541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.944991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.359047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.371559 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a79903f-aa9f-4e08-8fc6-090854b3dd48 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1463 microversion: 2.1 time: 1.461637 Aug 24 03:54:56.380288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2083/4419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:54 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1463 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:56.386414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e82ba371-aab2-4572-b10e-14cff0e3cbe9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1711846996", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": -1, "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:56.421587 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e82ba371-aab2-4572-b10e-14cff0e3cbe9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Flavor -1 could not be found. Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e82ba371-aab2-4572-b10e-14cff0e3cbe9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 206 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1711846996", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": -1, "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: exception: Flavor -1 could not be found. Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1711846996', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': -1, 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:56.434728 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 24 03:54:56.440557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:56.443522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e82ba371-aab2-4572-b10e-14cff0e3cbe9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:56.444821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e82ba371-aab2-4572-b10e-14cff0e3cbe9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.063319 Aug 24 03:54:56.445606 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2084/4420] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:56 2022] POST /compute/v2.1/servers => generated 73 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:56.465427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:56.469487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:56.487978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.488494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.488950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.489721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.490224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.490702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.549706 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d92f55d3-c2b4-4edf-9fca-542d2bb08d2d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101771 Aug 24 03:54:56.551050 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2085/4421] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:56 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:56.912343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.935646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-17265eae-b2d6-4962-8b81-99c7806c0565 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 1.009673 Aug 24 03:54:56.939619 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2337/4422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:55 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:56.948105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:56.949556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:56.965532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:56.966582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:56.981064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.984497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.985896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.986717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.987447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.988586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.990805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.991927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.992756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.993498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.994625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.995884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.644106 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-22f03ae7-c0ab-444d-9fc8-c584d81ca1cc tempest-MigrationsAdminTest-1769895743 tempest-MigrationsAdminTest-1769895743-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1616 microversion: 2.1 time: 1.091318 Aug 24 03:54:57.647922 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2086/4423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:56 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1616 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:57.691136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:57.702657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:57.716358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.717457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.719944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.723217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.724122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.724907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.819549 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67a99083-2a52-4657-adca-b6c717a725dd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148014 Aug 24 03:54:57.830701 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2087/4424] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:57 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:57.836269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:57.836811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:57.864207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.865705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.867105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.868872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.869625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.870282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.915521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:57.975952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:57.996405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:54:58.004310 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31ee587f-4f42-4a6f-816b-71099c839a3f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.062959 Aug 24 03:54:58.007734 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2338/4425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:56 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:58.029015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:58.029923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:58.054468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.055576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.057321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.061136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.063299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.066234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.332007 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae45d5fd-838c-4220-af95-d97afa0a9e65 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 204 len: 0 microversion: 2.1 time: 0.499576 Aug 24 03:54:58.333232 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2088/4426] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:57 2022] DELETE /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:54:58.341781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:58.342508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:58.365616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.366304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.366588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.367349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.370744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.371434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.795451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:58.834074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.847749 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ac7ec49-1a34-4da9-9014-0af72eca8275 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 0.834887 Aug 24 03:54:58.851104 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2339/4427] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:58 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:58.864636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:58.866817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:58.896332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.899430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.899962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.900754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:58.905912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:58.909421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.021764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=14 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:59.115844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:59.182570 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11732819-16ad-4fa2-a689-3acc5d1f2d51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.847758 Aug 24 03:54:59.183738 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2089/4428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:58 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:59.198445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:59.200915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:59.227354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.227883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.228955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.229743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.230138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.230560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.393329 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea41ea61-b017-4054-8e0b-90bec5af52d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207381 Aug 24 03:54:59.397297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2090/4429] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:54:59 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:59.414107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec031212-87ff-40e2-abc4-b252448acfc4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-39250949", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec031212-87ff-40e2-abc4-b252448acfc4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 171 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-39250949", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-39250949', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi -1 Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:54:59.428394 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec031212-87ff-40e2-abc4-b252448acfc4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ec031212-87ff-40e2-abc4-b252448acfc4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.031763 Aug 24 03:54:59.437347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2091/4430] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:54:59 2022] POST /compute/v2.1/servers => generated 145 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:54:59.445608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fea80d5d-343d-40cc-9059-5334cb263bd8 req-3ac8cab9-973d-4530-8b5a-823e231547e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "name": "network-vif-plugged", "status": "completed", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:59.476234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fea80d5d-343d-40cc-9059-5334cb263bd8 req-3ac8cab9-973d-4530-8b5a-823e231547e3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.479287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fea80d5d-343d-40cc-9059-5334cb263bd8 req-3ac8cab9-973d-4530-8b5a-823e231547e3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.480110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fea80d5d-343d-40cc-9059-5334cb263bd8 req-3ac8cab9-973d-4530-8b5a-823e231547e3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.511539 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fea80d5d-343d-40cc-9059-5334cb263bd8 req-3ac8cab9-973d-4530-8b5a-823e231547e3 service nova] Creating event network-vif-plugged:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h1-846470-15 Aug 24 03:54:59.526236 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fea80d5d-343d-40cc-9059-5334cb263bd8 req-3ac8cab9-973d-4530-8b5a-823e231547e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089984 Aug 24 03:54:59.532338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2092/4431] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:59.554256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:59.555265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:59.565299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.566298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.569702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.571879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.573886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.574542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.102716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.117606 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a1a7f3c-d672-4e1f-aab0-7824ab39b9c7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1469 microversion: 2.1 time: 1.264156 Aug 24 03:55:00.118215 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2340/4432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:58 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1469 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:00.155819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:00.156447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:00.174719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.176264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.178712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.183163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.184075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.185062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.739010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.751124 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f5ec029a-807c-42e8-8a9b-4fb98f41448d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 0.613048 Aug 24 03:55:00.757582 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2341/4433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:00 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:00.772946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:00.780056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:00.803954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.805600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.806593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.807535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.808199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.808832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.917103 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-322f2bdc-edba-4358-877d-deefd9fc35d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157601 Aug 24 03:55:00.929486 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2342/4434] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:00 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337/os-volume_attachments => generated 25 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:55:01.115780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.138566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.140572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.168877 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a1775ca8-d670-4e94-98d7-2fdd89479b0e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.633953 Aug 24 03:55:01.188521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.190978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.190978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.190978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.190978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.191563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.198855 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2093/4435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:59 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:01.211894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.222651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.264521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.265047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.265499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.266322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.266794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.267234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.354732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:01.647599 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ad28954-086f-48e0-9cdb-2e9e3d981a39 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 204 len: 0 microversion: 2.1 time: 0.518675 Aug 24 03:55:01.648461 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2343/4436] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:01 2022] DELETE /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:01.660065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.660782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.681750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.683128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.684200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.685663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.686685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.697494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.029690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.032336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.045940 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-842db244-e437-4d79-883f-88d15786a8e4 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1469 microversion: 2.1 time: 0.845261 Aug 24 03:55:02.046168 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aba7b964-7c1a-43f0-9303-f5b66f7cfe1f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.395701 Aug 24 03:55:02.046918 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2344/4437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:01 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:02.064337 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2094/4438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:01 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1469 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:02.078100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:02.078870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:02.100129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:02.102482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:02.106066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.106608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.107055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.107834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.108292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.108715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.121850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.122697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.123426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.126206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.129993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.132443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.498006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.516192 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e9e28054-985c-40bb-9c5d-97bbf48916e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1679 microversion: 2.1 time: 0.465208 Aug 24 03:55:02.517087 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2345/4439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:02 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1679 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:02.525040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6304ca50-0760-4c48-ab69-4a40c23ddd44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1400397679", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:02.536741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6304ca50-0760-4c48-ab69-4a40c23ddd44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6304ca50-0760-4c48-ab69-4a40c23ddd44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 216 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1400397679", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1400397679', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:02.539712 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:02.544684 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:02.544684 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:02.544684 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:02.544684 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:02.544684 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:02.544684 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 03:55:02.544684 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:02.548295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6304ca50-0760-4c48-ab69-4a40c23ddd44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:02.550053 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6304ca50-0760-4c48-ab69-4a40c23ddd44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030804 Aug 24 03:55:02.552062 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2346/4440] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:02 2022] POST /compute/v2.1/servers => generated 123 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:55:02.562514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a42dce33-f50d-44cf-a82e-8c9bb5b27fb1 req-82244174-15d4-48d6-92b4-52a5107d312e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3efe5c-3f6c-4e92-887e-2c216fefa5b0", "name": "network-vif-plugged", "status": "completed", "tag": "6fe99947-159a-49ee-a1b1-89bf6b7fc98f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:02.580161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:02.585060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a42dce33-f50d-44cf-a82e-8c9bb5b27fb1 req-82244174-15d4-48d6-92b4-52a5107d312e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.587319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a42dce33-f50d-44cf-a82e-8c9bb5b27fb1 req-82244174-15d4-48d6-92b4-52a5107d312e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.589854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a42dce33-f50d-44cf-a82e-8c9bb5b27fb1 req-82244174-15d4-48d6-92b4-52a5107d312e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.623831 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a42dce33-f50d-44cf-a82e-8c9bb5b27fb1 req-82244174-15d4-48d6-92b4-52a5107d312e service nova] Creating event network-vif-plugged:6fe99947-159a-49ee-a1b1-89bf6b7fc98f for instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 on n-h2-846470-15 Aug 24 03:55:02.632393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a42dce33-f50d-44cf-a82e-8c9bb5b27fb1 req-82244174-15d4-48d6-92b4-52a5107d312e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077575 Aug 24 03:55:02.633652 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2347/4441] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:02.680447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:02.681441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:02.691562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.693115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.694751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.696753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.697830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.698478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.270049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.289903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50d24154-25de-411b-969b-3fa93db6f442 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 1.220868 Aug 24 03:55:03.290785 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2095/4442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:02 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:03.300125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.303113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.319649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.320482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.321091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.321976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.322625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.323583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.407023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.416715 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8370e9a6-2304-41c0-acc0-391231408738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.781290 Aug 24 03:55:03.428180 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2348/4443] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:02 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:03.447389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.450734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.469903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.470735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.472290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.476570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.477169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.477684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.791527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.805506 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9346cd99-ad5c-4eb9-91d1-074cb38fca56 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.367823 Aug 24 03:55:03.808026 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2349/4444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:03.819957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.820974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.836889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.837603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.839478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.841598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.844383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.844901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.933614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:03.950561 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f82c8068-4613-4f39-82d9-0530c9d7aedf tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1427 microversion: 2.1 time: 0.658102 Aug 24 03:55:03.951962 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2096/4445] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1427 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:03.957965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6747270b-5a64-4efb-9a13-7c597f5c408e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1862002330", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-key-158448612", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:04.154146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-6747270b-5a64-4efb-9a13-7c597f5c408e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] validate_networks() for [('30db1ab3-f4e6-44fc-9e86-51a37d221ee3', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:55:04.561747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.576035 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1cb0c76-9e81-4ab8-b32c-612ce81efa0b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1679 microversion: 2.1 time: 0.766350 Aug 24 03:55:04.579309 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2350/4446] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1679 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:04.604580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:04.605193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:04.619964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.623579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.624159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.624931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.625428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.625915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.867860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.886470 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4ad0850-c041-4567-8bf0-1f262fe9d758 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1314 microversion: 2.1 time: 0.305022 Aug 24 03:55:04.889201 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2351/4447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:04 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:04.896298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ff52aba2-647e-41b4-914a-2269d9448c31 req-e27e2e44-ad12-4377-8bce-fe27101688d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d93eca5-4c96-4f06-9d87-ba0151a2fe02", "name": "network-vif-deleted", "tag": "53a82e6d-0505-4f7b-9e9e-fcc6521128e8"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:04.929018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ff52aba2-647e-41b4-914a-2269d9448c31 req-e27e2e44-ad12-4377-8bce-fe27101688d8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.929513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ff52aba2-647e-41b4-914a-2269d9448c31 req-e27e2e44-ad12-4377-8bce-fe27101688d8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.929939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ff52aba2-647e-41b4-914a-2269d9448c31 req-e27e2e44-ad12-4377-8bce-fe27101688d8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.950089 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ff52aba2-647e-41b4-914a-2269d9448c31 req-e27e2e44-ad12-4377-8bce-fe27101688d8 service nova] Creating event network-vif-deleted:53a82e6d-0505-4f7b-9e9e-fcc6521128e8 for instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 on n-h1-846470-15 Aug 24 03:55:04.961015 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ff52aba2-647e-41b4-914a-2269d9448c31 req-e27e2e44-ad12-4377-8bce-fe27101688d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069877 Aug 24 03:55:04.967427 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2352/4448] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:04.979822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:04.982082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:04.992163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.995631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.996447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.997381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.998212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.998907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.042658 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6747270b-5a64-4efb-9a13-7c597f5c408e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Invalid key_name provided. Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6747270b-5a64-4efb-9a13-7c597f5c408e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 246 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1862002330", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-key-158448612", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid key_name provided. Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1862002330', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'key_name': 'tempest-key-158448612', 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1076, in _validate_and_build_base_options Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-158448612 not found for user 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:05.045336 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 24 03:55:05.050233 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:05.052972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6747270b-5a64-4efb-9a13-7c597f5c408e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid key_name provided. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:05.054042 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6747270b-5a64-4efb-9a13-7c597f5c408e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.100520 Aug 24 03:55:05.057444 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2097/4449] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:03 2022] POST /compute/v2.1/servers => generated 70 bytes in 1105 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:05.066905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:05.076682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.100348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.100843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.101285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.101750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lazy-loading 'fault' on Instance uuid 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:05.105644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.106243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.113282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.115856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.117628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.119253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.273749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:05.277639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:05.290284 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cdbbb61b-ac9d-4f99-8a1d-72768603ac57 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 200 len: 1303 microversion: 2.1 time: 0.314891 Aug 24 03:55:05.293314 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2353/4450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:04 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:05.599261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:05.600153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.607011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.616172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.616940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.618514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.619158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.619827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.015517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.057538 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f9309484-8359-4878-b245-f89d4a016e1e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.993131 Aug 24 03:55:06.101234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2098/4451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:05 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:06.120177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.121001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.160298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.160803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.161251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.161995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.162507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.162880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.756520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.771853 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93aedcc1-d8d8-4d66-9f1b-c2c74d72291a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1611 microversion: 2.1 time: 1.176942 Aug 24 03:55:06.772842 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2354/4452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:05 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1611 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:06.803240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.805116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.820214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.825020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.827086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.836775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.837563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.838423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.094407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:07.104786 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9345659b-97ed-454f-bab9-a22bab138fa3 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1500 microversion: 2.1 time: 1.001563 Aug 24 03:55:07.105264 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2099/4453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1500 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:07.124093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.124954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 3d93eca5-4c96-4f06-9d87-ba0151a2fe02] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.137161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.140678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.143501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.144723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.147310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.148037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.176424 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] HTTP exception thrown: Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 could not be found. Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Request method failure captured: Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 HTTP/1.1 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ-UkkhsvH52trsAcmywfPO_8G71OU2Y6heBBXgK8Rbje-tb2y1hjjTk4ETzyfPAkvSSAn1JlGmPJCRjc6QHKIVXJTNNW10vF8_tBDtCTPDL-AvfHmEUCDE89TC01B_Ag1vr9M7TUoszAn8mN9isbqZpCo1W0txW6VpZiGo9iYQW04A Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: bae5f7d73df84e3d8f38db05b3fe17a9 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: bae5f7d73df84e3d8f38db05b3fe17a9 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-MigrationsAdminTest-2103018183-project Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 1121b62203674b82ae3c7cfcb3112eb5 Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-MigrationsAdminTest-2103018183-project Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 could not be found. Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '3d93eca5-4c96-4f06-9d87-ba0151a2fe02'} Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 could not be found. Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 could not be found. Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:07.178303 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.182405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.182405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:07.182405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:07.182405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:07.182405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:07.182405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 could not be found. Aug 24 03:55:07.182405 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.182851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:07.184557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Returning 404 to user: Instance 3d93eca5-4c96-4f06-9d87-ba0151a2fe02 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:07.185711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f3d187dd-f894-4e5a-8192-8770d3bd50db tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02" status: 404 len: 111 microversion: 2.1 time: 0.066832 Aug 24 03:55:07.187428 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2100/4454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/3d93eca5-4c96-4f06-9d87-ba0151a2fe02 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:07.193244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.194685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.197389 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c2645768-d83a-44e7-b5fc-d295439830e0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.423162 Aug 24 03:55:07.200213 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2355/4455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:07.211089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.223713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.223713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.224613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.225407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.226405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.227094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.228053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.231570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.232327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.232545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.257294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.258059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.258531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.339383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:07.486485 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-11c290b3-c697-4b16-98ca-7901732722b3 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 204 len: 0 microversion: 2.1 time: 0.283475 Aug 24 03:55:07.491467 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2356/4456] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:07 2022] DELETE /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:07.501858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ac5489f-8d9b-4eb1-9716-5cf3b6d1808d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-768790276", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:07.661361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-7ac5489f-8d9b-4eb1-9716-5cf3b6d1808d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Neutron security group does_not_exist not found {{(pid=122536) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 24 03:55:07.661978 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-7ac5489f-8d9b-4eb1-9716-5cf3b6d1808d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ac5489f-8d9b-4eb1-9716-5cf3b6d1808d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 257 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-768790276", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-768790276', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 24 03:55:07.674707 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1061, in _validate_and_build_base_options Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 508, in _check_requested_secgroups Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 24 03:55:07.678868 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:07.684082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ac5489f-8d9b-4eb1-9716-5cf3b6d1808d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:07.685375 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ac5489f-8d9b-4eb1-9716-5cf3b6d1808d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.190066 Aug 24 03:55:07.688290 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2357/4457] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:07 2022] POST /compute/v2.1/servers => generated 106 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:55:07.698288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.712669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.723937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.724441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.724898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.725607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.726067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.726496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.917657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:07.926248 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e969afbd-192f-451e-8669-ee806316b820 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1534 microversion: 2.1 time: 0.236621 Aug 24 03:55:07.927265 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2358/4458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1534 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:07.933532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.934244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.945717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.946218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.946660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.947379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.947866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.948539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.123507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.136949 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7df54f0d-30e4-4f12-9259-f9d3df46a710 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.208339 Aug 24 03:55:08.153043 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2359/4459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:08.229500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2cf8306-3dc0-45bf-8aa9-059c98e8cbe3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'create', calling method: .version_select at 0x7f1021faf4c0>, body: {"keypair": {"name": "tempest-keypair-1822020799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFVfGGPwKovFN4iANuqSGjr4V1Lpp/oJSe4cgVyH4wfad+k85SUhKrj8KgYVOIK7pqrVA9pi/iuD+OlkhhjN9pSeIfd1trUnz13ZxVL0YwKvb/kdPiLRlKabHEFgu2t2Q=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:08.248903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a2cf8306-3dc0-45bf-8aa9-059c98e8cbe3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Getting quotas for project bf93478ba0a74d2a8c3b7bbae86cbd69. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:08.256596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a2cf8306-3dc0-45bf-8aa9-059c98e8cbe3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Getting quotas for user fc82859254e34a42902e5b72a6580362 and project bf93478ba0a74d2a8c3b7bbae86cbd69. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:08.308966 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2cf8306-3dc0-45bf-8aa9-059c98e8cbe3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.169924 Aug 24 03:55:08.309777 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2360/4460] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 03:55:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:55:08.321453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.322078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.330322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.330826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.331270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.332043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.332496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.332921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.397381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.422387 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-107d89f0-db4f-470d-8b21-59d4fbcba5b5 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1500 microversion: 2.1 time: 1.233413 Aug 24 03:55:08.423140 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2101/4461] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1500 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:08.442949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.446924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.476360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.479858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.481656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.483553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.486454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.487586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.488271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.504748 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3987720a-c2a5-4f0a-8eb2-42f848a93790 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 200 len: 1611 microversion: 2.1 time: 0.187401 Aug 24 03:55:08.505369 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2361/4462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 1611 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:08.519514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-399ffb85-1c82-463a-a4f1-fef9eec8bfbf req-21bcdc94-1338-4ca1-a678-c1a3139f5506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16d8242-aae4-4be3-9f15-f083a4815337", "name": "network-vif-deleted", "tag": "2d2a78ad-9ceb-4860-8a98-485998cd4f9b"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:08.555114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-399ffb85-1c82-463a-a4f1-fef9eec8bfbf req-21bcdc94-1338-4ca1-a678-c1a3139f5506 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.555645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-399ffb85-1c82-463a-a4f1-fef9eec8bfbf req-21bcdc94-1338-4ca1-a678-c1a3139f5506 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.556118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-399ffb85-1c82-463a-a4f1-fef9eec8bfbf req-21bcdc94-1338-4ca1-a678-c1a3139f5506 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.601118 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-399ffb85-1c82-463a-a4f1-fef9eec8bfbf req-21bcdc94-1338-4ca1-a678-c1a3139f5506 service nova] Creating event network-vif-deleted:2d2a78ad-9ceb-4860-8a98-485998cd4f9b for instance c16d8242-aae4-4be3-9f15-f083a4815337 on n-h1-846470-15 Aug 24 03:55:08.613798 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-399ffb85-1c82-463a-a4f1-fef9eec8bfbf req-21bcdc94-1338-4ca1-a678-c1a3139f5506 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106641 Aug 24 03:55:08.615935 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2362/4463] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:08.636023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:08.636672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.646486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.646988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.647426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.648187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.648642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.649076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.702054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lazy-loading 'flavor' on Instance uuid 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:08.851218 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a53e430-4b96-4fc4-85dd-4cf17d15dfbe tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "POST /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0/action" status: 202 len: 0 microversion: 2.1 time: 0.221950 Aug 24 03:55:08.852651 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2363/4464] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:08 2022] POST /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:08.862963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.864387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.876737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.877540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.878329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.879358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.880092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.880690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.138788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.160439 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-26f3071d-e775-4809-aa1c-02828f9b0a08 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1508 microversion: 2.1 time: 0.303554 Aug 24 03:55:09.164854 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2364/4465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:09.173738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.180454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.193177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.195202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.200442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.200796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.201586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.202251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.398096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.413034 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-00c3803a-5876-48ce-bd4f-b40156135f9e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.981103 Aug 24 03:55:09.414040 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2102/4466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:09.442153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:09.445835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.453057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.453956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.454604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.455540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.456218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.456821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.502706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.513625 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44edee02-21df-4e85-b52f-fa049080067b tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1534 microversion: 2.1 time: 0.347101 Aug 24 03:55:09.517276 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2365/4467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1534 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:09.524786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2654a10e-84a4-46b1-90e4-1c6c0f92bc00 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.524786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2654a10e-84a4-46b1-90e4-1c6c0f92bc00 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 4667bacb-3a09-43a2-ab3b-ed51c36c0a8c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.540608 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01e8c601-3a77-454d-9d6a-11af1d56fda4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076/action" status: 200 len: 24570 microversion: 2.1 time: 0.103578 Aug 24 03:55:09.542176 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2103/4468] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:09 2022] POST /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076/action => generated 24570 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:09.548498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.549670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.552850 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-2654a10e-84a4-46b1-90e4-1c6c0f92bc00 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 4667bacb-3a09-43a2-ab3b-ed51c36c0a8c could not be found. Aug 24 03:55:09.558393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.559141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.559887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.560947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.561633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.562241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2654a10e-84a4-46b1-90e4-1c6c0f92bc00 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/4667bacb-3a09-43a2-ab3b-ed51c36c0a8c HTTP/1.1 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 4667bacb-3a09-43a2-ab3b-ed51c36c0a8c could not be found. Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '4667bacb-3a09-43a2-ab3b-ed51c36c0a8c'} Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4667bacb-3a09-43a2-ab3b-ed51c36c0a8c could not be found. Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4667bacb-3a09-43a2-ab3b-ed51c36c0a8c could not be found. Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.563601 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4667bacb-3a09-43a2-ab3b-ed51c36c0a8c could not be found. Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.568551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2654a10e-84a4-46b1-90e4-1c6c0f92bc00 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 4667bacb-3a09-43a2-ab3b-ed51c36c0a8c could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:09.571815 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2654a10e-84a4-46b1-90e4-1c6c0f92bc00 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4667bacb-3a09-43a2-ab3b-ed51c36c0a8c" status: 404 len: 111 microversion: 2.1 time: 0.049331 Aug 24 03:55:09.576000 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2366/4469] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:09 2022] DELETE /compute/v2.1/servers/4667bacb-3a09-43a2-ab3b-ed51c36c0a8c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:09.589709 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 HTTP/1.1 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'c16d8242-aae4-4be3-9f15-f083a4815337'} Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:09.592023 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.597973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.597973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:09.597973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:09.597973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:09.597973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:09.597973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 03:55:09.597973 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.598506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.598506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.599635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:09.601109 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d5884ee0-92ec-49a2-8392-43682302bc08 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 404 len: 111 microversion: 2.1 time: 0.057355 Aug 24 03:55:09.602280 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2104/4470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:09.612133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e953afb4-43ec-48e2-b067-9e1a3c039799 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '.version_select at 0x7f102ae933a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.620639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.621141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.637228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.638033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.638525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.641366 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e953afb4-43ec-48e2-b067-9e1a3c039799 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-416247830" status: 202 len: 0 microversion: 2.1 time: 0.034039 Aug 24 03:55:09.645132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.646167 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2105/4471] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:55:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-416247830 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:55:10.091421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.106868 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7c55ebe6-1116-4be2-8863-6a0bdb6145e2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.529450 Aug 24 03:55:10.107467 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2367/4472] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:10.148760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.155977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.172914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.178898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.179902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.181023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.181780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.182558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.191748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.192366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.228286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.231483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.232336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.233876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.247438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.257094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.682073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.696855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.710367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eea15d99-cb9d-47a3-b2ad-bcbba6532ba0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.570744 Aug 24 03:55:10.712188 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-51766f7c-f2a8-45f9-ab6f-886009630252 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1491 microversion: 2.1 time: 0.525143 Aug 24 03:55:10.713026 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2368/4473] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1491 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:10.725830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.727650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.735180 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2106/4474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:10.747703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:10.749380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.757137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.757654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.758727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.759918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.760679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.761134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.771785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.772764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.773427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.774343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.778691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.779709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.906267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:10.946663 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d91eced4-4597-465f-903a-b341296b453e tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "POST /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0/action" status: 202 len: 0 microversion: 2.1 time: 0.209682 Aug 24 03:55:10.952369 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2107/4475] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:10 2022] POST /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:10.970415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7fb390ee-634b-4079-be7e-c1c6091f421b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.972414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7fb390ee-634b-4079-be7e-c1c6091f421b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 03:55:10.974505 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7fb390ee-634b-4079-be7e-c1c6091f421b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7fb390ee-634b-4079-be7e-c1c6091f421b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 9223372036854775808 could not be found. Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9223372036854775808'} Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:10.979904 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:10.984681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:10.984681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:10.984681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:10.984681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 24 03:55:10.984681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:10.987312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7fb390ee-634b-4079-be7e-c1c6091f421b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:10.990939 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7fb390ee-634b-4079-be7e-c1c6091f421b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.035357 Aug 24 03:55:10.994811 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2108/4476] 10.222.0.58 () {58 vars in 1188 bytes} [Wed Aug 24 03:55:10 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:55:11.008276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.009332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.023220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.034632 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1c783e2-3641-4131-9359-b121e0d04898 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1492 microversion: 2.1 time: 0.319535 Aug 24 03:55:11.035222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.036029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.036804 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2369/4477] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1492 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:11.037372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.038330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.052921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.058896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.059240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.060534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.091877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.104661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.105558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.107763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.111012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.111754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.361656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.366018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:11.386086 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f91b995-e43e-457f-86e2-7be7f5016b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.342499 Aug 24 03:55:11.415384 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2370/4478] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:11 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:11.434243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.434891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.459203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.460113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.464927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.465949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.466649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.467250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.881279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.903780 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-200c065d-2080-4a24-8ae0-1345acba2453 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1497 microversion: 2.1 time: 0.906855 Aug 24 03:55:11.918121 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2109/4479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1497 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:11.923507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-db682a92-ee4f-42c0-9338-9821224518cc req-efcb7857-57db-42c3-ac05-1d2f08984bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324f2dc7-031f-4cdf-854a-7461685dca7b", "name": "network-vif-deleted", "tag": "627d1dd5-f861-4a32-8fd6-f672f062f6d3"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:11.939331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-db682a92-ee4f-42c0-9338-9821224518cc req-efcb7857-57db-42c3-ac05-1d2f08984bf9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.940393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-db682a92-ee4f-42c0-9338-9821224518cc req-efcb7857-57db-42c3-ac05-1d2f08984bf9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.941155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-db682a92-ee4f-42c0-9338-9821224518cc req-efcb7857-57db-42c3-ac05-1d2f08984bf9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.959095 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-db682a92-ee4f-42c0-9338-9821224518cc req-efcb7857-57db-42c3-ac05-1d2f08984bf9 service nova] Creating event network-vif-deleted:627d1dd5-f861-4a32-8fd6-f672f062f6d3 for instance 324f2dc7-031f-4cdf-854a-7461685dca7b on n-h2-846470-15 Aug 24 03:55:11.966732 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-db682a92-ee4f-42c0-9338-9821224518cc req-efcb7857-57db-42c3-ac05-1d2f08984bf9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045933 Aug 24 03:55:11.967928 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2110/4480] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:11.977715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.993042 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-727646e8-cfd8-4e95-8e17-43fde849311b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.570595 Aug 24 03:55:11.993890 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2371/4481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:11 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:12.034703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d65d3096-f89d-4b98-8820-93af8015c2eb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.036368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d65d3096-f89d-4b98-8820-93af8015c2eb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Failed to fetch instance by id -1 {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 03:55:12.039556 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-d65d3096-f89d-4b98-8820-93af8015c2eb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance -1 could not be found. Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d65d3096-f89d-4b98-8820-93af8015c2eb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance -1 could not be found. Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '-1'} Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:12.045612 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:12.050437 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:12.050437 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:12.050437 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 24 03:55:12.050437 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:12.050437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d65d3096-f89d-4b98-8820-93af8015c2eb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:12.050437 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d65d3096-f89d-4b98-8820-93af8015c2eb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.028391 Aug 24 03:55:12.054343 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2111/4482] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 03:55:12 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:55:12.057896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.058526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:12.068848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.069880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:12.078761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.079944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.080596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.082129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.083305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.084002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.086030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.090706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.091240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.092057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.092546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.093177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.130539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.131141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.131659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.132309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lazy-loading 'fault' on Instance uuid 324f2dc7-031f-4cdf-854a-7461685dca7b {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:12.530592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:12.548438 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f39a3303-cab6-4063-abcb-21722e6111ac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.494380 Aug 24 03:55:12.550171 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2372/4483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:12 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:12.571631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.571971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:12.587442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.587984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.588638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.589738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.590508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.591178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.613990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:12.622236 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5d5c17c2-c89c-48bd-8a9c-5b88957d9c07 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 200 len: 1369 microversion: 2.1 time: 0.561274 Aug 24 03:55:12.635974 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2112/4484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:12 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 1369 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:12.635974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-707577368", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3f89937-69ed-45e1-92ee-4bebfe7fadf3"}], "security_groups": [{"name": "tempest-securitygroup--361415241"}], "key_name": "tempest-keypair-1822020799", "user_data": "}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:12.936608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] validate_networks() for [('b3f89937-69ed-45e1-92ee-4bebfe7fadf3', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:55:12.994784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.006158 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3e2becd1-462d-413e-813d-1cf181443987 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.438673 Aug 24 03:55:13.007634 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2373/4485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:12 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:13.013486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.014477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.022034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.023298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.024129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.025351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.026129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.026962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.415505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.430484 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8ff2536-fd01-409d-8386-632bccb3f0a8 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1497 microversion: 2.1 time: 0.421409 Aug 24 03:55:13.431059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2374/4486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1497 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:13.440593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cbadf4c3-a58c-4e78-b61e-7fe213daca51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:13.443374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cbadf4c3-a58c-4e78-b61e-7fe213daca51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 5a9ff37f-deba-4b2c-8cda-3e6759b44e3c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.451364 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-cbadf4c3-a58c-4e78-b61e-7fe213daca51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 5a9ff37f-deba-4b2c-8cda-3e6759b44e3c could not be found. Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cbadf4c3-a58c-4e78-b61e-7fe213daca51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/5a9ff37f-deba-4b2c-8cda-3e6759b44e3c/action HTTP/1.1 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 19 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: {"forceDelete": {}} Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 5a9ff37f-deba-4b2c-8cda-3e6759b44e3c could not be found. Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5a9ff37f-deba-4b2c-8cda-3e6759b44e3c', 'body': {'forceDelete': {}}} Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9ff37f-deba-4b2c-8cda-3e6759b44e3c could not be found. Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9ff37f-deba-4b2c-8cda-3e6759b44e3c could not be found. Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:13.463346 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:13.470623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:13.470623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:13.470623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9ff37f-deba-4b2c-8cda-3e6759b44e3c could not be found. Aug 24 03:55:13.470623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.470623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cbadf4c3-a58c-4e78-b61e-7fe213daca51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 5a9ff37f-deba-4b2c-8cda-3e6759b44e3c could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:13.470623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cbadf4c3-a58c-4e78-b61e-7fe213daca51 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/5a9ff37f-deba-4b2c-8cda-3e6759b44e3c/action" status: 404 len: 111 microversion: 2.1 time: 0.032466 Aug 24 03:55:13.470623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2375/4487] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:13 2022] POST /compute/v2.1/servers/5a9ff37f-deba-4b2c-8cda-3e6759b44e3c/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:13.476519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9fc76e0-a3b1-4769-97e9-443b3949dfb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: .version_select at 0x7f1021ed3d30>, body: {"keypair": {"name": "tempest-keypair-391199567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXXAQ8oPKtzSeL7mAcuF0kJLuZYy1rQg6HF7I5sXmxYV+CQAtpYwQstfZfJ538UsWY2YrXeWf7O7HkagNLGA0lQNvH10j0/pKsI6RCcoK9ajyZqkGlgCFulc20uMXCwdg=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:13.514166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f9fc76e0-a3b1-4769-97e9-443b3949dfb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:13.527124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f9fc76e0-a3b1-4769-97e9-443b3949dfb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for user cf384a2eab3649a2ad4f5eec8d8c6b0a and project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:13.556903 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9fc76e0-a3b1-4769-97e9-443b3949dfb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085449 Aug 24 03:55:13.560601 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2376/4488] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:55:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:13.563012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.563910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.571816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.572592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.573225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.574395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.575060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.575697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.726368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:55:13.728095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:55:13.729625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:55:13.731511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:55:13.732861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:55:13.757203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.758520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.759151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.760524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.761663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.762181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.788985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Getting quotas for project bf93478ba0a74d2a8c3b7bbae86cbd69. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:13.800911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Getting quotas for user fc82859254e34a42902e5b72a6580362 and project bf93478ba0a74d2a8c3b7bbae86cbd69. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:13.825836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:55:13.830567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:55:13.890659 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a13a9ac2-1e5e-4dd2-b132-6455a3b084ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.266268 Aug 24 03:55:13.898283 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2113/4489] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:55:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:55:13.904399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.905429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 324f2dc7-031f-4cdf-854a-7461685dca7b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.913388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.914291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.914968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.915995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.916724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.917386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.942263 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] HTTP exception thrown: Instance 324f2dc7-031f-4cdf-854a-7461685dca7b could not be found. Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Request method failure captured: Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b HTTP/1.1 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ-UkkhsvH52trsAcmywfPO_8G71OU2Y6heBBXgK8Rbje-tb2y1hjjTk4ETzyfPAkvSSAn1JlGmPJCRjc6QHKIVXJTNNW10vF8_tBDtCTPDL-AvfHmEUCDE89TC01B_Ag1vr9M7TUoszAn8mN9isbqZpCo1W0txW6VpZiGo9iYQW04A Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: bae5f7d73df84e3d8f38db05b3fe17a9 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: bae5f7d73df84e3d8f38db05b3fe17a9 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-MigrationsAdminTest-2103018183-project Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 1121b62203674b82ae3c7cfcb3112eb5 Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-MigrationsAdminTest-2103018183-project Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 324f2dc7-031f-4cdf-854a-7461685dca7b could not be found. Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '324f2dc7-031f-4cdf-854a-7461685dca7b'} Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324f2dc7-031f-4cdf-854a-7461685dca7b could not be found. Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324f2dc7-031f-4cdf-854a-7461685dca7b could not be found. Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:13.943923 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324f2dc7-031f-4cdf-854a-7461685dca7b could not be found. Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Returning 404 to user: Instance 324f2dc7-031f-4cdf-854a-7461685dca7b could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:13.949124 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-18fb327e-e1df-4b2e-aa7e-5bea055ac5c0 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b" status: 404 len: 111 microversion: 2.1 time: 0.044954 Aug 24 03:55:13.950438 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2114/4490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/324f2dc7-031f-4cdf-854a-7461685dca7b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:13.955170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e446095a-f18c-4123-9972-d6f5ad250113 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.955867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e446095a-f18c-4123-9972-d6f5ad250113 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.046324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e446095a-f18c-4123-9972-d6f5ad250113 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.070122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e446095a-f18c-4123-9972-d6f5ad250113 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.071755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e446095a-f18c-4123-9972-d6f5ad250113 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.073006 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e446095a-f18c-4123-9972-d6f5ad250113 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1281 microversion: 2.20 time: 0.122250 Aug 24 03:55:14.080136 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2115/4491] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:14.084961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-13be58ec-fcf1-4cd8-8f9f-ade6495793ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '.version_select at 0x7f102a7baee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.140692 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-13be58ec-fcf1-4cd8-8f9f-ade6495793ba tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898131552" status: 202 len: 0 microversion: 2.1 time: 0.049531 Aug 24 03:55:14.140692 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2116/4492] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 03:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898131552 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:14.232980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.242491 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42670688-1d92-428a-a0ba-6d89ddd4fa05 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.683458 Aug 24 03:55:14.243697 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2377/4493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:14.265336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.266051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.272974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.273947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.274472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.275398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.275944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.276428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.461143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.462215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.514890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.515450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.515922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.516641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.520435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.521196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.809242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.822920 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-10425ee2-8d91-4dc8-a422-c38b4140a3ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.562046 Aug 24 03:55:14.824123 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2117/4494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:14.852331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61750e95-6e1a-4be1-b57f-f63bf2b4ea4a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:14.855116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-61750e95-6e1a-4be1-b57f-f63bf2b4ea4a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: caf0eb42-4fdf-46e9-b9f6-1da210ac5866] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.862853 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-61750e95-6e1a-4be1-b57f-f63bf2b4ea4a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance caf0eb42-4fdf-46e9-b9f6-1da210ac5866 could not be found. Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61750e95-6e1a-4be1-b57f-f63bf2b4ea4a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/caf0eb42-4fdf-46e9-b9f6-1da210ac5866/action HTTP/1.1 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 39 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: {"os-getConsoleOutput": {"length": 10}} Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance caf0eb42-4fdf-46e9-b9f6-1da210ac5866 could not be found. Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'caf0eb42-4fdf-46e9-b9f6-1da210ac5866', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf0eb42-4fdf-46e9-b9f6-1da210ac5866 could not be found. Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf0eb42-4fdf-46e9-b9f6-1da210ac5866 could not be found. Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:14.869776 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:14.876719 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:14.876719 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:14.876719 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:14.876719 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:14.876719 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf0eb42-4fdf-46e9-b9f6-1da210ac5866 could not be found. Aug 24 03:55:14.876719 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:14.881079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61750e95-6e1a-4be1-b57f-f63bf2b4ea4a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance caf0eb42-4fdf-46e9-b9f6-1da210ac5866 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:14.883017 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-61750e95-6e1a-4be1-b57f-f63bf2b4ea4a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/caf0eb42-4fdf-46e9-b9f6-1da210ac5866/action" status: 404 len: 111 microversion: 2.1 time: 0.038708 Aug 24 03:55:14.884220 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2118/4495] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:14 2022] POST /compute/v2.1/servers/caf0eb42-4fdf-46e9-b9f6-1da210ac5866/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:14.899602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.903118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.914445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.936885 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c4b3dbbe-dfdc-4b10-956d-d5cc1138ce0f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1497 microversion: 2.1 time: 0.484888 Aug 24 03:55:14.939035 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2378/4496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1497 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:14.947872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.947872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.947872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.947872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.947872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.947872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.110837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.113001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.143488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.144593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.145528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.147177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.163852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.164704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.313862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.325692 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8e41115f-232b-4e6f-acb1-5682f25d2a4e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.431063 Aug 24 03:55:15.331455 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2119/4497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:15.341303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.350442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.351548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.354673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.356845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.358167 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-57575259-ff14-4a54-83d8-944f17e5e91c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1333 microversion: 2.20 time: 0.259134 Aug 24 03:55:15.359417 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2379/4498] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1333 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:15.368775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:15.374477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.375561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.376056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.377132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.377609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.378098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.827818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.841912 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7fb62016-f499-4855-bc0e-2c6729562b7f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.495746 Aug 24 03:55:15.846959 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2120/4499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:15.867226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f2b3a31-ced6-4ca3-ac41-8cca9e188e90 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.867896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f2b3a31-ced6-4ca3-ac41-8cca9e188e90 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 8cc3df6f-70e4-4794-867b-7dfd9323fe80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.876207 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-2f2b3a31-ced6-4ca3-ac41-8cca9e188e90 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 8cc3df6f-70e4-4794-867b-7dfd9323fe80 could not be found. Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f2b3a31-ced6-4ca3-ac41-8cca9e188e90 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/8cc3df6f-70e4-4794-867b-7dfd9323fe80 HTTP/1.1 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 8cc3df6f-70e4-4794-867b-7dfd9323fe80 could not be found. Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8cc3df6f-70e4-4794-867b-7dfd9323fe80'} Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc3df6f-70e4-4794-867b-7dfd9323fe80 could not be found. Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc3df6f-70e4-4794-867b-7dfd9323fe80 could not be found. Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:15.878457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:15.882942 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:15.882942 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:15.882942 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:15.882942 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc3df6f-70e4-4794-867b-7dfd9323fe80 could not be found. Aug 24 03:55:15.882942 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:15.885193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f2b3a31-ced6-4ca3-ac41-8cca9e188e90 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 8cc3df6f-70e4-4794-867b-7dfd9323fe80 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:15.887010 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f2b3a31-ced6-4ca3-ac41-8cca9e188e90 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/8cc3df6f-70e4-4794-867b-7dfd9323fe80" status: 404 len: 111 microversion: 2.1 time: 0.023560 Aug 24 03:55:15.888476 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2380/4500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/8cc3df6f-70e4-4794-867b-7dfd9323fe80 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:15.897976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.898857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.920938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.920938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.920938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.920938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.921433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.922297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.964214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.966827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.989622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.990552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.991277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.993133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.993756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.994478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.317918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.319621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.343285 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45d82dba-edfe-4fa4-bd32-ad0539c3f46f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.449869 Aug 24 03:55:16.344617 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e790c5f-6373-4941-9d8e-07d9147b3d6a tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1500 microversion: 2.1 time: 0.383138 Aug 24 03:55:16.346142 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2121/4501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:16.347596 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2381/4502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1500 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:16.352848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.353858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.369113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.370662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.371649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.372957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.374102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.375372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.386091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.387279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.402969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.404021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.404698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.406165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.407598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.408347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.417775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:16.514764 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8c688062-415f-4084-9428-2f2f64bf0d83 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 204 len: 0 microversion: 2.1 time: 0.165970 Aug 24 03:55:16.515391 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2122/4503] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:16 2022] DELETE /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:16.522544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.523589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.530510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.531011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.531785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.532815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.532815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.533269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.553968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.564473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.568116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.570130 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cefeaa24-5345-43bb-ad8c-b4cdd1c5a19b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1339 microversion: 2.20 time: 0.192123 Aug 24 03:55:16.571692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2382/4504] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:16 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:16.578070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:16.579815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.584783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:16.597571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.598425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.599361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.601301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.602339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.603089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.642510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lazy-loading 'flavor' on Instance uuid 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:16.739172 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e761f28-8d41-489a-936c-11b12db80680 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "POST /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0/action" status: 202 len: 0 microversion: 2.1 time: 0.165696 Aug 24 03:55:16.740423 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2383/4505] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:16 2022] POST /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:16.746069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.746865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.753852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.754447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.754963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.755796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.756341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.756842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.873236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.883401 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f94cfd36-8312-4189-aaec-400695711525 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.366090 Aug 24 03:55:16.884142 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2123/4506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:16 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:16.889905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.891167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.902086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.902994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.903654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.906567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.907923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.908150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.211239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.220540 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef826938-a45c-44cd-8d97-df1706dd3f12 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1508 microversion: 2.1 time: 0.334904 Aug 24 03:55:17.221770 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2124/4507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:16 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:17.237262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31945ed5-dc94-4c00-9540-3a2ee9d70d9d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1445999445", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31945ed5-dc94-4c00-9540-3a2ee9d70d9d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 238 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1445999445", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1445999445', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.253811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31945ed5-dc94-4c00-9540-3a2ee9d70d9d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31945ed5-dc94-4c00-9540-3a2ee9d70d9d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035497 Aug 24 03:55:17.263286 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2125/4508] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:55:17.267574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-175413334", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dedb9b92-960d-40c5-ae39-a6e49a145a80"}], "security_groups": [{"name": "tempest-securitygroup--217145802"}], "key_name": "tempest-keypair-391199567", "user_data": "}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:17.405657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] validate_networks() for [('dedb9b92-960d-40c5-ae39-a6e49a145a80', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:55:17.475249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.484467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48e32583-0e7e-4ea9-8237-a6de85f5b7b5 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1464 microversion: 2.1 time: 0.742509 Aug 24 03:55:17.492563 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2384/4509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:16 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1464 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:17.497060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:17.498090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:17.505692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.506185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.506627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.507338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.507983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.508415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.849276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.865483 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e5373a10-1e25-49f2-925a-8723ecdecba2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.377773 Aug 24 03:55:17.866865 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2385/4510] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:17 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:17.875476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:17.877353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:17.895007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.896447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.897521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.898951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.900699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.901622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.301334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.313683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.316833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.318051 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c87228b-44d2-4fa2-bdae-97e3c6eaffa7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 0.449402 Aug 24 03:55:18.332418 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2386/4511] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:17 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:18.332418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.332418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:18.340103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.340904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.341503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.342456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.343382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.344769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.468499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:55:18.469516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:55:18.469516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:55:18.469812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:55:18.470426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:55:18.482811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.483600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.484311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.486694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.487792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.488617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.520506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:18.528861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for user cf384a2eab3649a2ad4f5eec8d8c6b0a and project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:18.546787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:55:18.549971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:55:18.663939 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f367e20c-b982-454d-bd4b-142894690614 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.402355 Aug 24 03:55:18.673531 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2126/4512] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:55:18.687808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.703116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:18.752085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.752864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.753479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.756331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.757545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.758209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.809875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.820119 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b55208a-b37a-4be7-9812-1ce659644336 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.496592 Aug 24 03:55:18.836059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2387/4513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:18 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:18.843826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.845882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:18.860238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.868761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.869336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.870108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.870588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.871027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.089577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:19.099426 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-efbbe4f2-5898-42a8-b6fe-fe71f3a24908 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1491 microversion: 2.1 time: 0.424359 Aug 24 03:55:19.100384 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2127/4514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:18 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1491 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:19.106350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-051da718-809a-4160-8afb-80ea990bd314 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:19.107175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-051da718-809a-4160-8afb-80ea990bd314 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:19.307834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:19.309716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-051da718-809a-4160-8afb-80ea990bd314 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:19.321145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:19.338681 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-051da718-809a-4160-8afb-80ea990bd314 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1240 microversion: 2.1 time: 0.236320 Aug 24 03:55:19.351652 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b065cd54-4851-47c3-a0ee-6ec0ba575795 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 200 len: 1464 microversion: 2.1 time: 0.514020 Aug 24 03:55:19.355825 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2388/4515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:18 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 1464 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:19.357798 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2128/4516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:19 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1240 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:19.371848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:19.374519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72c83e44-f9d8-4be2-9e6d-a47f7baaf629 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-103875270", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:19.375481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72c83e44-f9d8-4be2-9e6d-a47f7baaf629 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 234 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-103875270", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-103875270', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.384706 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 03:55:19.389677 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:19.395578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72c83e44-f9d8-4be2-9e6d-a47f7baaf629 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:19.395578 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72c83e44-f9d8-4be2-9e6d-a47f7baaf629 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.036834 Aug 24 03:55:19.395578 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2389/4517] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:19 2022] POST /compute/v2.1/servers => generated 133 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:55:19.395936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.395936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.396320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.397047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.400608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.404312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.406695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:19.407608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:19.418159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.418925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.419555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.420456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.421075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.421664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.558493 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24e4d36e-411c-46a8-b98a-c70f16cb5b33 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "POST /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0/action" status: 202 len: 0 microversion: 2.1 time: 0.196573 Aug 24 03:55:19.561361 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2129/4518] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:19 2022] POST /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:19.583924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:19.589378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:19.614935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.617045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.618223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.620165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.621697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.623634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.068346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:20.087549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:20.090368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:20.093992 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8ef1662e-283d-47b4-8cb2-02df12013f71 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 0.698460 Aug 24 03:55:20.097772 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2390/4519] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:19 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:20.104909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:20.112623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:20.127528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.130673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.131378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.133838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.136309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.137240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.149431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:20.157201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:20.166321 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58493ae1-da0b-44c3-9395-cf8430e89927 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.603210 Aug 24 03:55:20.189983 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2130/4520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:19 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:20.195356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ddf6dac5-0318-46ad-a5fd-628aafbdf8d9 req-6f748fc1-6f83-4310-bc3d-f914941a9b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38807978-26d4-4c2b-b052-28f012675e23", "name": "network-vif-deleted", "tag": "bd18e940-693e-4c89-a6be-6594e2b035c6"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:20.253339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ddf6dac5-0318-46ad-a5fd-628aafbdf8d9 req-6f748fc1-6f83-4310-bc3d-f914941a9b07 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.253982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ddf6dac5-0318-46ad-a5fd-628aafbdf8d9 req-6f748fc1-6f83-4310-bc3d-f914941a9b07 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.254744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ddf6dac5-0318-46ad-a5fd-628aafbdf8d9 req-6f748fc1-6f83-4310-bc3d-f914941a9b07 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.274934 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ddf6dac5-0318-46ad-a5fd-628aafbdf8d9 req-6f748fc1-6f83-4310-bc3d-f914941a9b07 service nova] Creating event network-vif-deleted:bd18e940-693e-4c89-a6be-6594e2b035c6 for instance 38807978-26d4-4c2b-b052-28f012675e23 on n-h2-846470-15 Aug 24 03:55:20.281621 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ddf6dac5-0318-46ad-a5fd-628aafbdf8d9 req-6f748fc1-6f83-4310-bc3d-f914941a9b07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089855 Aug 24 03:55:20.282924 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2131/4521] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:20.304238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:20.305113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:20.316132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.316928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.317499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.318768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.319497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.320222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.828162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:20.848819 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-59a9781d-228a-4202-a149-dec60d9394fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.551612 Aug 24 03:55:20.850495 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2132/4522] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:20 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:20.856446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:20.857393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:20.865707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.866586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.867265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.868339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.869355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.870155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.912507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:20.921505 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3c6d4012-367f-4868-84f9-35570dcf4743 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1497 microversion: 2.1 time: 0.822400 Aug 24 03:55:20.923222 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2391/4523] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:20 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1497 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:20.928890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:20.930069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: 38807978-26d4-4c2b-b052-28f012675e23] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:20.937854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.939085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.939877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.940827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.941507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.941949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.963542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] HTTP exception thrown: Instance 38807978-26d4-4c2b-b052-28f012675e23 could not be found. Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Request method failure captured: Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 HTTP/1.1 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ-UkkhsvH52trsAcmywfPO_8G71OU2Y6heBBXgK8Rbje-tb2y1hjjTk4ETzyfPAkvSSAn1JlGmPJCRjc6QHKIVXJTNNW10vF8_tBDtCTPDL-AvfHmEUCDE89TC01B_Ag1vr9M7TUoszAn8mN9isbqZpCo1W0txW6VpZiGo9iYQW04A Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: bae5f7d73df84e3d8f38db05b3fe17a9 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: bae5f7d73df84e3d8f38db05b3fe17a9 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-MigrationsAdminTest-2103018183-project Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 1121b62203674b82ae3c7cfcb3112eb5 Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-MigrationsAdminTest-2103018183-project Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 38807978-26d4-4c2b-b052-28f012675e23 could not be found. Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '38807978-26d4-4c2b-b052-28f012675e23'} Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38807978-26d4-4c2b-b052-28f012675e23 could not be found. Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38807978-26d4-4c2b-b052-28f012675e23 could not be found. Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:20.965561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:20.970277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:20.970277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:20.970277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:20.970277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:20.970277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:20.970277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38807978-26d4-4c2b-b052-28f012675e23 could not be found. Aug 24 03:55:20.970277 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:20.970277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Returning 404 to user: Instance 38807978-26d4-4c2b-b052-28f012675e23 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:20.976047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c6b3147-cd9a-4d00-a0e6-f89a06278a93 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23" status: 404 len: 111 microversion: 2.1 time: 0.050944 Aug 24 03:55:20.978157 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2392/4524] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:20 2022] GET /compute/v2.1/servers/38807978-26d4-4c2b-b052-28f012675e23 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:20.987418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff718a06-f4d9-460d-8a16-c19f41adaef4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:20.988614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ff718a06-f4d9-460d-8a16-c19f41adaef4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 6f7f98f7-51d3-4033-abe1-59431e5f4bf5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:20.995991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.019063 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ff718a06-f4d9-460d-8a16-c19f41adaef4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 6f7f98f7-51d3-4033-abe1-59431e5f4bf5 could not be found. Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff718a06-f4d9-460d-8a16-c19f41adaef4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/6f7f98f7-51d3-4033-abe1-59431e5f4bf5/action HTTP/1.1 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 13 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: {"pause": {}} Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 6f7f98f7-51d3-4033-abe1-59431e5f4bf5 could not be found. Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '6f7f98f7-51d3-4033-abe1-59431e5f4bf5', 'body': {'pause': {}}} Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7f98f7-51d3-4033-abe1-59431e5f4bf5 could not be found. Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7f98f7-51d3-4033-abe1-59431e5f4bf5 could not be found. Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:21.022452 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:21.026953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:21.026953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:21.026953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7f98f7-51d3-4033-abe1-59431e5f4bf5 could not be found. Aug 24 03:55:21.026953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:21.027221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-61a75da6-b520-410d-943a-dc40eb1908fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1310 microversion: 2.1 time: 0.168013 Aug 24 03:55:21.029240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff718a06-f4d9-460d-8a16-c19f41adaef4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 6f7f98f7-51d3-4033-abe1-59431e5f4bf5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:21.033752 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ff718a06-f4d9-460d-8a16-c19f41adaef4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/6f7f98f7-51d3-4033-abe1-59431e5f4bf5/action" status: 404 len: 111 microversion: 2.1 time: 0.053923 Aug 24 03:55:21.034692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2393/4525] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:20 2022] POST /compute/v2.1/servers/6f7f98f7-51d3-4033-abe1-59431e5f4bf5/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:21.038936 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2133/4526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:20 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1310 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:21.044702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:21.045288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:21.052292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:21.054178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.054778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:21.054928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.055479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.056833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.057498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.058418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.086503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.087239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.087872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.088756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.091580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.092361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.099352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:21.232488 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-139c3e42-acda-4a40-8809-1838c5c31b96 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 204 len: 0 microversion: 2.1 time: 0.196014 Aug 24 03:55:21.234190 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2394/4527] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:21 2022] DELETE /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:21.241837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:21.242551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:21.248843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.249479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.250670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.251406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.251932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.252373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.546722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.563939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.565713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.568042 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7f794eb1-8490-4293-a014-3403137baa3f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 0.331941 Aug 24 03:55:21.583872 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2395/4528] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:21 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:21.591098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:21.592524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:21.601630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.602532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.603206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.604190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.604867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.605527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.609661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.624336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd27b905-0e48-4439-861c-3db91daafff2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.583297 Aug 24 03:55:21.624934 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2134/4529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:21 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:21.663248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:21.663913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:21.676083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.677679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.678182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.679338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.680230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.680855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.969602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.988225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.005482 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-260a01ad-7b3d-4fec-aadf-b19fdc07a3d9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.345978 Aug 24 03:55:22.022493 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3aa54d15-e426-4c8e-a47b-f3cdd940b303 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1468 microversion: 2.1 time: 0.436843 Aug 24 03:55:22.033549 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2396/4530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:21 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1468 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:22.033901 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2135/4531] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:21 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:22.034071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:22.034071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.034326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:22.034326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.045373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.046095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.046845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.047612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.048141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.048568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.049124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.049988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.050702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.052063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.053057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.054037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.174789 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af008730-c29b-4959-995f-90220b0079c5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.147823 Aug 24 03:55:22.176272 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2136/4532] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:22 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:22.182647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:22.183849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.236528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.248892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.249948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.273665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.274497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.275116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.398321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.408652 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-092be8cc-764c-488e-b55b-78ead958fd71 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1497 microversion: 2.1 time: 0.384207 Aug 24 03:55:22.409919 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2397/4533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:22 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1497 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:22.418137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:22.421690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.439460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.440436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.441061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.441968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.443766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.449993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.507514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.519013 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a24d395a-6b65-4d17-9255-74c24f289a01 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1298 microversion: 2.1 time: 0.341002 Aug 24 03:55:22.519827 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2137/4534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:22 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1298 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:22.527610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f9141777-4782-4eb6-85ce-214c75c6d062 req-88f82c10-9921-41ec-91c2-94fb3ed1ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebaceb98-646f-4cc9-b6d0-564c697b2537", "tag": "b4cd305e-193b-42fa-834b-651256717f69"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:22.545471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9141777-4782-4eb6-85ce-214c75c6d062 req-88f82c10-9921-41ec-91c2-94fb3ed1ea5d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.546302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9141777-4782-4eb6-85ce-214c75c6d062 req-88f82c10-9921-41ec-91c2-94fb3ed1ea5d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.546919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f9141777-4782-4eb6-85ce-214c75c6d062 req-88f82c10-9921-41ec-91c2-94fb3ed1ea5d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.576263 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f9141777-4782-4eb6-85ce-214c75c6d062 req-88f82c10-9921-41ec-91c2-94fb3ed1ea5d service nova] Creating event network-changed:b4cd305e-193b-42fa-834b-651256717f69 for instance ebaceb98-646f-4cc9-b6d0-564c697b2537 on n-h1-846470-15 Aug 24 03:55:22.584073 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f9141777-4782-4eb6-85ce-214c75c6d062 req-88f82c10-9921-41ec-91c2-94fb3ed1ea5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061676 Aug 24 03:55:22.586538 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2138/4535] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:22.600306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:22.602958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.613915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.614601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.615351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.616672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.617524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.618093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.899475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.907573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.933977 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-24d67888-a705-48b1-8a5d-8634a383166f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1511 microversion: 2.1 time: 0.521374 Aug 24 03:55:22.936522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.938928 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2398/4536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:22 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:22.950564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.954004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-951c9d55-7f0f-4ad6-a9ef-e733bb42377b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 0.359171 Aug 24 03:55:22.955011 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2139/4537] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:22 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:23.056587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.057583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.068963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.069850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.071329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.072502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.075969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.077604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.331806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:23.343025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ebc4deeb-5021-4e2d-a4aa-87d8f65c2d1c tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1468 microversion: 2.1 time: 0.293524 Aug 24 03:55:23.345015 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2399/4538] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:23 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:23.433277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.434135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.442428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.443036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.443567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.444380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.444903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.445397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.551095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.552142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.554777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:23.569529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.570403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.571102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.572079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.572767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.574562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.704140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:23.722149 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-626f1f16-8ba5-4e26-b7b6-eb86c86ff3e6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1298 microversion: 2.1 time: 0.180658 Aug 24 03:55:23.742001 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2400/4539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:23 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:23.821208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:23.829945 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-384efe9a-5fe1-4731-839d-ff169f03638f tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1500 microversion: 2.1 time: 0.400810 Aug 24 03:55:23.831502 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2140/4540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:23 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1500 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:23.851140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.851789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.866084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.866580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.867011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.870431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.874262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.874802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.958467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.960418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.977929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:23.980273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.981042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.981690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.987944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.988727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.996268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.170927 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-246cb20c-70a7-4ddc-836b-2e29b9f89bc1 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 204 len: 0 microversion: 2.1 time: 0.320469 Aug 24 03:55:24.175254 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2401/4541] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:23 2022] DELETE /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:24.191907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:24.194092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:24.213124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.213974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.214657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.215775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.216453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.217166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.294582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.310957 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ed9791c-3dbf-416d-a169-0262072cda6e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1491 microversion: 2.1 time: 0.356345 Aug 24 03:55:24.325022 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2141/4542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:23 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1491 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:24.336425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:24.337365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:24.345348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.346295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.346795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.347609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.348183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.348732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.674389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.684125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.686146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.687787 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a78ab15-df2e-4619-8c64-176d787c5580 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 0.513838 Aug 24 03:55:24.688630 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2402/4543] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:24 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:24.703581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.710387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:24.711506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:24.718586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.720040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.720658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.721569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.722208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.722833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.723200 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-92117907-ec99-4b1b-844c-1506070db600 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1506 microversion: 2.1 time: 0.388915 Aug 24 03:55:24.724010 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2142/4544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:24 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:24.729687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:24.730612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:24.751433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.752398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.752997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.753901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.754537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.755128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.766589 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Cannot 'pause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state paused Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action HTTP/1.1 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 13 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: {"pause": {}} Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: exception: Cannot 'pause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state paused Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'pause': {}}} Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b in vm_state paused. Cannot pause while the instance is in this state. Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state paused Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:24.768802 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:24.774542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:24.774542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:24.774542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:24.774542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state paused Aug 24 03:55:24.774542 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:24.778308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 409 to user: Cannot 'pause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state paused {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:24.782007 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db024e86-4c4a-4285-8c8b-7d03f2e1f714 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 409 len: 143 microversion: 2.1 time: 0.073923 Aug 24 03:55:24.783182 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2403/4545] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:24 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 143 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:55:24.794450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.795014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.795156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1d5e30da-ab08-4078-add3-ecd3ea1e3ac0 req-4e101aee-3d00-4bff-905e-e8dd71d5d4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47cbf84-c598-4d84-b81a-8eca598e1f10", "name": "network-vif-deleted", "tag": "7f5412b6-161b-4e0a-959a-bc19d45e58f6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:24.796053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.796755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lazy-loading 'fault' on Instance uuid c47cbf84-c598-4d84-b81a-8eca598e1f10 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:24.805599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d5e30da-ab08-4078-add3-ecd3ea1e3ac0 req-4e101aee-3d00-4bff-905e-e8dd71d5d4b4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.806159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d5e30da-ab08-4078-add3-ecd3ea1e3ac0 req-4e101aee-3d00-4bff-905e-e8dd71d5d4b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.806759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d5e30da-ab08-4078-add3-ecd3ea1e3ac0 req-4e101aee-3d00-4bff-905e-e8dd71d5d4b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.821129 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1d5e30da-ab08-4078-add3-ecd3ea1e3ac0 req-4e101aee-3d00-4bff-905e-e8dd71d5d4b4 service nova] Creating event network-vif-deleted:7f5412b6-161b-4e0a-959a-bc19d45e58f6 for instance c47cbf84-c598-4d84-b81a-8eca598e1f10 on n-h2-846470-15 Aug 24 03:55:24.827313 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1d5e30da-ab08-4078-add3-ecd3ea1e3ac0 req-4e101aee-3d00-4bff-905e-e8dd71d5d4b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042571 Aug 24 03:55:24.828683 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2404/4546] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:24.836384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:24.837599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:24.845131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.845775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.846274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.847007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.847699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.848521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.072965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.082187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db095fa7-e88f-4f7a-90ce-d25b2e9fabe7 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1303 microversion: 2.1 time: 0.356879 Aug 24 03:55:25.089684 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2143/4547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:24 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1303 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:25.101923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:25.102842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:25.109973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.110578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.111290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.112298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.112988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.113642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.213883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.217087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:25.229969 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a0498d5-24ad-406c-9952-f8ebc2e57b33 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.138283 Aug 24 03:55:25.231520 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2144/4548] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:25 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:25.235958 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b685799-c86d-4c89-8566-f81cd10761ae tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.405218 Aug 24 03:55:25.236571 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2405/4549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:24 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:25.242978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:25.243989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:25.255084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.256089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.257022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.258289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.259095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.259793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.713024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:25.714266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:25.723816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.724580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.725189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.726064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.726677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.727464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.758604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.770700 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1405192e-984e-4f9c-961a-b52af0557f50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1498 microversion: 2.1 time: 0.533576 Aug 24 03:55:25.773927 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2145/4550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:25 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1498 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:25.802953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:25.804049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:25.812063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.812962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.813848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.814824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.815479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.816124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.839884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:25.983975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.997144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.998790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.999962 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aecc94b5-4369-4e74-9eca-0d4963b1db94 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 0.293290 Aug 24 03:55:26.000568 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2406/4551] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:25 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:26.111468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:26.112138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:26.122416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.123175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.123629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.124358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.124828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.126318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.164805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.165812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.165812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.166179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lazy-loading 'fault' on Instance uuid c47cbf84-c598-4d84-b81a-8eca598e1f10 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:26.213571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1121b62203674b82ae3c7cfcb3112eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae5f7d73df84e3d8f38db05b3fe17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.226134 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f4e2e59-9ea3-4527-8974-a1ecc5eb1e39 tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 200 len: 1303 microversion: 2.1 time: 0.119694 Aug 24 03:55:26.226760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2407/4552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:26 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:26.242812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.251204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-301e485e-1215-488c-a0d3-35f9bdd11e5c tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1506 microversion: 2.1 time: 0.452346 Aug 24 03:55:26.263861 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2146/4553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:25 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:26.266153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:26.267887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:26.276105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.276622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.277057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.277764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.278231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.278637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.435459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.446636 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ecd1c2c6-8210-4bc3-9063-19a5fd00c3a6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.185177 Aug 24 03:55:26.447598 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2408/4554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:26 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:26.798633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:26.799284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:26.809004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.809738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.810412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.813844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.814530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.815125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.943387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-92e64311-0642-4a20-8b42-b6cee768081d req-88f4d920-f3e5-4ca1-b150-a98a2aa8db37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51814e8b-04b9-4f0a-a8eb-9a1ec11813ee", "tag": "4cad4df9-6370-4f75-8184-c66935f131fd"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:26.968651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-92e64311-0642-4a20-8b42-b6cee768081d req-88f4d920-f3e5-4ca1-b150-a98a2aa8db37 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.970535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-92e64311-0642-4a20-8b42-b6cee768081d req-88f4d920-f3e5-4ca1-b150-a98a2aa8db37 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.971473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-92e64311-0642-4a20-8b42-b6cee768081d req-88f4d920-f3e5-4ca1-b150-a98a2aa8db37 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.018358 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-92e64311-0642-4a20-8b42-b6cee768081d req-88f4d920-f3e5-4ca1-b150-a98a2aa8db37 service nova] Creating event network-changed:4cad4df9-6370-4f75-8184-c66935f131fd for instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee on n-h1-846470-15 Aug 24 03:55:27.037436 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-92e64311-0642-4a20-8b42-b6cee768081d req-88f4d920-f3e5-4ca1-b150-a98a2aa8db37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096975 Aug 24 03:55:27.038897 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2409/4555] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:27.046814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.047867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.059956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.060679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.061330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.062888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.063821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.064575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.246456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.258527 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c6ba2301-3a6e-4079-bde0-af816c995b3e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.464160 Aug 24 03:55:27.272391 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2147/4556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:26 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:27.279336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6425d26d-6ba2-4fe7-afef-54b830a615e7 req-48264c4b-11d4-45d3-95bf-ed106b8c7c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaceb98-646f-4cc9-b6d0-564c697b2537", "name": "network-vif-plugged", "status": "completed", "tag": "b4cd305e-193b-42fa-834b-651256717f69"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:27.305922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6425d26d-6ba2-4fe7-afef-54b830a615e7 req-48264c4b-11d4-45d3-95bf-ed106b8c7c60 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.306254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6425d26d-6ba2-4fe7-afef-54b830a615e7 req-48264c4b-11d4-45d3-95bf-ed106b8c7c60 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.316044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6425d26d-6ba2-4fe7-afef-54b830a615e7 req-48264c4b-11d4-45d3-95bf-ed106b8c7c60 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.328470 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6425d26d-6ba2-4fe7-afef-54b830a615e7 req-48264c4b-11d4-45d3-95bf-ed106b8c7c60 service nova] Creating event network-vif-plugged:b4cd305e-193b-42fa-834b-651256717f69 for instance ebaceb98-646f-4cc9-b6d0-564c697b2537 on n-h1-846470-15 Aug 24 03:55:27.334056 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6425d26d-6ba2-4fe7-afef-54b830a615e7 req-48264c4b-11d4-45d3-95bf-ed106b8c7c60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059357 Aug 24 03:55:27.335320 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2148/4557] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:27.340951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.341931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] [instance: c47cbf84-c598-4d84-b81a-8eca598e1f10] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.349009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.349788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.350431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.351354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.352041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.352664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.374779 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] HTTP exception thrown: Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 could not be found. Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Request method failure captured: Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 HTTP/1.1 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ-UkkhsvH52trsAcmywfPO_8G71OU2Y6heBBXgK8Rbje-tb2y1hjjTk4ETzyfPAkvSSAn1JlGmPJCRjc6QHKIVXJTNNW10vF8_tBDtCTPDL-AvfHmEUCDE89TC01B_Ag1vr9M7TUoszAn8mN9isbqZpCo1W0txW6VpZiGo9iYQW04A Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: bae5f7d73df84e3d8f38db05b3fe17a9 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bae5f7d73df84e3d8f38db05b3fe17a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: bae5f7d73df84e3d8f38db05b3fe17a9 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-MigrationsAdminTest-2103018183 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-MigrationsAdminTest-2103018183-project Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 1121b62203674b82ae3c7cfcb3112eb5 Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-MigrationsAdminTest-2103018183-project Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 could not be found. Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'c47cbf84-c598-4d84-b81a-8eca598e1f10'} Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 could not be found. Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 could not be found. Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:27.388370 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.393520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:27.393520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:27.393520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:27.393520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:27.393520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:27.393520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 could not be found. Aug 24 03:55:27.393520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.410914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] Returning 404 to user: Instance c47cbf84-c598-4d84-b81a-8eca598e1f10 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:27.412693 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94dd464a-1df7-49ae-90de-dedc0a0bbfac tempest-MigrationsAdminTest-2103018183 tempest-MigrationsAdminTest-2103018183-project] 10.222.0.58 "GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10" status: 404 len: 111 microversion: 2.1 time: 0.075623 Aug 24 03:55:27.414601 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2149/4558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/c47cbf84-c598-4d84-b81a-8eca598e1f10 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:27.421644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.424428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.432587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.433624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.434288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.436411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.439540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.443239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.582074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e373e046ca0646069d82a172162dfaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c39778c45e4bb89209770def13b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.597271 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11031065-7d3a-455e-a855-47351baa0652 tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 200 len: 1464 microversion: 2.1 time: 0.180846 Aug 24 03:55:27.601925 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2150/4559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:27.606943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.628662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.641440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.650969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.651645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.652701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.653441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.654110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.658132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.677494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.679006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.680206 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9c031e31-788b-42e7-a709-7bf24d074b9f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 0.639629 Aug 24 03:55:27.680782 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2410/4560] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:27.700732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.707845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.726334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.726981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.727427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.728180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.728637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.729063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.987245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.996018 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fe8e0f18-b7f9-44fa-af4e-4d5a4baa04c9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.392727 Aug 24 03:55:28.016143 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2151/4561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:28.037596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:28.042260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:28.052915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.054094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.055069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.056797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.058039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.059363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.101668 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5/action HTTP/1.1 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 28 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: {"reboot": {"type": "SOFT"}} Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '307e338d-b5fd-4bee-af5d-4b4025316da5', 'body': {'reboot': {'type': 'SOFT'}}} Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:28.105257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:28.115797 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.126718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:28.129212 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16b81765-0776-4c15-a4dd-d4173dfb5732 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5/action" status: 404 len: 111 microversion: 2.1 time: 0.099447 Aug 24 03:55:28.135833 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2152/4562] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:28 2022] POST /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5/action => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:55:28.149606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:28.151529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:28.171475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.172208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.172664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.173411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.173987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.174371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.412012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:28.430507 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-424538d1-bf34-43cc-81bf-8c29af9a8834 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.736151 Aug 24 03:55:28.432383 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2411/4563] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:28.507066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:28.562469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:28.581116 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b5afac0-b9ad-4af8-996d-6e2bb4687f2b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.442731 Aug 24 03:55:28.584808 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2153/4564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:28 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:28.607845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:28.608713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:28.625812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:28.627083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.627929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] [instance: 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:28.629178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.629855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.631161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.633849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.634295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.652670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.653172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.661825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.662941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.664593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.666905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.697845 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] HTTP exception thrown: Instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 could not be found. Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Request method failure captured: Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 HTTP/1.1 Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaD2y7OpKnoUZvh2eeRhObWK94PZ2hLCdpQtcCVQ5z7v1DRAxYdsYrT7ANHAvB5v60SRgQ-3ZHdlWreoit3Plc7Ipx4O4ONpETqVpi8enpwyncDafMPwb9OgtdzZydbCJjbN3R18CcJ8MuM63gaFQcKc1D88PTty7r2xFZ4zf_eHx9c Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 49c39778c45e4bb89209770def13b66c Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestServerAdvancedOps-563066559 Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49c39778c45e4bb89209770def13b66c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49c39778c45e4bb89209770def13b66c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49c39778c45e4bb89209770def13b66c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49c39778c45e4bb89209770def13b66c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestServerAdvancedOps-563066559 Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 49c39778c45e4bb89209770def13b66c Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestServerAdvancedOps-563066559 Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestServerAdvancedOps-563066559-project Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: e373e046ca0646069d82a172162dfaa2 Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestServerAdvancedOps-563066559-project Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 could not be found. Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9a3efe5c-3f6c-4e92-887e-2c216fefa5b0'} Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 could not be found. Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 could not be found. Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:28.703276 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.708775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:28.708775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:28.708775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:28.708775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:28.708775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:28.708775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 could not be found. Aug 24 03:55:28.708775 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:28.712224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] Returning 404 to user: Instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:28.713429 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b434fbd3-0e77-4320-871e-befd9c21c12d tempest-TestServerAdvancedOps-563066559 tempest-TestServerAdvancedOps-563066559-project] 10.222.0.58 "GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0" status: 404 len: 111 microversion: 2.1 time: 0.094881 Aug 24 03:55:28.715049 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2154/4565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:28 2022] GET /compute/v2.1/servers/9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:28.730438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:28.732132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:28.742447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.743439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.744406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.745437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.746320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.747002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.322277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=16 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:29.561221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.571643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.573865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.575309 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-03bf6c33-0857-4c52-9c7d-48bf706a035a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 0.859044 Aug 24 03:55:29.576514 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2155/4566] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:28 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:29.587894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8d30d435-b393-48e9-b877-abb96e192b86 req-040d4fe3-ff5d-4715-b6d9-7962026fd48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3efe5c-3f6c-4e92-887e-2c216fefa5b0", "name": "network-vif-deleted", "tag": "6fe99947-159a-49ee-a1b1-89bf6b7fc98f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:29.600569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8d30d435-b393-48e9-b877-abb96e192b86 req-040d4fe3-ff5d-4715-b6d9-7962026fd48a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.601529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8d30d435-b393-48e9-b877-abb96e192b86 req-040d4fe3-ff5d-4715-b6d9-7962026fd48a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.602237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8d30d435-b393-48e9-b877-abb96e192b86 req-040d4fe3-ff5d-4715-b6d9-7962026fd48a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.617517 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8d30d435-b393-48e9-b877-abb96e192b86 req-040d4fe3-ff5d-4715-b6d9-7962026fd48a service nova] Creating event network-vif-deleted:6fe99947-159a-49ee-a1b1-89bf6b7fc98f for instance 9a3efe5c-3f6c-4e92-887e-2c216fefa5b0 on n-h2-846470-15 Aug 24 03:55:29.626414 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8d30d435-b393-48e9-b877-abb96e192b86 req-040d4fe3-ff5d-4715-b6d9-7962026fd48a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045659 Aug 24 03:55:29.633680 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2156/4567] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:29.648567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:29.650905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.659124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.660064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.660999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.662156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.662887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.663557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.841170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.865787 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6aece978-405a-4b8e-8256-5a8f814257ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.261002 Aug 24 03:55:29.870307 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2412/4568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:28 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:29.893781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0dad3fdd-84ac-4456-91f5-e88847e2bc96 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:29.900076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0dad3fdd-84ac-4456-91f5-e88847e2bc96 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 002e7b4a-3892-42f3-936b-29a235c9ae39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.933926 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-0dad3fdd-84ac-4456-91f5-e88847e2bc96 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 002e7b4a-3892-42f3-936b-29a235c9ae39 could not be found. Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0dad3fdd-84ac-4456-91f5-e88847e2bc96 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/002e7b4a-3892-42f3-936b-29a235c9ae39/action HTTP/1.1 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 28 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: {"reboot": {"type": "SOFT"}} Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 002e7b4a-3892-42f3-936b-29a235c9ae39 could not be found. Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '002e7b4a-3892-42f3-936b-29a235c9ae39', 'body': {'reboot': {'type': 'SOFT'}}} Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002e7b4a-3892-42f3-936b-29a235c9ae39 could not be found. Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002e7b4a-3892-42f3-936b-29a235c9ae39 could not be found. Aug 24 03:55:29.937313 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002e7b4a-3892-42f3-936b-29a235c9ae39 could not be found. Aug 24 03:55:29.942780 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.948553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0dad3fdd-84ac-4456-91f5-e88847e2bc96 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 002e7b4a-3892-42f3-936b-29a235c9ae39 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:29.949829 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0dad3fdd-84ac-4456-91f5-e88847e2bc96 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/002e7b4a-3892-42f3-936b-29a235c9ae39/action" status: 404 len: 111 microversion: 2.1 time: 0.062299 Aug 24 03:55:29.962655 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2413/4569] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:29 2022] POST /compute/v2.1/servers/002e7b4a-3892-42f3-936b-29a235c9ae39/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:55:29.969672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:29.970471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.984832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.985669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.986481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.987393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.988063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.988646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.021642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:30.050349 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7c1c4bc6-1302-4aee-8df3-dbb326f911a3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.414058 Aug 24 03:55:30.052648 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2157/4570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:29 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:30.376084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:30.391845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-488f8ee4-0893-4ed3-8a49-f3ba8a1c0432 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.424153 Aug 24 03:55:30.393354 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2414/4571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:29 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:30.419418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:30.420142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:30.424368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:30.447204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.447842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.452069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.453260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.453812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.454265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.604425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:30.605450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:30.615789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.616681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.617348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.619609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.621376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.622058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.058860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.076296 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5e4b2e0-6b64-421e-b444-b9da29433310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.661971 Aug 24 03:55:31.080677 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2158/4572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:30 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:31.100888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:31.101510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:31.119316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.119920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.120370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.121099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.121555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.121986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.517179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.536976 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a677390-7489-4f28-b2ba-74a9124fb64a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.451495 Aug 24 03:55:31.537772 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2159/4573] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:31 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:31.546666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:31.551696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:31.560934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.561435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.561866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.562630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.563083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.563505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.587431 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5/action HTTP/1.1 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 65 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '307e338d-b5fd-4bee-af5d-4b4025316da5', 'body': {'rebuild': {'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3'}}} Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 03:55:31.589737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:31.596285 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f2dedce-d87d-4d1c-8c93-791e4e645d99 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5/action" status: 404 len: 111 microversion: 2.1 time: 0.051780 Aug 24 03:55:31.600307 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2160/4574] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:31 2022] POST /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:31.605351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:31.606148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:31.617123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.617849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.618362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.619405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.620359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.621017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.659986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.673008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.677057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.680540 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ff88ccd-299c-404f-9bba-c86a3cdbd959 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1406 microversion: 2.20 time: 1.080200 Aug 24 03:55:31.682145 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2415/4575] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:30 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1406 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:31.882232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.896812 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07ff13de-786e-4c8e-921d-57bf62d0a6ed tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.295139 Aug 24 03:55:31.911697 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2161/4576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:31 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:31.932356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:31.933191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:31.944220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.945166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.945802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.946857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.947788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.948624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.566516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:32.567173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.584290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.584796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.585396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.586506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.586972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.587408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.667534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:32.684930 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa74c4d9-5401-422f-8cab-43e8fe7ad578 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.764592 Aug 24 03:55:32.689867 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2416/4577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:31 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:32.710657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:32.713333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.732343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.733172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.737077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.738538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.739527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.741084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.875390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:32.887143 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8e14b67-dd21-404b-9e81-f44225223871 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.332116 Aug 24 03:55:32.893475 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2162/4578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:32 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:32.905350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7fe3c9a5-85aa-43de-b147-7c9ec2ab322c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:32.912017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7fe3c9a5-85aa-43de-b147-7c9ec2ab322c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 444882b6-26ba-4e8b-97be-857502122fc0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.919771 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7fe3c9a5-85aa-43de-b147-7c9ec2ab322c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 444882b6-26ba-4e8b-97be-857502122fc0 could not be found. Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7fe3c9a5-85aa-43de-b147-7c9ec2ab322c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/444882b6-26ba-4e8b-97be-857502122fc0/action HTTP/1.1 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 65 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 444882b6-26ba-4e8b-97be-857502122fc0 could not be found. Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '444882b6-26ba-4e8b-97be-857502122fc0', 'body': {'rebuild': {'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3'}}} Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 444882b6-26ba-4e8b-97be-857502122fc0 could not be found. Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 03:55:32.922954 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 444882b6-26ba-4e8b-97be-857502122fc0 could not be found. Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 444882b6-26ba-4e8b-97be-857502122fc0 could not be found. Aug 24 03:55:32.928154 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:32.931015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7fe3c9a5-85aa-43de-b147-7c9ec2ab322c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 444882b6-26ba-4e8b-97be-857502122fc0 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:32.931981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7fe3c9a5-85aa-43de-b147-7c9ec2ab322c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/444882b6-26ba-4e8b-97be-857502122fc0/action" status: 404 len: 111 microversion: 2.1 time: 0.035868 Aug 24 03:55:32.932584 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2163/4579] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:32 2022] POST /compute/v2.1/servers/444882b6-26ba-4e8b-97be-857502122fc0/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:32.943277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:32.944235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.955494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.956037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.956486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.957225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.957860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.958219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.132314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.143618 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fd6afe97-b16c-45cc-b72c-6800047afb8c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.205990 Aug 24 03:55:33.144244 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2164/4580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:32 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:33.294177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2c35b30d-a2ab-428c-9cda-cf249a53f952 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Action: 'update', calling method: .version_select at 0x7f103437c4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:33.367105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c35b30d-a2ab-428c-9cda-cf249a53f952 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.367578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c35b30d-a2ab-428c-9cda-cf249a53f952 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.368290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c35b30d-a2ab-428c-9cda-cf249a53f952 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.369028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c35b30d-a2ab-428c-9cda-cf249a53f952 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.369492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c35b30d-a2ab-428c-9cda-cf249a53f952 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.369925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c35b30d-a2ab-428c-9cda-cf249a53f952 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.428612 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2c35b30d-a2ab-428c-9cda-cf249a53f952 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/aa5b07356f20402da6f0d1aec48c6ada" status: 200 len: 148 microversion: 2.57 time: 0.283058 Aug 24 03:55:33.429261 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2165/4581] 10.222.0.58 () {62 vars in 1303 bytes} [Wed Aug 24 03:55:33 2022] PUT /compute/v2.1/os-quota-sets/aa5b07356f20402da6f0d1aec48c6ada => generated 148 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:33.440210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.440834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.447088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.448275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.448711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.449461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.449925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.450334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.594300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.596367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.606792 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6f2d1bf-9c80-457a-92d1-04ecdfe98535 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.170748 Aug 24 03:55:33.607824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.611782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.613592 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ad7ebd05-9f51-4aac-bccd-8a5cbcae30f8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1596 microversion: 2.20 time: 0.909173 Aug 24 03:55:33.614251 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2417/4582] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:32 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1596 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:33.621739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-30520bb3-c806-4cbb-ac20-399c1edfdf0d tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Calling method '.version_select at 0x7f102209f3a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.624833 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2166/4583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:33.630733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-337f7f37-4078-497d-b2ff-19f838427436 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:33.631338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-337f7f37-4078-497d-b2ff-19f838427436 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: adca7397-943a-4fda-9de4-b9dc6a35d96c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.639201 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-337f7f37-4078-497d-b2ff-19f838427436 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance adca7397-943a-4fda-9de4-b9dc6a35d96c could not be found. Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-337f7f37-4078-497d-b2ff-19f838427436 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/adca7397-943a-4fda-9de4-b9dc6a35d96c/action HTTP/1.1 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 15 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: {"restore": {}} Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance adca7397-943a-4fda-9de4-b9dc6a35d96c could not be found. Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'adca7397-943a-4fda-9de4-b9dc6a35d96c', 'body': {'restore': {}}} Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adca7397-943a-4fda-9de4-b9dc6a35d96c could not be found. Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adca7397-943a-4fda-9de4-b9dc6a35d96c could not be found. Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:33.641218 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:33.646280 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:33.646280 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:33.646280 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adca7397-943a-4fda-9de4-b9dc6a35d96c could not be found. Aug 24 03:55:33.646280 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:33.646280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-337f7f37-4078-497d-b2ff-19f838427436 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance adca7397-943a-4fda-9de4-b9dc6a35d96c could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:33.646280 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-337f7f37-4078-497d-b2ff-19f838427436 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/adca7397-943a-4fda-9de4-b9dc6a35d96c/action" status: 404 len: 111 microversion: 2.1 time: 0.016693 Aug 24 03:55:33.647114 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2167/4584] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:33 2022] POST /compute/v2.1/servers/adca7397-943a-4fda-9de4-b9dc6a35d96c/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:33.657897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.658471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.668603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.669126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.669569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.671770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.673484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.674178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.749234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30520bb3-c806-4cbb-ac20-399c1edfdf0d tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.750149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30520bb3-c806-4cbb-ac20-399c1edfdf0d tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.750766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30520bb3-c806-4cbb-ac20-399c1edfdf0d tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.752214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30520bb3-c806-4cbb-ac20-399c1edfdf0d tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.752214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30520bb3-c806-4cbb-ac20-399c1edfdf0d tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.752811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30520bb3-c806-4cbb-ac20-399c1edfdf0d tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.798327 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-30520bb3-c806-4cbb-ac20-399c1edfdf0d tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/aa5b07356f20402da6f0d1aec48c6ada/detail" status: 200 len: 463 microversion: 2.57 time: 0.180959 Aug 24 03:55:33.799904 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2418/4585] 10.222.0.58 () {60 vars in 1304 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/os-quota-sets/aa5b07356f20402da6f0d1aec48c6ada/detail => generated 463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:33.806392 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05c02578-983f-444c-a2bf-8366aebf4996 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.157193 Aug 24 03:55:33.807064 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2168/4586] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:33.821174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.823185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.844305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.845092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.845746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.846765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.848154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.848603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.910373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.910860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.917237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.917980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.918580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.919616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.920272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.920861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.221852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.230659 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-21ba8cd3-66de-455a-bf02-bf4bf47be54e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.325885 Aug 24 03:55:34.231838 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2169/4587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:34.238019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Action: 'update', calling method: .version_select at 0x7f102ad4c820>, body: {"quota_set": {"ram": "2048"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:34.352609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.352609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.352919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.353588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.354043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.354488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.377841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.423967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.431553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.432342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.434111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.434994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.435519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.436983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.453305 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f56c625-3591-4bdd-b187-fb0f71df844b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.650542 Aug 24 03:55:34.455046 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2419/4588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:34.482908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:34.483976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:34.495845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.496629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.496844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.497794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.498631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.499072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.526406 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7c703b5d-a71c-41ab-ae46-543d42e9d701 tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/aa5b07356f20402da6f0d1aec48c6ada?user_id=626de2a7068f41a7b6375584464545c7" status: 200 len: 148 microversion: 2.57 time: 0.293396 Aug 24 03:55:34.534926 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2170/4589] 10.222.0.58 () {62 vars in 1384 bytes} [Wed Aug 24 03:55:34 2022] PUT /compute/v2.1/os-quota-sets/aa5b07356f20402da6f0d1aec48c6ada?user_id=626de2a7068f41a7b6375584464545c7 => generated 148 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:34.541430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0760eb59-5063-4e01-82e9-cbdd610af41c tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] Calling method '.version_select at 0x7f102a14dc10>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:34.905816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0760eb59-5063-4e01-82e9-cbdd610af41c tempest-QuotasAdminTestV257-466453475 tempest-QuotasAdminTestV257-466453475-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/aa5b07356f20402da6f0d1aec48c6ada?user_id=626de2a7068f41a7b6375584464545c7" status: 200 len: 190 microversion: 2.57 time: 0.369233 Aug 24 03:55:34.908810 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2171/4590] 10.222.0.58 () {60 vars in 1364 bytes} [Wed Aug 24 03:55:34 2022] GET /compute/v2.1/os-quota-sets/aa5b07356f20402da6f0d1aec48c6ada?user_id=626de2a7068f41a7b6375584464545c7 => generated 190 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:34.914798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fc898d58-60ce-42f3-a410-5f8256ef76da req-8c2c5df0-de26-4562-9daa-808e4bd8020b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51814e8b-04b9-4f0a-a8eb-9a1ec11813ee", "name": "network-vif-plugged", "status": "completed", "tag": "4cad4df9-6370-4f75-8184-c66935f131fd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:34.932107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fc898d58-60ce-42f3-a410-5f8256ef76da req-8c2c5df0-de26-4562-9daa-808e4bd8020b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.932828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fc898d58-60ce-42f3-a410-5f8256ef76da req-8c2c5df0-de26-4562-9daa-808e4bd8020b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.933580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fc898d58-60ce-42f3-a410-5f8256ef76da req-8c2c5df0-de26-4562-9daa-808e4bd8020b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.948897 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fc898d58-60ce-42f3-a410-5f8256ef76da req-8c2c5df0-de26-4562-9daa-808e4bd8020b service nova] Creating event network-vif-plugged:4cad4df9-6370-4f75-8184-c66935f131fd for instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee on n-h1-846470-15 Aug 24 03:55:34.958171 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fc898d58-60ce-42f3-a410-5f8256ef76da req-8c2c5df0-de26-4562-9daa-808e4bd8020b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047594 Aug 24 03:55:34.959441 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2172/4591] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:34.994971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.032445 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ddf30185-c7b7-46f8-8709-b7bfea4d6f27 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.557421 Aug 24 03:55:35.033997 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2420/4592] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:34 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:35.055928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:35.056689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.071800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.072526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.072995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.073767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.074245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.074673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.131904 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Cannot 'restore' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action HTTP/1.1 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 15 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: {"restore": {}} Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot 'restore' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'restore': {}}} Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b in vm_state active. Cannot restore while the instance is in this state. Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:35.133614 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:35.138924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:35.138924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:35.138924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:35.138924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:55:35.138924 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.142286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 409 to user: Cannot 'restore' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:35.143356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9491e05c-c4ca-4198-a202-4c92ee66e29d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 409 len: 145 microversion: 2.1 time: 0.092167 Aug 24 03:55:35.144605 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2173/4593] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:35 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 145 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:55:35.155538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.156406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.164121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.164623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.165054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.166255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.166809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.167433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.268248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.270847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.285210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.286541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.287920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.289925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.291257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.292045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.512621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.526907 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5b8fec9-b24c-41fe-99b3-450753a03fa8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.373820 Aug 24 03:55:35.527595 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2421/4594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:35.553112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.554106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.560880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.561635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.562231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.563836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.564946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.566259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.729352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.738838 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9e17dd5e-db12-458d-8536-a0098596c05a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.481304 Aug 24 03:55:35.743127 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2174/4595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:35.802273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.818325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b81e4ecd-991f-41cc-8d71-1d9c9f225b44 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.270328 Aug 24 03:55:35.819979 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2422/4596] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:35.844442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af3ad6aa-4ff6-43ab-b35d-8876492636c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:35.844993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af3ad6aa-4ff6-43ab-b35d-8876492636c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: e02cfed9-84ce-4081-9be4-157843d01de4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.855871 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-af3ad6aa-4ff6-43ab-b35d-8876492636c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance e02cfed9-84ce-4081-9be4-157843d01de4 could not be found. Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af3ad6aa-4ff6-43ab-b35d-8876492636c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/e02cfed9-84ce-4081-9be4-157843d01de4/action HTTP/1.1 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 14 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: {"resume": {}} Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e02cfed9-84ce-4081-9be4-157843d01de4 could not be found. Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e02cfed9-84ce-4081-9be4-157843d01de4', 'body': {'resume': {}}} Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02cfed9-84ce-4081-9be4-157843d01de4 could not be found. Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02cfed9-84ce-4081-9be4-157843d01de4 could not be found. Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:35.865300 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:35.870803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:35.870803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:35.870803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02cfed9-84ce-4081-9be4-157843d01de4 could not be found. Aug 24 03:55:35.870803 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:35.870803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af3ad6aa-4ff6-43ab-b35d-8876492636c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance e02cfed9-84ce-4081-9be4-157843d01de4 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:35.870803 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af3ad6aa-4ff6-43ab-b35d-8876492636c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/e02cfed9-84ce-4081-9be4-157843d01de4/action" status: 404 len: 111 microversion: 2.1 time: 0.028346 Aug 24 03:55:35.870803 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2175/4597] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:35 2022] POST /compute/v2.1/servers/e02cfed9-84ce-4081-9be4-157843d01de4/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:35.877016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.877813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.889695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.890203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.890712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.891438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.891927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.892373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.399621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c222757d-9382-4581-88a6-9cff27131ced req-4579b6f9-5e3a-4bd9-ba38-850630b33f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebaceb98-646f-4cc9-b6d0-564c697b2537", "tag": "b4cd305e-193b-42fa-834b-651256717f69"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:36.426579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c222757d-9382-4581-88a6-9cff27131ced req-4579b6f9-5e3a-4bd9-ba38-850630b33f98 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.427286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c222757d-9382-4581-88a6-9cff27131ced req-4579b6f9-5e3a-4bd9-ba38-850630b33f98 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.427766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c222757d-9382-4581-88a6-9cff27131ced req-4579b6f9-5e3a-4bd9-ba38-850630b33f98 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.442829 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c222757d-9382-4581-88a6-9cff27131ced req-4579b6f9-5e3a-4bd9-ba38-850630b33f98 service nova] Creating event network-changed:b4cd305e-193b-42fa-834b-651256717f69 for instance ebaceb98-646f-4cc9-b6d0-564c697b2537 on n-h1-846470-15 Aug 24 03:55:36.448398 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c222757d-9382-4581-88a6-9cff27131ced req-4579b6f9-5e3a-4bd9-ba38-850630b33f98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054660 Aug 24 03:55:36.450120 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2176/4598] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:36.657146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:36.668343 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a39c845-99d4-4af4-b683-a8988aaf0995 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.795607 Aug 24 03:55:36.669633 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2423/4599] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:36.693408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:36.694276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:36.705961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.710415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.711269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.712140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.714862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.715406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.768198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:36.769227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:36.788837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.791722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.792579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.794196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.796353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.799985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.844436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:37.040469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:37.056692 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1bda7364-4eae-44d9-9b90-6bd72d1b7cac tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.367035 Aug 24 03:55:37.057699 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2177/4600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:36 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:37.089976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:37.090549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:37.110848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.111343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.111811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.112531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.112985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.117130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.153414 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Cannot 'resume' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action HTTP/1.1 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 14 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: {"resume": {}} Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot 'resume' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'resume': {}}} Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b in vm_state active. Cannot resume while the instance is in this state. Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:37.156206 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:37.160350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:37.160350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:37.160350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:37.160350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:55:37.160350 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.163099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 409 to user: Cannot 'resume' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:37.164372 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69fefd5c-51ab-401c-8610-5ffc00a4784b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 409 len: 144 microversion: 2.1 time: 0.083695 Aug 24 03:55:37.165544 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2178/4601] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:37 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 144 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:55:37.179345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:37.180060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:37.188115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.188558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.189008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.189751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.190217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.190652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.579004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:37.599445 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7cb4273a-8a26-45cd-97cf-75872138cf79 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.427103 Aug 24 03:55:37.601469 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2179/4602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:37 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:37.633994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:37.635640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:37.661059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.661423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:37.664141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.678509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.685237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.688183 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7c93176-9eb8-48bc-b199-4b15aa5129a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1365 microversion: 2.1 time: 0.926014 Aug 24 03:55:37.692842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.695699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.704858 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2424/4603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:36 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1365 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:38.231748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:38.243210 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a1cb9f1a-594c-40fd-938e-e5d82fe3ddc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.617436 Aug 24 03:55:38.258489 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2180/4604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:37 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:38.368338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c228d7e-12cd-4264-8e71-d91b0ff18ffb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c228d7e-12cd-4264-8e71-d91b0ff18ffb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 160 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: {"server": {"name": "", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "30db1ab3-f4e6-44fc-9e86-51a37d221ee3"}]}} Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'server': {'name': '', 'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3', 'flavorRef': '452', 'networks': [{'uuid': '30db1ab3-f4e6-44fc-9e86-51a37d221ee3'}]}}} Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi '' Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:55:38.383736 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:55:38.389133 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:38.393386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c228d7e-12cd-4264-8e71-d91b0ff18ffb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:38.396400 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c228d7e-12cd-4264-8e71-d91b0ff18ffb tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.033757 Aug 24 03:55:38.407556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:38.408620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:38.415961 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2425/4605] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:38 2022] POST /compute/v2.1/servers => generated 108 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:55:38.430999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.431495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.434184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.437158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.437742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.440984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.668401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:38.683363 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-38c5b5be-5cb5-425c-a0aa-b9239f034178 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.280328 Aug 24 03:55:38.684378 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2181/4606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:38 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:38.705713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:38.706656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:38.711895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:38.713159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:38.714819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:38.720572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.721331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.721953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.722868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.723516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.724192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.734796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.735635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.736241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.737080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.738131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.738674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.965330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:38.978513 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ecd020f4-4237-438d-9e51-2872980be31a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1554 microversion: 2.1 time: 0.272074 Aug 24 03:55:38.993446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2182/4607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:38 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1554 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:39.004122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:39.004625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:39.011107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.011770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.012456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.013235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.013938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.014463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.146462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:39.155384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db8abfdf-9596-4c7f-889c-03b81f479a67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.453890 Aug 24 03:55:39.156294 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2426/4608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:38 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:39.181203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-867557df-ef25-48f2-ad23-e606e44c53ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:39.182019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-867557df-ef25-48f2-ad23-e606e44c53ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 78fb4c9e-ddb7-4beb-b5de-6d7b32830618] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:39.192012 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-867557df-ef25-48f2-ad23-e606e44c53ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 78fb4c9e-ddb7-4beb-b5de-6d7b32830618 could not be found. Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-867557df-ef25-48f2-ad23-e606e44c53ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/78fb4c9e-ddb7-4beb-b5de-6d7b32830618/action HTTP/1.1 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 14 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: {"shelve": {}} Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 78fb4c9e-ddb7-4beb-b5de-6d7b32830618 could not be found. Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '78fb4c9e-ddb7-4beb-b5de-6d7b32830618', 'body': {'shelve': {}}} Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78fb4c9e-ddb7-4beb-b5de-6d7b32830618 could not be found. Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78fb4c9e-ddb7-4beb-b5de-6d7b32830618 could not be found. Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:39.196474 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:39.201035 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:39.201035 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:39.201035 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78fb4c9e-ddb7-4beb-b5de-6d7b32830618 could not be found. Aug 24 03:55:39.201035 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:55:39.202981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-867557df-ef25-48f2-ad23-e606e44c53ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 78fb4c9e-ddb7-4beb-b5de-6d7b32830618 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:39.204605 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-867557df-ef25-48f2-ad23-e606e44c53ce tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/78fb4c9e-ddb7-4beb-b5de-6d7b32830618/action" status: 404 len: 111 microversion: 2.1 time: 0.027935 Aug 24 03:55:39.210096 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2427/4609] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:39 2022] POST /compute/v2.1/servers/78fb4c9e-ddb7-4beb-b5de-6d7b32830618/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:55:39.217508 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3beda057-4d36-4e5b-8673-3d3e21fe9b51 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217217 Aug 24 03:55:39.218793 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2183/4610] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:55:38 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:39.222441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:39.223166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:39.231123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.231773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.232319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.233244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.233798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.234376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.739073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:39.750601 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-afb25b3a-cc8a-453a-b014-62f9f667ec8e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.538714 Aug 24 03:55:39.751946 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2428/4611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:39 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:39.773334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:39.773874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:39.781352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.782264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.783141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.784231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.784933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.786299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.202751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:40.226720 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5e6fff0-78eb-4b02-89e3-7e1b366dc513 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.458226 Aug 24 03:55:40.227521 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2184/4612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:39 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:40.252115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:40.252704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:40.266220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.274625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.276490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.277499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.278285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.278887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.337889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lazy-loading 'flavor' on Instance uuid 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:40.700143 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23630042-62bb-457f-8a62-8ad5895e9123 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.453917 Aug 24 03:55:40.701897 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2429/4613] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:55:40 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:40.713713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:40.717040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:40.726850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.727758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.729420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.730436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.731311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.732964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:41.113094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:41.124214 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3b0b5888-d876-4f5c-8633-f37025a68738 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.417493 Aug 24 03:55:41.126832 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2185/4614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:40 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:41.703749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-23460c54-3ea8-4d47-bc8d-4e9b190fe63b req-aaf46b35-ed5c-45d1-8157-9e39d1be6e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51814e8b-04b9-4f0a-a8eb-9a1ec11813ee", "tag": "4cad4df9-6370-4f75-8184-c66935f131fd"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:41.718106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-23460c54-3ea8-4d47-bc8d-4e9b190fe63b req-aaf46b35-ed5c-45d1-8157-9e39d1be6e80 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:41.719112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-23460c54-3ea8-4d47-bc8d-4e9b190fe63b req-aaf46b35-ed5c-45d1-8157-9e39d1be6e80 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:41.719816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-23460c54-3ea8-4d47-bc8d-4e9b190fe63b req-aaf46b35-ed5c-45d1-8157-9e39d1be6e80 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:41.735645 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-23460c54-3ea8-4d47-bc8d-4e9b190fe63b req-aaf46b35-ed5c-45d1-8157-9e39d1be6e80 service nova] Creating event network-changed:4cad4df9-6370-4f75-8184-c66935f131fd for instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee on n-h1-846470-15 Aug 24 03:55:41.741644 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-23460c54-3ea8-4d47-bc8d-4e9b190fe63b req-aaf46b35-ed5c-45d1-8157-9e39d1be6e80 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042933 Aug 24 03:55:41.742481 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2430/4615] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:41.971731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1977917266", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": "none"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:42.035119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:55:42.035529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:55:42.036052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:55:42.036548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:55:42.036868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:55:42.046702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:42.047513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:42.048164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:42.049095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:42.049718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:42.050307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:42.083817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Getting quotas for project a855dac72e594a6880c130abadcbbfdd. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:42.087382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:42.092378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Getting quotas for user b5600daec3d849559118e2c1b7206939 and project a855dac72e594a6880c130abadcbbfdd. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:42.111174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:55:42.113849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:55:42.148179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:42.149214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:42.156868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:42.157695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:42.158354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:42.159326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:42.159979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:42.160587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:42.185937 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47de82c0-bf41-4e3a-bb01-5fff4e177e5d tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.366153 Aug 24 03:55:42.192047 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2186/4616] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 03:55:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:55:42.199302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd0ec409-106f-41ac-9518-5df0e1dfd9ab tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:42.204242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd0ec409-106f-41ac-9518-5df0e1dfd9ab tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:42.347931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.360777 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fa0d554e-cfb2-4bdd-84c3-bc18e86ddf76 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.216630 Aug 24 03:55:42.377595 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2431/4617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:42 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:42.433874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd0ec409-106f-41ac-9518-5df0e1dfd9ab tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.468389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd0ec409-106f-41ac-9518-5df0e1dfd9ab tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.476130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd0ec409-106f-41ac-9518-5df0e1dfd9ab tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.491850 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd0ec409-106f-41ac-9518-5df0e1dfd9ab tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "PUT /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1359 microversion: 2.75 time: 0.296853 Aug 24 03:55:42.508117 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2187/4618] 10.222.0.58 () {62 vars in 1297 bytes} [Wed Aug 24 03:55:42 2022] PUT /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1359 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:42.518227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c34bedd-1647-46c7-9b6e-2fef9b865276 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:42.519082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2c34bedd-1647-46c7-9b6e-2fef9b865276 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:42.578339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c34bedd-1647-46c7-9b6e-2fef9b865276 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.591802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c34bedd-1647-46c7-9b6e-2fef9b865276 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.594026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c34bedd-1647-46c7-9b6e-2fef9b865276 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:42.606030 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c34bedd-1647-46c7-9b6e-2fef9b865276 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1359 microversion: 2.75 time: 0.092016 Aug 24 03:55:42.618743 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2432/4619] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:42 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1359 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:43.390986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:43.393285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:43.408037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:43.409841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:43.410561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:43.411603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:43.412335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:43.412991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:43.637444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:43.638846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:43.655906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:43.658574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:43.659350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:43.661960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:43.663490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:43.664388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:43.813514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:43.852679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:43.862789 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2f727762-33e5-48fe-9a34-5e78fe0191e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.482085 Aug 24 03:55:43.873106 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2188/4620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:43 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:43.896099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:43.907791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:43.910540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:43.917222 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd9821b1-d718-4457-9e99-2150e3535e61 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1429 microversion: 2.75 time: 0.285621 Aug 24 03:55:43.918410 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2433/4621] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:43 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1429 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:44.886673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:44.888294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:44.901342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:44.902108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:44.902708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:44.903712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:44.904543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:44.906803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:44.948692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:44.950346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:44.962056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:44.963086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:44.963936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:44.965649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:44.966772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:44.967452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:45.113445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:45.123103 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-503ea6ba-a941-49b7-ac27-3115dc6f9291 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.240415 Aug 24 03:55:45.123926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:45.124524 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2189/4622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:44 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:45.148069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:45.155419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:45.163273 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b472a717-d240-4968-9201-031f4a7d46ea tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1417 microversion: 2.75 time: 0.222892 Aug 24 03:55:45.178584 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2434/4623] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:44 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1417 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:46.147577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:46.149086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:46.165883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:46.166388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:46.166830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:46.172539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:46.173207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:46.173673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:46.191121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:46.194807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:46.205395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:46.209065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:46.214419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:46.215506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:46.216236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:46.221401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:46.329477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:46.348191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:46.353424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:46.364597 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-61c87a07-1932-4264-ab53-5a44ddbc0f4c tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1417 microversion: 2.75 time: 0.177312 Aug 24 03:55:46.370549 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2435/4624] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:46 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1417 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:46.644744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:46.669956 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0feac38-9ed5-4e68-9ff3-32a682b44ebf tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.528170 Aug 24 03:55:46.670566 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2190/4625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:46 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:47.399002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:47.400716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:47.423886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:47.426565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:47.427273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:47.433127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:47.434345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:47.440869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:47.575812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:47.596765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:47.601490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:47.614931 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-274b0632-affa-4e64-a113-10d8629ad188 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1417 microversion: 2.75 time: 0.218853 Aug 24 03:55:47.616040 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2436/4626] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:47 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1417 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:47.698435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:47.699168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:47.709513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:47.710316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:47.711452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:47.712538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:47.713179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:47.713784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:48.096035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:48.108000 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8785f09-57b5-4daa-9cd2-6c6bb6dc47dc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.415214 Aug 24 03:55:48.108913 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2191/4627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:47 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:48.639936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:48.640617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:48.649820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:48.650838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:48.653727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:48.659204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:48.660181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:48.661518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:48.860908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:48.873889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:48.875509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:48.893867 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de63e5c2-b501-4d51-8c44-4f17a4fcf940 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1438 microversion: 2.75 time: 0.257621 Aug 24 03:55:48.897471 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2437/4628] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:48 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1438 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:48.924795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:48.930083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:48.945804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:48.947081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:48.947790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:48.950300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:48.951026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:48.951682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:49.055442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:49.080366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:55:49.081230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:55:49.081821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:55:49.082315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:55:49.082890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:55:49.134507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:49.135444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:49.144282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:49.144788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:49.155295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:49.166848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:49.167381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:49.167882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:49.175262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:49.188349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:49.188857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:49.189308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:49.190032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:49.204545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:49.204545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:49.608226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:49.626944 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03857564-017d-464c-9a06-eaf3c7a69fb3 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.495757 Aug 24 03:55:49.628060 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2438/4629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:49 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:49.858460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:49.871295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:49.874530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:49.881971 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b732e5a9-a169-4ca1-ad94-8dad5c479684 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "POST /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f/action" status: 202 len: 1495 microversion: 2.75 time: 0.963135 Aug 24 03:55:49.883327 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2192/4630] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:55:48 2022] POST /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f/action => generated 1495 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 03:55:49.908108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:49.909513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:49.916953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:49.918732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:49.919681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:49.920526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:49.921153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:49.921743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:50.016033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:50.026288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:50.028531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:50.035408 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf6f4f3e-62e7-4ffa-923a-4cc272e94637 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.132454 Aug 24 03:55:50.036091 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2439/4631] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:49 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:50.651284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:50.653020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:50.675225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:50.675894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:50.676410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:50.677221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:50.677886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:50.678511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:51.025246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:51.040618 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d9cc476-e7f2-4cef-b917-7a077bdb6ab7 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.394349 Aug 24 03:55:51.041809 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2193/4632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:50 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:51.061278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:51.063042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:51.070963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:51.071915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:51.072791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:51.073886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:51.074650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:51.075371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:51.195283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:51.213681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:51.215233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:51.221176 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c9e03ef5-863f-4400-b643-7dcc419d642b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.164024 Aug 24 03:55:51.222146 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2440/4633] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:51 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:52.062645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:52.064185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:52.067374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=9 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:52.074969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:52.075754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:52.076987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:52.078200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:52.078938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:52.079779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:52.252393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:52.253035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:52.261293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:52.262190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:52.262862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:52.264020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:52.264722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:52.265214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:52.451458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=32 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:52.585297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:52.673250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:52.685202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:52.687321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:52.693586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9858fe7-c96e-4322-a327-eb2b2639af0f tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.446636 Aug 24 03:55:52.694448 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2441/4634] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:52 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:52.807351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:52.817962 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2259867e-a681-4cf7-ba88-778b94d9a662 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.758942 Aug 24 03:55:52.820587 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2194/4635] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:52 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:53.575382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e57f1e10-68b0-40f7-944b-5c3bd95d20ad tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'create', calling method: .version_select at 0x7f10341e6d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-443643713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdk28DbQR2fc5rpNVmTOGA9TqYepsRHx62X/dbxXElb07ljJOfDgbQkFArnqG2EywUn8YiwyP7AFVj96hp4uNprhm0rjTOfrpzLHJwANzoUh1XGn+kFT1sQlpfbMFKEmw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:53.595559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e57f1e10-68b0-40f7-944b-5c3bd95d20ad tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:53.604330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e57f1e10-68b0-40f7-944b-5c3bd95d20ad tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for user 5c7f4a326b7a4b598ca962847679ac13 and project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:53.632809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e57f1e10-68b0-40f7-944b-5c3bd95d20ad tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.061304 Aug 24 03:55:53.634226 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2442/4636] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:55:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:53.738701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:53.739502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:53.767543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:53.768289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:53.769217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:53.770189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:53.770884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:53.771640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:53.848647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:53.849601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:53.857429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:53.858304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:53.859280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:53.860580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:53.861228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:53.861939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:53.968539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:53.984833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:53.989456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:53.998806 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-54ae40f8-9954-42cf-9df5-63d4dec55fb2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.281109 Aug 24 03:55:54.000475 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2195/4637] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:53 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:54.148050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:54.150690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:54.161426 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4728ef20-8c70-40de-995e-cb6935461387 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.319839 Aug 24 03:55:54.176596 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2443/4638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:53 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:55.025227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:55.026604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:55.034893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:55.035388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:55.036066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:55.036970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:55.037428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:55.037854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:55.182529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:55.183792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:55.191866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:55.192684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:55.193297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:55.194201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:55.194826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:55.195413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:55.494928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:55.508701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:55.526216 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-89fa6e44-e573-4a4a-ab94-a3d86677db53 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.347551 Aug 24 03:55:55.532315 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2444/4639] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:55 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:55.551352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:55.552999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:55.562622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-860dcab0-836f-411a-a2f1-800436f84ca7 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.541167 Aug 24 03:55:55.578141 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2196/4640] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:55 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:56.561238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:56.562589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-721249208", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a182ecdc-2730-4a8e-9b40-fedefe110981"}], "key_name": "tempest-TestNetworkBasicOps-443643713", "security_groups": [{"name": "tempest-secgroup-smoke-1744637199"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:56.564020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:56.583232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:56.586299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:56.586906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:56.590024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:56.590686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:56.591227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:56.822577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:56.830811 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2fe9a01f-9acb-4e2a-86bc-eae3508d0538 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.279078 Aug 24 03:55:56.831405 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2197/4641] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:56 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:56.836399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:56.837015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:56.843045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:56.844192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:56.844952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:56.845686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:56.846780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:56.847222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:56.913290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:56.922048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:56.924244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:56.929346 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-28cb8171-8f50-4f49-9d59-78ae50671782 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.096860 Aug 24 03:55:56.930310 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2198/4642] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:56 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:56.937212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] validate_networks() for [('a182ecdc-2730-4a8e-9b40-fedefe110981', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:55:57.854029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.854543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:57.883698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:57.884490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:57.885233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:57.886019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:57.886511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:57.887096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.108500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:55:58.109358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:55:58.110741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:55:58.111351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:55:58.112601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:55:58.123007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:58.123950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:58.124880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.125757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:58.126374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:58.127102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.146976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:58.152897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for user 5c7f4a326b7a4b598ca962847679ac13 and project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:58.168320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:55:58.170793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:55:58.183502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:58.194819 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-21f9026e-5723-4db4-b852-031c1b32e03e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1533 microversion: 2.1 time: 0.344888 Aug 24 03:55:58.195969 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2199/4643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1533 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:58.202421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:58.203557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:58.213898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:58.214407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:58.214929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.215782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:58.216247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:58.216718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.229042 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-862d9ed1-9228-4fd8-890e-6545adf1798f tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.676486 Aug 24 03:55:58.237182 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2445/4644] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:55:58.243188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f406a82c-83ae-421b-9089-9f19ddbdf199 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:58.243993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f406a82c-83ae-421b-9089-9f19ddbdf199 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:58.340010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f406a82c-83ae-421b-9089-9f19ddbdf199 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:58.352840 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f406a82c-83ae-421b-9089-9f19ddbdf199 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1247 microversion: 2.1 time: 0.114307 Aug 24 03:55:58.355282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2446/4645] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:58 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1247 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:58.411862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:58.426140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:58.427778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:58.443910 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-363e5a3e-2f45-48cd-8624-6d3f1b590a98 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.246493 Aug 24 03:55:58.444721 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2200/4646] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:58 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:59.217863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:59.218911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:59.240554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.241054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.241503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.242240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.242707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.243151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.382148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:59.383463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:59.392524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.393343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.394051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.395006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.395642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.396394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.496579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.506790 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-20bb706f-3fa4-4e55-992b-6cebf4bc7cda tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1243 microversion: 2.1 time: 0.128075 Aug 24 03:55:59.523308 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2201/4647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:59 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1243 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:59.533302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:59.534690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:59.544409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.545631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.546498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.547913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.548702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.549674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.611079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.625274 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-36005b2c-6c42-4b8f-8eda-f400e2a26563 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1533 microversion: 2.1 time: 0.411335 Aug 24 03:55:59.628487 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2447/4648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:59 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1533 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:59.665088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.677000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.678884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.684977 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24d95b25-3d69-49b5-bced-bbe4b576ba46 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.158700 Aug 24 03:55:59.686163 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2202/4649] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:59 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:00.539420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:00.540963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:00.558622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:00.560259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:00.561195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.562941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:00.565310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:00.567016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.654786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:00.655459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:00.664875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:00.672838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:00.673337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:00.673988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.674905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:00.675543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:00.676477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.680764 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cfa1e083-58ec-4022-850d-9d5b39770d73 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1305 microversion: 2.1 time: 0.151596 Aug 24 03:56:00.682196 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2448/4650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:00 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1305 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:00.713443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:00.714475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:00.732573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:00.733401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:00.734242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.735111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:00.736733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:00.737577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.854048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:00.868571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:00.872707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:00.897882 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d5a3f4a-089f-4472-be12-04545c398b22 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.188902 Aug 24 03:56:00.899951 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2449/4651] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:00 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:01.220999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:01.234048 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47d094ab-228c-4d4d-a3df-8cede34f3d67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1533 microversion: 2.1 time: 0.583200 Aug 24 03:56:01.242436 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2203/4652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:00 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1533 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:01.705553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:01.706432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:01.727213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.727745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.728191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.729560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.730604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.731503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.815764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-8e411865-0945-461e-8d38-7221b429d367 req-d3e5e580-d75d-4106-971a-9468367221bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b", "name": "network-vif-plugged", "status": "completed", "tag": "7ecd8efe-e9af-4340-8d71-bf379a496626"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:01.834335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8e411865-0945-461e-8d38-7221b429d367 req-d3e5e580-d75d-4106-971a-9468367221bb service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.835240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8e411865-0945-461e-8d38-7221b429d367 req-d3e5e580-d75d-4106-971a-9468367221bb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.835791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8e411865-0945-461e-8d38-7221b429d367 req-d3e5e580-d75d-4106-971a-9468367221bb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.860078 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-8e411865-0945-461e-8d38-7221b429d367 req-d3e5e580-d75d-4106-971a-9468367221bb service nova] Creating event network-vif-plugged:7ecd8efe-e9af-4340-8d71-bf379a496626 for instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b on n-h2-846470-15 Aug 24 03:56:01.867332 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-8e411865-0945-461e-8d38-7221b429d367 req-d3e5e580-d75d-4106-971a-9468367221bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194889 Aug 24 03:56:01.868844 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2450/4653] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:01.931923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:01.933080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:01.935549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:01.946964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.948218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.948638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.949602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.950054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.950487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:02.039978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:02.051452 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-658ad508-ad14-4b02-9c35-6e8bff9c1455 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1305 microversion: 2.1 time: 0.351725 Aug 24 03:56:02.052826 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2204/4654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:01 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1305 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:02.088967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:02.109439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:02.112981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:02.124666 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0cda1a02-c6b6-4fff-8b5b-cd7cbbd7f4bf tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.197578 Aug 24 03:56:02.139119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2451/4655] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:01 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:02.274628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:02.275287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:02.300069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:02.300900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:02.302559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:02.303417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:02.304087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:02.304642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.027086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:03.048606 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f454ac0c-cea9-4fd8-a8a8-2de388ab53d0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1533 microversion: 2.1 time: 0.765847 Aug 24 03:56:03.063437 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2205/4656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:02 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1533 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:03.091092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:03.093921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:03.112376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:03.113042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:03.113773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.115260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:03.116057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:03.120330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.153266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:03.153907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:03.168555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:03.169319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:03.169794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.170699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:03.171434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:03.172083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.369020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:03.384137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:03.389924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:03.416529 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc96a075-2e62-4405-8688-2241d12be0bc tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.267656 Aug 24 03:56:03.423833 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2206/4657] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:03 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:03.998541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.017379 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74c27cba-4379-4b94-802c-8a49a21e6598 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 0.936631 Aug 24 03:56:04.018273 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2452/4658] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:03 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:04.073647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:04.074262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:04.094664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:04.095464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:04.096021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:04.099848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:04.101256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:04.102585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:04.176690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:04.454477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:04.455132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:04.477803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:04.480944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:04.481674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:04.482614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:04.484745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:04.485410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:04.731467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.742793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.755012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.776761 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d3ac2c30-24c7-4f13-bd77-69563f3f59cd tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.328757 Aug 24 03:56:04.781639 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2453/4659] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:04 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:04.937544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.949610 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3142bcd7-0215-4871-a00f-c53da197b8c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.882955 Aug 24 03:56:04.963709 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2207/4660] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:04 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:05.041753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:05.042608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:05.055618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.056150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.056599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.057327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.057795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.058234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.526704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:05.544525 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b89ed850-1568-4335-b9f9-89312b34234e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 0.504717 Aug 24 03:56:05.550071 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2454/4661] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:05 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:05.631593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cbeac748-29be-4691-89a8-58ab427e5285 req-d85638bf-02f7-48e6-a58d-7b2810f3f555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "563222f3-d1d3-4947-aaf0-b0c4a0873122", "tag": "61edf39c-e448-4a79-9b6f-2bf699376b7f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:05.654386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cbeac748-29be-4691-89a8-58ab427e5285 req-d85638bf-02f7-48e6-a58d-7b2810f3f555 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.655129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cbeac748-29be-4691-89a8-58ab427e5285 req-d85638bf-02f7-48e6-a58d-7b2810f3f555 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.657809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cbeac748-29be-4691-89a8-58ab427e5285 req-d85638bf-02f7-48e6-a58d-7b2810f3f555 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.689909 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cbeac748-29be-4691-89a8-58ab427e5285 req-d85638bf-02f7-48e6-a58d-7b2810f3f555 service nova] Creating event network-changed:61edf39c-e448-4a79-9b6f-2bf699376b7f for instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 on n-h2-846470-15 Aug 24 03:56:05.700283 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cbeac748-29be-4691-89a8-58ab427e5285 req-d85638bf-02f7-48e6-a58d-7b2810f3f555 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198360 Aug 24 03:56:05.702176 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2208/4662] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:05.805315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:05.806318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:05.821386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.822209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.826443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.828106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.830387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.831081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.977948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:05.979147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:06.001224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:06.005330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:06.008591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:06.015068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:06.016469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:06.017261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:06.029203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:06.049052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:06.050691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:06.066769 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8f3b3602-9858-42a5-b7bf-487197e59a14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.266843 Aug 24 03:56:06.067639 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2455/4663] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:05 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:06.570827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:06.571517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:06.584187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:06.593357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:06.594003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:06.594929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:06.599866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:06.600527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:06.789128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:06.808957 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89a6d012-a1b1-42a2-8ef9-9b58147a5f0b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.834221 Aug 24 03:56:06.811781 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2209/4664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:05 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:06.997294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:07.008463 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2dd91681-07d9-48a1-b3e6-99b914e7e1c5 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 0.441686 Aug 24 03:56:07.009166 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2456/4665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:06 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:07.098064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:07.098822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:07.105642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:07.106556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:07.107217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:07.108330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:07.109179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:07.109979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:07.329343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:07.339274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:07.347823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:07.362816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-973c328d-3093-4e0a-aa48-2c48ac79cd66 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.268961 Aug 24 03:56:07.371339 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2210/4666] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:07 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:07.832542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:07.833912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:07.841945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:07.842884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:07.843595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:07.844567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:07.845140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:07.845670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.029968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:08.030716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:08.046840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.047413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.047894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.048655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.049125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.049574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.136359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:08.154410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.169459 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1ba3ab13-48ac-4384-a110-c2cabee829ae tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.341013 Aug 24 03:56:08.191414 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2457/4667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:07 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:08.396420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:08.397211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:08.406557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:08.411182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.414692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.415521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.416523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.419426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.420501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.529592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.548139 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58155940-1ba7-4d5d-90a1-bc5abcd9e731 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 0.519692 Aug 24 03:56:08.551072 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2211/4668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:08 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:08.635778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.650799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.657928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.672218 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-40805055-06e8-4eee-bf85-61eeb09a7783 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.279116 Aug 24 03:56:08.673646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2458/4669] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:08 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:09.199793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:09.200776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:09.221751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.222261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.222729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.223626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.224307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.224739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.569958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:09.570749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:09.581180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.581682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.582137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.583394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.584002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.584442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.609250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.620457 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8a477de-f927-4ddc-b001-a021a3720695 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.425219 Aug 24 03:56:09.622055 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2212/4670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:09 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:09.709415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:09.710015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:09.732616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.736158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.737198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.738152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.738463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.738901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.899522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.906242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.918781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.923398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.932354 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-114e64ee-772e-45ea-926f-faeb31723929 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 0.366428 Aug 24 03:56:09.935250 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2459/4671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:09 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:09.935525 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02e30228-c421-44c7-8ad2-bbe3d8799b14 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.230384 Aug 24 03:56:09.940916 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2213/4672] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:09 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:10.644269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:10.645713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:10.675638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:10.676170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:10.676609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:10.677356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:10.677821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:10.678249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:10.955368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:10.956452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:10.964652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:10.965581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:10.966208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:10.967188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:10.967870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:10.968545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.347843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.366947 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05601d34-3863-45ce-baf9-81de993a89ad tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.727780 Aug 24 03:56:11.371816 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2460/4673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:10 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:11.385369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:11.386635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:11.403300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.404359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.405071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.407378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.409173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.409887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.504808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.537545 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8a8c79a-94b1-477a-9b04-eb9d3d20d2d4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 0.585220 Aug 24 03:56:11.548654 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2214/4674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:10 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:11.576626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.601958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.609928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.633787 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f81c4be2-661f-4c3e-8e1f-119b8809017b tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.260176 Aug 24 03:56:11.634689 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2461/4675] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:11 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:12.397405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:12.398213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:12.416089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:12.429662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.435853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.438715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.443682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.444491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.447612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.560762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:12.561530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:12.578459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.578959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.579399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.580425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.581856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.582496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.829198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:12.832185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:12.841210 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b0c496e-32e9-4f10-ab5d-cc76017b7aa4 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 0.284362 Aug 24 03:56:12.842554 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2462/4676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:12 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:12.848788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:12.849665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:12.859147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.860424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.861360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.862399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.863189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.864227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.917270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:12.928866 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-715a6dbd-f2ce-455a-8235-56c117b3e5fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.536046 Aug 24 03:56:12.929865 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2215/4677] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:12 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:13.108909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:13.122093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:13.124433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:13.141604 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6831777e-bc16-41ff-9970-ca063af5d1ed tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.293938 Aug 24 03:56:13.142639 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2463/4678] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:12 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:13.862847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:13.864653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:13.877948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.878460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.878891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.879605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.884734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.885196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.950405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:13.951008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:13.961929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.962415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.962849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.971948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.972795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.973413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.287852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.300264 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c9605a0f-74bf-43dc-8a9a-a3aa833c1c67 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.353618 Aug 24 03:56:14.301171 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2464/4679] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:13 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:14.329908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-95583850-e541-421f-8700-478ae663980f req-c590212c-719d-4dd4-9e4b-50f0b0494e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563222f3-d1d3-4947-aaf0-b0c4a0873122", "name": "network-vif-plugged", "status": "completed", "tag": "61edf39c-e448-4a79-9b6f-2bf699376b7f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:14.360227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-95583850-e541-421f-8700-478ae663980f req-c590212c-719d-4dd4-9e4b-50f0b0494e2b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.363494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-95583850-e541-421f-8700-478ae663980f req-c590212c-719d-4dd4-9e4b-50f0b0494e2b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.364112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-95583850-e541-421f-8700-478ae663980f req-c590212c-719d-4dd4-9e4b-50f0b0494e2b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.393333 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-95583850-e541-421f-8700-478ae663980f req-c590212c-719d-4dd4-9e4b-50f0b0494e2b service nova] Creating event network-vif-plugged:61edf39c-e448-4a79-9b6f-2bf699376b7f for instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 on n-h2-846470-15 Aug 24 03:56:14.415151 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-95583850-e541-421f-8700-478ae663980f req-c590212c-719d-4dd4-9e4b-50f0b0494e2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092514 Aug 24 03:56:14.416277 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2465/4680] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:14.424988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:14.428444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:14.448850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.449534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.450071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.452154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.453378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.454939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.632867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.645100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.660834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.688536 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-006120df-22df-4f97-a6f2-0ab4d5e874d5 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.268959 Aug 24 03:56:14.698829 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2466/4681] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:14 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:14.909607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.920870 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0867c313-6a93-4faf-95a3-5bfb79dfec0b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 1.062139 Aug 24 03:56:14.921972 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2216/4682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:13 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:15.323513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:15.324375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:15.336822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.339276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.340939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.342135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.342727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.343256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.729489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:15.730278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:15.743293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.744810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.748350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.752317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.756772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.764198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.001372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.014539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.019271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.024420 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55edd2bb-82e9-4a4a-871e-91a05c07d62c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.705606 Aug 24 03:56:16.029108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.038277 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2467/4683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:15 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:16.051895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:16.057862 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2b1c422-69c5-41bd-95dc-a103bf97a182 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.332834 Aug 24 03:56:16.058025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:16.067847 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2217/4684] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:15 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:16.080064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.080571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.081018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.081743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.082203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.082630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.552271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.570720 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ce8d13d-15f1-4659-8a22-07974755b5d1 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1373 microversion: 2.1 time: 0.525344 Aug 24 03:56:16.574862 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2468/4685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:16 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1373 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:17.058249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:17.058841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:17.074008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.074514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.074953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.075719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.081716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.082171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.094970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:17.095591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:17.102837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.118637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.119291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.120145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.120627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.121133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.369561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.378917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.387210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.399155 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3cf54b2c-81c5-4e59-ad36-82935b6d2578 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.308382 Aug 24 03:56:17.400035 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2469/4686] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:17 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:17.554339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.563962 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19913339-575e-4f3e-b902-a2f5c4e95200 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.509966 Aug 24 03:56:17.568453 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2218/4687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:17 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:17.597628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:17.599770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:17.622795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.628858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.630209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.633134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.636493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.637253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.010857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.021718 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bbc99cdb-be33-4be4-9b92-4047f4a2760d tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1545 microversion: 2.1 time: 0.429724 Aug 24 03:56:18.025677 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2470/4688] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:17 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1545 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:18.060122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.063343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:18.090707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.095741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.096446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.098178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.100305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.102151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.424433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.425359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:18.434619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.445346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.446238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.447210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.447934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.448614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.577131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.599859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.609374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.626510 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0e1a81b-2d6c-4a06-b632-8ac5207625f8 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.206050 Aug 24 03:56:18.628260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2471/4689] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:18 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:18.636982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.643629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:18.655496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.656541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.657252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.658193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.660973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.661676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.695703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.710528 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-335c3f07-613e-42b7-bc35-51ea8be22846 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1545 microversion: 2.1 time: 0.659390 Aug 24 03:56:18.726967 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2219/4690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:18 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1545 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:19.097841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:19.116156 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c199a864-59a1-411f-83d5-5f7ae87270ba tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.482808 Aug 24 03:56:19.120230 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2472/4691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:18 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:19.658512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:19.659377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:19.679119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.692310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.697603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.702727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.708893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.711596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.111604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:20.130755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:20.138241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:20.143885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:20.146251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:20.157457 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c29060b4-9634-428a-a9e2-02fa4907a2fb tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1447 microversion: 2.75 time: 0.504032 Aug 24 03:56:20.162338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.163102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.164335 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2220/4692] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:19 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1447 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:20.172156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.173736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.174229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.174672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.198672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:21.200332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:21.209441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.214439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.263587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.264993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.267334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.272141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.488267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.497350 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9e012fd8-07cd-4018-aa8a-e8ff0348f391 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 1.358859 Aug 24 03:56:21.512173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.518443 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2473/4693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:20 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:21.542690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.550085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.565602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7213fb6d-2e32-4469-a210-a9fc0df6c544 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1453 microversion: 2.75 time: 0.376189 Aug 24 03:56:21.585006 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2221/4694] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:21 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1453 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:22.536558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:22.537653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:22.554645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.557720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.558252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.559133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.563549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.564253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.596320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:22.597626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:22.622849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.627304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.629221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.632857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.639097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.639801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.005188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.030814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.052561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.098886 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0daf4a43-d077-4c15-b6ed-787bfd5f6480 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1453 microversion: 2.75 time: 0.505949 Aug 24 03:56:23.123956 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2222/4695] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:22 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1453 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:23.347076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.395315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2de1e3ba-7a45-4be5-b8bb-48c0b0f15d36 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.863358 Aug 24 03:56:23.404322 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2474/4696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:22 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:24.130110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:24.143452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.159235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.167957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.169592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.170646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.171433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.172113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.429827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:24.431204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.450789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.454205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.454855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.456027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.458553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.459219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.504973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.522853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.529344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.546695 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0b078f1-9521-43d6-862d-e4ed7faeea05 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1453 microversion: 2.75 time: 0.424514 Aug 24 03:56:24.585843 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2223/4697] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:24 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1453 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:25.085227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.102812 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9c416a7-aa5b-4ee9-98ef-7606e9d37b98 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.685583 Aug 24 03:56:25.132522 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2475/4698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:24 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:25.575486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:25.576791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:25.599879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.603380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.604102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.605112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.607035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.607654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.652112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:25.790545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.800236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.816411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.840913 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-39121eec-d4e5-4422-86ba-c4fe6b66c59e tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1453 microversion: 2.75 time: 0.269305 Aug 24 03:56:25.854173 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2224/4699] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:25 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1453 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:26.156439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:26.157876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:26.170086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.178737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.179736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.180792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.183410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.184218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.478257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:26.489044 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-245b872e-df00-47a6-845d-21f8db3474c0 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.336704 Aug 24 03:56:26.496838 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2476/4700] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:26 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:26.880239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:26.881378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:26.900135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.901500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.902535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.907571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.908955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.909676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.097900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.106960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.119196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.137454 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37fb7cfc-d1d1-4052-86d2-a021343cb2a2 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1438 microversion: 2.75 time: 0.262766 Aug 24 03:56:27.169826 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2225/4701] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:26 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1438 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:27.268828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:27.272065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:27.295245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.308307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.309227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.310562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.311205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.312938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.457129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:56:27.461984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:56:27.462579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:56:27.463066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:56:27.464212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:56:27.517480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:27.518107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:27.538656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.538656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.539378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.553255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.553786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.562047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.686236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:27.721008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.721684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.722810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.726009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.727114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.727990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.049420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:28.072728 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d50e413d-5944-4712-adde-a17549806284 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1528 microversion: 2.1 time: 0.561363 Aug 24 03:56:28.077145 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2226/4702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:27 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:28.624287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:28.633927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:28.690036 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0ffafb35-adec-4b9a-b4ca-82937a14952c tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f/action" status: 202 len: 1944 microversion: 2.75 time: 1.520248 Aug 24 03:56:28.730253 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2477/4703] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:56:27 2022] POST /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f/action => generated 1944 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 24 03:56:28.761676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:28.762729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:28.776666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.781004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.782474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.789681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.791418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.792640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.099137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:29.099838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:29.106905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.107400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.108087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.108896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.109352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.109956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.284340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:29.292966 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c0bd37c-bcd5-431f-8e30-ae4f16c1596e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1510 microversion: 2.1 time: 0.198151 Aug 24 03:56:29.304053 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2478/4704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:29 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:29.361594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:29.383386 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff255e04-68c6-46bc-9050-bbcbbb31f5c9 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.625981 Aug 24 03:56:29.396558 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2227/4705] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:28 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:30.314696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:30.315347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:30.322886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.323366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.324055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.324951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.325401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.325818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.410289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:30.411117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:30.420208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.420208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.421247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.422141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.422719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.423428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.548881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:30.579250 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6072fe3-e1ea-42cb-9dd0-748fd132d3f5 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.172886 Aug 24 03:56:30.580698 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2228/4706] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:30 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:30.589225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:30.603802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ddfd7775-7150-4e0e-a5c7-faef8cd2de8b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1510 microversion: 2.1 time: 0.293066 Aug 24 03:56:30.604686 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2479/4707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:30 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:31.609381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:31.610159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:31.619974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:31.619974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:31.619974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:31.629637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:31.630470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:31.631588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:31.632474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:31.635096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:31.645691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:31.647598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:31.648280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:31.650445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:31.651260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:31.654441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:31.792715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:31.831402 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e057530b-ea63-486e-84a6-0a6bdf45abcd tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.226227 Aug 24 03:56:31.848604 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2229/4708] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:31 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:32.029668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:32.041615 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a7cabcf-36a7-4918-9f5c-91e54809c622 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1510 microversion: 2.1 time: 0.415547 Aug 24 03:56:32.056425 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2480/4709] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:31 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1510 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:32.860327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:32.862056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:32.870257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:32.870894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:32.872363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:32.873293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:32.873831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:32.874455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.009181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:33.031328 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e414b0c-665b-4f92-b548-fc9ba7a4b8f1 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.176677 Aug 24 03:56:33.031963 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2230/4710] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:32 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:33.066109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:33.067616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:33.070809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=84 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:33.089391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.090393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.091025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.092295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.093192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.093871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.151676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-53956018-df73-4c4a-ba75-68d0f3025622 req-6f574e6a-3113-40c2-aede-bd2876ff3b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b", "name": "network-vif-unplugged", "status": "completed", "tag": "7ecd8efe-e9af-4340-8d71-bf379a496626"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:33.165881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-53956018-df73-4c4a-ba75-68d0f3025622 req-6f574e6a-3113-40c2-aede-bd2876ff3b4d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.166005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-53956018-df73-4c4a-ba75-68d0f3025622 req-6f574e6a-3113-40c2-aede-bd2876ff3b4d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.166401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-53956018-df73-4c4a-ba75-68d0f3025622 req-6f574e6a-3113-40c2-aede-bd2876ff3b4d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.178520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.server_external_events [req-53956018-df73-4c4a-ba75-68d0f3025622 req-6f574e6a-3113-40c2-aede-bd2876ff3b4d service nova] Unable to find a host for instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b. Dropping event network-vif-unplugged {{(pid=122535) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:56:33.179753 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-53956018-df73-4c4a-ba75-68d0f3025622 req-6f574e6a-3113-40c2-aede-bd2876ff3b4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033370 Aug 24 03:56:33.180717 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2231/4711] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 03:56:33.754502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:33.771952 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3cd8200-2ecd-4b9c-9ed1-b808b44919fa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1453 microversion: 2.1 time: 0.709697 Aug 24 03:56:33.772939 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2481/4712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:33 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1453 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:33.795028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:33.795649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:33.803221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.803729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.804211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.804923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.805376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.805866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.059794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:34.061052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:34.069142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.070461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.071141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.072099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.072773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.073413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.167116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:34.181863 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a37c8e25-3d1f-4978-94fb-1306882839fe tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1453 microversion: 2.1 time: 0.390902 Aug 24 03:56:34.189012 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2232/4713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:33 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1453 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:34.290290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:34.290839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:34.301568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.303178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.303894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.306419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.307264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.307995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.329692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:34.371169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lazy-loading 'flavor' on Instance uuid 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:34.383205 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7612aa2-9c5d-4357-af3c-62b99428bc63 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.327847 Aug 24 03:56:34.384114 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2482/4714] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:34 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:34.411909 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Cannot 'shelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state shelved_offloaded Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action HTTP/1.1 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 14 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: {"shelve": {}} Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot 'shelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state shelved_offloaded Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'shelve': {}}} Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:56:34.414146 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state shelved_offloaded Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state shelved_offloaded Aug 24 03:56:34.418668 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:56:34.421063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 409 to user: Cannot 'shelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state shelved_offloaded {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:34.422218 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bedfc3bd-1f35-4a15-978e-f486b474402c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 409 len: 155 microversion: 2.1 time: 0.138513 Aug 24 03:56:34.423484 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2233/4715] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:56:34 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 155 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:56:34.438707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:34.438941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:34.455384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.456569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.459711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.470838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.471572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.472060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.538652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122536) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:56:34.667707 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-714df3a9-d96f-4d8f-bec0-bd14ef1aac60 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.238600 Aug 24 03:56:34.677005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:34.677417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:34.683429 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2483/4716] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:56:34 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:56:34.688114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.688713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.690553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.692131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.692613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.693043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.163214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:35.183018 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81f08a45-d851-401f-ae34-5a86f94bc48d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1461 microversion: 2.1 time: 0.507764 Aug 24 03:56:35.183617 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2234/4717] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:34 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1461 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:35.412947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:35.414212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:35.429512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.431241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.431898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.432646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.437276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.452536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.636848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:35.710247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42d81cbf-3ce1-4602-a511-0ad2ebee6615 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.291979 Aug 24 03:56:35.732058 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2484/4718] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:35 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:36.212278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:36.212950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:36.237080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.237588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.238781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.243371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.243915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.244372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.558611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:36.570123 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04505502-3476-455d-b1ca-d9c5c8a9f998 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1461 microversion: 2.1 time: 0.367487 Aug 24 03:56:36.571404 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2235/4719] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:36 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1461 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:36.741086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:36.742372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:36.765913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.770090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.772917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.774410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:36.776240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:36.777025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.969390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:37.010790 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5534fb0e-3a62-411a-83a3-01de7fbaf619 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.273380 Aug 24 03:56:37.012137 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2485/4720] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:36 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:37.602704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:37.604138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:37.621188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.621688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.622128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.622845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.624220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.624958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.040326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:38.041251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:38.056826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.057565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.058097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.058925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.059494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.060263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.071453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:38.087816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0caf909f-e4d4-4e64-9eb9-fe5d54c9cc4b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.494845 Aug 24 03:56:38.094443 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2236/4721] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:37 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:38.207788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:38.263954 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db1b15f9-1fd5-40bc-964f-894e01f30562 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.230169 Aug 24 03:56:38.265090 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2486/4722] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:38 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:39.132565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:39.133850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:39.148026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.148530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.149003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.149674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.150135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.150564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.298367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:39.299162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:39.312500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.314676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.315202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.316492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.316980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.318655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.653813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.669069 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9e094564-4b5f-4aa3-9004-c0c548ad54e4 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.540685 Aug 24 03:56:39.672792 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2237/4723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:39 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:39.689821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:39.745178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1a3563eb-6fdc-4d6a-8136-98be260d0ac3 req-d7cb232e-540e-4870-b765-631e4c637784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b", "tag": "7ecd8efe-e9af-4340-8d71-bf379a496626"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:39.755934 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1d81780-289f-4096-8ff6-6779be328dec tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.464245 Aug 24 03:56:39.777862 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2487/4724] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:39 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:39.781993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1a3563eb-6fdc-4d6a-8136-98be260d0ac3 req-d7cb232e-540e-4870-b765-631e4c637784 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.785296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1a3563eb-6fdc-4d6a-8136-98be260d0ac3 req-d7cb232e-540e-4870-b765-631e4c637784 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.786299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1a3563eb-6fdc-4d6a-8136-98be260d0ac3 req-d7cb232e-540e-4870-b765-631e4c637784 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.802942 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1a3563eb-6fdc-4d6a-8136-98be260d0ac3 req-d7cb232e-540e-4870-b765-631e4c637784 service nova] Creating event network-changed:7ecd8efe-e9af-4340-8d71-bf379a496626 for instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b on n-h1-846470-15 Aug 24 03:56:39.825261 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1a3563eb-6fdc-4d6a-8136-98be260d0ac3 req-d7cb232e-540e-4870-b765-631e4c637784 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082100 Aug 24 03:56:39.829119 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2238/4725] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:40.701026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:40.703865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:40.722158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.722822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.723380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.728191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.732011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.732923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.787236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:40.789952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:40.833592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.838587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.839898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.842256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.843690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.844345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.989528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:41.049890 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11c20dfd-9b46-47fd-8b6e-ffab74418d78 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.269333 Aug 24 03:56:41.060139 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2239/4726] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:40 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:41.711995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:41.725043 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5beec9e1-6e0c-4e8c-94da-a33f5a8ae654 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 1.031507 Aug 24 03:56:41.725594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2488/4727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:40 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:42.077735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:42.078941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:42.093879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.094367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.094807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.095534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.096023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.096451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.567542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:42.585625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:42.641039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=76 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:42.647580 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9859df80-c515-4cd4-8f1a-b8d9970e22d3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.573994 Aug 24 03:56:42.649532 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2240/4728] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:42 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:42.753040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:42.759516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:42.788623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.789128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.789575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.792487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.794701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.796686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.677906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:43.678521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:43.706205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.708171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.708688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.710759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.712926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.715356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.894175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:43.946747 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6839f66-5402-419e-883c-19403aac27bf tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.274706 Aug 24 03:56:43.962018 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2241/4729] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:43 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:44.231410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:44.261738 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-160b6fef-e690-41e1-9131-e5fee4ebf98d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 1.513725 Aug 24 03:56:44.262341 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2489/4730] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:42 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:44.977849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:44.978675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:44.996198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.016989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.017577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.023616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.025931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.028086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.288677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:45.290041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:45.300837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.317639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.318579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.319612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.347544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.348573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.786890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:45.844034 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cbbf4adb-5dcf-451c-92d5-d54cc5ca1762 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.869899 Aug 24 03:56:45.865156 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2242/4731] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:44 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:46.013643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:46.023489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e39168ed-bd2d-4e3e-82be-1653cc4e2444 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.739553 Aug 24 03:56:46.045090 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2490/4732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:45 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:46.877468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:46.878746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:46.894640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:46.895724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:46.896166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:46.898628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:46.900172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:46.900616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:47.054043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:47.055456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:47.080777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:47.081534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:47.084426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:47.085928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:47.086894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:47.088179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:47.115623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:47.999022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:48.034516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.046604 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b33a1894-148b-465c-beab-7a335d8b4439 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 1.174437 Aug 24 03:56:48.048985 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2243/4733] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:46 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:48.093499 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72b1de68-006b-4949-9a03-71444cd0624a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 1.005265 Aug 24 03:56:48.111178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2491/4734] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:47 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:49.089864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:49.091346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:49.102586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.104194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.121303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:49.123766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:49.125576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.134446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.135314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.135963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.140599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.141158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.141644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.142694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.144813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.145536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.360069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:49.407853 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3cf72ebc-a619-4f03-b9f9-490be7707756 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.323560 Aug 24 03:56:49.413090 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2244/4735] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:49 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:49.558051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.575725 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e7cd257-e06d-4bf7-a6d3-fbb1f2ae9cc6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.459196 Aug 24 03:56:49.581930 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2492/4736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:49 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:50.438762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:50.440024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:50.468284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.469605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.470799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.472536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.473357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.474784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.602783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:50.604128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:50.609583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:50.631108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.631638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.640618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.641406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.641887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.645474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.652983 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a8d8491-2569-4581-ac33-d349dc5bc354 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.219615 Aug 24 03:56:50.654237 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2245/4737] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:50 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:51.565215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:51.602420 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8ce4bbed-0dd7-4eb1-a704-0926f9a2de50 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 1.002082 Aug 24 03:56:51.622373 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2493/4738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:50 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:51.683094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:51.688865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:51.709391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.710212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.710831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.712078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.712740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.721004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.998350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:52.082136 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-00ef02d6-88fa-4290-8d92-8a51a83059e7 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.405139 Aug 24 03:56:52.104285 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2246/4739] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:51 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:52.635859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:52.637191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:52.656229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:52.658156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:52.660646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:52.663069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:52.665231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:52.668672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.130888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:53.131456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:53.131578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:53.154559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.155405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.156047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.156942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.157569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.158198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.166045 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e2e01564-060c-430b-aaf3-678e5a6a92a5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.535502 Aug 24 03:56:53.186531 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2494/4740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:52 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:53.485529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:53.535482 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b75b0fd0-05ba-4512-9c8c-5c8b65fd53f3 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.408392 Aug 24 03:56:53.556753 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2247/4741] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:53 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:54.198180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:54.198864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:54.208488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.208986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.209604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.210522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.210969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.212034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.493872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:54.504489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d125338-c270-4203-860f-c69fb5cf088c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.316605 Aug 24 03:56:54.522412 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2495/4742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:54 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:54.564845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:54.565424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:54.572967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.573793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.574434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.575338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.576900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.577744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.695083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:54.723345 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb478060-e698-4444-915a-729c249d668f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.162590 Aug 24 03:56:54.736607 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2248/4743] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:54 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:55.530032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:55.530826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:55.545255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:55.546137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:55.546874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:55.547833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:55.548479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:55.549095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:55.750678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:55.751290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:55.772091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:55.772091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:55.772447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:55.778799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:55.779446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:55.780099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:55.847508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:55.858846 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d71f0c94-acb5-4397-bd06-5b5b73adaed6 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.332826 Aug 24 03:56:55.860771 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2496/4744] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:55 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:55.900132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:55.924871 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-33086428-5a3d-498e-afb8-3a98930088bb tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.178156 Aug 24 03:56:55.925784 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2249/4745] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:55 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:56.885123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:56.887090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:56.896716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:56.897516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:56.898150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:56.899036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:56.900375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:56.900997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:56.952631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:56.953203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:56.960132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:56.961892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:56.962679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:56.963595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:56.964245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:56.964842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:57.146220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:57.156872 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e5887f88-f78b-4ecf-8e14-32d1dae27184 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.275566 Aug 24 03:56:57.158038 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2497/4746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:56 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:57.467512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:57.496502 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8580612f-07ec-4be8-95d0-83c1e7376434 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.548354 Aug 24 03:56:57.514944 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2250/4747] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:56 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:58.178737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:58.179548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:58.198700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.199277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.199763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.200939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.201955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.202438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.524487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:58.525743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:58.533108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.533804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.534441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.535131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.535779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.536371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.605704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:58.615479 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c2f47b78-eb56-4d9e-b6c6-d1af3ef3692f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.440879 Aug 24 03:56:58.631357 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2498/4748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:58 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:58.678385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:58.727180 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91c22aa8-182f-4b2d-b5f0-8f0e1f2ce8a4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.206427 Aug 24 03:56:58.749069 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2251/4749] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:58 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:59.638467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:59.639916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:59.650442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:59.651259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:59.651935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:59.652897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:59.653562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:59.654160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:59.759934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:59.762323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:59.777326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:59.780787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:59.781719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:59.785284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:59.786674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:59.790732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:59.913900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:59.934147 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-884bbeb4-3abe-4fb7-aa26-9bd5923abe75 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.299614 Aug 24 03:56:59.936298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:56:59.936878 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2499/4750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:59 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:59.975984 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cfdda02d-8a24-467f-b879-797088e49a4d tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1931 microversion: 2.75 time: 0.222887 Aug 24 03:56:59.985643 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2252/4751] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:59 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1931 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:00.965561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:00.974825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:00.992344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:00.993197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:00.993863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:00.995444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:00.996634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:00.997265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:01.009509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:01.010128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:01.020030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:01.020522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:01.020962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:01.021665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:01.032502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:01.033289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:01.039055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:01.526745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:01.546562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:01.558145 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ebafc74-36e6-4e39-8109-ea38e15954e5 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.603299 Aug 24 03:57:01.558747 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2500/4752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:00 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:01.566159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:01.574062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:01.578539 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af099795-23d6-4e7e-b1f5-7e725d7d4dc4 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1937 microversion: 2.75 time: 0.572789 Aug 24 03:57:01.597396 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2253/4753] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:01 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1937 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:01.602235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:01.606609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:01.607074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:01.609404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:01.609975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:01.610425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:01.652341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:01.782391 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66891490-6408-46d9-95bd-8a12b850ec7b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "DELETE /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 204 len: 0 microversion: 2.1 time: 0.220383 Aug 24 03:57:01.784677 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2501/4754] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:01 2022] DELETE /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:01.797410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:01.798916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:01.809578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:01.810717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:01.811844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:01.820877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:01.822917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:01.826929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.199888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:02.215443 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b3d4afb5-f5b2-4766-bf4b-f815f9bba773 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1551 microversion: 2.1 time: 0.424772 Aug 24 03:57:02.230743 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2254/4755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:01 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1551 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:02.583570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:02.584822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:02.595078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:02.595987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:02.596738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.598039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:02.599023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:02.599605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.617996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:02.623592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:02.636570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:02.637932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:02.639443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.641187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:02.642218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:02.643214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.750631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:02.783456 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-179e5bbd-308a-4cba-ae70-111492660a33 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1937 microversion: 2.75 time: 0.174021 Aug 24 03:57:02.785048 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2255/4756] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:02 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1937 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:02.896808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:02.910302 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b29a1e41-12c0-4197-883d-e88024fe1b88 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.332040 Aug 24 03:57:02.911364 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2502/4757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:02 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:03.240842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.241781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.258557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.261857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.262680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.266106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.268082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.268874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.811974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.812751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.816865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:03.854767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.855634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.862529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.868407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.869732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.872442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.891549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:03.919511 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7e9dfe68-7038-4d7f-af7f-02a0d831d7a0 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1551 microversion: 2.1 time: 0.684118 Aug 24 03:57:03.920739 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2256/4758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:03 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1551 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:03.939253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.940011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.955944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.971055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.972222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.973506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.974360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.975107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:04.147102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:04.199572 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e36676c-e418-4a04-aacf-a43cd34d6f97 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1937 microversion: 2.75 time: 0.392222 Aug 24 03:57:04.201325 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2503/4759] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:03 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1937 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:04.439830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:04.472302 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a68fd1a2-cdb5-41c0-aa2e-9aa88ff5800a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.537266 Aug 24 03:57:04.484873 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2257/4760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:03 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:04.960925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:04.963520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:04.985993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:04.986802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:04.987410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:04.988356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:04.989328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:04.990334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:05.234693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:05.235326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:05.242496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:05.243007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:05.243590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:05.244339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:05.244802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:05.245233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:05.372906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:05.396822 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a3fca2b3-489a-4ae4-9ade-bf466207f29f tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1937 microversion: 2.75 time: 0.166167 Aug 24 03:57:05.397649 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2258/4761] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:05 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1937 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:05.527137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:05.528136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:05.540006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:05.543826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:05.544674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:05.545900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:05.546693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:05.547454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:05.609541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:05.620184 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e774d2f3-005a-4567-9113-e3b5edb842b8 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1551 microversion: 2.1 time: 0.669403 Aug 24 03:57:05.635704 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2504/4762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:04 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1551 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:05.883160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-51b56b42-0eb4-40b5-b7d2-8386b37ca6e7 req-b7828471-ba2d-403f-a88c-2db7197d3297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b", "name": "network-vif-plugged", "status": "completed", "tag": "7ecd8efe-e9af-4340-8d71-bf379a496626"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:05.903934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-51b56b42-0eb4-40b5-b7d2-8386b37ca6e7 req-b7828471-ba2d-403f-a88c-2db7197d3297 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:05.904554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-51b56b42-0eb4-40b5-b7d2-8386b37ca6e7 req-b7828471-ba2d-403f-a88c-2db7197d3297 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:05.905429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-51b56b42-0eb4-40b5-b7d2-8386b37ca6e7 req-b7828471-ba2d-403f-a88c-2db7197d3297 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:05.933785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-51b56b42-0eb4-40b5-b7d2-8386b37ca6e7 req-b7828471-ba2d-403f-a88c-2db7197d3297 service nova] Creating event network-vif-plugged:7ecd8efe-e9af-4340-8d71-bf379a496626 for instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b on n-h1-846470-15 Aug 24 03:57:05.943382 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-51b56b42-0eb4-40b5-b7d2-8386b37ca6e7 req-b7828471-ba2d-403f-a88c-2db7197d3297 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064416 Aug 24 03:57:05.947894 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2505/4763] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:57:06.183786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:06.193560 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3df88160-21c6-4eea-94dc-0ce6764080fc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.672554 Aug 24 03:57:06.197128 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2259/4764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:05 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:06.385752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:06.387004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:06.405546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:06.407146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:06.409550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:06.413360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:06.414615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:06.416838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:06.439432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:06.442467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:06.475176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:06.476827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:06.484694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:06.487688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:06.492948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:06.494026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:06.549646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15a1b213-5d36-4a0f-be7f-6d28954d0872 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/ips" status: 200 len: 150 microversion: 2.20 time: 0.170391 Aug 24 03:57:06.556730 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2506/4765] 10.222.0.58 () {60 vars in 1289 bytes} [Wed Aug 24 03:57:06 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/ips => generated 150 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:57:06.665231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:06.665734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:06.681814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:06.682322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:06.682761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:06.683496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:06.688719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:06.689444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:06.761283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:06.863068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] Lazy-loading 'services' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:06.914793 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04ce4810-faa0-4d3b-a58c-0ff7eba74815 tempest-ServersAdmin275Test-1283126925 tempest-ServersAdmin275Test-1283126925-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1922 microversion: 2.75 time: 0.481032 Aug 24 03:57:06.917363 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2260/4766] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:06 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1922 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:06.963177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:06.964103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:06.974124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:06.975089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:06.975808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:06.976900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:06.979257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:06.980300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:07.071500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:07.318324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:07.329999 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3819d23-7d4b-4777-bbbd-637da3bcd2dc tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 200 len: 1551 microversion: 2.1 time: 0.670537 Aug 24 03:57:07.333010 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2507/4767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:06 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 1551 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:07.348233 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff7db241-d250-4502-bc86-a54ebb647703 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "DELETE /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 204 len: 0 microversion: 2.75 time: 0.381850 Aug 24 03:57:07.348233 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2261/4768] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 03:57:06 2022] DELETE /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:57:07.348233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:07.349513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:07.359592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:07.360162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:07.360868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:07.361869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:07.362538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:07.363094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:07.366296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a9c6eb47-1193-4f1e-a1bc-3c3c1e4d50d9 req-59c33236-0e0f-4eb5-8e8a-186badaa7d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563222f3-d1d3-4947-aaf0-b0c4a0873122", "name": "network-vif-deleted", "tag": "61edf39c-e448-4a79-9b6f-2bf699376b7f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:07.415729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a9c6eb47-1193-4f1e-a1bc-3c3c1e4d50d9 req-59c33236-0e0f-4eb5-8e8a-186badaa7d86 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:07.416379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a9c6eb47-1193-4f1e-a1bc-3c3c1e4d50d9 req-59c33236-0e0f-4eb5-8e8a-186badaa7d86 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:07.416761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a9c6eb47-1193-4f1e-a1bc-3c3c1e4d50d9 req-59c33236-0e0f-4eb5-8e8a-186badaa7d86 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:07.453905 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a9c6eb47-1193-4f1e-a1bc-3c3c1e4d50d9 req-59c33236-0e0f-4eb5-8e8a-186badaa7d86 service nova] Creating event network-vif-deleted:61edf39c-e448-4a79-9b6f-2bf699376b7f for instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 on n-h2-846470-15 Aug 24 03:57:07.460882 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a9c6eb47-1193-4f1e-a1bc-3c3c1e4d50d9 req-59c33236-0e0f-4eb5-8e8a-186badaa7d86 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125444 Aug 24 03:57:07.462470 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2508/4769] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:07.468496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:07.469528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:07.477350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:07.478324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:07.478992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:07.480514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:07.486816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:07.487806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:07.664191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:07.687311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:07.690869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:07.699844 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72bf0bc7-8ac2-47d1-b1a4-065e12908434 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1444 microversion: 2.75 time: 0.235716 Aug 24 03:57:07.701230 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2509/4770] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:07 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1444 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:07.720024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:07.743265 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-356a89a7-a8bc-4489-b5bb-534ed102608b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.401178 Aug 24 03:57:07.745177 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2262/4771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:07 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:08.365473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:08.366212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 563222f3-d1d3-4947-aaf0-b0c4a0873122] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:08.379051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.380128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.380856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.381884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.382783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.383950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.410335 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] HTTP exception thrown: Instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 could not be found. Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Request method failure captured: Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 HTTP/1.1 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDGwk5VnkVx-wp3f1b44KZqYk6Q1Nkv2qgRW586DvlJ7Uyh4uyO4i9zi7BR6NFtFQ0Sht9aPAEM4UP8DeolxPn-X_fpeJtW8O3GDLrU8c6aPawSUy8NALuTD_bdlCyTHtJgsMvhnbDr_eHe_QbyDsYABlE6HjBIFohUzJZs0PUUb-0 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 3d1641d4e3764347a4ad4c91c0ee21ee Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestNetworkBasicOps-1145880211 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestNetworkBasicOps-1145880211 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 3d1641d4e3764347a4ad4c91c0ee21ee Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestNetworkBasicOps-1145880211 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestNetworkBasicOps-1145880211-project Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5c7f4a326b7a4b598ca962847679ac13 Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestNetworkBasicOps-1145880211-project Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 could not be found. Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '563222f3-d1d3-4947-aaf0-b0c4a0873122'} Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 could not be found. Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 could not be found. Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:08.416259 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 could not be found. Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Returning 404 to user: Instance 563222f3-d1d3-4947-aaf0-b0c4a0873122 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-328faa06-3d5d-4b50-8743-6d984d62ed07 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122" status: 404 len: 111 microversion: 2.1 time: 0.069045 Aug 24 03:57:08.428150 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2510/4772] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:08 2022] GET /compute/v2.1/servers/563222f3-d1d3-4947-aaf0-b0c4a0873122 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:08.662993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ca90aaf-ca36-4d9a-a387-2e178d794f48 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '.version_select at 0x7f1029e3ce50>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:08.718783 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ca90aaf-ca36-4d9a-a387-2e178d794f48 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-443643713" status: 202 len: 0 microversion: 2.1 time: 0.063440 Aug 24 03:57:08.719930 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2263/4773] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 24 03:57:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-443643713 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:08.742603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:08.743829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:08.756232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.756947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.757551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.758463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.759088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.759776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.767207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:08.769234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:08.782164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.782965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.783623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.784659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.785147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.785812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.932247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:08.949391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:08.951330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:08.957374 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fde00b74-7a2a-409f-b835-f3259d1dc409 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1444 microversion: 2.75 time: 0.218572 Aug 24 03:57:08.958596 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2511/4774] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:08 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1444 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:08.974451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:08.975292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:08.988919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.989418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.989850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.990565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.991014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.991435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:09.027090 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05fc84f6-9baf-4411-a597-88866e65f029 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/ips" status: 200 len: 149 microversion: 2.1 time: 0.067033 Aug 24 03:57:09.028247 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2512/4775] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:57:08 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/ips => generated 149 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:09.255145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:09.271909 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-faa43206-db61-4b3f-a297-b98d8c546fe1 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.500834 Aug 24 03:57:09.286819 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2264/4776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:08 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:09.992818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:09.993449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:10.007450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.010597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.011627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.012638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.014959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.017231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.096362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:10.097802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:10.115077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.116016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.119254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.120375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.121109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.122955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.135356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.135865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.136309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.136770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lazy-loading 'fault' on Instance uuid 82fcd567-aaed-420a-9522-f0f1234b442f {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:10.188798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lazy-loading 'flavor' on Instance uuid ebaceb98-646f-4cc9-b6d0-564c697b2537 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:10.337986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:10.502563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:10.513644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:10.530201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5600daec3d849559118e2c1b7206939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a855dac72e594a6880c130abadcbbfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:10.540032 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15e3c1d0-e606-49be-8901-57da416ec561 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 200 len: 1449 microversion: 2.75 time: 0.558924 Aug 24 03:57:10.542292 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2513/4777] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:09 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 1449 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:10.548225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:10.551472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:10.558655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.559547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.560275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.561308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.562018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.562718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.625047 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06b14c4e-c7ce-42ca-ad13-16bef23d6d10 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/action" status: 202 len: 0 microversion: 2.20 time: 0.532777 Aug 24 03:57:10.628471 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2265/4778] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:57:10 2022] POST /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:57:10.645327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:10.647444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:10.667602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.668583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.669462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.672882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.673983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.675515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:11.161045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:11.180268 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5479d741-7be4-4ec8-a33f-ee6f80c37121 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1519 microversion: 2.1 time: 0.636467 Aug 24 03:57:11.180882 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2514/4779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:10 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1519 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:11.313642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:11.323853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:11.334479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:11.335859 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-416230cf-dcdd-4777-aa6c-6f67d1441d6b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.701133 Aug 24 03:57:11.338773 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2266/4780] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:10 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:11.575277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:11.577345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] [instance: 82fcd567-aaed-420a-9522-f0f1234b442f] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:11.594405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:11.595959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:11.598341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:11.601709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:11.603065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:11.604811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:11.635950 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] HTTP exception thrown: Instance 82fcd567-aaed-420a-9522-f0f1234b442f could not be found. Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Request method failure captured: Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f HTTP/1.1 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaE8saksmYRCneO1FrQgzD8xZoFfqTwR5H9Dh3eG_Btv3SBRB-f3fHoCG5Nbo0940WZYaxzzRQgBuTNk47zBX8RuZhJ54sHVYFGNLuRIwmYRUrUaeRjF_c9D2xsa-9ds1YZwBPLmkLBnUEdxirRCGCKTtXNcbBuL94fOPgojVa5HOMg Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.75 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a855dac72e594a6880c130abadcbbfdd Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAdmin275Test-1056029893 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a855dac72e594a6880c130abadcbbfdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a855dac72e594a6880c130abadcbbfdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a855dac72e594a6880c130abadcbbfdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a855dac72e594a6880c130abadcbbfdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAdmin275Test-1056029893 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a855dac72e594a6880c130abadcbbfdd Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAdmin275Test-1056029893 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAdmin275Test-1056029893-project Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: b5600daec3d849559118e2c1b7206939 Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAdmin275Test-1056029893-project Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 82fcd567-aaed-420a-9522-f0f1234b442f could not be found. Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '82fcd567-aaed-420a-9522-f0f1234b442f'} Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82fcd567-aaed-420a-9522-f0f1234b442f could not be found. Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82fcd567-aaed-420a-9522-f0f1234b442f could not be found. Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:11.637952 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:11.643025 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:11.643025 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:11.643025 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:11.643025 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:11.643025 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:11.643025 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82fcd567-aaed-420a-9522-f0f1234b442f could not be found. Aug 24 03:57:11.643025 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:11.645076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] Returning 404 to user: Instance 82fcd567-aaed-420a-9522-f0f1234b442f could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:11.646142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-837752de-1974-4df5-aaa4-ff309e470573 tempest-ServersAdmin275Test-1056029893 tempest-ServersAdmin275Test-1056029893-project] 10.222.0.58 "GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f" status: 404 len: 111 microversion: 2.75 time: 0.082350 Aug 24 03:57:11.648934 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2515/4781] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:11 2022] GET /compute/v2.1/servers/82fcd567-aaed-420a-9522-f0f1234b442f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:57:11.869583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74109d8e-8d6a-4f0e-840c-ad2cf782d5ac"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:11.874810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:11.883911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:11.884671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:11.885342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:11.886336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:11.887028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:11.887736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.203163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:12.204463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:12.216101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.216819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.217491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.218459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.219323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.220171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.368918 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3296f678-c2b5-41da-aca9-d3d928ab5f2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504447 Aug 24 03:57:12.370630 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2267/4782] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:57:11 2022] POST /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:12.391985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:12.394368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:12.409221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.410107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.411971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.415095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.415579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.416047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.942767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:12.961049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:12.967832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:12.977126 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7c8b4549-15f7-40ec-8f43-7d89078f95ff tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.601472 Aug 24 03:57:12.978268 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2268/4783] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:12 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:13.049058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:13.079802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3afc444a-9da3-4f76-b298-f934d5da696d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.878615 Aug 24 03:57:13.083556 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2516/4784] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:12 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:13.106793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:13.107947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:13.117510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.118429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.119051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.127223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.132846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.133328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.784160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:13.786345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:13.820802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.822719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.825559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.829860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.835398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.837149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.935947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:14.231498 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e2113b02-fa82-4b9c-86b6-3f1baba0a84a tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 204 len: 0 microversion: 2.1 time: 0.456061 Aug 24 03:57:14.234480 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2517/4785] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:13 2022] DELETE /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:14.243542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b952fe14-6b97-447d-b0c5-246dac38c210 req-39dccd24-2201-417b-b18f-e59064f1af21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef86c7ec-f3e1-4c56-9205-740d31e89076", "tag": "ed6512db-5da4-45c9-a92b-5fbca5daa197"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:14.269154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b952fe14-6b97-447d-b0c5-246dac38c210 req-39dccd24-2201-417b-b18f-e59064f1af21 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.274466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b952fe14-6b97-447d-b0c5-246dac38c210 req-39dccd24-2201-417b-b18f-e59064f1af21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.274466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b952fe14-6b97-447d-b0c5-246dac38c210 req-39dccd24-2201-417b-b18f-e59064f1af21 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.296049 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b952fe14-6b97-447d-b0c5-246dac38c210 req-39dccd24-2201-417b-b18f-e59064f1af21 service nova] Creating event network-changed:ed6512db-5da4-45c9-a92b-5fbca5daa197 for instance ef86c7ec-f3e1-4c56-9205-740d31e89076 on n-h1-846470-15 Aug 24 03:57:14.307357 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b952fe14-6b97-447d-b0c5-246dac38c210 req-39dccd24-2201-417b-b18f-e59064f1af21 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070204 Aug 24 03:57:14.308134 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2518/4786] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:14.316639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:14.317495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:14.325497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.326109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.326656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.327435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.327998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.328494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.364247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:14.375983 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-595a2770-c1d3-4b90-880d-f52305570404 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.273479 Aug 24 03:57:14.387760 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2269/4787] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:13 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:14.399427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:14.399427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:14.415174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:14.417259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.417684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.418125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.418876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.419340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.419800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.924310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:14.943605 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a669573-3274-4458-8328-9e283c60dcbe tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1669 microversion: 2.1 time: 0.565521 Aug 24 03:57:14.948449 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2270/4788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:14 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1669 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:14.986213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:14.990764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:15.007799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.011814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.012730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.013780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.016764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.017559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.124012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:15.137170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:15.138733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:15.140257 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cf947b51-2f3b-400b-ac48-54e96e27b11b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.830953 Aug 24 03:57:15.140831 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2519/4789] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:14 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:15.404975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:15.413201 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7908120a-88d0-4bc2-93d8-c88ca010887f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.456229 Aug 24 03:57:15.429026 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2271/4790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:14 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:15.436713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c7134f2-77ea-4056-ad81-245af719ac7b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:15.453648 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5c7134f2-77ea-4056-ad81-245af719ac7b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 81df9a65-df6a-48f9-b960-fa58d3bfc6a3 has no mapping to a cell. Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c7134f2-77ea-4056-ad81-245af719ac7b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/81df9a65-df6a-48f9-b960-fa58d3bfc6a3/action HTTP/1.1 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 15 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: {"os-stop": {}} Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 81df9a65-df6a-48f9-b960-fa58d3bfc6a3 has no mapping to a cell. Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '81df9a65-df6a-48f9-b960-fa58d3bfc6a3', 'body': {'os-stop': {}}} Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 81df9a65-df6a-48f9-b960-fa58d3bfc6a3 has no mapping to a cell. Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:15.462816 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81df9a65-df6a-48f9-b960-fa58d3bfc6a3 has no mapping to a cell. Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81df9a65-df6a-48f9-b960-fa58d3bfc6a3 has no mapping to a cell. Aug 24 03:57:15.468098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:15.469972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c7134f2-77ea-4056-ad81-245af719ac7b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 81df9a65-df6a-48f9-b960-fa58d3bfc6a3 has no mapping to a cell. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:15.471037 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c7134f2-77ea-4056-ad81-245af719ac7b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/81df9a65-df6a-48f9-b960-fa58d3bfc6a3/action" status: 404 len: 117 microversion: 2.1 time: 0.038590 Aug 24 03:57:15.472151 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2520/4791] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:15 2022] POST /compute/v2.1/servers/81df9a65-df6a-48f9-b960-fa58d3bfc6a3/action => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:15.480283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:15.480923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:15.491173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.491699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.492150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.492850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.493304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.493733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.978051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:15.979278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:16.014600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.017332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.018661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.020810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.021473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.023412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.178454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.188018 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b5d192e-9943-4973-95ba-ad170933dbf2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.711324 Aug 24 03:57:16.189263 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2272/4792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:15 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:16.207321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:16.208287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:16.219700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.220990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.223046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.225115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.226166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.227205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.750202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.769679 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5bd019c8-a643-46b8-80a0-11dec5eb237b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1669 microversion: 2.1 time: 0.802473 Aug 24 03:57:16.771633 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2521/4793] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:15 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1669 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:16.782852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:16.784321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:16.796075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.805080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.805833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.807036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.807888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.808622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.851600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.864510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.868130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.869426 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf046158-ecc5-4cd0-9ce7-506f7359ddae tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.678928 Aug 24 03:57:16.870029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2273/4794] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:16 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:17.498661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:17.511810 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99f498f5-0375-4368-9655-cc63c918853f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.737405 Aug 24 03:57:17.513488 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2522/4795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:16 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:17.554727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b8a71d3-71af-48ee-91d2-7e6f28d3a1c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:17.555283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9b8a71d3-71af-48ee-91d2-7e6f28d3a1c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: e143ecbd-9b7f-43c4-81ab-b047a705f01c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:17.567853 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-9b8a71d3-71af-48ee-91d2-7e6f28d3a1c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance e143ecbd-9b7f-43c4-81ab-b047a705f01c could not be found. Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b8a71d3-71af-48ee-91d2-7e6f28d3a1c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/e143ecbd-9b7f-43c4-81ab-b047a705f01c/action HTTP/1.1 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 15 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: {"suspend": {}} Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e143ecbd-9b7f-43c4-81ab-b047a705f01c could not be found. Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e143ecbd-9b7f-43c4-81ab-b047a705f01c', 'body': {'suspend': {}}} Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e143ecbd-9b7f-43c4-81ab-b047a705f01c could not be found. Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e143ecbd-9b7f-43c4-81ab-b047a705f01c could not be found. Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:17.569557 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:17.575217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:17.575217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:17.575217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e143ecbd-9b7f-43c4-81ab-b047a705f01c could not be found. Aug 24 03:57:17.575217 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:17.575217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b8a71d3-71af-48ee-91d2-7e6f28d3a1c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance e143ecbd-9b7f-43c4-81ab-b047a705f01c could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:17.575217 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9b8a71d3-71af-48ee-91d2-7e6f28d3a1c2 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/e143ecbd-9b7f-43c4-81ab-b047a705f01c/action" status: 404 len: 111 microversion: 2.1 time: 0.021395 Aug 24 03:57:17.581644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:17.590905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:17.610709 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2274/4796] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:17 2022] POST /compute/v2.1/servers/e143ecbd-9b7f-43c4-81ab-b047a705f01c/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:17.613906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.615223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.619898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.621777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.626142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.629294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.799001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:17.800033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:17.828097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.842184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.851263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.854472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.860963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.863037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.412426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:18.424910 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53e60d06-07b9-4ab6-b35c-f7f48159d407 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.847096 Aug 24 03:57:18.433758 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2523/4797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:17 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:18.442408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:18.443022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:18.470097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.470593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.471029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.471773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.472229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.477116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.532005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:18.571215 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-46d60d73-eb75-436c-be6e-b23a67990f4b tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1669 microversion: 2.1 time: 0.780830 Aug 24 03:57:18.572951 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2275/4798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:17 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1669 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:18.594613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:18.596582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:18.627658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.628872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.631407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.637233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.638882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.640701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.057557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:19.080270 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-041af684-5bbe-47cf-a68d-44f6f66858bc tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.499863 Aug 24 03:57:19.081594 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2276/4799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:18 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:19.097890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9d1b4a59-02aa-49ec-b87f-758d49b98f05 req-504bf796-e6b9-4bfc-8cf0-5c68670d3917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef86c7ec-f3e1-4c56-9205-740d31e89076", "name": "network-vif-deleted", "tag": "ed6512db-5da4-45c9-a92b-5fbca5daa197"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:19.123764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9d1b4a59-02aa-49ec-b87f-758d49b98f05 req-504bf796-e6b9-4bfc-8cf0-5c68670d3917 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.125025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9d1b4a59-02aa-49ec-b87f-758d49b98f05 req-504bf796-e6b9-4bfc-8cf0-5c68670d3917 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.128549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9d1b4a59-02aa-49ec-b87f-758d49b98f05 req-504bf796-e6b9-4bfc-8cf0-5c68670d3917 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.163203 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9d1b4a59-02aa-49ec-b87f-758d49b98f05 req-504bf796-e6b9-4bfc-8cf0-5c68670d3917 service nova] Creating event network-vif-deleted:ed6512db-5da4-45c9-a92b-5fbca5daa197 for instance ef86c7ec-f3e1-4c56-9205-740d31e89076 on n-h1-846470-15 Aug 24 03:57:19.182935 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9d1b4a59-02aa-49ec-b87f-758d49b98f05 req-504bf796-e6b9-4bfc-8cf0-5c68670d3917 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097315 Aug 24 03:57:19.183592 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2277/4800] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:19.199112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:19.206167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:19.238587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.239428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.242662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.245927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.246484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.246936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.371466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lazy-loading 'flavor' on Instance uuid 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:19.469739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:19.493943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:19.504074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:19.506709 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9cb57328-36fc-4f17-b7cd-91f55c826ef6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 1.070781 Aug 24 03:57:19.511795 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2524/4801] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:18 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:19.601482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:19.602305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:19.621641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.626890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.627362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.628157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.628629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.629065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.724953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.725447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.725891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.726359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lazy-loading 'fault' on Instance uuid ef86c7ec-f3e1-4c56-9205-740d31e89076 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:19.742666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:19.979929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:19.998743 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-102396c9-a9a0-4a1f-8c27-1f8f289f36e6 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 200 len: 1337 microversion: 2.1 time: 0.402378 Aug 24 03:57:19.999350 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2525/4802] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:19 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 1337 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:20.258388 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8f99b058-8a17-475e-8935-40240e9effb9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 202 len: 0 microversion: 2.1 time: 1.070837 Aug 24 03:57:20.260122 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2278/4803] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:19 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:20.270937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:20.272144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:20.283558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.285731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.289657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.294436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.297111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.300603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.536635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:20.537346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:20.550504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.558543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.559745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.560521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.563384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.564111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.684045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:20.695878 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86d26230-9d4b-4eba-bf3b-84d9b3011a5e tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1514 microversion: 2.1 time: 0.429476 Aug 24 03:57:20.696864 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2526/4804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:20 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1514 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:21.025077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:21.025873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: ef86c7ec-f3e1-4c56-9205-740d31e89076] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:21.033287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.044811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.045483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.048191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.050479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.053209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.108102 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] HTTP exception thrown: Instance ef86c7ec-f3e1-4c56-9205-740d31e89076 could not be found. Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Request method failure captured: Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 HTTP/1.1 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDGwk5VnkVx-wp3f1b44KZqYk6Q1Nkv2qgRW586DvlJ7Uyh4uyO4i9zi7BR6NFtFQ0Sht9aPAEM4UP8DeolxPn-X_fpeJtW8O3GDLrU8c6aPawSUy8NALuTD_bdlCyTHtJgsMvhnbDr_eHe_QbyDsYABlE6HjBIFohUzJZs0PUUb-0 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 3d1641d4e3764347a4ad4c91c0ee21ee Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestNetworkBasicOps-1145880211 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestNetworkBasicOps-1145880211 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 3d1641d4e3764347a4ad4c91c0ee21ee Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestNetworkBasicOps-1145880211 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestNetworkBasicOps-1145880211-project Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5c7f4a326b7a4b598ca962847679ac13 Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestNetworkBasicOps-1145880211-project Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance ef86c7ec-f3e1-4c56-9205-740d31e89076 could not be found. Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'ef86c7ec-f3e1-4c56-9205-740d31e89076'} Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef86c7ec-f3e1-4c56-9205-740d31e89076 could not be found. Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef86c7ec-f3e1-4c56-9205-740d31e89076 could not be found. Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:21.113203 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.117769 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:21.117769 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:21.117769 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:21.117769 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:21.117769 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:21.117769 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef86c7ec-f3e1-4c56-9205-740d31e89076 could not be found. Aug 24 03:57:21.117769 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.120926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Returning 404 to user: Instance ef86c7ec-f3e1-4c56-9205-740d31e89076 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:21.125212 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e2491d9-bf0a-45b1-8918-aa47d5098af3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076" status: 404 len: 111 microversion: 2.1 time: 0.103832 Aug 24 03:57:21.128484 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2527/4805] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:21 2022] GET /compute/v2.1/servers/ef86c7ec-f3e1-4c56-9205-740d31e89076 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:21.383441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:21.401317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:21.423079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:21.442407 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-43e43782-a01d-41ab-ae9e-8f08d0fb8502 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.905970 Aug 24 03:57:21.451436 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2279/4806] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:20 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:21.560255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b2d813cf-884d-4d6c-b7ec-4588eef96aaa tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '.version_select at 0x7f1029d84310>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:21.611500 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b2d813cf-884d-4d6c-b7ec-4588eef96aaa tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-868391116" status: 202 len: 0 microversion: 2.1 time: 0.055298 Aug 24 03:57:21.613229 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2280/4807] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 24 03:57:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-868391116 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:21.730776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:21.731547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:21.765111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.766086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.766727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.767704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.770539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.775390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.808107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-252319657", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:21.931841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:57:22.258772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:22.273016 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-12e5a48d-436c-43ef-882c-2d9198bbf059 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1497 microversion: 2.1 time: 0.547080 Aug 24 03:57:22.282484 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2281/4808] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:21 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1497 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:22.324729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:22.325594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:22.343093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.344038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.345061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.346254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.347044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.347795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.383387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:22.389882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lazy-loading 'flavor' on Instance uuid 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:22.416357 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Cannot 'suspend' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state suspended Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action HTTP/1.1 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 15 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: {"suspend": {}} Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot 'suspend' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state suspended Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'suspend': {}}} Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b in vm_state suspended. Cannot suspend while the instance is in this state. Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 24 03:57:22.419543 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state suspended Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state suspended Aug 24 03:57:22.426552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.432080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 409 to user: Cannot 'suspend' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state suspended {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:22.433284 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d7c6c33-6d08-4f82-8260-e60fd8c28029 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 409 len: 148 microversion: 2.1 time: 0.113581 Aug 24 03:57:22.434441 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2282/4809] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:22 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 148 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:57:22.453625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:22.456605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:22.482015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.484284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.485033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.487455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.507442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.508416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.672684 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a59be44-d921-45c7-9264-c2b0ae13858d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.228899 Aug 24 03:57:22.673691 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2283/4810] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:22 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:22.686670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:22.689738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:22.703774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.707704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.709667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.710657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.714859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.715590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:23.508239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:23.522310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:23.532893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:23.534170 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dcf635d9-8f76-4b15-97a8-594322def27c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.858441 Aug 24 03:57:23.534813 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2284/4811] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:22 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:23.562340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:23.562974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:23.580035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:23.580552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:23.581002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:23.581761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:23.582235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:23.582663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:23.706397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:57:23.706990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:57:23.707560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:57:23.708030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:57:23.708928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:57:23.748829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:23.749624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:23.750252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:23.751469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:23.752285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:23.752903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:23.809537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Getting quotas for project cc701588f8524a4aa1668b96c8a494c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:57:23.816736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Getting quotas for user d5e5b8a94a774ed794e1aed66bb5b9cf and project cc701588f8524a4aa1668b96c8a494c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:57:23.847065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:57:23.849948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:57:23.914294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:23.930461 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5fc919ec-514d-4ad0-b8ca-1dc33d3b614a tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1503 microversion: 2.1 time: 0.374931 Aug 24 03:57:23.933103 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2285/4812] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:23 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:23.985176 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e95f530-627a-4232-80a0-2f95e2a24d34 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.470672 Aug 24 03:57:23.987471 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2528/4813] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:57:24.091522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-988498621", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:24.186228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:57:24.562950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:24.563599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:24.576314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:24.577946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:24.578617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:24.579807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:24.580521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:24.581341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.148234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:25.165412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:25.167189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:25.168507 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4958e144-5f7a-4e77-ada9-763f5645d139 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.611033 Aug 24 03:57:25.175052 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2529/4814] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:24 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:25.197135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:25.197976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:25.220358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.220894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.221317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.226553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.227073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.227684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.282725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:57:25.283249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:57:25.283838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:57:25.284359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:57:25.284877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:57:25.300600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.312501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.315108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.317073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.319119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.322642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.364477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Getting quotas for project cc701588f8524a4aa1668b96c8a494c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:57:25.371537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Getting quotas for user d5e5b8a94a774ed794e1aed66bb5b9cf and project cc701588f8524a4aa1668b96c8a494c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:57:25.390479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:57:25.393276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:57:25.488160 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e44ae19-b4de-4c4a-8830-b6143bee8c9f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400561 Aug 24 03:57:25.489613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2286/4815] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:57:25.501308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5d86ae15-6cf2-4d40-b1c4-8db02a8b9b04 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:25.502362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5d86ae15-6cf2-4d40-b1c4-8db02a8b9b04 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:25.638642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5d86ae15-6cf2-4d40-b1c4-8db02a8b9b04 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:25.662076 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5d86ae15-6cf2-4d40-b1c4-8db02a8b9b04 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1213 microversion: 2.1 time: 0.163313 Aug 24 03:57:25.675468 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2287/4816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:25 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:25.789073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:25.829516 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5205260-f740-4882-b62a-9bc1ec0d9310 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1503 microversion: 2.1 time: 0.652901 Aug 24 03:57:25.831063 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2530/4817] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:25 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1503 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:26.222108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:26.223039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:26.236125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:26.236916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:26.237695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:26.238812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:26.240078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:26.241946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:26.682506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:26.683211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:26.683577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:26.697067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:26.698619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:26.699878 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db57eda4-50d7-4552-abd1-d7238185a97d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.485174 Aug 24 03:57:26.712120 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2288/4818] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:26 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:26.716875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:26.718188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:26.718676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:26.719520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:26.721519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:26.721984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:26.874651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:26.875293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:26.889305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:26.891989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:26.893194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:26.898049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:26.900736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:26.903013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:26.943596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:26.960436 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9f039c7-fcbb-4a22-9bf8-da7cd5532b01 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1209 microversion: 2.1 time: 0.281451 Aug 24 03:57:26.961050 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2531/4819] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:26 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1209 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:27.728421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:27.729789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:27.737373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.738116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.738731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.743809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.744893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.745533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.933565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:27.943169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a41fefd-13df-4b57-bb93-d17429f4899f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1503 microversion: 2.1 time: 1.073435 Aug 24 03:57:27.956432 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2289/4820] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:26 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1503 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:27.982291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:27.983222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:27.991434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.996136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.999838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:28.002537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:28.007911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:28.009300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:28.119911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:28.135278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:28.143231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:28.144440 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0e01483c-f588-422c-85f7-e59492c927d0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1742 microversion: 2.20 time: 0.419997 Aug 24 03:57:28.147048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:28.147244 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2532/4821] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:27 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1742 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:28.157524 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27e9936a-7dc9-4f2d-91ad-d8159dfb4251 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1265 microversion: 2.1 time: 0.179161 Aug 24 03:57:28.158122 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2290/4822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:27 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:28.675406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74109d8e-8d6a-4f0e-840c-ad2cf782d5ac"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:28.684909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:28.709057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:28.709984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:28.710949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:28.714097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:28.714952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:28.720532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:28.920290 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Invalid volume: volume 74109d8e-8d6a-4f0e-840c-ad2cf782d5ac is already attached to instances: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments HTTP/1.1 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 74 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: {"volumeAttachment": {"volumeId": "74109d8e-8d6a-4f0e-840c-ad2cf782d5ac"}} Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid volume: volume 74109d8e-8d6a-4f0e-840c-ad2cf782d5ac is already attached to instances: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': '51814e8b-04b9-4f0a-a8eb-9a1ec11813ee', 'body': {'volumeAttachment': {'volumeId': '74109d8e-8d6a-4f0e-840c-ad2cf782d5ac'}}} Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 74109d8e-8d6a-4f0e-840c-ad2cf782d5ac is already attached to instances: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:28.926217 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 74109d8e-8d6a-4f0e-840c-ad2cf782d5ac is already attached to instances: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 74109d8e-8d6a-4f0e-840c-ad2cf782d5ac is already attached to instances: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee Aug 24 03:57:28.931971 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:28.937190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 400 to user: Invalid volume: volume 74109d8e-8d6a-4f0e-840c-ad2cf782d5ac is already attached to instances: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:28.939793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de95e901-c727-43cc-a013-32452f931553 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.268607 Aug 24 03:57:28.960043 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2533/4823] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:57:28 2022] POST /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 174 bytes in 290 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:57:28.967829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:28.968524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:28.979447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:28.979989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:28.980445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:28.981202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:28.981678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:28.982116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.067099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:29.067521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:29.079570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.080158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.080620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.081385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.081852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.082291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.258371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lazy-loading 'services' on Instance uuid 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:29.435565 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-855f1276-03ec-45bc-9bd3-49f49f0145d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments/74109d8e-8d6a-4f0e-840c-ad2cf782d5ac" status: 202 len: 0 microversion: 2.1 time: 0.371904 Aug 24 03:57:29.436951 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2534/4824] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 03:57:29 2022] DELETE /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments/74109d8e-8d6a-4f0e-840c-ad2cf782d5ac => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:29.465622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:29.467041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:29.498725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.501078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.502260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.504017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.504866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.507121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.563934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:29.576287 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5dbb15f-4c8b-4109-baa6-19462c4c6d74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.613070 Aug 24 03:57:29.588140 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2291/4825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:28 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:29.612578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:29.614984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:29.638333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.639264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.641987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.643127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.643834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.645532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.771408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:29.792218 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e075b8fe-65cf-41b2-b044-41f939f33cc0 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1271 microversion: 2.1 time: 0.199674 Aug 24 03:57:29.793996 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2292/4826] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:29 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:29.802505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:29.808102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:29.833043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.833903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.834650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.837805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.839410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.841735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.850179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:29.865164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:29.872283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:29.875193 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-647cfcf2-b007-4702-b2a2-1ab1c716f499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1742 microversion: 2.20 time: 0.436646 Aug 24 03:57:29.879866 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2535/4827] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:29 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1742 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:29.892024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:29.892024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:29.898497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.899521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.901069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.903255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:29.904161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:29.906139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:29.912866 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bdba420d-1f4e-4dcf-b1b9-a56cb00444d2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116940 Aug 24 03:57:29.919194 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2293/4828] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:29 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:30.333934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:30.402029 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47494d34-8e12-4807-991f-224209a01470 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.520455 Aug 24 03:57:30.403942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2536/4829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:29 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:30.424879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72a6279d-4e48-4e63-88dd-70c212fe6e5f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:30.426130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-72a6279d-4e48-4e63-88dd-70c212fe6e5f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 05300fea-3e09-4700-9046-3d19244bc4db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:30.441100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-72a6279d-4e48-4e63-88dd-70c212fe6e5f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 05300fea-3e09-4700-9046-3d19244bc4db could not be found. Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72a6279d-4e48-4e63-88dd-70c212fe6e5f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/05300fea-3e09-4700-9046-3d19244bc4db/action HTTP/1.1 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 15 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: {"unpause": {}} Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 05300fea-3e09-4700-9046-3d19244bc4db could not be found. Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '05300fea-3e09-4700-9046-3d19244bc4db', 'body': {'unpause': {}}} Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05300fea-3e09-4700-9046-3d19244bc4db could not be found. Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05300fea-3e09-4700-9046-3d19244bc4db could not be found. Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:30.443063 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:30.459049 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:30.459049 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:30.459049 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05300fea-3e09-4700-9046-3d19244bc4db could not be found. Aug 24 03:57:30.459049 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:30.459049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72a6279d-4e48-4e63-88dd-70c212fe6e5f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 05300fea-3e09-4700-9046-3d19244bc4db could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:30.459049 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72a6279d-4e48-4e63-88dd-70c212fe6e5f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/05300fea-3e09-4700-9046-3d19244bc4db/action" status: 404 len: 111 microversion: 2.1 time: 0.024999 Aug 24 03:57:30.459049 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2294/4830] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:30 2022] POST /compute/v2.1/servers/05300fea-3e09-4700-9046-3d19244bc4db/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:30.461108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:30.462265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:30.473859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:30.481191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:30.484877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:30.485832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:30.491553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:30.493156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:30.494782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:30.816469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:30.817473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:30.828337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:30.832794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:30.836325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:30.837699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:30.838407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:30.839046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:30.843097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:30.858666 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf3d211c-b231-4d41-9bb1-8244e967536c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.407833 Aug 24 03:57:30.866204 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2537/4831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:30 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:30.901488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:30.903130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:30.925853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:30.928607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:30.929111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:30.929861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:30.930331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:30.937496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:31.211351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:31.232892 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2660943-9994-4439-acd2-624c5af39dbe tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1271 microversion: 2.1 time: 0.421758 Aug 24 03:57:31.233504 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2295/4832] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:30 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1271 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:31.267292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:31.267954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:31.281698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:31.287839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:31.288681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:31.289646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:31.290293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:31.290925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.131484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:32.147111 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7440f026-5d03-4685-af59-b58040080a8d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.255118 Aug 24 03:57:32.147729 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2538/4833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:30 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:32.166393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:32.170690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:32.199401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.200356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.201270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.214278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.215253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.216102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.312486 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b25e013-b863-496b-9c1e-5c2a4be42d2b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163158 Aug 24 03:57:32.314301 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2539/4834] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:32 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:32.349742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:32.351061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:32.362694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.362931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.363687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.364951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.365635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.366308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.430437 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Cannot 'unpause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action HTTP/1.1 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 15 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: {"unpause": {}} Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: exception: Cannot 'unpause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'unpause': {}}} Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b in vm_state active. Cannot unpause while the instance is in this state. Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:32.438081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:32.443735 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:32.443735 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:32.443735 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:32.443735 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:57:32.443735 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:32.443735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 409 to user: Cannot 'unpause' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:32.444778 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8abf4777-4365-40fb-86b4-f1d3e3670a2c tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 409 len: 145 microversion: 2.1 time: 0.103951 Aug 24 03:57:32.450552 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2540/4835] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:32 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 145 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:57:32.475564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:32.477321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:32.499620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.504424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.505546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.507120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.508440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.509655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.813198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:32.846156 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d589c7e-133e-4b00-8c88-43dd44b305af tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1271 microversion: 2.1 time: 0.381242 Aug 24 03:57:32.849297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2541/4836] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:32 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1271 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:32.874067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:32.877438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:32.907215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.912431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.914327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.916645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:32.919139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:32.922022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:32.970071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:33.008349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:33.012680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:33.016641 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6464543c-3997-454e-868e-e4c3e3cf72be tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1742 microversion: 2.20 time: 1.754236 Aug 24 03:57:33.019620 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2296/4837] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:31 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1742 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:33.333684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:33.340893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:33.404698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.412933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.418990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.425867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.426888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.434670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.577320 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b3c60ef8-bce7-4b29-915c-cfff8b1ecbbe tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.251270 Aug 24 03:57:33.578445 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2297/4838] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:33 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 197 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:33.608489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bfc26838-b8ea-4a29-bdd4-4839286dc0af req-59f71562-3517-4805-8ce5-bf8ffa7cea3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f3f729-84f5-4837-ad9c-063a22104016", "tag": "2aa178f0-2520-4e55-bf9a-17d4ee0b5701"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:33.639222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfc26838-b8ea-4a29-bdd4-4839286dc0af req-59f71562-3517-4805-8ce5-bf8ffa7cea3e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.647002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfc26838-b8ea-4a29-bdd4-4839286dc0af req-59f71562-3517-4805-8ce5-bf8ffa7cea3e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.647583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfc26838-b8ea-4a29-bdd4-4839286dc0af req-59f71562-3517-4805-8ce5-bf8ffa7cea3e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.675171 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bfc26838-b8ea-4a29-bdd4-4839286dc0af req-59f71562-3517-4805-8ce5-bf8ffa7cea3e service nova] Creating event network-changed:2aa178f0-2520-4e55-bf9a-17d4ee0b5701 for instance d1f3f729-84f5-4837-ad9c-063a22104016 on n-h2-846470-15 Aug 24 03:57:33.684168 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bfc26838-b8ea-4a29-bdd4-4839286dc0af req-59f71562-3517-4805-8ce5-bf8ffa7cea3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080738 Aug 24 03:57:33.688198 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2298/4839] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:57:33.778798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:33.829012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:33.873985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:33.874783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:33.885422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.885931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.891287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:33.900912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.901345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.901831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.902270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.906141 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-13adc6ed-7f22-4b1b-9a82-919ecca4a05f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.051073 Aug 24 03:57:33.913400 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2542/4840] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:32 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:33.950666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:33.951593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:33.965412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.966210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.970868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:33.972119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:33.972867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:33.973620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:34.036899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:34.380925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:34.384697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:34.393041 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7c88c4b3-2b90-4b55-9cff-d5f998b29b16 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.447454 Aug 24 03:57:34.398767 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2543/4841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:33 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:34.416297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:34.417187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:34.429740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:34.431637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:34.432316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:34.434149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:34.435993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:34.443586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:34.444918 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ce9548e-23ac-4741-89ea-2ad03e28e921 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 0.575517 Aug 24 03:57:34.451145 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2299/4842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:33 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:34.474670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98acb7be-09f6-4a00-8bef-9517b9b1295d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:34.475292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98acb7be-09f6-4a00-8bef-9517b9b1295d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 77e56f1a-f254-4a2c-ab83-7114151345e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:34.490367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-98acb7be-09f6-4a00-8bef-9517b9b1295d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 77e56f1a-f254-4a2c-ab83-7114151345e6 could not be found. Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98acb7be-09f6-4a00-8bef-9517b9b1295d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/77e56f1a-f254-4a2c-ab83-7114151345e6/action HTTP/1.1 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 18 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: {"unshelve": null} Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 77e56f1a-f254-4a2c-ab83-7114151345e6 could not be found. Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '77e56f1a-f254-4a2c-ab83-7114151345e6', 'body': {'unshelve': None}} Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e56f1a-f254-4a2c-ab83-7114151345e6 could not be found. Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e56f1a-f254-4a2c-ab83-7114151345e6 could not be found. Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:34.493472 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:34.499401 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:34.499401 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:34.499401 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:34.499401 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:34.499401 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:34.499401 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:34.499401 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e56f1a-f254-4a2c-ab83-7114151345e6 could not be found. Aug 24 03:57:34.499401 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:34.502870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98acb7be-09f6-4a00-8bef-9517b9b1295d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 77e56f1a-f254-4a2c-ab83-7114151345e6 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:34.504140 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98acb7be-09f6-4a00-8bef-9517b9b1295d tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/77e56f1a-f254-4a2c-ab83-7114151345e6/action" status: 404 len: 111 microversion: 2.1 time: 0.051433 Aug 24 03:57:34.507470 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2300/4843] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:34 2022] POST /compute/v2.1/servers/77e56f1a-f254-4a2c-ab83-7114151345e6/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:34.518998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:34.522035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:34.551831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:34.552975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:34.553639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:34.554717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:34.555730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:34.556932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:35.090992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:35.109792 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a3b8d543-9444-40d7-b143-b854ad56e6e9 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.596091 Aug 24 03:57:35.110414 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2301/4844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:34 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:35.125246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:35.136686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:35.176689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:35.178398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:35.179595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:35.180573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:35.181238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:35.181857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:35.187637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:35.255487 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-404f56b0-4d95-4e04-b174-239d678f90d6 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139122 Aug 24 03:57:35.256737 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2302/4845] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:35 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:35.276866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:35.281555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:35.305100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:35.307507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:35.310502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:35.314844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:35.316032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:35.320513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:35.393546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:35.658047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:36.062309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:36.070765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e90a30b6-1925-4c7f-b8a9-dd1842000e29 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.810935 Aug 24 03:57:36.074288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2303/4846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:35 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:36.079679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:36.082580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:36.123210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.127381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.139375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.140959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.144683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.145415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.322740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:36.343682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:36.345407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:36.357375 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97f3201b-8c06-4ae0-8522-65916d9119c9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1742 microversion: 2.20 time: 1.956897 Aug 24 03:57:36.358006 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2544/4847] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:34 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1742 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:36.381243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-eafea5eb-e867-4df7-809c-76bcf9279c26 req-a96fcbfb-77b7-4e99-b682-c966f671ae66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaceb98-646f-4cc9-b6d0-564c697b2537", "name": "network-vif-plugged", "status": "completed", "tag": "b4cd305e-193b-42fa-834b-651256717f69"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:36.407946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eafea5eb-e867-4df7-809c-76bcf9279c26 req-a96fcbfb-77b7-4e99-b682-c966f671ae66 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.408395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eafea5eb-e867-4df7-809c-76bcf9279c26 req-a96fcbfb-77b7-4e99-b682-c966f671ae66 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.411809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-eafea5eb-e867-4df7-809c-76bcf9279c26 req-a96fcbfb-77b7-4e99-b682-c966f671ae66 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.434325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-eafea5eb-e867-4df7-809c-76bcf9279c26 req-a96fcbfb-77b7-4e99-b682-c966f671ae66 service nova] Creating event network-vif-plugged:b4cd305e-193b-42fa-834b-651256717f69 for instance ebaceb98-646f-4cc9-b6d0-564c697b2537 on n-h1-846470-15 Aug 24 03:57:36.440797 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-eafea5eb-e867-4df7-809c-76bcf9279c26 req-a96fcbfb-77b7-4e99-b682-c966f671ae66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079207 Aug 24 03:57:36.441803 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2545/4848] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:36.451182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:36.453111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:36.464265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.465444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.466163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.467421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.468416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.471337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.529428 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Cannot 'unshelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action HTTP/1.1 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 18 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: {"unshelve": null} Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: exception: Cannot 'unshelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'unshelve': None}} Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b in vm_state active. Cannot unshelve while the instance is in this state. Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:57:36.536877 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 409 to user: Cannot 'unshelve' instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b while it is in vm_state active {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e417b796-e606-420b-af99-ca8ca4bede06 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action" status: 409 len: 146 microversion: 2.1 time: 0.095547 Aug 24 03:57:36.543008 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2546/4849] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:57:36 2022] POST /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b/action => generated 146 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:57:36.546318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:36.550708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:36.572952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.573552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.574059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.574886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.575415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.576218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.594656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:36.604300 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-29707c54-e894-46d0-9661-0109e724d0ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 0.528564 Aug 24 03:57:36.607751 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2304/4850] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:36 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:36.621715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:36.622398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:36.654640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.655428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.656076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.657002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.657656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.658299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.708070 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1197f09-7a74-478a-9b75-d35ddf23f87d tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165992 Aug 24 03:57:36.713301 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2547/4851] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:36 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:36.722256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-37837d90-8298-4d57-ab24-4ba1450d7bdb req-6ed44171-7158-4afd-b88c-4073f185fdec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188ff354-fb76-4eab-ae4e-f71851c55298", "tag": "5cd46ba5-2765-4573-b88e-656db2569a00"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:36.760302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-37837d90-8298-4d57-ab24-4ba1450d7bdb req-6ed44171-7158-4afd-b88c-4073f185fdec service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:36.764737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-37837d90-8298-4d57-ab24-4ba1450d7bdb req-6ed44171-7158-4afd-b88c-4073f185fdec service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:36.767636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-37837d90-8298-4d57-ab24-4ba1450d7bdb req-6ed44171-7158-4afd-b88c-4073f185fdec service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:36.807621 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-37837d90-8298-4d57-ab24-4ba1450d7bdb req-6ed44171-7158-4afd-b88c-4073f185fdec service nova] Creating event network-changed:5cd46ba5-2765-4573-b88e-656db2569a00 for instance 188ff354-fb76-4eab-ae4e-f71851c55298 on n-h1-846470-15 Aug 24 03:57:36.819762 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-37837d90-8298-4d57-ab24-4ba1450d7bdb req-6ed44171-7158-4afd-b88c-4073f185fdec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106260 Aug 24 03:57:36.824353 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2548/4852] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:37.196252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:37.228083 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6b4abf7d-6a46-4c35-acba-d003fab71289 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.619101 Aug 24 03:57:37.231233 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2305/4853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:36 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:37.279346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:37.282410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:37.311869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:37.318601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:37.320420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:37.324389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:37.332858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:37.335221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:37.391622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:37.392435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:37.406340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:37.407012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:37.407567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:37.408483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:37.410622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:37.412343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.502036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:38.516156 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa7387ea-232a-4d54-8c0e-5bc3befe0339 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.249528 Aug 24 03:57:38.537650 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2549/4854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:37 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:38.557895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:38.567909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:38.574993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.576051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.587556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.588866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.589602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.590264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.727145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:38.738651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:38.740325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:38.741997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bdf3c3be-1c3b-4476-80c8-575480d49619 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 1.355363 Aug 24 03:57:38.761014 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2306/4855] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:37 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:38.771240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:38.774164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:38.801150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.802053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.802730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.804416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.805163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:38.805825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:38.885856 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d9fce298-4921-42a3-a6fc-768dd2677c14 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122847 Aug 24 03:57:38.888405 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2307/4856] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:38 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:38.898042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aab1a145-d2d8-44e7-875c-c4d7b9f966dd tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-895107578_updated"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:38.911410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aab1a145-d2d8-44e7-875c-c4d7b9f966dd tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 424f6329-bba5-42f1-b7e8-0de979aa7100] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:38.926317 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-aab1a145-d2d8-44e7-875c-c4d7b9f966dd tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 424f6329-bba5-42f1-b7e8-0de979aa7100 could not be found. Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aab1a145-d2d8-44e7-875c-c4d7b9f966dd tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/servers/424f6329-bba5-42f1-b7e8-0de979aa7100 HTTP/1.1 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 80 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-895107578_updated"}} Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 424f6329-bba5-42f1-b7e8-0de979aa7100 could not be found. Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '424f6329-bba5-42f1-b7e8-0de979aa7100', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-895107578_updated'}}} Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424f6329-bba5-42f1-b7e8-0de979aa7100 could not be found. Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 24 03:57:38.928660 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424f6329-bba5-42f1-b7e8-0de979aa7100 could not be found. Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424f6329-bba5-42f1-b7e8-0de979aa7100 could not be found. Aug 24 03:57:38.933199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:38.935925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aab1a145-d2d8-44e7-875c-c4d7b9f966dd tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 424f6329-bba5-42f1-b7e8-0de979aa7100 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:38.937294 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aab1a145-d2d8-44e7-875c-c4d7b9f966dd tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "PUT /compute/v2.1/servers/424f6329-bba5-42f1-b7e8-0de979aa7100" status: 404 len: 111 microversion: 2.1 time: 0.047383 Aug 24 03:57:38.939338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2308/4857] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:57:38 2022] PUT /compute/v2.1/servers/424f6329-bba5-42f1-b7e8-0de979aa7100 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:38.959484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:38.968945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:38.991938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:38.998507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.008488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.010577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.014326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.020218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.572560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:39.595443 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42bd3482-d918-422d-81f9-8ab453bf1d57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 1.054487 Aug 24 03:57:39.597068 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2550/4858] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:38 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:39.700169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:39.724659 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb86d159-0568-42c2-a86d-91dab2ac6573 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.781101 Aug 24 03:57:39.730842 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2309/4859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:38 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:39.751197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:39.753076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:39.764581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.765553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.766228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.767442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.768199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.769594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.770733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:39.771357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:39.786319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.790505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.791235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.799278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.802060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.805379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.304883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:40.316313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:40.322612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:40.335878 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e9eb5c33-92d4-4c1d-9220-ba22684c49a4 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.560680 Aug 24 03:57:40.339654 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2310/4860] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:39 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:40.352200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:40.358011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:40.363136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:40.368991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.369866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.370536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.371562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.373134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.373890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.432321 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2025cd0d-4644-482e-bc01-eb70716c25d8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089502 Aug 24 03:57:40.438617 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2311/4861] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:40 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:57:40.564536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:40.565307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:40.579175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.582456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.583320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.587230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.588198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.589762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.653187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:40.808141 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-95d3dfa5-90a0-4458-b88e-06b07cc705f4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 204 len: 0 microversion: 2.1 time: 0.252959 Aug 24 03:57:40.817325 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2312/4862] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:40 2022] DELETE /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:40.834986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:40.837012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:40.847096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.847983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.848725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:40.849723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:40.850498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:40.851211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.106146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:41.141808 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f8b57ff-a045-4b4e-9db8-5f834af19b5b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 1.392107 Aug 24 03:57:41.160700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:41.162291 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2551/4863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:39 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:41.183846 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5decfe64-84df-41c9-96ab-f3fec7340004 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 0.361912 Aug 24 03:57:41.187782 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2313/4864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:40 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:41.189666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:41.199399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:41.210517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-115091fe-6f5a-4327-8faf-8d3aa4ec8a19 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:41.212654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.213155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.213595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.214308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.214759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.215372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-115091fe-6f5a-4327-8faf-8d3aa4ec8a19 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b HTTP/1.1 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 280 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:41.223956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-115091fe-6f5a-4327-8faf-8d3aa4ec8a19 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-115091fe-6f5a-4327-8faf-8d3aa4ec8a19 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "PUT /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 400 len: 619 microversion: 2.1 time: 0.036974 Aug 24 03:57:41.232412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2314/4865] 10.222.0.58 () {60 vars in 1257 bytes} [Wed Aug 24 03:57:41 2022] PUT /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 619 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:57:41.244649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:41.249323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:41.265255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.266375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.269523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.270652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.271240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.271786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.528239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:41.541783 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9b95ffda-80a1-4fd9-a8dc-7f3e5f5c6887 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.304848 Aug 24 03:57:41.548994 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2315/4866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:41 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:41.561533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:41.564065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:41.583291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.584355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.584971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.586014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.587072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.588427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.866542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:41.894607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:41.898271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:41.900521 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49371d7a-1eeb-48a1-b451-d909bef0220c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.345680 Aug 24 03:57:41.901925 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2316/4867] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:41 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:41.958056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:41.959167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:41.973218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.974117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.974950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.976166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.976893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.977829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.363707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:42.367904 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-958d6efb-91e9-4660-ad53-5c4327987e00 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1679 microversion: 2.1 time: 1.203601 Aug 24 03:57:42.368488 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2552/4868] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:41 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1679 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:42.390448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:42.391086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:42.417338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.417693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.418945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.421749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.422235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.423005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.492557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:42.512870 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7198d1d7-9830-41d5-8fc5-55b6321b5ce8 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.575120 Aug 24 03:57:42.519811 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2317/4869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:41 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:42.546309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8dc7e215-ec17-4143-97c8-328c9e7ee75f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8dc7e215-ec17-4143-97c8-328c9e7ee75f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: request: PUT /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b HTTP/1.1 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 24 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: {"server": {"name": ""}} Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b', 'body': {'server': {'name': ''}}} Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi '' Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:57:42.554802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 03:57:42.559702 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:42.563827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8dc7e215-ec17-4143-97c8-328c9e7ee75f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:42.565029 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8dc7e215-ec17-4143-97c8-328c9e7ee75f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "PUT /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 400 len: 108 microversion: 2.1 time: 0.023382 Aug 24 03:57:42.565874 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2318/4870] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 03:57:42 2022] PUT /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:57:42.577640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:42.578724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:42.588532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.589442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.590154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.591110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.592411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.593540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.888560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:42.918963 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-327f6bd1-b7c3-4eb2-8ca7-13b3fd650a41 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1506 microversion: 2.1 time: 0.345446 Aug 24 03:57:42.923719 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2319/4871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:42 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:42.942095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c5e5bbae-a31e-4600-a60f-ff40132a7972 req-ff38e951-7e95-4bcb-938c-65831f92114b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f3f729-84f5-4837-ad9c-063a22104016", "name": "network-vif-plugged", "status": "completed", "tag": "2aa178f0-2520-4e55-bf9a-17d4ee0b5701"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:42.987084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5e5bbae-a31e-4600-a60f-ff40132a7972 req-ff38e951-7e95-4bcb-938c-65831f92114b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.989476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5e5bbae-a31e-4600-a60f-ff40132a7972 req-ff38e951-7e95-4bcb-938c-65831f92114b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.991113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5e5bbae-a31e-4600-a60f-ff40132a7972 req-ff38e951-7e95-4bcb-938c-65831f92114b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.003763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:43.020698 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c5e5bbae-a31e-4600-a60f-ff40132a7972 req-ff38e951-7e95-4bcb-938c-65831f92114b service nova] Creating event network-vif-plugged:2aa178f0-2520-4e55-bf9a-17d4ee0b5701 for instance d1f3f729-84f5-4837-ad9c-063a22104016 on n-h2-846470-15 Aug 24 03:57:43.036462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c5e5bbae-a31e-4600-a60f-ff40132a7972 req-ff38e951-7e95-4bcb-938c-65831f92114b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109022 Aug 24 03:57:43.037790 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2320/4872] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:43.066065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:43.072309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:43.102667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:43.103185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:43.103640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.109605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:43.114146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:43.114666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.444332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:43.460880 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5570e6d0-e51b-42fb-98e3-0eb1daa5364e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 1.089985 Aug 24 03:57:43.480160 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2553/4873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:42 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:43.499636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:43.501373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:43.512760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:43.514144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:43.515251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.517399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:43.518609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:43.519744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.588107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:43.626378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:43.646137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:43.650026 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-193af4f1-5395-44e9-a3c3-eae76dce08b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.608127 Aug 24 03:57:43.651216 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2321/4874] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:43 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:44.350735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:44.364901 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d804eb64-4b14-4ffe-858d-184c259318d1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1679 microversion: 2.1 time: 0.882832 Aug 24 03:57:44.365507 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2554/4875] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:43 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1679 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:44.505025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:44.507755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:44.558849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.564833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.573361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.573361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.577449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.582299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.678656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:44.680026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:44.693533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.699465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.702608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.706756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.709463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.710166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.015325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:46.064364 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd22af7a-7907-4b26-906f-73ecd890ca57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 1.569049 Aug 24 03:57:46.083415 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2322/4876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:44 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:46.095198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:46.100587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:46.106351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:46.111916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:46.116794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:46.129654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-35b6a04a-9ef2-4c0f-8b73-bda1d23455a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 1.448383 Aug 24 03:57:46.131548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:46.132214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2555/4877] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:44 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:46.133107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:46.134063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.134939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:46.136659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:46.137195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.108061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:47.113300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:47.168310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:47.170013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:47.171527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.173810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:47.176075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:47.177559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.553278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:47.565598 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b36b2af-4559-4be2-8bf0-bdbe0338a9b2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1679 microversion: 2.1 time: 1.480417 Aug 24 03:57:47.568627 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2323/4878] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:46 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1679 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:47.583433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:47.584417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:47.600850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:47.601674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:47.602319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.603258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:47.603965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:47.609640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.876520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:47.884848 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d016fd14-eb31-45a9-bf79-d3a10045b1eb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 0.791720 Aug 24 03:57:47.893879 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2556/4879] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:47 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:48.592047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:48.592835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:48.619354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:48.622055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:48.624056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:48.626756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:48.630660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:48.631205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.261028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:49.285903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:49.326008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:49.330793 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d5f72e59-c15b-4533-a4b4-256b29c807f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 1.751247 Aug 24 03:57:49.331418 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2324/4880] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:47 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:49.363924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2712860b-d0a3-4db5-b571-1ecbb6d37e55 req-b33576e4-f03d-4243-a63a-f3054f73309d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188ff354-fb76-4eab-ae4e-f71851c55298", "name": "network-vif-plugged", "status": "completed", "tag": "5cd46ba5-2765-4573-b88e-656db2569a00"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:49.406056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2712860b-d0a3-4db5-b571-1ecbb6d37e55 req-b33576e4-f03d-4243-a63a-f3054f73309d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.409203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2712860b-d0a3-4db5-b571-1ecbb6d37e55 req-b33576e4-f03d-4243-a63a-f3054f73309d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.409938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2712860b-d0a3-4db5-b571-1ecbb6d37e55 req-b33576e4-f03d-4243-a63a-f3054f73309d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.470026 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2712860b-d0a3-4db5-b571-1ecbb6d37e55 req-b33576e4-f03d-4243-a63a-f3054f73309d service nova] Creating event network-vif-plugged:5cd46ba5-2765-4573-b88e-656db2569a00 for instance 188ff354-fb76-4eab-ae4e-f71851c55298 on n-h1-846470-15 Aug 24 03:57:49.506319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:49.515803 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2712860b-d0a3-4db5-b571-1ecbb6d37e55 req-b33576e4-f03d-4243-a63a-f3054f73309d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167454 Aug 24 03:57:49.516518 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2325/4881] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:49.528042 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3920f56f-a79b-499f-9b2c-557010c4d806 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1612 microversion: 2.1 time: 0.941492 Aug 24 03:57:49.558912 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2557/4882] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:48 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1612 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:49.583878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:49.584712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:49.599907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5151c263-628c-417e-8744-7eb807fa9fb7 req-14d942e9-eebf-49d8-8672-6be9371ed870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51814e8b-04b9-4f0a-a8eb-9a1ec11813ee", "name": "network-vif-deleted", "tag": "4cad4df9-6370-4f75-8184-c66935f131fd"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:49.634647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.635160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.635606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.636377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.636847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.637288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.676287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5151c263-628c-417e-8744-7eb807fa9fb7 req-14d942e9-eebf-49d8-8672-6be9371ed870 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.676776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5151c263-628c-417e-8744-7eb807fa9fb7 req-14d942e9-eebf-49d8-8672-6be9371ed870 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.677204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5151c263-628c-417e-8744-7eb807fa9fb7 req-14d942e9-eebf-49d8-8672-6be9371ed870 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.773287 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5151c263-628c-417e-8744-7eb807fa9fb7 req-14d942e9-eebf-49d8-8672-6be9371ed870 service nova] Creating event network-vif-deleted:4cad4df9-6370-4f75-8184-c66935f131fd for instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee on n-h1-846470-15 Aug 24 03:57:49.789970 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5151c263-628c-417e-8744-7eb807fa9fb7 req-14d942e9-eebf-49d8-8672-6be9371ed870 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229592 Aug 24 03:57:49.798114 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2558/4883] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:50.358416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:50.359226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:50.378365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.388427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.394834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.403172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.405227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.405227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.566718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:50.576743 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31cff6b1-9ff4-4dac-8299-3ba5a24ce2fa tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 1.058775 Aug 24 03:57:50.578129 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2326/4884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:49 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:50.595433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:50.598722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:50.624538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.625531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.628436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.629518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.630978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.632156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.716802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.717632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.720336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.721062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lazy-loading 'fault' on Instance uuid 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:50.823305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:50.858499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bcf2c766-b7f8-4e4e-bd68-8fb08b26b4e7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 200 len: 1330 microversion: 2.1 time: 0.274306 Aug 24 03:57:50.860735 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2327/4885] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:50 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 1330 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:51.600397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:51.602278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:51.643932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.647461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.648269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:51.649843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.653226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.653923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:52.073822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:52.099579 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15b2717b-38d4-468b-ae81-90c2b4a54c44 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1313 microversion: 2.1 time: 0.494621 Aug 24 03:57:52.100958 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2328/4886] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:51 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:52.106312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:52.107002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:52.146047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:52.146615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:52.147118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:52.147944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:52.154395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:52.155722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:52.189162 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee HTTP/1.1 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '51814e8b-04b9-4f0a-a8eb-9a1ec11813ee'} Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:52.204404 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:52.210430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:52.210430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:52.210430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:52.210430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:52.210430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:52.210430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 03:57:52.210430 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:52.214349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:52.215855 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ce96d50-9dfa-41f1-832f-61379a8e4155 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 404 len: 111 microversion: 2.1 time: 0.113514 Aug 24 03:57:52.226674 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2329/4887] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:52 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:52.235749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5fbffa2b-b156-4730-b41a-ae32b8cab34c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '.version_select at 0x7f1034243f70>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:52.258182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:52.297789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:52.304806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:52.317543 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b630adbf-a2a5-4df2-9e99-ab21f8ad2c7d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 1.962815 Aug 24 03:57:52.343501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2559/4888] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:50 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:52.352204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5fbffa2b-b156-4730-b41a-ae32b8cab34c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-391199567" status: 202 len: 0 microversion: 2.1 time: 0.121225 Aug 24 03:57:52.353299 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2330/4889] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 03:57:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-391199567 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:53.124637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:53.126517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:53.157430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.161115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.163494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.167270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.168540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.172711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.346646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:53.347756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:53.375819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.376343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.376801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.387631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:53.388417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:53.388884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.668166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.689903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.691748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.693961 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0b4670c-2b9d-471f-90f9-7cf4cca8a5a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.353103 Aug 24 03:57:53.714171 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2331/4890] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:53 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:53.996038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a9a1023-0422-4f3c-a643-dbac1268d494 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: .version_select at 0x7f1029ee3f70>, body: {"keypair": {"name": "tempest-keypair-510182398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzNayaJeQG+jjv+kweueetyrs5RvvdxJtFydmQAGKWlhoNr1eP0Q8U4OWzvTY2hQWHGcjfpy+a1QobfS1MN4l8zT46NJ2Mv+KnlSDrbtV2/yFozCULEB5ho2dde2D+Awg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:54.015351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3a9a1023-0422-4f3c-a643-dbac1268d494 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:57:54.022058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3a9a1023-0422-4f3c-a643-dbac1268d494 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for user cf384a2eab3649a2ad4f5eec8d8c6b0a and project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:57:54.061017 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a9a1023-0422-4f3c-a643-dbac1268d494 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068702 Aug 24 03:57:54.062936 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2332/4891] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:57:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:54.723227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:54.724045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:54.746897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.747612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.750273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.752157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.755745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.757073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.789113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:54.801708 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-136c4d16-cae4-4539-a678-8a6d0d877b5b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1462 microversion: 2.1 time: 1.684595 Aug 24 03:57:54.805497 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2560/4892] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:53 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1462 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:54.830067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:54.830675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:54.841372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.842116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.842722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.843463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.850206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.851096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.164874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.177629 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-becb31fc-5642-41ac-a42e-b9c7b0111137 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1463 microversion: 2.1 time: 0.351991 Aug 24 03:57:55.181748 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2561/4893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:54 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1463 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:55.195792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:55.197833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:55.232613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.234962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.238085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.245252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.245978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.246605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.250986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:55.278621 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 HTTP/1.1 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '307e338d-b5fd-4bee-af5d-4b4025316da5'} Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:55.281504 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.287693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.290537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:55.292156 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c614038e-1fe1-455e-9fb7-47513279be74 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 404 len: 111 microversion: 2.1 time: 0.108129 Aug 24 03:57:55.293185 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2562/4894] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:55 2022] DELETE /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:55.303259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-509393389", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d1f3f729-84f5-4837-ad9c-063a22104016"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:55.328371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.345804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.351366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.352903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-163f5d1e-b77f-4256-a5da-165c5bcf9995 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.634545 Aug 24 03:57:55.360059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2333/4895] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:54 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:55.368026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:55.368970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 307e338d-b5fd-4bee-af5d-4b4025316da5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:55.386404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.387266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.394404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.406160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.407075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.407562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.419287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:57:55.442601 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 HTTP/1.1 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '307e338d-b5fd-4bee-af5d-4b4025316da5'} Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:55.445351 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.450321 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:55.450321 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:55.450321 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:55.450321 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:55.450321 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:55.450321 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. Aug 24 03:57:55.450321 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:57:55.452618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 307e338d-b5fd-4bee-af5d-4b4025316da5 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:55.453753 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7c181033-1377-4ccc-beb3-73e15df4a873 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5" status: 404 len: 111 microversion: 2.1 time: 0.089761 Aug 24 03:57:55.454837 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2334/4896] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:55 2022] GET /compute/v2.1/servers/307e338d-b5fd-4bee-af5d-4b4025316da5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:55.476779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:55.477533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:55.487070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.499309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.500414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.501374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.502948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.503709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.553473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:55.782207 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b9151c2b-a2e5-4836-8ea9-e4c395ccd26b tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 204 len: 0 microversion: 2.1 time: 0.311145 Aug 24 03:57:55.784223 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2335/4897] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:55 2022] DELETE /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:55.795704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:55.800270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:55.810061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.812310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.813035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.814054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.814813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.815454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.256072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:56.265533 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3bbc5900-e2ec-4ce9-9a24-2064133e9caa tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.475347 Aug 24 03:57:56.275582 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2336/4898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:55 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:56.378048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:56.379010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:56.395537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.396400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.397698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.399480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.400455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.401183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.763844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:57:56.764484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:57:56.764746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:57:56.765175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:57:56.765598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:57:56.803019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.810384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.817186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.821909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.827943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.831577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.918493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Getting quotas for project cc701588f8524a4aa1668b96c8a494c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:57:56.937685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Getting quotas for user d5e5b8a94a774ed794e1aed66bb5b9cf and project cc701588f8524a4aa1668b96c8a494c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:57:57.008172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:57:57.019154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:57:57.174224 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cfe1a686-4f4a-4b23-89a8-e57da6d0d8ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878986 Aug 24 03:57:57.176982 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2563/4899] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:57:57.188187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.197008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6559393f-5ea3-4198-b160-7726d8068f57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:57.199179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6559393f-5ea3-4198-b160-7726d8068f57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:57.222966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.231191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.245382 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dff745e2-ca45-4e2e-8f0b-2b583cfcdddc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.864286 Aug 24 03:57:57.247482 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2337/4900] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:56 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:57.304591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:57.308983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:57.330948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:57.331944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:57.332775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:57.334362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:57.336307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:57.337758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:57.803961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6559393f-5ea3-4198-b160-7726d8068f57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.823847 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6559393f-5ea3-4198-b160-7726d8068f57 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1213 microversion: 2.1 time: 0.639306 Aug 24 03:57:57.827065 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2564/4901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:57 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1213 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:58.294223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:58.295438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:58.319582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:58.324231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:58.326397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:58.328549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:58.331398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:58.333251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:58.874873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:58.936382 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47750697-9894-4132-bfe3-55cdae6b8eef tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 1.638586 Aug 24 03:57:58.958794 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2338/4902] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:57 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:58.969694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:58.970640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:59.009900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:59.011764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:59.014053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:59.018036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:59.018868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:59.019495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:59.081641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:59.192480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:59.204016 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d1a7133a-16b7-44c8-96f5-0c906c45540c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1265 microversion: 2.1 time: 0.242716 Aug 24 03:57:59.204574 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2339/4903] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:58 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:59.218568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1633007742", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dedb9b92-960d-40c5-ae39-a6e49a145a80"}], "security_groups": [{"name": "tempest-securitygroup--481532810"}], "key_name": "tempest-keypair-510182398", "user_data": "}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:59.546398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] validate_networks() for [('dedb9b92-960d-40c5-ae39-a6e49a145a80', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:57:59.562310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:59.586610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:59.588534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:59.589783 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d6286083-6c33-43aa-8739-d7af08d42ad1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 1.303924 Aug 24 03:57:59.590378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2565/4904] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:58 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:59.999623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:00.000297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:00.006490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.006982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.013626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:00.014395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.014877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.015316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:00.568195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954bba87fcf4e76b41d51c2388651c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a588d986b44a2a321f79764a8f765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:00.577389 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-51c1df55-0fa3-4a49-b156-e16dd7b82657 tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 200 len: 1512 microversion: 2.1 time: 0.582144 Aug 24 03:58:00.588297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2566/4905] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:59 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 1512 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:00.593389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:00.594021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:00.596991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:00.613209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.613984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.626120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:00.627282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.628311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.630421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:00.902117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:00.928397 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f512583-ae21-4be2-885d-a79ba38245ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1271 microversion: 2.1 time: 0.346334 Aug 24 03:58:00.932670 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2567/4906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:00 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1271 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:00.952767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:00.953516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:00.978775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.979842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.980586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:00.981630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:00.982537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:00.983201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.451100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:01.469299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:01.471541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:01.473902 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05b19c8f-2ec4-4662-910b-19272ebe18ea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.535552 Aug 24 03:58:01.488756 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2568/4907] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:00 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:01.495704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-40a07880-edfb-4c53-b525-ab7ab0564178 req-d98b2c77-0fc1-4ad6-8423-0cd30506315d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b", "name": "network-vif-deleted", "tag": "7ecd8efe-e9af-4340-8d71-bf379a496626"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:01.508238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-40a07880-edfb-4c53-b525-ab7ab0564178 req-d98b2c77-0fc1-4ad6-8423-0cd30506315d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.509320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-40a07880-edfb-4c53-b525-ab7ab0564178 req-d98b2c77-0fc1-4ad6-8423-0cd30506315d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.509979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-40a07880-edfb-4c53-b525-ab7ab0564178 req-d98b2c77-0fc1-4ad6-8423-0cd30506315d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.526173 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-40a07880-edfb-4c53-b525-ab7ab0564178 req-d98b2c77-0fc1-4ad6-8423-0cd30506315d service nova] Creating event network-vif-deleted:7ecd8efe-e9af-4340-8d71-bf379a496626 for instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b on n-h1-846470-15 Aug 24 03:58:01.537183 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-40a07880-edfb-4c53-b525-ab7ab0564178 req-d98b2c77-0fc1-4ad6-8423-0cd30506315d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046768 Aug 24 03:58:01.540711 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2569/4908] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:01.549999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1aa20592-3b2a-448d-9dd6-9c5dffe5d673 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'create', calling method: .version_select at 0x7f10234388b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-324190809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBpueXOwPc/MrXsESKWNGpvfs3hwgeF3VcOgLJZXczUgW/kiT3ps49qPFI1MY+KExBy7+jlGY/ADlHJoAS6d86s829HA3TMQZ798oKRuqbGUawoXeIqXN2cp1jh8tYhQQ=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:01.568497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1aa20592-3b2a-448d-9dd6-9c5dffe5d673 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:58:01.576703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1aa20592-3b2a-448d-9dd6-9c5dffe5d673 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for user 5c7f4a326b7a4b598ca962847679ac13 and project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:58:01.617241 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1aa20592-3b2a-448d-9dd6-9c5dffe5d673 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.071297 Aug 24 03:58:01.619799 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2570/4909] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 03:58:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:01.632116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:01.633105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] [instance: 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:01.640297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.641449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.642596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.644112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.644880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.646290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.669584 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] HTTP exception thrown: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b could not be found. Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Request method failure captured: Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b HTTP/1.1 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaDD5ZX5eQ8Z-MDvZDYVE1bBmOOcy_LRKJXcKBqIq93yvt3_LOuahl7iY5V3IroCXLQj8CkkIalqSiTYVD17KTCiFyKUb681jbGDhsr80m45e6X0JarvAKw2ZL0FJr1MwXMz-UAP8fzzUWh6TUVzbRYFWGrFIKsc5groEzCkODx3GH4 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b1a588d986b44a2a321f79764a8f765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b1a588d986b44a2a321f79764a8f765 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-743651872 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5954bba87fcf4e76b41d51c2388651c5 Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-743651872-project Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b could not be found. Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b'} Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b could not be found. Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b could not be found. Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:01.672328 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.677891 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:01.677891 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:01.677891 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:01.677891 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:01.677891 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:01.677891 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b could not be found. Aug 24 03:58:01.677891 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:58:01.678472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] Returning 404 to user: Instance 16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:01.680675 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16266528-4cdb-4e0c-a92f-4695dbefa78f tempest-ServersNegativeTestJSON-743651872 tempest-ServersNegativeTestJSON-743651872-project] 10.222.0.58 "GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b" status: 404 len: 111 microversion: 2.1 time: 0.057951 Aug 24 03:58:01.686238 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2571/4910] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:01 2022] GET /compute/v2.1/servers/16d5b8a9-90fe-4aee-aa67-ec285b1f6b4b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:58:01.959482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:01.962312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:01.975876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.979933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.980854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:01.981877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:01.982593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:01.985345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:02.138810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:02.152929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2822e400-3970-41fb-88cb-34f7df190f74 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1271 microversion: 2.1 time: 0.201285 Aug 24 03:58:02.170647 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2572/4911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:01 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:02.506059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:02.520071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:02.534109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:02.558086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:02.558552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:02.559309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:02.559801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:02.560558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:02.988226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:03.026273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:03.028908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:03.031095 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-355b0a02-6115-4feb-9410-2095ff6372b1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.535259 Aug 24 03:58:03.048768 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2573/4912] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:02 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:03.178050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:03.179070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:03.189337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:03.189847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:03.196186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:03.198421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:03.199114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:03.199767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:03.431422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:58:03.432066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:58:03.433624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:58:03.434503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:58:03.434972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:58:03.463447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:03.469406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:03.470653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:03.475814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:03.476074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:03.476506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:03.553373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:58:03.569991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Getting quotas for user cf384a2eab3649a2ad4f5eec8d8c6b0a and project fd5b7dab3ce34ee7a7280eb670023a03. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:58:03.604226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:58:03.611765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:58:03.690791 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c19ccee2-c28d-458a-88e0-b00f7583e9d4 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.482187 Aug 24 03:58:03.691842 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2340/4913] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:57:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 4484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:58:03.707182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:03.721511 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e9ca2ef-fe6b-4bcc-8b9c-5730bf53c2d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1271 microversion: 2.1 time: 0.546413 Aug 24 03:58:03.730049 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2574/4914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:03 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1271 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:03.738720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c9c3d3f-7938-4af4-87af-938f2569629c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:03.739361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c9c3d3f-7938-4af4-87af-938f2569629c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:03.786508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:04.055013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:04.056360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:04.086403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.087354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.087925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.092393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.092936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.093423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.363888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c9c3d3f-7938-4af4-87af-938f2569629c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:04.392227 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c9c3d3f-7938-4af4-87af-938f2569629c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1241 microversion: 2.1 time: 0.684997 Aug 24 03:58:04.402302 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2341/4915] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:03 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1241 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:04.710387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:04.726299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:04.741842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:04.742686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:04.743880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:04.748586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76f3eca4-33a6-4260-a964-890b78576f1f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.693517 Aug 24 03:58:04.751236 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2575/4916] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:04 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:04.770167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.770440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.770697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.781944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.785392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.787347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:05.418261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:05.421276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:05.439642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:05.443157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:05.446928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:05.450511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:05.451321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:05.454960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:05.725413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:05.745145 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7ff1c00-38b8-49a9-8228-226edf7b977e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1293 microversion: 2.1 time: 0.333118 Aug 24 03:58:05.746081 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2576/4917] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:05 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1293 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:05.778955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:05.779755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:05.812226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:05.814031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:05.814598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:05.816028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:05.816567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:05.817069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:06.000267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.021290 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-10620d98-873a-453d-9d8f-c01e076deb67 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 1.282471 Aug 24 03:58:06.037757 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2342/4918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:04 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:06.395077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.425893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.435845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.437844 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8cbfb15a-8232-4aa6-bad4-babc60371356 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1737 microversion: 2.20 time: 0.663656 Aug 24 03:58:06.440825 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2577/4919] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:05 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1737 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:06.772160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:06.772783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:06.806467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:06.807377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:06.816206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:06.817052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:06.817545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:06.817981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.032971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.045870 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ddb8e3d-f7e1-49ec-a795-8f0829cee681 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1299 microversion: 2.1 time: 0.277459 Aug 24 03:58:07.049207 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2343/4920] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:06 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:07.050454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:07.065934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:07.066808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:07.081319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.081812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.082443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.083151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.083608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.084063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.470199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:07.477685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.482978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:07.511475 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9cbf2dab-f1ea-4254-bcfc-bf601ed28358 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 0.454893 Aug 24 03:58:07.514240 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2578/4921] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:07 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:07.518070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.519001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.519623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.520578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.521397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.521986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.074625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:08.075928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:08.092826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.093264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.093719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.094465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.094933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.099048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.372126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.388455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.390291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.401711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-51f14d6c-7966-4da2-b118-a7181ca12161 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1719 microversion: 2.20 time: 0.941658 Aug 24 03:58:08.426609 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2344/4922] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:07 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1719 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:08.468453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.482043 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7f2f6fb9-98f9-494c-b7aa-272cfa26ac38 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1299 microversion: 2.1 time: 0.416284 Aug 24 03:58:08.484697 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2579/4923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:08 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1299 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:08.537235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:08.537865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:08.545903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.546873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.549800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.551241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.552067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.553291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.259154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a630ba6d-dc93-41b7-86d2-ab05db078a7e req-10ad09ce-5509-44e8-ae5f-3af0baef64fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef4b894-cf51-42d9-9be0-26c55757f63e", "tag": "87b63e62-8f5b-43bd-8ca4-01f1bc8bb464"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:09.284300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a630ba6d-dc93-41b7-86d2-ab05db078a7e req-10ad09ce-5509-44e8-ae5f-3af0baef64fc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.285285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a630ba6d-dc93-41b7-86d2-ab05db078a7e req-10ad09ce-5509-44e8-ae5f-3af0baef64fc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.285896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a630ba6d-dc93-41b7-86d2-ab05db078a7e req-10ad09ce-5509-44e8-ae5f-3af0baef64fc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.322834 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a630ba6d-dc93-41b7-86d2-ab05db078a7e req-10ad09ce-5509-44e8-ae5f-3af0baef64fc service nova] Creating event network-changed:87b63e62-8f5b-43bd-8ca4-01f1bc8bb464 for instance 9ef4b894-cf51-42d9-9be0-26c55757f63e on n-h2-846470-15 Aug 24 03:58:09.340172 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a630ba6d-dc93-41b7-86d2-ab05db078a7e req-10ad09ce-5509-44e8-ae5f-3af0baef64fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085994 Aug 24 03:58:09.341158 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2580/4924] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:09.346579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1771606765", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "5938698e-ecff-40ed-81fd-c8173d51c3ce"}], "key_name": "tempest-TestNetworkBasicOps-324190809", "security_groups": [{"name": "tempest-secgroup-smoke-603673134"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:09.783598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:09.800531 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bee85440-81e8-40ae-921d-a81313b17ce2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 1.268791 Aug 24 03:58:09.817961 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2345/4925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:08 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:09.840493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:09.841700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:09.851310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.853521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] validate_networks() for [('5938698e-ecff-40ed-81fd-c8173d51c3ce', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:58:09.858587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.859408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.862146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.865145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.883285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:10.513683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:10.525460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:10.527303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:10.529378 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-70ea236b-50d4-4786-9630-2c1a4f9ba7bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1719 microversion: 2.20 time: 0.709234 Aug 24 03:58:10.531237 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2346/4926] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:09 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1719 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:10.547176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:10.547867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:10.564794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:10.565434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:10.565890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:10.566715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:10.569627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:10.570100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:10.960683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:10.971164 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-620ef68a-5b50-4693-b042-425a554a55a8 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.438607 Aug 24 03:58:10.979202 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2347/4927] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:10 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:11.001181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:11.001800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:11.023752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.024287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.026667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.027412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.027937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.028345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.589516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:11.767252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:11.779255 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3f8883e7-d871-4909-a06b-b8c5c37d2f58 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 0.797754 Aug 24 03:58:11.795956 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2348/4928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:10 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:11.804451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6484f23b-6ae0-49a0-8986-d2b879312cf1 req-b1b906bb-c63f-4731-a4d9-1a2d939d5d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaceb98-646f-4cc9-b6d0-564c697b2537", "name": "network-vif-unplugged", "status": "completed", "tag": "b4cd305e-193b-42fa-834b-651256717f69"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:11.831823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6484f23b-6ae0-49a0-8986-d2b879312cf1 req-b1b906bb-c63f-4731-a4d9-1a2d939d5d51 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.838833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6484f23b-6ae0-49a0-8986-d2b879312cf1 req-b1b906bb-c63f-4731-a4d9-1a2d939d5d51 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.839396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6484f23b-6ae0-49a0-8986-d2b879312cf1 req-b1b906bb-c63f-4731-a4d9-1a2d939d5d51 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.884584 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6484f23b-6ae0-49a0-8986-d2b879312cf1 req-b1b906bb-c63f-4731-a4d9-1a2d939d5d51 service nova] Creating event network-vif-unplugged:b4cd305e-193b-42fa-834b-651256717f69 for instance ebaceb98-646f-4cc9-b6d0-564c697b2537 on n-h1-846470-15 Aug 24 03:58:11.903438 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6484f23b-6ae0-49a0-8986-d2b879312cf1 req-b1b906bb-c63f-4731-a4d9-1a2d939d5d51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105763 Aug 24 03:58:11.906420 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2349/4929] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:11.929342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:11.930214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:11.953632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.954983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.960757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.963550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.964172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.965568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.336462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:12.349551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:12.352670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:12.353948 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-273b860b-b3d2-495e-83ce-e5193709adea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1719 microversion: 2.20 time: 0.442993 Aug 24 03:58:12.371810 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2350/4930] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:11 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1719 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:12.377268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:12.378168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:12.385061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.385919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.386565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.387605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.388725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.389427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.584982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:12.594357 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-55161ce5-e33d-4157-997d-689aa44a7ecb tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.221086 Aug 24 03:58:12.594994 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2351/4931] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:12 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:12.599945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fb2b21be-9c9e-4f77-a6c9-ae36cb1a4490 req-858aa964-6892-459c-a1e9-6994d45ed810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d08b0fd-813e-439c-acca-a34994d9fccc", "tag": "7425a222-91e8-4baa-8e76-8ceb65737641"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:12.610294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fb2b21be-9c9e-4f77-a6c9-ae36cb1a4490 req-858aa964-6892-459c-a1e9-6994d45ed810 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.610781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fb2b21be-9c9e-4f77-a6c9-ae36cb1a4490 req-858aa964-6892-459c-a1e9-6994d45ed810 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.611215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fb2b21be-9c9e-4f77-a6c9-ae36cb1a4490 req-858aa964-6892-459c-a1e9-6994d45ed810 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.623739 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fb2b21be-9c9e-4f77-a6c9-ae36cb1a4490 req-858aa964-6892-459c-a1e9-6994d45ed810 service nova] Creating event network-changed:7425a222-91e8-4baa-8e76-8ceb65737641 for instance 1d08b0fd-813e-439c-acca-a34994d9fccc on n-h2-846470-15 Aug 24 03:58:12.628983 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fb2b21be-9c9e-4f77-a6c9-ae36cb1a4490 req-858aa964-6892-459c-a1e9-6994d45ed810 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032628 Aug 24 03:58:12.629597 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2352/4932] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:12.802786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:12.803552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:12.810534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.811052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.811500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.812263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.812758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.813192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.967881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:12.976919 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16d58e40-89fc-42d6-8ba2-3e030ba4eef1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 0.178472 Aug 24 03:58:12.977569 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2353/4933] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:12 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:12.980305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:58:12.981683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:58:12.981683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:58:12.982146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:58:12.983832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:58:12.993584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.994075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.994547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.995282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.995840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.996297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.015649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:58:13.021023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Getting quotas for user 5c7f4a326b7a4b598ca962847679ac13 and project 3d1641d4e3764347a4ad4c91c0ee21ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:58:13.034576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:58:13.037767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:58:13.095469 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb9a301c-f95c-465c-9a16-6e9fd2ac7367 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.752866 Aug 24 03:58:13.102321 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2581/4934] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:58:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 3755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:58:13.108160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-533b123a-3ef8-4ab2-a317-39d1e244742e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:13.108790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-533b123a-3ef8-4ab2-a317-39d1e244742e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:13.164103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-533b123a-3ef8-4ab2-a317-39d1e244742e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:13.171336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-533b123a-3ef8-4ab2-a317-39d1e244742e tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1248 microversion: 2.1 time: 0.067332 Aug 24 03:58:13.171945 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2354/4935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:13 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1248 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:13.380482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:13.385993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:13.414146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:13.414874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:13.415913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.416989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:13.417740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:13.418397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.622003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:13.623115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:13.637409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:13.644624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:13.647482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:13.648540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.651610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:13.653884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:13.654843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.134835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.145062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.162276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.164315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4295b862-7edd-44fa-ac74-7b10ba958fd0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1662 microversion: 2.20 time: 0.788801 Aug 24 03:58:14.166886 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2582/4936] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:13 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1662 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:14.179416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:14.180367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:14.196978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.197753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.199456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.201504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.202903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.212340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.334611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.348107 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fe34b477-2364-4702-9950-423e4bc5ca83 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.734230 Aug 24 03:58:14.349134 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2355/4937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:13 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:14.358194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:14.361801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:14.377787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.381162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.384369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.385437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.386882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.390580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.572926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.583047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81f22151-dd64-4aa3-8936-b765dd77603f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 0.413282 Aug 24 03:58:14.595934 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2583/4938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:14 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:14.609948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.616507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c034b186-9366-46a0-b787-f9c51171af1d"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:14.619181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:14.619339 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db6f9ae3-03c3-490f-8e53-eea66b8f8a3c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1244 microversion: 2.1 time: 0.268759 Aug 24 03:58:14.623373 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2356/4939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:14 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1244 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:14.641417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.642477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.643124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.644119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.644748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.645357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.820144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:15.378549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:15.381186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:15.398722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.399227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.400169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.402350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.405451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.405891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.418346 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e8ee3b1d-f4f1-46e6-8ec7-09bef11b04b7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.806379 Aug 24 03:58:15.425602 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2584/4940] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 24 03:58:14 2022] POST /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 188 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:58:15.619333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:15.627806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:15.642655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.642655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.642872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.643545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.644403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.644848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.762160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.772298 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06b6fb87-47c6-40a2-ab30-485b9ac7d6a1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.405010 Aug 24 03:58:15.773660 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2357/4941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:15 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:15.780635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:15.781307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:15.787868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.788663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.789363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.790779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.791439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.792012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.901638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.909706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122535) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:58:15.909919 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f7d88f65-b9d0-41e3-b7e2-a6802b196b6c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 0.295949 Aug 24 03:58:15.910392 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2585/4942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:15 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:15.929662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:15.930552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:15.937142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.937910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.938534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.939415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.940173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.940774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.031959 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cec75b11-39b1-4b9a-a5ab-ab8bf8bf85de tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/action" status: 202 len: 0 microversion: 2.20 time: 0.256323 Aug 24 03:58:16.032595 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2358/4943] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 03:58:15 2022] POST /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:58:16.047773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.051350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:16.052036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:16.071449 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-841dc6b9-1a8c-4fca-b716-de4869092ac3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1306 microversion: 2.1 time: 0.145657 Aug 24 03:58:16.077873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.078553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.078912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.079692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.080171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.080602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.093428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:16.102446 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2586/4944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:15 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1306 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:16.677561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-038b8383-6afc-4310-a706-e24747c62d28 req-df6a67ca-e296-4ac4-9a86-c7c935137da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef4b894-cf51-42d9-9be0-26c55757f63e", "name": "network-vif-plugged", "status": "completed", "tag": "87b63e62-8f5b-43bd-8ca4-01f1bc8bb464"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:16.694755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-038b8383-6afc-4310-a706-e24747c62d28 req-df6a67ca-e296-4ac4-9a86-c7c935137da5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.697755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-038b8383-6afc-4310-a706-e24747c62d28 req-df6a67ca-e296-4ac4-9a86-c7c935137da5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.698928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-038b8383-6afc-4310-a706-e24747c62d28 req-df6a67ca-e296-4ac4-9a86-c7c935137da5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.731585 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-038b8383-6afc-4310-a706-e24747c62d28 req-df6a67ca-e296-4ac4-9a86-c7c935137da5 service nova] Creating event network-vif-plugged:87b63e62-8f5b-43bd-8ca4-01f1bc8bb464 for instance 9ef4b894-cf51-42d9-9be0-26c55757f63e on n-h2-846470-15 Aug 24 03:58:16.737698 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-038b8383-6afc-4310-a706-e24747c62d28 req-df6a67ca-e296-4ac4-9a86-c7c935137da5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064110 Aug 24 03:58:16.738909 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2587/4945] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:16.804531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.806898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:16.824413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.825538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.828126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.829250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.831228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.840407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.434967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.448068 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9a2bdf52-29f1-4ce6-ade1-c26e82c97024 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.655206 Aug 24 03:58:17.451123 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2588/4946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:16 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:17.465632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:17.466689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:17.473817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:17.474547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:17.475186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.476260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:17.476917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:17.477453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.554936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.572826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.581313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.582711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab36f0f3-6813-4eb7-bba6-c749e5c80874 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1748 microversion: 2.20 time: 1.545544 Aug 24 03:58:17.583885 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2359/4947] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:16 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1748 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:17.592345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:17.593224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:17.625419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:17.626908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:17.627576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.630052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:17.631398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:17.632291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.803577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.819148 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce7d7ffc-8892-4b44-b9dd-9dd244f4d4fb tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 0.366834 Aug 24 03:58:17.834902 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2589/4948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:17 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:18.400921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:18.416128 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e3061761-a8e4-4c0f-b66b-43528f8dc3ec tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.825564 Aug 24 03:58:18.418007 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2360/4949] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:17 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:18.473352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:18.474309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:18.484243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.488507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.489226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.490211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.490857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.491463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.611151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:18.611921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:18.619979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.621143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.621606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.622528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.623320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.623952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.890311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:18.925758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b5af15d-7337-44a9-8b34-4723fe49769c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.458656 Aug 24 03:58:18.940491 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2590/4950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:18 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:18.940491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:18.940491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:18.953027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.953548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.958144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.959315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.961543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.961543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:19.127563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:19.143641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:19.145415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:19.146839 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff6eed6e-1f47-4816-b893-a09ae055ead3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1750 microversion: 2.20 time: 0.542778 Aug 24 03:58:19.160311 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2361/4951] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:18 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1750 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:19.383887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:19.397392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ec6c9ac-3043-4516-9f57-3f876e8c1400 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 0.465825 Aug 24 03:58:19.399977 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2591/4952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:18 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:19.437531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:19.438154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:19.447327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:19.449885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:19.451220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:19.453725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:19.454387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:19.455074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:19.802373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:19.810860 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-edfe831f-4a46-4c01-b585-9cb5c7c41498 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.377381 Aug 24 03:58:19.815611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2362/4953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:19 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:19.947489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:19.948145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:19.979793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:19.980584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:19.981048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:19.983932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:19.984449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:19.984891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:20.099316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0cf57d2e-8809-4190-af6b-c65ef8eb83a2 req-0ad2889e-423e-4df2-85a8-8499ae89c02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dfa6037-d629-433f-aa3f-ee1e0180d7f8", "tag": "c06a845d-1c04-4cfc-93c1-ddc875bedf5e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:20.114673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0cf57d2e-8809-4190-af6b-c65ef8eb83a2 req-0ad2889e-423e-4df2-85a8-8499ae89c02b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.121689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0cf57d2e-8809-4190-af6b-c65ef8eb83a2 req-0ad2889e-423e-4df2-85a8-8499ae89c02b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.122361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0cf57d2e-8809-4190-af6b-c65ef8eb83a2 req-0ad2889e-423e-4df2-85a8-8499ae89c02b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:20.166759 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0cf57d2e-8809-4190-af6b-c65ef8eb83a2 req-0ad2889e-423e-4df2-85a8-8499ae89c02b service nova] Creating event network-changed:c06a845d-1c04-4cfc-93c1-ddc875bedf5e for instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 on n-h1-846470-15 Aug 24 03:58:20.178291 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0cf57d2e-8809-4190-af6b-c65ef8eb83a2 req-0ad2889e-423e-4df2-85a8-8499ae89c02b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077208 Aug 24 03:58:20.178291 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2363/4954] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:20.182877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:20.184296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:20.194207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.195369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.196008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:20.198000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.199083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.199778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:20.348857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:20.359411 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dabda483-3e58-48e7-a8a5-1194e97fdd68 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.416485 Aug 24 03:58:20.365793 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2592/4955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:19 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:20.422015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:20.422922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:20.435862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.436793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.437437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:20.440006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.442672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.443605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:20.717612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:20.736980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:20.742530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:20.744220 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1fda9c83-2cbe-4e4d-8e36-f61d3e8a7081 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1750 microversion: 2.20 time: 0.567694 Aug 24 03:58:20.755043 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2364/4956] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:20 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1750 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:20.837890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:20.838608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:20.851076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.851692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.852156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:20.852914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:20.853437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:20.853900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.176442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:21.197342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fed5d22-a2c6-4bdd-b6f9-986936629925 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1313 microversion: 2.1 time: 0.776739 Aug 24 03:58:21.198516 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2593/4957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:20 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1313 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:21.385808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:21.386936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:21.401739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:21.418652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:21.425673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:21.426292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.427064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:21.427539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:21.430377 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-da797e2f-10ca-468f-aa0a-e8ab549667ae tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.588498 Aug 24 03:58:21.431837 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2365/4958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:20 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:21.432927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.787405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:21.788473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:21.799703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:21.811237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:21.812171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.813131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:21.813778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:21.814379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.826782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:21.851330 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b977a21-2787-45a9-a0bf-250d23744809 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.470170 Aug 24 03:58:21.865200 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2594/4959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:21 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:22.193932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:22.216935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:22.219131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:22.224215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:22.225559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:22.225825 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c0c21d5b-8310-4b65-964d-bf3dacced572 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1750 microversion: 2.20 time: 0.441361 Aug 24 03:58:22.228861 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2366/4960] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:21 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1750 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:22.240587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.241839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.242823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.243905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.248429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.251202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.455846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:22.456783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:22.468348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.472511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.473284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.474397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.480681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.481617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.853091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:22.872801 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f3f97b6-62ee-437a-87dc-4b62e82b202f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1462 microversion: 2.1 time: 0.649263 Aug 24 03:58:22.873742 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2595/4961] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:22 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1462 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:22.888386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:22.890403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:22.907875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.909037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.912869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.913922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.914509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.917388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:23.005981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:23.028509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:23.052567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:23.074210 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d4e46156-4d97-4ddf-a6f9-615101867ec3 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.620214 Aug 24 03:58:23.075270 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2367/4962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:22 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:23.168605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=14 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:23.538121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:23.546867 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b30031e-def2-4c49-86bf-af42f4e1b6c0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.669956 Aug 24 03:58:23.566776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2596/4963] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:22 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:23.592721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:23.593656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:23.601612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:23.613486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:23.613946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:23.614710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:23.615799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:23.615799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:23.963119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:23.973307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Searching by: {'deleted': False, 'project_id': '172356fb42d54878b370be604e4b4ae9'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:58:24.006159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.006727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.007165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.017891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.019335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.019891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.108703 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-638f3c0d-d12f-4f3b-9252-8dab0821b6fb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.027462 Aug 24 03:58:24.110321 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2368/4964] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 03:58:23 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:58:24.121869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:24.132767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:24.145683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.146631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.147387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.148410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.149208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.150058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.217501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:24.232701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:24.239809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:24.245843 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f38191ea-92d8-4d18-924e-00b7c47dff58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1750 microversion: 2.20 time: 0.677342 Aug 24 03:58:24.247505 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2597/4965] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:23 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1750 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:24.256731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:24.273693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Searching by: {'deleted': False} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:58:24.292112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.294817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.296603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.298953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.300519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.302766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.702268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:58:24.853843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:24.854351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:24.854783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:24.858434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:25.227604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:25.241199 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef5d8de8-daba-4b47-aa90-9a5509d1fb13 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 1.128407 Aug 24 03:58:25.241804 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2369/4966] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:24 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:25.255915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:25.256726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:25.270572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.281989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.286633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:25.302811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.303502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.304007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:25.504432 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7a797c0-21af-4e5a-885f-fce2093b6693 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 9653 microversion: 2.1 time: 1.255051 Aug 24 03:58:25.505470 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2598/4967] 10.222.0.58 () {58 vars in 1171 bytes} [Wed Aug 24 03:58:24 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 9653 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:25.510368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a5a7de24-c049-41be-aff5-a895beb23b87 req-f3e7a9f4-f3e5-4b76-b4c0-cc8ed68fe18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d08b0fd-813e-439c-acca-a34994d9fccc", "name": "network-vif-plugged", "status": "completed", "tag": "7425a222-91e8-4baa-8e76-8ceb65737641"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:25.522655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5a7de24-c049-41be-aff5-a895beb23b87 req-f3e7a9f4-f3e5-4b76-b4c0-cc8ed68fe18c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.523541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5a7de24-c049-41be-aff5-a895beb23b87 req-f3e7a9f4-f3e5-4b76-b4c0-cc8ed68fe18c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.524241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5a7de24-c049-41be-aff5-a895beb23b87 req-f3e7a9f4-f3e5-4b76-b4c0-cc8ed68fe18c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:25.545281 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a5a7de24-c049-41be-aff5-a895beb23b87 req-f3e7a9f4-f3e5-4b76-b4c0-cc8ed68fe18c service nova] Creating event network-vif-plugged:7425a222-91e8-4baa-8e76-8ceb65737641 for instance 1d08b0fd-813e-439c-acca-a34994d9fccc on n-h2-846470-15 Aug 24 03:58:25.553581 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a5a7de24-c049-41be-aff5-a895beb23b87 req-f3e7a9f4-f3e5-4b76-b4c0-cc8ed68fe18c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046544 Aug 24 03:58:25.554953 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2599/4968] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:25.563890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:25.565037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:25.573072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.573935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.574613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:25.575621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:25.576620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:25.577288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:25.892658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:25.929562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:25.931066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:25.932369 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b6c88b6-8239-40c3-9eeb-e3a708d95a62 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1750 microversion: 2.20 time: 0.375629 Aug 24 03:58:25.932944 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2600/4969] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:25 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1750 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:25.963215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:25.968067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:25.976331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Searching by: {'deleted': False, 'project_id': '172356fb42d54878b370be604e4b4ae9'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:58:25.983512 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f7477335-2fc9-44ff-97eb-27dd524424d7 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.737565 Aug 24 03:58:25.984334 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2370/4970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:25 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:26.013847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:26.014488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:26.014943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:26.015798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:26.016274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:26.016706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:26.111286 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ad9bd359-adca-489f-99cf-b93f4836d6fa tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?tenant_id=cc701588f8524a4aa1668b96c8a494c0" status: 200 len: 15 microversion: 2.1 time: 0.168777 Aug 24 03:58:26.127925 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2601/4971] 10.222.0.58 () {58 vars in 1231 bytes} [Wed Aug 24 03:58:25 2022] GET /compute/v2.1/servers/detail?tenant_id=cc701588f8524a4aa1668b96c8a494c0 => generated 15 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:58:26.135196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.142128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Searching by: {'tenant_id': 'cc701588f8524a4aa1668b96c8a494c0', 'deleted': False} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:58:26.167880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:26.170098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:26.172987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:26.173813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:26.177029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:26.177603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:26.247803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:58:26.288677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:26.290151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:26.321799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:26.339982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:26.341385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:26.342508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:26.353195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:26.353492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:26.354737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:26.354961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:26.356076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:26.356419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:26.733366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:26.747908 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b1dc655e-1754-4374-bc51-976e672ebd36 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.463448 Aug 24 03:58:26.749585 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2602/4972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:26.996534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:27.000695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:27.016343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.017616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.018955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.020441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.021655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.022623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.188375 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7ffd4b93-99a9-4082-9ab7-44355d2e2d70 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cc701588f8524a4aa1668b96c8a494c0" status: 200 len: 4829 microversion: 2.1 time: 1.056151 Aug 24 03:58:27.203699 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2371/4973] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cc701588f8524a4aa1668b96c8a494c0 => generated 4829 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:27.210214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:27.216715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:27.256306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.258651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.259853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.262886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.264956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.266729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.402863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:27.427244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:27.430563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:27.433509 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f115a1e0-8287-462e-9597-71b996ed088f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1750 microversion: 2.20 time: 0.440714 Aug 24 03:58:27.434906 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2603/4974] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:26 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1750 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:27.445785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:27.460846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Searching by: {'tenant_id': '172356fb42d54878b370be604e4b4ae9', 'deleted': False} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:58:27.471566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.473924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.474965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.476696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.478101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.479583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.564019 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4127327-7d01-4b4b-9820-6b4fecaac61b tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=172356fb42d54878b370be604e4b4ae9" status: 200 len: 15 microversion: 2.1 time: 0.127059 Aug 24 03:58:27.566377 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2604/4975] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 24 03:58:27 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=172356fb42d54878b370be604e4b4ae9 => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:58:27.598008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-540bfddd-77b1-43cb-9ddc-786cd2728868 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:27.617300 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-540bfddd-77b1-43cb-9ddc-786cd2728868 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.030019 Aug 24 03:58:27.634972 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2605/4976] 10.222.0.58 () {58 vars in 1189 bytes} [Wed Aug 24 03:58:27 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:58:27.693612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:27.705267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:27.725490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.726132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.726700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:27.727608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:27.731593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:27.732535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.025585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:28.053280 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dfdbc4a4-b1ca-4007-be8d-e59aaf45b28e tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1366 microversion: 2.1 time: 0.859984 Aug 24 03:58:28.058436 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2372/4977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:27 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1366 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:28.060292 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c04ce9c-e232-4cda-af72-776de1dafdcf tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action" status: 202 len: 0 microversion: 2.1 time: 0.377055 Aug 24 03:58:28.068179 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2606/4978] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:58:27 2022] POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:58:28.087240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:28.087510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:28.088548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:28.124615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.129321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.130233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.135538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.136576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.140786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.142324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:28.152926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:58:28.186541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.190690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.192721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.194979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.196530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.198775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.245725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:58:28.370291 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9a992690-b9da-4f3a-9834-8663044eacf1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.290557 Aug 24 03:58:28.371275 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2607/4979] 10.222.0.58 () {58 vars in 1150 bytes} [Wed Aug 24 03:58:28 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:28.392451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:28.397293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:28.422598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.424174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.424174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.426572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.426572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.426572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.668421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c6af52a-63f6-4e77-8e06-a3d12d8f6f33 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action" status: 202 len: 0 microversion: 2.1 time: 0.286820 Aug 24 03:58:28.669197 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2608/4980] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:58:28 2022] POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:58:28.689652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:28.694464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:28.727170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.727816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.728273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.730121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.730736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.731176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.735073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:28.786991 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f23cbef1-9f68-4b87-a509-1eb645dd6385 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.724861 Aug 24 03:58:28.799880 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2373/4981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:28 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:28.831276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:28.837745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:28.854996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.856021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.856869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:28.858158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:28.858947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:28.859731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.081617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:29.108885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:29.111442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:29.116665 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-efae4a60-8199-4464-89a4-e9dd07ae11ed tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1750 microversion: 2.20 time: 0.439346 Aug 24 03:58:29.119367 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2609/4982] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:28 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1750 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:29.139143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:29.140686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:29.149858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.155030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.158196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.159268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.160274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.163288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.285845 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ff1f7d8-15ad-44bd-bdda-3c4b80b8e5eb tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1616 microversion: 2.1 time: 0.482854 Aug 24 03:58:29.286729 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2374/4983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:28 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1616 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:29.308846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:29.309842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:29.317008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.317781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.318397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.319345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.320621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.321237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.532547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:29.546428 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be611646-840e-423f-9959-c8fdb0c641b3 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1556 microversion: 2.1 time: 0.421213 Aug 24 03:58:29.562785 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2610/4984] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:29 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1556 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:29.568208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:29.568707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:29.583832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.586590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.589907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.592875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.594739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.595203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.744845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c446499-8480-4c10-83cd-3de454b70339 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180416 Aug 24 03:58:29.752992 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2611/4985] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 03:58:29 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:29.841632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:29.847187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:29.891982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.894850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.896382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:29.900063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:29.904253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:29.906918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:30.256718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:30.268622 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-062b5c86-557f-42f6-842d-5e250f5a5e5c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.446615 Aug 24 03:58:30.269282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2612/4986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:29 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:30.285980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:30.286715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:30.304582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:30.305115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:30.305730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:30.308301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:30.309279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:30.310616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:30.646851 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5baf0254-516d-4555-9cb3-29b40326001f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1616 microversion: 2.1 time: 1.341888 Aug 24 03:58:30.683029 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2375/4987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:29 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1616 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:30.696986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:30.731408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Searching by: {'host': 'n-h2-846470-15', 'deleted': False} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:58:30.750718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:30.757489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:30.764649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:30.769209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:30.772911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:30.774421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.010587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:31.027243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:31.029037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:31.030479 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-470af013-04c1-4658-a8ec-6f4a1e40490b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.760258 Aug 24 03:58:31.035903 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2613/4988] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:30 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:31.043090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-19491ee0-e937-41bd-a9a0-ea83264fc4d4 req-09dc2e00-0011-4860-b32a-3cc6ef4f4edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfa6037-d629-433f-aa3f-ee1e0180d7f8", "name": "network-vif-plugged", "status": "completed", "tag": "c06a845d-1c04-4cfc-93c1-ddc875bedf5e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:31.049557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:58:31.073945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-19491ee0-e937-41bd-a9a0-ea83264fc4d4 req-09dc2e00-0011-4860-b32a-3cc6ef4f4edc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.074926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-19491ee0-e937-41bd-a9a0-ea83264fc4d4 req-09dc2e00-0011-4860-b32a-3cc6ef4f4edc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.075279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:31.077003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-19491ee0-e937-41bd-a9a0-ea83264fc4d4 req-09dc2e00-0011-4860-b32a-3cc6ef4f4edc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.110974 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-19491ee0-e937-41bd-a9a0-ea83264fc4d4 req-09dc2e00-0011-4860-b32a-3cc6ef4f4edc service nova] Creating event network-vif-plugged:c06a845d-1c04-4cfc-93c1-ddc875bedf5e for instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 on n-h1-846470-15 Aug 24 03:58:31.124612 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-19491ee0-e937-41bd-a9a0-ea83264fc4d4 req-09dc2e00-0011-4860-b32a-3cc6ef4f4edc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087019 Aug 24 03:58:31.127247 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2614/4989] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:31.210499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-762cd3dc-8721-46b2-a230-8463b959bbce tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=n-h2-846470-15&all_tenants=1" status: 200 len: 993 microversion: 2.1 time: 0.522259 Aug 24 03:58:31.219256 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2376/4990] 10.222.0.58 () {58 vars in 1192 bytes} [Wed Aug 24 03:58:30 2022] GET /compute/v2.1/servers?host=n-h2-846470-15&all_tenants=1 => generated 993 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:31.226315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:31.235694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:58:31.242396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.242886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.243320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.244081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.245576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.246003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.298007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:31.299135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:31.319709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.320909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.322053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.324749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.325587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.328753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.413093 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-87e31cad-c2df-483d-9d1d-056856c05b1a tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.192437 Aug 24 03:58:31.414100 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2615/4991] 10.222.0.58 () {58 vars in 1196 bytes} [Wed Aug 24 03:58:31 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:58:31.448096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:31.454461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:31.481557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.481557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.481557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.481557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.481557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.481557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.584044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:31.716011 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf115e99-4012-4c0e-b744-2261954577ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action" status: 202 len: 0 microversion: 2.1 time: 0.277068 Aug 24 03:58:31.717743 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2616/4992] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:58:31 2022] POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:58:31.727743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:31.730656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:31.762412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.764567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.765058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.765792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:31.766257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:31.774336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:31.939834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:31.966336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3be586c9-bc24-44f7-8ebe-c3000b336681 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.677015 Aug 24 03:58:31.983827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:58:31.984595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:58:31.985359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:58:31.986007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:58:31.986644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:58:32.000192 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2377/4993] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:31 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:32.065012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:32.066158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:32.108765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:32.109664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:32.114539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:32.119319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:32.120520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:32.121140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:32.232089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:32.253045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:32.253833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:32.254489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:32.256064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:32.256783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:32.257480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:32.320355 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-84784aba-f7c5-4d77-a164-c515bd8b85ab tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action" status: 202 len: 1067 microversion: 2.1 time: 0.598084 Aug 24 03:58:32.335434 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2617/4994] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:58:31 2022] POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action => generated 1067 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 03:58:32.341566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:32.342751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:32.368834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:32.369768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:32.370715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:32.380934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:32.383040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:32.390864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:32.680472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:32.705596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:32.706758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:32.716842 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2a25895-984e-407b-ac1a-ff2dead248e9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.651999 Aug 24 03:58:32.719350 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2378/4995] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:32 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:33.030490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:33.034562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:33.041510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:33.052303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.053520 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0953a32-7503-454d-9ae8-e969cb61fd61 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1471 microversion: 2.1 time: 0.716512 Aug 24 03:58:33.053962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.055177 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2618/4996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:32 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1471 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:33.055497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:33.057785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.059165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.061852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:33.452254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:33.482257 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7f464926-f21d-41b4-b598-5cbae0a510c7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1373 microversion: 2.1 time: 0.455784 Aug 24 03:58:33.484194 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2379/4997] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:33 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1373 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:33.645874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-050b3db0-4b4a-4292-a885-648811b058f8 req-99296fa2-9cc1-470a-8d8c-0b3a7db45fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d08b0fd-813e-439c-acca-a34994d9fccc", "tag": "7425a222-91e8-4baa-8e76-8ceb65737641"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:33.665037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-050b3db0-4b4a-4292-a885-648811b058f8 req-99296fa2-9cc1-470a-8d8c-0b3a7db45fd8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.665523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-050b3db0-4b4a-4292-a885-648811b058f8 req-99296fa2-9cc1-470a-8d8c-0b3a7db45fd8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.665962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-050b3db0-4b4a-4292-a885-648811b058f8 req-99296fa2-9cc1-470a-8d8c-0b3a7db45fd8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:33.692744 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-050b3db0-4b4a-4292-a885-648811b058f8 req-99296fa2-9cc1-470a-8d8c-0b3a7db45fd8 service nova] Creating event network-changed:7425a222-91e8-4baa-8e76-8ceb65737641 for instance 1d08b0fd-813e-439c-acca-a34994d9fccc on n-h2-846470-15 Aug 24 03:58:33.701166 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-050b3db0-4b4a-4292-a885-648811b058f8 req-99296fa2-9cc1-470a-8d8c-0b3a7db45fd8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.515415 Aug 24 03:58:33.702638 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2619/4998] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:33.744533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:33.748991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:33.761333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.764466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.766100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:33.768947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.770473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.773049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.085341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:34.087439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:34.122445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:34.122970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:34.123413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.128061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:34.134569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:34.141544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.256129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:34.283908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:34.287943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:34.294987 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b54890b4-dc75-4414-9adf-a1bd78a15cfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.554583 Aug 24 03:58:34.303869 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2380/4999] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:33 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:34.509112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:34.510079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:34.512664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:34.539149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:34.540777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:34.541471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.546933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:34.547806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:34.551208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.765408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:34.777386 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-45171715-d846-4696-850e-c6844ce5fa03 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1471 microversion: 2.1 time: 0.696854 Aug 24 03:58:34.795637 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2620/5000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:34 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1471 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:35.329827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:35.330548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:35.332724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:35.345979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:35.346887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:35.347562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:35.348547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:35.349238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:35.349983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:35.460128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:35.476377 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e3fe9040-ba63-47f4-9279-7c9398dee390 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1545 microversion: 2.1 time: 0.973168 Aug 24 03:58:35.479349 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2381/5001] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:34 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1545 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:35.511233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:35.512412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:35.529526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:35.530203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:35.530723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:35.531843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:35.532771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:35.533373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:35.733619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:35.751238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:35.753449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:35.761377 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-918a319b-792c-4e11-a86d-37db36273348 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.432593 Aug 24 03:58:35.762312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2621/5002] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:35 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:35.801478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:35.802311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:35.814268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:35.818755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:35.845607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:35.848604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:35.848604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:35.848604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:35.943918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:35.954343 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d0bb5bf-243e-4039-b33c-a79cba7df668 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1545 microversion: 2.1 time: 0.449073 Aug 24 03:58:35.973245 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2382/5003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:35 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1545 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:36.140437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:36.151099 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd319a77-bc38-4405-bcd8-7b4b642d452b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1471 microversion: 2.1 time: 0.354775 Aug 24 03:58:36.172351 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2622/5004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:35 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1471 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:36.788958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:36.790564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:36.818853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:36.823247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:36.825069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:36.825668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:36.828801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:36.830532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:36.831864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:37.173344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:37.174361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:37.189734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:37.190243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:37.190655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:37.193320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:37.195019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:37.195982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:37.387764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:37.409343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:37.411645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:37.415290 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-956540f4-c2cb-4dd4-b4fd-db6b1ca4f948 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.629183 Aug 24 03:58:37.435950 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2383/5005] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:36 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:37.505538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:37.525724 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-54a0829f-3daf-45b1-9330-7fca415e333e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1471 microversion: 2.1 time: 0.356195 Aug 24 03:58:37.535314 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2623/5006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:37 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:38.442805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:38.444207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:38.460635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.462627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.463368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.466673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.470471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.472814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.552602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:38.554076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:38.579383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.580724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.585479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.598533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.602462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.604831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.969384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:38.979068 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-216b89e2-24f1-4613-a72f-11cd1a4d36ad tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1471 microversion: 2.1 time: 0.431148 Aug 24 03:58:38.993554 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2624/5007] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:38 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1471 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:39.052595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:39.089358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:39.091821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:39.097386 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-62d76ae8-9c05-47e8-8d4b-88794102a683 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.655031 Aug 24 03:58:39.101874 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2384/5008] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:38 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:40.017000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:40.018258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:40.054045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.063284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.064325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.065656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.066527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.067191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.132556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:40.134363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:40.197421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.197421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.198997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.210340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.215289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.218084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.489123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.511915 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f92da243-f7de-4267-9c90-cfdec15b1908 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1471 microversion: 2.1 time: 0.514371 Aug 24 03:58:40.531113 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2625/5009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:39 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1471 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:40.880828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:40.921765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.957766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.960973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.963563 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-021a7135-5e2c-4284-865a-54665fd00d87 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.838441 Aug 24 03:58:40.976121 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2385/5010] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:40 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:41.487071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-22aaf71a-40e3-46d2-95f2-98e065019495 req-0dd24628-5ef6-4b0c-8bac-6e33c1d16bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dfa6037-d629-433f-aa3f-ee1e0180d7f8", "tag": "c06a845d-1c04-4cfc-93c1-ddc875bedf5e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:41.537533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=10 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:41.546210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-22aaf71a-40e3-46d2-95f2-98e065019495 req-0dd24628-5ef6-4b0c-8bac-6e33c1d16bff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:41.562845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-22aaf71a-40e3-46d2-95f2-98e065019495 req-0dd24628-5ef6-4b0c-8bac-6e33c1d16bff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:41.564963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:41.569815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-22aaf71a-40e3-46d2-95f2-98e065019495 req-0dd24628-5ef6-4b0c-8bac-6e33c1d16bff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:41.572446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:41.609718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:41.612513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:41.614968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:41.623056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:41.625264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:41.629637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:41.657291 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-22aaf71a-40e3-46d2-95f2-98e065019495 req-0dd24628-5ef6-4b0c-8bac-6e33c1d16bff service nova] Creating event network-changed:c06a845d-1c04-4cfc-93c1-ddc875bedf5e for instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 on n-h1-846470-15 Aug 24 03:58:41.680814 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-22aaf71a-40e3-46d2-95f2-98e065019495 req-0dd24628-5ef6-4b0c-8bac-6e33c1d16bff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202991 Aug 24 03:58:41.681873 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2626/5011] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:42.013598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:42.014678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:42.039520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:42.040149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:42.040665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:42.041430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:42.041945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:42.042400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:42.726933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:42.743264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:42.757351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:42.758609 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-525d4111-ac03-43c7-9b28-9cf9c7fd5a5c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.750454 Aug 24 03:58:42.759730 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2627/5012] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:42 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:43.631105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:43.654935 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-56e0de8d-f8da-4a97-ae99-e4132f873127 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1471 microversion: 2.1 time: 2.101963 Aug 24 03:58:43.655565 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2386/5013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:41 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1471 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:43.782198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:43.782948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:43.811004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:43.817316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:43.819468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:43.829067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:43.829904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:43.833553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:44.455803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:44.521369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:44.546734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:44.573860 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67f25a25-a094-4e4a-87db-3f7a1ff89e24 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.795322 Aug 24 03:58:44.575205 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2628/5014] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:43 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:44.681544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:44.682524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:44.703280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:44.709384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:44.717654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:44.720000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:44.725430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:44.726318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:45.608478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:45.618689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:45.677667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:45.680519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:45.684659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:45.686606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:45.691998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:45.694759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:45.845378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:45.868134 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1e60bb6d-9024-4f88-9432-dadd602a833c tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1471 microversion: 2.1 time: 1.190288 Aug 24 03:58:45.870072 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2387/5015] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:44 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1471 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:46.190279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:46.229752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:46.238642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:46.252945 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b66de144-6504-40f3-a28a-02f2557fbd84 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.649516 Aug 24 03:58:46.267715 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2629/5016] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:45 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:46.912320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:46.914943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:46.935127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:46.936154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:46.938897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:46.941602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:46.942839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:46.944360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:47.303103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:47.305290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:47.319682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:47.320787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:47.321864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:47.323459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:47.324322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:47.325134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:47.485788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.515034 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5f51ed09-6808-4e13-87a0-a3726bf34c83 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1477 microversion: 2.1 time: 0.619438 Aug 24 03:58:47.529345 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2388/5017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:46 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1477 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:47.664758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.682827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.686431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.688498 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-837a76d2-d5e0-4d46-bab0-31d2131154cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.392397 Aug 24 03:58:47.705047 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2630/5018] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:47 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:48.562002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:48.568599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:48.608925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-050bbfa5-778c-4f1d-b1c6-e284b3b82866 req-6a680b91-fe5b-4a1e-9dca-7beec26d3b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f3f729-84f5-4837-ad9c-063a22104016", "name": "network-vif-unplugged", "status": "completed", "tag": "2aa178f0-2520-4e55-bf9a-17d4ee0b5701"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:48.638400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.639784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.644208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.647099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.659164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.663127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.712885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-050bbfa5-778c-4f1d-b1c6-e284b3b82866 req-6a680b91-fe5b-4a1e-9dca-7beec26d3b69 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.718112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-050bbfa5-778c-4f1d-b1c6-e284b3b82866 req-6a680b91-fe5b-4a1e-9dca-7beec26d3b69 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.719420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-050bbfa5-778c-4f1d-b1c6-e284b3b82866 req-6a680b91-fe5b-4a1e-9dca-7beec26d3b69 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.765060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:48.811085 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-050bbfa5-778c-4f1d-b1c6-e284b3b82866 req-6a680b91-fe5b-4a1e-9dca-7beec26d3b69 service nova] Creating event network-vif-unplugged:2aa178f0-2520-4e55-bf9a-17d4ee0b5701 for instance d1f3f729-84f5-4837-ad9c-063a22104016 on n-h2-846470-15 Aug 24 03:58:48.846326 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-050bbfa5-778c-4f1d-b1c6-e284b3b82866 req-6a680b91-fe5b-4a1e-9dca-7beec26d3b69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.245088 Aug 24 03:58:48.847482 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2631/5019] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:48.875602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:48.877834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:48.904342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.904881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.906114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.907069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.907681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.908368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.087549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.096994 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bb1f77e3-2253-4051-8cdf-a2dbacf7fa9b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1477 microversion: 2.1 time: 0.545036 Aug 24 03:58:49.098442 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2389/5020] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:48 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1477 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:49.200241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.214254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.215805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.217060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a80e4cab-0a66-42ad-8656-804c1c021bc3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.361466 Aug 24 03:58:49.217859 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2632/5021] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:48 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:50.122855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:50.124410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:50.138149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.140219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.141314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.142643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.144086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.145216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.242325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:50.242880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:50.255189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.255713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.256578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.256931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.257379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.257819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.426486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.438026 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8dc86784-ae6a-46f7-bc44-1f47f49abeb4 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1477 microversion: 2.1 time: 0.321558 Aug 24 03:58:50.444280 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2390/5022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:50 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:50.530685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.545579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.551267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.555933 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55f77c46-1d5c-4b28-9344-fd0fe56c2594 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.318651 Aug 24 03:58:50.557276 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2633/5023] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:50 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:51.483532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:51.484233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:51.499960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.501103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.503737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.505619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.507975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.509300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.597935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:51.599576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:51.615833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.616870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.617803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.632828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.636544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.637440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.885941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:51.912561 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bc7ee87d-ab02-43d1-aa8e-6710153cc590 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1463 microversion: 2.1 time: 0.433777 Aug 24 03:58:51.914415 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2391/5024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:51 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1463 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:51.958624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:51.961321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:51.975288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.976744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.977768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.980254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.981725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.983003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.031905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:52.049939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:52.052273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:52.055583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fbac5a5e-92be-4635-bf50-56155003e809 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.461863 Aug 24 03:58:52.071737 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2634/5025] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:51 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:52.309020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:52.318372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:52.325562 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3fafe0e5-a7ab-4d9f-a3b5-aa4e5695d495 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1463 microversion: 2.1 time: 0.373293 Aug 24 03:58:52.326600 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2392/5026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:51 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1463 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:52.352251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:52.355387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:52.369540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.370048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.370496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.371219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.371731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.372380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.475193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:58:52.475612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:58:52.476319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:58:52.476919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:58:52.477339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:58:52.579175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:52.603885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.604862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.606777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.607766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.609294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.613181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.689887 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b5272cf7-bf6e-4c63-a03c-1d116245d3f3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action" status: 202 len: 1067 microversion: 2.1 time: 0.341596 Aug 24 03:58:52.692083 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2635/5027] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:58:52 2022] POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action => generated 1067 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 03:58:52.716646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:52.723046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:52.739137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.742260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.744027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.745655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.746905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.748927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.949560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c547e5aa-6ba6-4625-8180-a81730c7edae req-957cade5-8267-4e57-a8f9-ff4d5b4f4dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f3f729-84f5-4837-ad9c-063a22104016", "name": "network-vif-plugged", "status": "completed", "tag": "2aa178f0-2520-4e55-bf9a-17d4ee0b5701"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:52.983855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c547e5aa-6ba6-4625-8180-a81730c7edae req-957cade5-8267-4e57-a8f9-ff4d5b4f4dea service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:52.984568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c547e5aa-6ba6-4625-8180-a81730c7edae req-957cade5-8267-4e57-a8f9-ff4d5b4f4dea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:52.985803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c547e5aa-6ba6-4625-8180-a81730c7edae req-957cade5-8267-4e57-a8f9-ff4d5b4f4dea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:53.003315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c547e5aa-6ba6-4625-8180-a81730c7edae req-957cade5-8267-4e57-a8f9-ff4d5b4f4dea service nova] Creating event network-vif-plugged:2aa178f0-2520-4e55-bf9a-17d4ee0b5701 for instance d1f3f729-84f5-4837-ad9c-063a22104016 on n-h2-846470-15 Aug 24 03:58:53.010585 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c547e5aa-6ba6-4625-8180-a81730c7edae req-957cade5-8267-4e57-a8f9-ff4d5b4f4dea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078766 Aug 24 03:58:53.012033 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2636/5028] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:53.075857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.092265 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e15a353-0101-48d4-8c52-ccaac62bd3e1 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.383799 Aug 24 03:58:53.107805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:53.109901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:53.110448 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2393/5029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:52 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:53.125390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:53.126702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:53.127834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:53.129375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:53.130493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:53.131542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:53.531549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.543779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.545884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.547770 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ea99d1b3-ff5f-4503-9de4-f2fe1482167e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.455216 Aug 24 03:58:53.548989 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2637/5030] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:53 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:54.122085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:54.124351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:54.139715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.142000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.143129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.144774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.145889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.147248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.595970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:54.600105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:54.626748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.629285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.629598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.631783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.633454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.634651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.636323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.664849 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-932d5a62-d775-483f-8bd9-649c7bb00e5e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.551632 Aug 24 03:58:54.674617 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2394/5031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:54 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:54.918895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.934052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.940470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.942015 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-539f93a3-6fff-49bc-88ff-fb7d3d7e6c29 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.358757 Aug 24 03:58:54.942833 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2638/5032] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:54 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:55.711117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:55.712439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:55.724037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.725251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.727050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.728613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.729690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.730677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.992905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:55.994207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:56.024968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.027375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.032171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.037843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.038872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.039961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.195461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:56.206383 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-99e7cb67-4580-44a8-be98-623ecabfbe35 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.501478 Aug 24 03:58:56.208874 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2395/5033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:55 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:56.410992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:56.427824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:56.430908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:56.435188 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d61b00cc-6863-48ee-8968-071926f419a1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.457496 Aug 24 03:58:56.437314 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2639/5034] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:55 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:57.246229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:57.247413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:57.255946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:57.257055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:57.257750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.258860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:57.259570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:57.260289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.471718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:57.472802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:57.504215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=84 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:57.514867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:57.521133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:57.521988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.523216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:57.525301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:57.525971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.538601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:57.551844 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4ede72bf-51b5-4d73-971a-332d433da2ca tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.310379 Aug 24 03:58:57.552792 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2396/5035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:57 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:57.892871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:57.926744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:57.936781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:57.940058 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8afc269c-ed21-45e5-ac8f-784e5a6908d3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.476346 Aug 24 03:58:57.945126 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2640/5036] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:57 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:58.579262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:58.580463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:58.594925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:58.596291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:58.597090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:58.598604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:58.599263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:58.600439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:58.842894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:58.859295 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c8ed15f4-5c8f-4563-9aea-67c19644f306 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.287440 Aug 24 03:58:58.875705 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2397/5037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:58 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:58.983651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:58.984793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:58.998976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:58.999889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:59.000647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:59.001845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:59.002634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:59.003381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:59.304285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:59.325663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:59.330150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:59.332806 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-61273143-8f19-482a-b6a7-06d74785016b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.357754 Aug 24 03:58:59.334153 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2641/5038] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:58 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:59.895126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:59.896651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:59.914465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:59.915409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:59.916286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:59.917484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:59.918210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:59.920358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:00.136597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:00.154057 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2f24a8e3-2707-4d74-9513-e9d85656fad3 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.266074 Aug 24 03:59:00.156150 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2398/5039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:59 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:00.373303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:00.374783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:00.388615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:00.392528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:00.393171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:00.395563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:00.396336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:00.398280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:00.666544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:00.687586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:00.691177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:00.693502 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96053eae-ae93-447e-b7f8-9df8d2a9314d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.324039 Aug 24 03:59:00.694456 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2642/5040] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:00 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:59:01.185561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:01.186272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:01.195363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:01.196075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:01.196690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:01.197414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:01.198258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:01.198892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:01.442812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:01.464039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5c90f51d-52f3-4168-b3ba-f8b8b895d367 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.288713 Aug 24 03:59:01.465081 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2399/5041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:01 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:01.733790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:01.735914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:01.759995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:01.761137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:01.762017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:01.764564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:01.765509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:01.766173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:01.978578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:01.990923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:01.992892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:01.994403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-95c3da4e-3fcb-4a9e-bc18-694d7f03b1bf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.267754 Aug 24 03:59:01.995111 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2643/5042] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:01 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:59:02.490882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:02.492211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:02.503213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:02.504116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:02.504965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:02.505910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:02.507380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:02.508016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:02.613388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d71fd60c-b12f-420e-bba8-f92f2f7cb441 req-d3d879e9-acc9-4f89-8062-0087cdbf1915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaceb98-646f-4cc9-b6d0-564c697b2537", "name": "network-vif-plugged", "status": "completed", "tag": "b4cd305e-193b-42fa-834b-651256717f69"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:02.630449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d71fd60c-b12f-420e-bba8-f92f2f7cb441 req-d3d879e9-acc9-4f89-8062-0087cdbf1915 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:02.630912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d71fd60c-b12f-420e-bba8-f92f2f7cb441 req-d3d879e9-acc9-4f89-8062-0087cdbf1915 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:02.631980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d71fd60c-b12f-420e-bba8-f92f2f7cb441 req-d3d879e9-acc9-4f89-8062-0087cdbf1915 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:02.651334 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d71fd60c-b12f-420e-bba8-f92f2f7cb441 req-d3d879e9-acc9-4f89-8062-0087cdbf1915 service nova] Creating event network-vif-plugged:b4cd305e-193b-42fa-834b-651256717f69 for instance ebaceb98-646f-4cc9-b6d0-564c697b2537 on n-h1-846470-15 Aug 24 03:59:02.659924 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d71fd60c-b12f-420e-bba8-f92f2f7cb441 req-d3d879e9-acc9-4f89-8062-0087cdbf1915 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053112 Aug 24 03:59:02.661970 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2644/5043] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:03.021108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:03.022872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:03.040626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:03.041342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:03.041885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:03.042885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:03.043837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:03.044072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:03.085114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:03.101486 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c6359a3-f837-487c-984d-75490db85075 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.612688 Aug 24 03:59:03.104273 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2400/5044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:02 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:03.421504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:03.441025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:03.449382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:03.457004 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9cb45386-4b78-40d3-b2d8-b7a4f937d84e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.438108 Aug 24 03:59:03.460971 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2645/5045] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:03 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:59:04.133285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:04.136967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:04.155226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:04.156870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:04.158483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:04.160397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:04.161559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:04.163695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:04.516451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:04.517158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:04.536366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:04.537307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:04.537996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:04.539280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:04.552377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:04.553292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:04.641676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:04.653672 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7e4d56f4-a7cf-475a-934c-59f6665cc547 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.528395 Aug 24 03:59:04.655153 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2401/5046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:04 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:04.943518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:04.960254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:04.963456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:04.964852 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-54b0307b-2f27-4695-a6da-555d0dea4cf2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.468510 Aug 24 03:59:04.966024 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2646/5047] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:04 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:59:05.695130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:05.696260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:05.701391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=42 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:05.717835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:05.719271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:05.720373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:05.721902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:05.723463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:05.728161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:06.030763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:06.032966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:06.082533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:06.085915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:06.093583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:06.095224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:06.096503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:06.097646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:06.221687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:06.241080 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af12f1ad-5075-4ba9-b609-eccdf779fdb6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.552654 Aug 24 03:59:06.243080 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2402/5048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:05 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:06.565596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:06.582400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:06.592740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:06.595441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:06.598182 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-43be11bb-21f8-4e83-a3d3-1eca3b50b204 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1806 microversion: 2.20 time: 0.594779 Aug 24 03:59:06.599529 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2647/5049] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:06 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1806 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:59:07.270562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:07.273575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:07.287080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.287974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.288741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.290011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.290850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.291634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.558825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:07.584192 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2c3d57ee-0868-4d0e-b61f-de801093f801 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.319728 Aug 24 03:59:07.585347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2403/5050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:07 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:07.633614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:07.636747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:07.653743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.655053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.656192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:07.657808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:07.659786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:07.661932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.431278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:08.451850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:08.455266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:08.457993 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c383267-0708-4b09-81ba-8bdca1e73ae7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1793 microversion: 2.20 time: 0.834088 Aug 24 03:59:08.472511 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2648/5051] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 03:59:07 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1793 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:59:08.614288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:08.615537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:08.627524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.628278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.628766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.629636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:08.630223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:08.630804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:08.833188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:08.858441 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f20f3437-3208-4785-9d71-4354ba217d70 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.249136 Aug 24 03:59:08.859948 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2404/5052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:08 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:09.897018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:09.898021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:09.931816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:09.932646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:09.944407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:09.945638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:09.946483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:09.947260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:10.244188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:10.266299 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31d65a90-e07c-4b43-8a51-4cee6d519231 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.375966 Aug 24 03:59:10.267291 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2649/5053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:09 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:11.291854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:11.293081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:11.334674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:11.337741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:11.342120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:11.349067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:11.350614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:11.351770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:11.866526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:11.884415 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e5d6758-ff3f-4415-b1b6-5e084583628e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.599408 Aug 24 03:59:11.892002 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2405/5054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:11 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:12.931589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:12.934400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:12.961468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.963138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.964301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:12.976862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:12.980457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:12.981678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:13.382718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:13.394698 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-325d248a-c3a5-4570-95c8-944e5679a1a2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.471509 Aug 24 03:59:13.396113 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2650/5055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:12 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:14.433595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:14.436048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:14.469253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:14.472416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:14.473555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:14.475192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:14.476563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:14.477644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:14.983897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:15.002804 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f6845c58-a941-4877-adb9-3122d4855048 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.576289 Aug 24 03:59:15.025622 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2406/5056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:14 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:16.047445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:16.050707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:16.075640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:16.080211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:16.080924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:16.082652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:16.084347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:16.085001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:16.464564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:16.474073 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91eabc7c-f699-4371-adf9-f1fb83b61ce9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.434782 Aug 24 03:59:16.475573 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2651/5057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:16 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:17.511150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:17.512510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:17.519803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:17.520597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:17.521229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:17.522127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:17.522778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:17.523451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:17.852981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:17.872683 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f124f9b9-e700-43c9-a26f-a295eae9e261 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.365202 Aug 24 03:59:17.895791 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2407/5058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:17 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:18.458237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:18.463350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:18.483145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:18.484017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:18.485737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:18.487946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:18.489026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:18.489851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:18.655957 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-759cd1e2-67df-42ff-b748-5f7b1685f4c9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8/action" status: 200 len: 24571 microversion: 2.1 time: 0.721139 Aug 24 03:59:18.658829 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2652/5059] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:59:17 2022] POST /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8/action => generated 24571 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:59:18.908957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:18.909703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:18.921354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:18.922176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:18.922815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:18.924054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:18.924697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:18.925336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:19.142937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:19.160816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-635f11a5-5af2-48c1-9afa-bb2345bdbaed tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1472 microversion: 2.1 time: 0.255763 Aug 24 03:59:19.162898 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2408/5060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:18 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1472 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:20.204180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:20.206440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:20.221399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:20.222725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:20.223791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:20.225293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:20.226833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:20.237898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:20.546695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:20.568027 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4fc0eaa3-96f6-4b99-b44b-11e5a159c8db tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1478 microversion: 2.1 time: 0.373410 Aug 24 03:59:20.577414 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2653/5061] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:20 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1478 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:21.611914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:21.614192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:21.625530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:21.626801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:21.627843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:21.629583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:21.630725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:21.631770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:21.675431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:21.927459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:21.949806 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-841c96dc-c8ed-499e-a1df-999bebb4d780 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1478 microversion: 2.1 time: 0.344300 Aug 24 03:59:21.952109 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2409/5062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:21 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1478 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:22.971579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a90bc19e-a5e0-4934-84df-0a866660c87b req-103cd440-7006-403c-a008-6847403f0f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f3f729-84f5-4837-ad9c-063a22104016", "name": "network-vif-unplugged", "status": "completed", "tag": "2aa178f0-2520-4e55-bf9a-17d4ee0b5701"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:22.986201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:22.989179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:22.997684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a90bc19e-a5e0-4934-84df-0a866660c87b req-103cd440-7006-403c-a008-6847403f0f78 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.000412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a90bc19e-a5e0-4934-84df-0a866660c87b req-103cd440-7006-403c-a008-6847403f0f78 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.000932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a90bc19e-a5e0-4934-84df-0a866660c87b req-103cd440-7006-403c-a008-6847403f0f78 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.004688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.006160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.007264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.009108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.010315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.011548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.029324 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a90bc19e-a5e0-4934-84df-0a866660c87b req-103cd440-7006-403c-a008-6847403f0f78 service nova] Creating event network-vif-unplugged:2aa178f0-2520-4e55-bf9a-17d4ee0b5701 for instance d1f3f729-84f5-4837-ad9c-063a22104016 on n-h2-846470-15 Aug 24 03:59:23.035558 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a90bc19e-a5e0-4934-84df-0a866660c87b req-103cd440-7006-403c-a008-6847403f0f78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069646 Aug 24 03:59:23.036887 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2654/5063] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:23.448816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:23.469735 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-576a4cae-0549-49be-a90c-a07a35a779a5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1478 microversion: 2.1 time: 0.494250 Aug 24 03:59:23.472688 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2410/5064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:22 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1478 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:24.508072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:24.510600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:24.521106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:24.521931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:24.522620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:24.523728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:24.524437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:24.525088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:24.827712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:24.852118 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e5fb731-d3ee-4657-8ae9-f73634feba6a tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1478 microversion: 2.1 time: 0.359457 Aug 24 03:59:24.854356 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2655/5065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:24 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1478 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:25.892655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:25.894525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:25.907695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:25.908942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:25.909950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:25.911550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:25.912624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:25.913333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.239815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:26.256953 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-efc53984-a7c9-45df-8b59-a606950974d2 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1463 microversion: 2.1 time: 0.369603 Aug 24 03:59:26.258234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2411/5066] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:25 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1463 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:26.303432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:26.307939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:26.321898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.323247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.324418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.325626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.326530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.327502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.505743 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c15bb8f-c4dd-4676-b0f3-9d0d8e467b7f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action" status: 202 len: 0 microversion: 2.1 time: 0.208536 Aug 24 03:59:26.511914 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2656/5067] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:59:26 2022] POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:59:26.520355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:26.521269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:26.551305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.552154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.553561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.554047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.561807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.562623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.646512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.647484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.649149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.652526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lazy-loading 'fault' on Instance uuid d1f3f729-84f5-4837-ad9c-063a22104016 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:26.898234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1e42e2aa-cce6-4ae1-bbd5-8525d554926f tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1599 microversion: 2.1 time: 0.382096 Aug 24 03:59:26.899826 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2412/5068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:26 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1599 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:26.926618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:26.929015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:26.935705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.936490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.937116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.938039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.938513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.938911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.069297 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-11037be2-db7c-4547-a6fa-7d80d6e713ca tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action" status: 202 len: 0 microversion: 2.1 time: 0.146726 Aug 24 03:59:27.078868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:27.079928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:27.082739 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2657/5069] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:59:26 2022] POST /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:59:27.092358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.093172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.097584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.098644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.099142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.099775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.393190 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9e3d829c-a452-486f-82aa-4b2958eaf985 tempest-ServersAdminTestJSON-442240776 tempest-ServersAdminTestJSON-442240776-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1616 microversion: 2.1 time: 0.318253 Aug 24 03:59:27.394764 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2413/5070] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:27 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1616 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:27.421622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:27.422745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:27.437844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.438647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.441078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.442346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.444315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.451583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.511564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:59:27.656906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=38 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:27.696084 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a97b5180-9f22-4d2d-9156-578d9e1094bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 204 len: 0 microversion: 2.1 time: 0.278238 Aug 24 03:59:27.698069 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2658/5071] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:27 2022] DELETE /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:27.706656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:27.707860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:27.716905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.717994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.718677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.719693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.720424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.721079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.845029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-8d936420-cc3c-4692-aa4a-7ab6ac980a2b req-1fdcde59-1581-4cb7-9121-ab305990c374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f3f729-84f5-4837-ad9c-063a22104016", "name": "network-vif-plugged", "status": "completed", "tag": "2aa178f0-2520-4e55-bf9a-17d4ee0b5701"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:27.868211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8d936420-cc3c-4692-aa4a-7ab6ac980a2b req-1fdcde59-1581-4cb7-9121-ab305990c374 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.878430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8d936420-cc3c-4692-aa4a-7ab6ac980a2b req-1fdcde59-1581-4cb7-9121-ab305990c374 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.879062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8d936420-cc3c-4692-aa4a-7ab6ac980a2b req-1fdcde59-1581-4cb7-9121-ab305990c374 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.905528 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-8d936420-cc3c-4692-aa4a-7ab6ac980a2b req-1fdcde59-1581-4cb7-9121-ab305990c374 service nova] Creating event network-vif-plugged:2aa178f0-2520-4e55-bf9a-17d4ee0b5701 for instance d1f3f729-84f5-4837-ad9c-063a22104016 on n-h2-846470-15 Aug 24 03:59:27.920420 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-8d936420-cc3c-4692-aa4a-7ab6ac980a2b req-1fdcde59-1581-4cb7-9121-ab305990c374 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079986 Aug 24 03:59:27.924538 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2659/5072] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:59:28.018577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:28.057470 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2114330a-2c00-4efc-97ad-952eca4b06bd tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1468 microversion: 2.1 time: 0.351631 Aug 24 03:59:28.058739 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2414/5073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:27 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1468 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:29.100567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:29.105605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:29.130087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:29.136139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:29.138555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:29.140553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:29.145200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:29.152815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:29.907076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:29.915695 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07253cba-aabc-40f5-b24f-c772d73d1ca5 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1468 microversion: 2.1 time: 0.839983 Aug 24 03:59:29.922730 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2660/5074] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:29 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1468 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:30.378976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-16c30d0a-7d00-4762-81f5-a1fb7473d2ef req-c7088041-514c-4819-9040-d2e9ecaba8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef4b894-cf51-42d9-9be0-26c55757f63e", "name": "network-vif-deleted", "tag": "87b63e62-8f5b-43bd-8ca4-01f1bc8bb464"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:30.392292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-16c30d0a-7d00-4762-81f5-a1fb7473d2ef req-c7088041-514c-4819-9040-d2e9ecaba8d4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:30.393073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-16c30d0a-7d00-4762-81f5-a1fb7473d2ef req-c7088041-514c-4819-9040-d2e9ecaba8d4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:30.393737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-16c30d0a-7d00-4762-81f5-a1fb7473d2ef req-c7088041-514c-4819-9040-d2e9ecaba8d4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:30.407396 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-16c30d0a-7d00-4762-81f5-a1fb7473d2ef req-c7088041-514c-4819-9040-d2e9ecaba8d4 service nova] Creating event network-vif-deleted:87b63e62-8f5b-43bd-8ca4-01f1bc8bb464 for instance 9ef4b894-cf51-42d9-9be0-26c55757f63e on n-h2-846470-15 Aug 24 03:59:30.413776 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-16c30d0a-7d00-4762-81f5-a1fb7473d2ef req-c7088041-514c-4819-9040-d2e9ecaba8d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038921 Aug 24 03:59:30.415039 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2415/5075] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:30.951686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:30.952519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:30.970481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:30.972314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:30.974021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:30.976655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:30.980190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:30.980885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:31.035930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:31.052914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:31.054291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:31.054931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:31.055555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lazy-loading 'fault' on Instance uuid 9ef4b894-cf51-42d9-9be0-26c55757f63e {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:31.159224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:31.172533 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6a47c0c8-b742-4a73-9790-2664b1532a84 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 200 len: 1303 microversion: 2.1 time: 0.224850 Aug 24 03:59:31.188413 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2661/5076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:30 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 1303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:32.218166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:32.218882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 9ef4b894-cf51-42d9-9be0-26c55757f63e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:32.235357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:32.235960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:32.236409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:32.237153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:32.237623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:32.238182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:32.268958 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] HTTP exception thrown: Instance 9ef4b894-cf51-42d9-9be0-26c55757f63e could not be found. Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Request method failure captured: Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e HTTP/1.1 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaGfRnTeRO2LctTGnwoiXtdZsCfAo2HtGpLeILWk9KYzUh8FqTWvyuyhLW7CGAq6tFFBW040TP4ARzr2z632CKTJB5yoBvc21iOp7pVdUz0f1T2ByaOKWQrBHstuGSSiJbQUBcNdzHtVzK5FRnEgIiFIPRtNpOygXC_kddZedjQ-rr0 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: cc701588f8524a4aa1668b96c8a494c0 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: cc701588f8524a4aa1668b96c8a494c0 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersAdminTestJSON-1556567458-project Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d5e5b8a94a774ed794e1aed66bb5b9cf Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersAdminTestJSON-1556567458-project Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 9ef4b894-cf51-42d9-9be0-26c55757f63e could not be found. Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9ef4b894-cf51-42d9-9be0-26c55757f63e'} Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef4b894-cf51-42d9-9be0-26c55757f63e could not be found. Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef4b894-cf51-42d9-9be0-26c55757f63e could not be found. Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:32.270684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef4b894-cf51-42d9-9be0-26c55757f63e could not be found. Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Returning 404 to user: Instance 9ef4b894-cf51-42d9-9be0-26c55757f63e could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-12f91471-6fed-4f07-83bf-8954a8610f0e tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e" status: 404 len: 111 microversion: 2.1 time: 0.078638 Aug 24 03:59:32.284103 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2416/5077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:32 2022] GET /compute/v2.1/servers/9ef4b894-cf51-42d9-9be0-26c55757f63e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:32.289409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:32.289409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:32.299609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:32.305698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:32.306178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:32.307147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:32.307589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:32.308290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:32.347858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:59:32.501185 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d82396f7-30b3-4dda-8adb-a67277c90565 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 204 len: 0 microversion: 2.1 time: 0.221981 Aug 24 03:59:32.508895 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2662/5078] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:32 2022] DELETE /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:32.531515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:32.532940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:32.542152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:32.543762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:32.544690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:32.546271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:32.560788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:32.561260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:32.785182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:32.803061 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6de289a5-ccc7-4745-bd2f-ffe2cf4ea09f tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1468 microversion: 2.1 time: 0.287260 Aug 24 03:59:32.804097 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2417/5079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:32 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1468 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:33.838995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:33.841052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:33.868239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:33.868999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:33.869580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:33.870529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:33.871365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:33.872416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:34.245392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:34.272128 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3ddc717-c674-48ed-817a-7c453de6da64 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1468 microversion: 2.1 time: 0.437771 Aug 24 03:59:34.274500 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2663/5080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:33 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1468 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:35.296780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:35.299988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:35.312470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:35.314046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:35.315464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:35.316543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:35.318314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:35.319151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:35.696184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:35.736425 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d3313436-888a-48f9-aa2a-cf584d678fcc tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1468 microversion: 2.1 time: 0.444219 Aug 24 03:59:35.737895 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2418/5081] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:35 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1468 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:36.263585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-abe6698a-94aa-4fdc-a022-4ef1625062eb req-3e6c058a-f8da-4eae-b485-975810b804d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188ff354-fb76-4eab-ae4e-f71851c55298", "name": "network-vif-deleted", "tag": "5cd46ba5-2765-4573-b88e-656db2569a00"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:36.304628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-abe6698a-94aa-4fdc-a022-4ef1625062eb req-3e6c058a-f8da-4eae-b485-975810b804d0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.312218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-abe6698a-94aa-4fdc-a022-4ef1625062eb req-3e6c058a-f8da-4eae-b485-975810b804d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.313487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-abe6698a-94aa-4fdc-a022-4ef1625062eb req-3e6c058a-f8da-4eae-b485-975810b804d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.345993 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-abe6698a-94aa-4fdc-a022-4ef1625062eb req-3e6c058a-f8da-4eae-b485-975810b804d0 service nova] Creating event network-vif-deleted:5cd46ba5-2765-4573-b88e-656db2569a00 for instance 188ff354-fb76-4eab-ae4e-f71851c55298 on n-h1-846470-15 Aug 24 03:59:36.358771 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-abe6698a-94aa-4fdc-a022-4ef1625062eb req-3e6c058a-f8da-4eae-b485-975810b804d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130450 Aug 24 03:59:36.360305 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2664/5082] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:36.775191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:36.776939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:36.782401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=36 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:36.793094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.793974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.794737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.796085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.797122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.798115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.887400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:36.888002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:36.888393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.889219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lazy-loading 'fault' on Instance uuid 188ff354-fb76-4eab-ae4e-f71851c55298 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:36.985089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:37.000997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a04c3732-8375-4338-b7e7-ae660c51a5b6 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 200 len: 1303 microversion: 2.1 time: 0.232239 Aug 24 03:59:37.002984 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2419/5083] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:36 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:38.029834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:38.032400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: 188ff354-fb76-4eab-ae4e-f71851c55298] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:38.045708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.047231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.048544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.050139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.051160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.052686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.080687 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] HTTP exception thrown: Instance 188ff354-fb76-4eab-ae4e-f71851c55298 could not be found. Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Request method failure captured: Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 HTTP/1.1 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaGfRnTeRO2LctTGnwoiXtdZsCfAo2HtGpLeILWk9KYzUh8FqTWvyuyhLW7CGAq6tFFBW040TP4ARzr2z632CKTJB5yoBvc21iOp7pVdUz0f1T2ByaOKWQrBHstuGSSiJbQUBcNdzHtVzK5FRnEgIiFIPRtNpOygXC_kddZedjQ-rr0 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cc701588f8524a4aa1668b96c8a494c0 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cc701588f8524a4aa1668b96c8a494c0 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAdminTestJSON-1556567458-project Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d5e5b8a94a774ed794e1aed66bb5b9cf Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAdminTestJSON-1556567458-project Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 188ff354-fb76-4eab-ae4e-f71851c55298 could not be found. Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '188ff354-fb76-4eab-ae4e-f71851c55298'} Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188ff354-fb76-4eab-ae4e-f71851c55298 could not be found. Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188ff354-fb76-4eab-ae4e-f71851c55298 could not be found. Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:38.085098 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:38.092207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:38.092207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:38.092207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:38.092207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:38.092207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:38.092207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188ff354-fb76-4eab-ae4e-f71851c55298 could not be found. Aug 24 03:59:38.092207 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:38.094724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Returning 404 to user: Instance 188ff354-fb76-4eab-ae4e-f71851c55298 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:38.096852 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a026469f-b1ac-4f07-b7c2-bc26ebcd637b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298" status: 404 len: 111 microversion: 2.1 time: 0.075955 Aug 24 03:59:38.098507 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2665/5084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:38 2022] GET /compute/v2.1/servers/188ff354-fb76-4eab-ae4e-f71851c55298 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:38.130140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:38.131088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:38.151154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.153216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.154094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.157228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.158221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.159117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.204897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:59:38.439366 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-35b17735-b9ac-4c4d-a815-4a47740b6f65 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 204 len: 0 microversion: 2.1 time: 0.334076 Aug 24 03:59:38.444000 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2420/5085] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 03:59:38 2022] DELETE /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:38.455765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:38.462239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:38.502591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.506188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.507976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.512468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.515921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.516962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:39.203867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:39.239057 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5440a491-d3f0-43f9-8b28-98c06c83d2e9 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1469 microversion: 2.1 time: 0.791555 Aug 24 03:59:39.264522 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2666/5086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:38 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1469 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:40.279117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:40.286097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:40.304687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.305363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.305953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:40.306820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.307457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.308055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:41.098202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:41.107724 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b95b85f5-10d3-464d-be4a-4f1d64668577 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1469 microversion: 2.1 time: 0.836790 Aug 24 03:59:41.117819 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2421/5087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:40 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1469 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:41.516075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1ce1c594-eb71-423d-bee4-c83ee3ce1064 req-cbf48d9d-2d8b-4535-ad00-0dde3e5ab177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f3f729-84f5-4837-ad9c-063a22104016", "name": "network-vif-deleted", "tag": "2aa178f0-2520-4e55-bf9a-17d4ee0b5701"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:41.567152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ce1c594-eb71-423d-bee4-c83ee3ce1064 req-cbf48d9d-2d8b-4535-ad00-0dde3e5ab177 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:41.568049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ce1c594-eb71-423d-bee4-c83ee3ce1064 req-cbf48d9d-2d8b-4535-ad00-0dde3e5ab177 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:41.579183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1ce1c594-eb71-423d-bee4-c83ee3ce1064 req-cbf48d9d-2d8b-4535-ad00-0dde3e5ab177 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:41.653610 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1ce1c594-eb71-423d-bee4-c83ee3ce1064 req-cbf48d9d-2d8b-4535-ad00-0dde3e5ab177 service nova] Creating event network-vif-deleted:2aa178f0-2520-4e55-bf9a-17d4ee0b5701 for instance d1f3f729-84f5-4837-ad9c-063a22104016 on n-h2-846470-15 Aug 24 03:59:41.673630 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1ce1c594-eb71-423d-bee4-c83ee3ce1064 req-cbf48d9d-2d8b-4535-ad00-0dde3e5ab177 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165646 Aug 24 03:59:41.688550 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2667/5088] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:42.131387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:42.132083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:42.148855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:42.151198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:42.154279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:42.155283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:42.157939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:42.158559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:42.246510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:42.247505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:42.249126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:42.250305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lazy-loading 'fault' on Instance uuid d1f3f729-84f5-4837-ad9c-063a22104016 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:59:42.422367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e5b8a94a774ed794e1aed66bb5b9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc701588f8524a4aa1668b96c8a494c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:42.435019 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-759c9f38-6a67-4401-8262-2a7cae680a54 tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 200 len: 1303 microversion: 2.1 time: 0.308057 Aug 24 03:59:42.438727 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2422/5089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:42 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 1303 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:43.468452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:43.469555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] [instance: d1f3f729-84f5-4837-ad9c-063a22104016] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:43.485564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:43.486440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:43.488203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:43.489522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:43.490508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:43.491476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:43.521959 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] HTTP exception thrown: Instance d1f3f729-84f5-4837-ad9c-063a22104016 could not be found. Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Request method failure captured: Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 HTTP/1.1 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaGfRnTeRO2LctTGnwoiXtdZsCfAo2HtGpLeILWk9KYzUh8FqTWvyuyhLW7CGAq6tFFBW040TP4ARzr2z632CKTJB5yoBvc21iOp7pVdUz0f1T2ByaOKWQrBHstuGSSiJbQUBcNdzHtVzK5FRnEgIiFIPRtNpOygXC_kddZedjQ-rr0 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: cc701588f8524a4aa1668b96c8a494c0 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc701588f8524a4aa1668b96c8a494c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: cc701588f8524a4aa1668b96c8a494c0 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAdminTestJSON-1556567458 Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAdminTestJSON-1556567458-project Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d5e5b8a94a774ed794e1aed66bb5b9cf Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAdminTestJSON-1556567458-project Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d1f3f729-84f5-4837-ad9c-063a22104016 could not be found. Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd1f3f729-84f5-4837-ad9c-063a22104016'} Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f3f729-84f5-4837-ad9c-063a22104016 could not be found. Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f3f729-84f5-4837-ad9c-063a22104016 could not be found. Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:59:43.526342 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f3f729-84f5-4837-ad9c-063a22104016 could not be found. Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] Returning 404 to user: Instance d1f3f729-84f5-4837-ad9c-063a22104016 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15118981-639b-44a6-b265-d48d99267d6b tempest-ServersAdminTestJSON-1556567458 tempest-ServersAdminTestJSON-1556567458-project] 10.222.0.58 "GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016" status: 404 len: 111 microversion: 2.1 time: 0.069280 Aug 24 03:59:43.538893 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2668/5090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:43 2022] GET /compute/v2.1/servers/d1f3f729-84f5-4837-ad9c-063a22104016 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:47.425839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:47.427940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:47.465654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:47.466506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:47.467198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:47.468164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:47.470261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:47.472142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:47.563121 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f452260-4e4b-4e8d-8f8d-08026193f040 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/ips" status: 200 len: 149 microversion: 2.1 time: 0.143988 Aug 24 03:59:47.566900 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2423/5091] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 03:59:47 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/ips => generated 149 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:50.527617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa1492fe-b47b-4191-8bf5-05de23f82f03"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:50.537003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:50.554765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:50.557480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:50.558776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:50.561391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:50.562371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:50.564431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:51.102994 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14d27d9a-ea36-4ab8-9d1b-7d550a62396f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "POST /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584594 Aug 24 03:59:51.103643 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2669/5092] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 03:59:50 2022] POST /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 194 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:57.876330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:57.879970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:57.890724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:57.891422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:57.904010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:57.904943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:57.905599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:57.906630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:57.907323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:57.908003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:58.032191 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c56b4a42-0a5f-48c1-b23b-142822d7a934 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "POST /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8/action" status: 200 len: 32631 microversion: 2.1 time: 0.160709 Aug 24 03:59:58.033337 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2424/5093] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 03:59:57 2022] POST /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8/action => generated 32631 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:00:00.335166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1513851273", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "08e2a024-b48a-4e15-b943-96256a726160"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:00.374308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:00.593955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] validate_networks() for [('08e2a024-b48a-4e15-b943-96256a726160', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:00:00.787978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:00.796211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:00.820858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:00.821359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:00.833688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:00.835414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:00.836549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:00.837010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:00.923243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:00:01.087999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:01.211007 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b46ca49d-17e0-488f-808a-40b4fdf37a32 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 204 len: 0 microversion: 2.1 time: 0.435870 Aug 24 04:00:01.211752 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2425/5094] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:00 2022] DELETE /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:01.230162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ec8ef5d3-e8d9-4e24-9cca-fbcf0fefc11f req-9e46fdba-079b-4432-802e-a82046502f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dfa6037-d629-433f-aa3f-ee1e0180d7f8", "tag": "c06a845d-1c04-4cfc-93c1-ddc875bedf5e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:01.261425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ec8ef5d3-e8d9-4e24-9cca-fbcf0fefc11f req-9e46fdba-079b-4432-802e-a82046502f2a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:01.263107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ec8ef5d3-e8d9-4e24-9cca-fbcf0fefc11f req-9e46fdba-079b-4432-802e-a82046502f2a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:01.264213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ec8ef5d3-e8d9-4e24-9cca-fbcf0fefc11f req-9e46fdba-079b-4432-802e-a82046502f2a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:01.292052 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ec8ef5d3-e8d9-4e24-9cca-fbcf0fefc11f req-9e46fdba-079b-4432-802e-a82046502f2a service nova] Creating event network-changed:c06a845d-1c04-4cfc-93c1-ddc875bedf5e for instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 on n-h1-846470-15 Aug 24 04:00:01.306237 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ec8ef5d3-e8d9-4e24-9cca-fbcf0fefc11f req-9e46fdba-079b-4432-802e-a82046502f2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084674 Aug 24 04:00:01.312411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2426/5095] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:01.327306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:01.329077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:01.347121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:01.349240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:01.349952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:01.352304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:01.353990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:01.356125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:02.003488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:00:02.004269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:00:02.006064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:00:02.006845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:00:02.007882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:00:02.076420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:02.077280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:02.078046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:02.079304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:02.093192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:02.093989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:02.166598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Getting quotas for project 0dfa4e35f2154b4eb506e4336a3c4f16. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:00:02.179835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Getting quotas for user 5a56bbc01292446d81fbd60f13104da9 and project 0dfa4e35f2154b4eb506e4336a3c4f16. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:00:02.209247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:00:02.214870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:00:02.389585 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-615e5ddd-48ba-4444-9a02-93d640f785cd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.756332 Aug 24 04:00:02.396284 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2670/5096] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 03:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:00:02.411851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e15666c-cedf-42b3-a9c4-47a7d9774f70 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:02.412486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8e15666c-cedf-42b3-a9c4-47a7d9774f70 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:02.645084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e15666c-cedf-42b3-a9c4-47a7d9774f70 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:02.656085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:02.663623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8e15666c-cedf-42b3-a9c4-47a7d9774f70 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1208 microversion: 2.1 time: 0.259606 Aug 24 04:00:02.664262 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2671/5097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:02 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1208 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:02.696642 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5572e5c-acbc-4965-9cfc-8302f0940da7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1670 microversion: 2.1 time: 1.368479 Aug 24 04:00:02.696954 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2427/5098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:01 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1670 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:03.685112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:03.686423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:03.708416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:03.723599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:03.724501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:03.728920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:03.729361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:03.730240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:03.740607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:03.743772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:03.750410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:03.750903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:03.751357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:03.752248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:03.752729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:03.765827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:03.972283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:03.992559 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-62d726d5-bfe7-42d5-ad5f-a38491113a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1212 microversion: 2.1 time: 0.310524 Aug 24 04:00:03.994386 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2672/5099] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:03 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1212 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:04.782693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:04.798695 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cf0b8646-4859-4885-9f55-330f517f2f0c tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1670 microversion: 2.1 time: 1.082556 Aug 24 04:00:04.801697 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2428/5100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:03 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1670 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:05.037163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:05.040377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:05.053778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.060441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.061134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.066087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.080049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.080783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.270117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d28b0f0b-6970-4d8e-a9bf-eea3e72e33a2 req-b543f6c4-76fd-4dfb-9463-f0a063880d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfa6037-d629-433f-aa3f-ee1e0180d7f8", "name": "network-vif-deleted", "tag": "c06a845d-1c04-4cfc-93c1-ddc875bedf5e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:05.313017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d28b0f0b-6970-4d8e-a9bf-eea3e72e33a2 req-b543f6c4-76fd-4dfb-9463-f0a063880d4c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.319521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d28b0f0b-6970-4d8e-a9bf-eea3e72e33a2 req-b543f6c4-76fd-4dfb-9463-f0a063880d4c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.327082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d28b0f0b-6970-4d8e-a9bf-eea3e72e33a2 req-b543f6c4-76fd-4dfb-9463-f0a063880d4c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.353418 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d28b0f0b-6970-4d8e-a9bf-eea3e72e33a2 req-b543f6c4-76fd-4dfb-9463-f0a063880d4c service nova] Creating event network-vif-deleted:c06a845d-1c04-4cfc-93c1-ddc875bedf5e for instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 on n-h1-846470-15 Aug 24 04:00:05.370696 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d28b0f0b-6970-4d8e-a9bf-eea3e72e33a2 req-b543f6c4-76fd-4dfb-9463-f0a063880d4c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109375 Aug 24 04:00:05.370940 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2429/5101] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:05.456230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:05.467442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fd7a545-7a2f-4e82-8ed9-b1860cf7a2b9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1260 microversion: 2.1 time: 0.434473 Aug 24 04:00:05.471183 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2673/5102] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:05 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1260 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:05.838555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:05.859242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:05.923993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.924840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.925536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.926492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.927422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.929561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:06.026449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:06.027732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:06.030390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:06.033122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lazy-loading 'fault' on Instance uuid 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:00:06.190332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7f4a326b7a4b598ca962847679ac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1641d4e3764347a4ad4c91c0ee21ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:06.202228 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3d99423c-09c4-4136-b2b7-cd06743b1ff7 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 200 len: 1489 microversion: 2.1 time: 0.380212 Aug 24 04:00:06.212192 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2430/5103] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:05 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 1489 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:06.502869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:06.505360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:06.544848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:06.546745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:06.556328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:06.560293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:06.562348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:06.563644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:06.758456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:06.777650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4fdf1005-0acf-4189-9641-3d31e1912884 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1266 microversion: 2.1 time: 0.284866 Aug 24 04:00:06.783843 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2674/5104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:06 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:07.248177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:07.251342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] [instance: 7dfa6037-d629-433f-aa3f-ee1e0180d7f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:07.283077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:07.284631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:07.285659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:07.287313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:07.288551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:07.289123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:07.353459 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] HTTP exception thrown: Instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 could not be found. Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Request method failure captured: Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 HTTP/1.1 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaDGwk5VnkVx-wp3f1b44KZqYk6Q1Nkv2qgRW586DvlJ7Uyh4uyO4i9zi7BR6NFtFQ0Sht9aPAEM4UP8DeolxPn-X_fpeJtW8O3GDLrU8c6aPawSUy8NALuTD_bdlCyTHtJgsMvhnbDr_eHe_QbyDsYABlE6HjBIFohUzJZs0PUUb-0 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 3d1641d4e3764347a4ad4c91c0ee21ee Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestNetworkBasicOps-1145880211 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d1641d4e3764347a4ad4c91c0ee21ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestNetworkBasicOps-1145880211 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 3d1641d4e3764347a4ad4c91c0ee21ee Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestNetworkBasicOps-1145880211 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestNetworkBasicOps-1145880211-project Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5c7f4a326b7a4b598ca962847679ac13 Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestNetworkBasicOps-1145880211-project Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 could not be found. Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '7dfa6037-d629-433f-aa3f-ee1e0180d7f8'} Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 could not be found. Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 could not be found. Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:07.365834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:07.370594 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:07.370594 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:07.370594 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:07.370594 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:07.370594 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:07.370594 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 could not be found. Aug 24 04:00:07.370594 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:07.372728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Returning 404 to user: Instance 7dfa6037-d629-433f-aa3f-ee1e0180d7f8 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:07.374348 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af5a8e6a-0124-4dc9-a79b-d55358484ffb tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8" status: 404 len: 111 microversion: 2.1 time: 0.133922 Aug 24 04:00:07.380573 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2431/5105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:07 2022] GET /compute/v2.1/servers/7dfa6037-d629-433f-aa3f-ee1e0180d7f8 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:07.803095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:07.804451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:07.820761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:07.829430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:07.830243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:07.832115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:07.833112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:07.833788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:08.002248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ba369eb-2daa-46ad-8fd9-c8c2fe19a8e9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] Calling method '.version_select at 0x7f102b3b8160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:08.054772 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ba369eb-2daa-46ad-8fd9-c8c2fe19a8e9 tempest-TestNetworkBasicOps-1145880211 tempest-TestNetworkBasicOps-1145880211-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-324190809" status: 202 len: 0 microversion: 2.1 time: 0.058095 Aug 24 04:00:08.063367 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2432/5106] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 24 04:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-324190809 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:00:08.895121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:08.931067 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97a27edc-821a-4493-8a09-8f61b9a4546c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1308 microversion: 2.1 time: 1.131940 Aug 24 04:00:08.932857 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2675/5107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:07 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1308 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:09.132005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-616682759", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:09.221565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:00:09.665790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:00:09.666219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:00:09.666767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:00:09.667126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:00:09.667615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:00:09.685979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.686386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.686844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.687703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.691050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.691619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.723764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Getting quotas for project ea97658e38d0407192f80952674a000c. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:00:09.744813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Getting quotas for user defae7e13b6147e1a47d0bb87e994fc6 and project ea97658e38d0407192f80952674a000c. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:00:09.787047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:00:09.794113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:00:09.896063 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e61edff6-80fa-4656-bcbe-a32c66ed0c8b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769609 Aug 24 04:00:09.897898 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2433/5108] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:00:09.901374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5713ecd2-7854-41d9-b2fe-f319b5372196 req-532c4c9b-efe4-41f2-aa39-158853f5874a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27ee3d0-37d5-4d50-afcf-192e3bcf34f5", "tag": "c09bbf4d-7168-4dc9-886a-e317c50cdc70"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:09.918642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f07b4310-2341-4719-804e-cb3f8e853eb5 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:09.921748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f07b4310-2341-4719-804e-cb3f8e853eb5 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:09.967244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5713ecd2-7854-41d9-b2fe-f319b5372196 req-532c4c9b-efe4-41f2-aa39-158853f5874a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.969040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5713ecd2-7854-41d9-b2fe-f319b5372196 req-532c4c9b-efe4-41f2-aa39-158853f5874a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.971455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5713ecd2-7854-41d9-b2fe-f319b5372196 req-532c4c9b-efe4-41f2-aa39-158853f5874a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.998251 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5713ecd2-7854-41d9-b2fe-f319b5372196 req-532c4c9b-efe4-41f2-aa39-158853f5874a service nova] Creating event network-changed:c09bbf4d-7168-4dc9-886a-e317c50cdc70 for instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 on n-h2-846470-15 Aug 24 04:00:10.010776 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5713ecd2-7854-41d9-b2fe-f319b5372196 req-532c4c9b-efe4-41f2-aa39-158853f5874a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142805 Aug 24 04:00:10.012803 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2676/5109] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:10.029272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:10.031535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:10.049909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:10.051277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:10.053031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:10.058470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:10.063542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:10.064876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:10.303493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f07b4310-2341-4719-804e-cb3f8e853eb5 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:10.327158 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f07b4310-2341-4719-804e-cb3f8e853eb5 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1214 microversion: 2.1 time: 0.413530 Aug 24 04:00:10.338801 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2434/5110] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:09 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1214 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:10.350865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:10.352782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:10.382598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:10.383507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:10.384321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:10.396442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:10.397703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:10.398814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:10.580319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lazy-loading 'services' on Instance uuid 1d08b0fd-813e-439c-acca-a34994d9fccc {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:00:10.583819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:10.623946 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-308aca80-9a3f-4ce3-88eb-500f5df2a514 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1308 microversion: 2.1 time: 0.605764 Aug 24 04:00:10.628536 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2677/5111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:10 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:10.752295 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f78532f-4bbf-4ffa-a69f-b3bbbbbd4554 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments/aa1492fe-b47b-4191-8bf5-05de23f82f03" status: 202 len: 0 microversion: 2.1 time: 0.411230 Aug 24 04:00:10.753278 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2435/5112] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:00:10 2022] DELETE /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments/aa1492fe-b47b-4191-8bf5-05de23f82f03 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:00:10.767731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:10.783127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:10.800902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:10.801726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:10.802514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:10.803760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:10.810698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:10.820656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:10.921706 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4b6933b-7430-4338-bc32-b76a9dc9b6e0 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161313 Aug 24 04:00:10.924253 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2678/5113] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:10 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:11.375893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:11.379905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:11.421301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.436461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.436929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.437937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.438425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.438859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.603412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:11.612956 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fe4a67c7-fda9-48f1-a90f-6dd3d20bf1ad tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1266 microversion: 2.1 time: 0.248456 Aug 24 04:00:11.617563 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2436/5114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:11 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:11.648245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:11.648901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:11.661128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.661616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.662046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.667478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.668055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.668564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.942517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:11.953395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:11.975232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.989067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.990333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.992146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.993342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.994275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:12.112242 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5ad3e27-21c2-463d-a025-d9d5b6e1cca2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176964 Aug 24 04:00:12.124584 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2437/5115] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:11 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:12.154327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:12.364008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:12.398332 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-991b5db7-ca61-43a5-be11-085b848284a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1308 microversion: 2.1 time: 0.747194 Aug 24 04:00:12.400131 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2679/5116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:11 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1308 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:12.646204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:12.647367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:12.682766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:12.683736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:12.684447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:12.685233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:12.685944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:12.686700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:13.075154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:13.108862 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8f97b7dd-1145-4a30-beff-1827c20767c4 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1272 microversion: 2.1 time: 0.469696 Aug 24 04:00:13.110147 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2438/5117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:12 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1272 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:13.135782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:13.145484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:13.160580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:13.183940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:13.185068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:13.185977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:13.193800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:13.195640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:13.196947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:13.283081 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70dca297-1212-4d68-87cb-ed7d58e77434 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154674 Aug 24 04:00:13.284963 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2680/5118] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:13 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:13.425550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:13.426589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:13.450360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:13.461998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:13.462908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:13.463704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:13.464336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:13.464856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:13.918774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:13.927041 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-28cee0b5-7a4c-48ec-a369-754d927f06da tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1308 microversion: 2.1 time: 0.509367 Aug 24 04:00:13.940111 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2439/5119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:13 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:14.132613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:14.133742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:14.155509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.159133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.162638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.170962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.171888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.175896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.306179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:14.308997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:14.323317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.324160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.324754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.326138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.327574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:14.328339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.328937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.338440 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-18aed3e6-0590-49dc-9cab-02054066f20a tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1272 microversion: 2.1 time: 0.211208 Aug 24 04:00:14.352017 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2681/5120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:14 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:14.401950 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4af9b104-2a10-4a97-9bd8-686ec5574385 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100302 Aug 24 04:00:14.406769 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2440/5121] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:14 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:14.954099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:14.955099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:14.986486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.987289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.988370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.989274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.990048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.990729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:15.393402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:15.399149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:15.439050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:15.448493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:15.452627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:15.469010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:15.479735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:15.507177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:15.595873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:15.604215 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba98f77b-6e9c-4352-8815-ef9e9354a47e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1308 microversion: 2.1 time: 0.657323 Aug 24 04:00:15.604860 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2682/5122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:14 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1308 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:15.644182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:15.646472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:15.665041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:15.665771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:15.666549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:15.667634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:15.671835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:15.672449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:15.767971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:15.772947 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-68f28e81-e98a-4667-a879-3a17f4efe2e2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160472 Aug 24 04:00:15.783389 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2683/5123] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:15 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:15.800452 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-abc71bd8-c63d-4508-9110-69e244393b11 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1272 microversion: 2.1 time: 0.441706 Aug 24 04:00:15.804099 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2441/5124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:15 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1272 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:16.629675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:16.633200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:16.684674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:16.698169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:16.701051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:16.702770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:16.706185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:16.723560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:16.840088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:16.841585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:16.858272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:16.860966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:16.863142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:16.867142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:16.868848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:16.869991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:16.955137 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-56efbbba-3b15-4a03-acc2-c955f34a065d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments/c034b186-9366-46a0-b787-f9c51171af1d" status: 200 len: 194 microversion: 2.20 time: 1.170209 Aug 24 04:00:16.956070 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2684/5125] 10.222.0.58 () {60 vars in 1454 bytes} [Wed Aug 24 04:00:15 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments/c034b186-9366-46a0-b787-f9c51171af1d => generated 194 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:00:16.971402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:16.978293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:16.993277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:16.994367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:16.995236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:16.996415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:16.997392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:16.998027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.085229 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0ef3c6b-24a9-4d49-893c-b58e2bcadd77 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125508 Aug 24 04:00:17.095322 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2685/5126] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:16 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:17.105904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:17.106719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:17.136329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.137039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.137784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.138772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.141941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.142478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.431327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:17.437963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:17.503051 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-afd23ce7-7936-442a-912d-8b070bc666ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1308 microversion: 2.1 time: 0.880673 Aug 24 04:00:17.507571 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2442/5127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:16 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1308 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:17.533929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:17.534996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:17.562556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.563167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.563625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.566545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.567228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.568651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.820353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lazy-loading 'services' on Instance uuid ebaceb98-646f-4cc9-b6d0-564c697b2537 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:00:17.931165 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5ba8b4b8-a366-42c0-bece-ac663f6836ef tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments/c034b186-9366-46a0-b787-f9c51171af1d" status: 202 len: 0 microversion: 2.20 time: 0.419907 Aug 24 04:00:17.932320 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2443/5128] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 24 04:00:17 2022] DELETE /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments/c034b186-9366-46a0-b787-f9c51171af1d => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:17.952855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:17.956923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:17.967288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.968210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.968910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:17.970039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:17.970996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:17.972315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:18.010508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:18.030261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f2d46e86-ffd6-40de-afef-647a1728ff4b tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1314 microversion: 2.1 time: 0.926687 Aug 24 04:00:18.042100 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2686/5129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:17 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:18.062384 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b6737783-cdee-46fd-90ab-5d540f91d387 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119364 Aug 24 04:00:18.068649 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2444/5130] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:17 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:00:18.102715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:18.106390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:18.114619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:18.116339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:18.117199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:18.118295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:18.119861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:18.121113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:18.170586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92cb426c-0096-49ea-9172-1f39fca85877 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075958 Aug 24 04:00:18.178600 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2687/5131] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:18 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:18.546128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:18.547140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:18.562352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:18.563576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:18.564725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:18.566469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:18.567533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:18.568506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.055986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:19.056813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:19.072966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:19.073566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:19.074390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.075291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:19.081809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:19.082362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.112294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:19.124540 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-75930eeb-874a-4d6e-a7a2-a3c3e461e893 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1308 microversion: 2.1 time: 0.593318 Aug 24 04:00:19.125161 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2445/5132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:18 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1308 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:19.148346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e7a3c74c-40af-4caa-a10d-ab20925a08d1 req-6801e801-958c-4551-b487-431cd792d0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fadac8d-c9cd-4c13-b590-74e9c7d11c65", "tag": "d1413d4d-c4fd-4691-a8f3-68f0e29bf2b0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:19.184258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7a3c74c-40af-4caa-a10d-ab20925a08d1 req-6801e801-958c-4551-b487-431cd792d0fc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:19.184835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7a3c74c-40af-4caa-a10d-ab20925a08d1 req-6801e801-958c-4551-b487-431cd792d0fc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:19.185289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7a3c74c-40af-4caa-a10d-ab20925a08d1 req-6801e801-958c-4551-b487-431cd792d0fc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.213269 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e7a3c74c-40af-4caa-a10d-ab20925a08d1 req-6801e801-958c-4551-b487-431cd792d0fc service nova] Creating event network-changed:d1413d4d-c4fd-4691-a8f3-68f0e29bf2b0 for instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 on n-h1-846470-15 Aug 24 04:00:19.227841 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e7a3c74c-40af-4caa-a10d-ab20925a08d1 req-6801e801-958c-4551-b487-431cd792d0fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099145 Aug 24 04:00:19.228656 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2446/5133] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:19.249804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:19.254652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:19.266488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:19.267656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:19.268655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.270879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:19.271995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:19.272839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.376618 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a690504a-010b-4735-ad73-b71bf82fb98d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.142004 Aug 24 04:00:19.382470 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2447/5134] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:19 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:00:19.402704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:19.406891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:19.418261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:19.419188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:19.419808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.420693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:19.421307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:19.421882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.505862 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5d4cdbe3-cb8a-4fe6-8a18-70c8813843fc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119622 Aug 24 04:00:19.507410 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2448/5135] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:19 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:19.579193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-766e5685-9470-484d-afee-c87f467e8338 req-3d29cdc5-1b3a-44cb-8be4-25405532b8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27ee3d0-37d5-4d50-afcf-192e3bcf34f5", "name": "network-vif-plugged", "status": "completed", "tag": "c09bbf4d-7168-4dc9-886a-e317c50cdc70"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:19.608931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-766e5685-9470-484d-afee-c87f467e8338 req-3d29cdc5-1b3a-44cb-8be4-25405532b8fe service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:19.609903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-766e5685-9470-484d-afee-c87f467e8338 req-3d29cdc5-1b3a-44cb-8be4-25405532b8fe service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:19.610415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-766e5685-9470-484d-afee-c87f467e8338 req-3d29cdc5-1b3a-44cb-8be4-25405532b8fe service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:19.632997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-766e5685-9470-484d-afee-c87f467e8338 req-3d29cdc5-1b3a-44cb-8be4-25405532b8fe service nova] Creating event network-vif-plugged:c09bbf4d-7168-4dc9-886a-e317c50cdc70 for instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 on n-h2-846470-15 Aug 24 04:00:19.647472 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-766e5685-9470-484d-afee-c87f467e8338 req-3d29cdc5-1b3a-44cb-8be4-25405532b8fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074461 Aug 24 04:00:19.649270 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2449/5136] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:00:19.778514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:19.786456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:19.803895 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4205625-2d90-4971-9647-05bc7f16069e tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1314 microversion: 2.1 time: 0.753909 Aug 24 04:00:19.805712 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2688/5137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:19 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:20.164654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.176377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:20.180306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:20.193268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:20.194178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:20.194849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:20.196844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:20.198084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:20.198887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:20.326240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.399410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:20.407378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:20.437258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:20.441758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:20.442598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:20.444736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:20.447826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:20.448547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:20.552897 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1770a87b-63e9-44f0-980c-8eb9aa9fd04e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161550 Aug 24 04:00:20.561657 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2689/5138] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:20 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:00:20.569314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:20.571837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:20.587974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:20.588885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:20.589612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:20.591075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:20.591346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:20.592876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:20.649890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:20.661499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-18a456af-ac01-4cc0-b6e6-39d89aaf9c88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1308 microversion: 2.1 time: 0.501417 Aug 24 04:00:20.662112 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2450/5139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:20 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:20.707290 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0bc15c4f-7238-40ab-a739-e32814778bef tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143727 Aug 24 04:00:20.708631 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2690/5140] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:20 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:20.828444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:20.829344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:20.838013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:20.838879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:20.839491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:20.840435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:20.841050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:20.841700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.049693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:21.061493 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-08f86790-da51-444f-ad3f-8434cabb887f tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1314 microversion: 2.1 time: 0.239255 Aug 24 04:00:21.068279 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2451/5141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:20 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:21.571269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:21.591545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:21.615430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:21.616372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:21.617143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.618397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:21.619221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:21.620115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.665295 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-87597550-9664-4c33-9130-bce2ac9cf68f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103088 Aug 24 04:00:21.665703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2691/5142] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:21 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:00:21.695930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:21.698095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:21.711788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:21.713287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:21.714591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.716382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:21.717696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:21.718712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.725558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:21.727884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:21.739469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:21.740286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:21.740934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.741872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:21.742518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:21.743115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.786264 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cf52f2a4-fb47-4f93-b9bd-74c8700cc40a tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064258 Aug 24 04:00:21.787474 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2692/5143] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:00:21 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 04:00:21.897563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:21.899600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:21.915624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:21.916701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:21.919198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.920878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:21.921809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:21.922865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:21.997054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:00:22.174591 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9add250b-b034-492c-a36e-4e6c9b891763 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 204 len: 0 microversion: 2.1 time: 0.286606 Aug 24 04:00:22.176220 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2693/5144] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:21 2022] DELETE /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:22.186214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:22.188048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:22.202674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.203969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.205038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.206959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.208115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.209300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.304749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:22.322704 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74ac1384-5740-4020-8b9e-6e0752f1a749 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1488 microversion: 2.1 time: 0.636884 Aug 24 04:00:22.359391 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2452/5145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:21 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1488 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:22.383747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:22.394317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:22.407775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.409004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.410032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.411728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.412919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.414055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.573567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:22.589327 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7532d8ce-a237-441b-9d45-79d3c8abda3d tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1314 microversion: 2.1 time: 0.410957 Aug 24 04:00:22.591785 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2694/5146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:22 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:22.599762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:22.600829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:22.617882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.618696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.619310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.622439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.623262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.624148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.734482 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b5646985-ba02-4e14-b7bf-63ed40b3f666 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5/action" status: 202 len: 0 microversion: 2.1 time: 0.140854 Aug 24 04:00:22.735952 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2695/5147] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:00:22 2022] POST /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:00:22.743266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:22.747353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:22.756485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.757370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.758198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.759541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.760667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.761492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.811384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55060d8d-4928-440e-abab-85a4fb8896d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073217 Aug 24 04:00:22.821835 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2696/5148] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:22 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:00:22.828502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:22.829453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:22.840118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.842544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.843440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:22.844896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:22.845953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:22.847091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:23.163264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:23.185926 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8ddd7e2a-0d78-430f-8c1a-09c17eb5684e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1493 microversion: 2.1 time: 0.362154 Aug 24 04:00:23.186925 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2697/5149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:22 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1493 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:23.655446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:23.659704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:23.682561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:23.683429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:23.684248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:23.685584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:23.686462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:23.689492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:24.119282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:24.150981 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b328a437-8eca-4382-8759-34ed510a7065 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1314 microversion: 2.1 time: 0.504536 Aug 24 04:00:24.152401 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2698/5150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:23 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:24.180652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:24.192985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:24.211924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:24.213624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:24.215002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:24.217097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:24.218932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:24.222452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:24.315888 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7bd6f691-4412-4e8f-af35-59ffb6beaae6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161704 Aug 24 04:00:24.325486 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2699/5151] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:24 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:00:24.336119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:24.338068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:24.353730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:24.360394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:24.364549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:24.367819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:24.369141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:24.370394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:24.532747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:24.574477 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1198c16d-78db-44b6-9912-b36a89f88209 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1680 microversion: 2.1 time: 2.212156 Aug 24 04:00:24.576402 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2453/5152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:22 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1680 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:25.184056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:25.184950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:25.199299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.200438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.204099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:25.205150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.207446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.208152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:25.445114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:25.460488 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72f5515f-3437-4f0d-ae52-c89eaf9244a9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 200 len: 1473 microversion: 2.1 time: 1.132511 Aug 24 04:00:25.464772 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2700/5153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:24 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 1473 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:25.477708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ae627d5f-a689-4f8f-ae3b-1304528e4aa1 req-7f90d783-72d2-45e4-864a-309e830ac145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fadac8d-c9cd-4c13-b590-74e9c7d11c65", "name": "network-vif-plugged", "status": "completed", "tag": "d1413d4d-c4fd-4691-a8f3-68f0e29bf2b0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:25.540552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ae627d5f-a689-4f8f-ae3b-1304528e4aa1 req-7f90d783-72d2-45e4-864a-309e830ac145 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.541325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ae627d5f-a689-4f8f-ae3b-1304528e4aa1 req-7f90d783-72d2-45e4-864a-309e830ac145 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.543212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ae627d5f-a689-4f8f-ae3b-1304528e4aa1 req-7f90d783-72d2-45e4-864a-309e830ac145 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:25.580481 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ae627d5f-a689-4f8f-ae3b-1304528e4aa1 req-7f90d783-72d2-45e4-864a-309e830ac145 service nova] Creating event network-vif-plugged:d1413d4d-c4fd-4691-a8f3-68f0e29bf2b0 for instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 on n-h1-846470-15 Aug 24 04:00:25.600603 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ae627d5f-a689-4f8f-ae3b-1304528e4aa1 req-7f90d783-72d2-45e4-864a-309e830ac145 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131541 Aug 24 04:00:25.606256 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2701/5154] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:25.614180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:25.617268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:25.625054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.625895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.626567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:25.627789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.628725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.629378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:25.684975 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d9d4f4d3-ce29-4b75-b8ae-4d91f6f72a7c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075791 Aug 24 04:00:25.686264 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2702/5155] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:25 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:00:25.695436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1794684671"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:25.699496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:25.723454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.724389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.725146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:25.726419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.727278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.728117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:25.784288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:25.869746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:25.889173 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5f9a1418-2ddc-4ad9-a3c2-279f2a86d9eb tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1314 microversion: 2.1 time: 0.709027 Aug 24 04:00:25.890978 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2454/5156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:25 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:25.927572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:25.930875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:25.946548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.947126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.947629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:25.948536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:25.949276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:25.949766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:26.240501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:26.269886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-446b3e38-2ff0-40e6-bf43-0d8127e9a16b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5/action" status: 202 len: 0 microversion: 2.1 time: 0.574007 Aug 24 04:00:26.273433 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2703/5157] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:00:25 2022] POST /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 04:00:26.296513 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b2ef0ed1-5664-4b67-8258-6e696aaab4bc tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1613 microversion: 2.1 time: 0.364357 Aug 24 04:00:26.300218 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2455/5158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:25 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1613 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:26.311130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97661241-260d-47e8-8620-67eccf87eb0c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023284c10>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:26.369965 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97661241-260d-47e8-8620-67eccf87eb0c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.087551 Aug 24 04:00:26.384778 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2704/5159] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:26 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:26.701946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:26.704638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:26.720810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:26.721633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:26.722290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:26.723253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:26.724661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:26.725298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:26.808896 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-beb5c457-2fb3-40df-adae-849784c48266 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111160 Aug 24 04:00:26.814000 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2456/5160] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:26 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:00:26.885669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-26541a91-d2c1-4087-9af9-f81550190755 req-1c5fb054-ad7e-44f2-a919-b377103ed095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d08b0fd-813e-439c-acca-a34994d9fccc", "name": "network-vif-deleted", "tag": "7425a222-91e8-4baa-8e76-8ceb65737641"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:26.909731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-26541a91-d2c1-4087-9af9-f81550190755 req-1c5fb054-ad7e-44f2-a919-b377103ed095 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:26.910242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-26541a91-d2c1-4087-9af9-f81550190755 req-1c5fb054-ad7e-44f2-a919-b377103ed095 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:26.910723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-26541a91-d2c1-4087-9af9-f81550190755 req-1c5fb054-ad7e-44f2-a919-b377103ed095 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:26.933137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:26.933970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:26.948511 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-26541a91-d2c1-4087-9af9-f81550190755 req-1c5fb054-ad7e-44f2-a919-b377103ed095 service nova] Creating event network-vif-deleted:7425a222-91e8-4baa-8e76-8ceb65737641 for instance 1d08b0fd-813e-439c-acca-a34994d9fccc on n-h2-846470-15 Aug 24 04:00:26.949493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:26.950984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:26.954178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:26.958408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:26.959647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:26.960345 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-26541a91-d2c1-4087-9af9-f81550190755 req-1c5fb054-ad7e-44f2-a919-b377103ed095 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080210 Aug 24 04:00:26.960978 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2705/5161] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:00:26.962636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:27.265321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:27.295473 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81a28744-e068-48e4-8cfd-e7b12f00b9ac tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1314 microversion: 2.1 time: 0.369548 Aug 24 04:00:27.298880 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2457/5162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:26 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:27.346517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:27.347236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:27.366553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:27.367059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:27.367828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:27.370930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:27.370930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:27.370930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:27.392767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b1db018b-ce80-4af7-a01c-0ec2a12401bb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a71cca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:27.443724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:27.444200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:27.444646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:27.445116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lazy-loading 'fault' on Instance uuid 1d08b0fd-813e-439c-acca-a34994d9fccc {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:00:27.475131 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b1db018b-ce80-4af7-a01c-0ec2a12401bb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.087770 Aug 24 04:00:27.476779 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2458/5163] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:27 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:27.541808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf384a2eab3649a2ad4f5eec8d8c6b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7dab3ce34ee7a7280eb670023a03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:27.553972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2940c088-27c6-4aa7-a999-4f3501c81ec1 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 200 len: 1331 microversion: 2.1 time: 0.211656 Aug 24 04:00:27.554991 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2706/5164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:27 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 1331 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:27.841797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:27.846087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:27.862322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:27.863181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:27.863991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:27.865257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:27.866174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:27.868061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:27.994762 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1470d90e-a456-4e96-acb0-67b4421875a9 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168055 Aug 24 04:00:27.998691 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2459/5165] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:27 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:00:28.336403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:28.337543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:28.353488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:28.354294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:28.354867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:28.364173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:28.365193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:28.365776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:28.502160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb447a2e-6f77-469c-8f7b-82785c10cbd0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a7b1d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:28.650043 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb447a2e-6f77-469c-8f7b-82785c10cbd0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.157857 Aug 24 04:00:28.651565 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2460/5166] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:28 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:28.660037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:28.661422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:28.671174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:28.673762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:28.674806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:28.675567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:28.676883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:28.677724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:28.678704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:28.707829 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc HTTP/1.1 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '1d08b0fd-813e-439c-acca-a34994d9fccc'} Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:28.711003 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:28.717643 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:28.717643 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:28.717643 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:28.717643 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:28.717643 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:28.717643 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:28.717643 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:28.720946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:28.722532 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab23b8cb-2cd2-4c17-8d1d-c9d4cbbd536b tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 404 len: 111 microversion: 2.1 time: 0.069337 Aug 24 04:00:28.723911 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2461/5167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:28 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:28.746280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-42883ad0-2d3b-4a2e-a77b-9550f043470f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '.version_select at 0x7f102acc9b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:28.784341 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-42883ad0-2d3b-4a2e-a77b-9550f043470f tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510182398" status: 202 len: 0 microversion: 2.1 time: 0.046078 Aug 24 04:00:28.786255 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2462/5168] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 04:00:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510182398 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:00:28.798549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:28.828856 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-87a21736-37ad-4bb5-9707-507db8974a18 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1463 microversion: 2.1 time: 0.498939 Aug 24 04:00:28.848149 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2707/5169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:28 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1463 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:28.919052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:28.920040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:28.935732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:28.937432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:28.939065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:28.941059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:28.942930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:28.944531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.024477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:29.028264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:00:29.033455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:29.040237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:29.051175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:29.052234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:29.053212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.055471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:29.056731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:29.057641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.134365 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3278fd6-66ac-4181-a411-aa46a7d297f0 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.124619 Aug 24 04:00:29.136121 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2708/5170] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:00:29 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:29.239789 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06c16e6b-d330-4805-a7da-bd90a6039775 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 204 len: 0 microversion: 2.1 time: 0.329927 Aug 24 04:00:29.244412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2463/5171] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:28 2022] DELETE /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:29.273931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:29.282192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:29.286875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:29.288475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:29.291017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:29.303178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:29.303719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:29.305082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.307876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:29.308986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:29.309333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:29.309763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.310912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:29.311961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.313472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:29.314509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:29.315511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.389326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:00:29.538929 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1439e9a2-a31a-4db1-9425-40c63ea0e758 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 204 len: 0 microversion: 2.20 time: 0.259238 Aug 24 04:00:29.540560 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2464/5172] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 04:00:29 2022] DELETE /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 04:00:29.551797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:29.553005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:29.561753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:29.562768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:29.564197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.565304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:29.565999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:29.566646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:29.668394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:29.684748 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-907d38f5-4aa4-408b-94f2-083ab0844746 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1469 microversion: 2.1 time: 0.431082 Aug 24 04:00:29.686427 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2709/5173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:29 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:29.692635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dc19231d-e2d1-4861-b635-061d303b23ae tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023313af0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:29.808120 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dc19231d-e2d1-4861-b635-061d303b23ae tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.119047 Aug 24 04:00:29.809082 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2710/5174] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:29 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:29.887995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:29.904669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:29.908338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:29.910804 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81d5a81e-00c4-469f-87b3-42c57e608909 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.364917 Aug 24 04:00:29.923984 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2465/5175] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:29 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:00:30.709324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:30.709939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:30.721713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:30.722965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:30.724045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:30.725591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:30.726768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:30.727875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:30.823703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3677e003-9f6a-4c7c-b8a2-e3a5316540d0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1034416280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:30.923394 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3677e003-9f6a-4c7c-b8a2-e3a5316540d0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.103581 Aug 24 04:00:30.924448 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2466/5176] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:30 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:30.968682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:30.969795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:30.983141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:30.984062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:30.985095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:30.986974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:30.987846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:30.989004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:31.070403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:31.093767 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a264bc2d-b49b-4a29-8833-f209cea02185 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1469 microversion: 2.1 time: 0.390133 Aug 24 04:00:31.095570 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2711/5177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:30 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1469 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:31.228116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:31.243260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:31.246348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:31.248799 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb2a7213-6515-433b-9690-497b49b81ba3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.288443 Aug 24 04:00:31.250042 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2467/5178] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:30 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:00:31.952347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ee23e6ce-deb8-40ad-8000-07f6ac085c33 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023313af0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:32.041893 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ee23e6ce-deb8-40ad-8000-07f6ac085c33 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.099439 Aug 24 04:00:32.043219 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2712/5179] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:31 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:32.116225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:32.117631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:32.126212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:32.126943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:32.127448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:32.128282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:32.128810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:32.129447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:32.273045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:32.273748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:32.281636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:32.282602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:32.283253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:32.284065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:32.284733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:32.285342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:32.505109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:32.521853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:32.525388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:32.527953 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4893c199-6f8d-44ee-b5ed-7125fbdb4599 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.258538 Aug 24 04:00:32.529576 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2713/5180] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:32 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:00:32.763536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:32.777308 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ec0fa115-8ea7-4d56-8b65-eab6c3d05cd6 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1469 microversion: 2.1 time: 0.664857 Aug 24 04:00:32.781935 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2468/5181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:32 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1469 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:33.062040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b89ff469-23ad-4274-b718-b60c7e9099eb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10236fd310>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:33.228190 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b89ff469-23ad-4274-b718-b60c7e9099eb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.172331 Aug 24 04:00:33.242718 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2714/5182] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:33 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:33.557053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:33.557749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:33.573990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:33.573990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:33.575539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:33.577365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:33.577851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:33.578286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:33.660803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-179762b1-97d0-47df-9064-d966dc4aa36c req-e7ff8c29-2d25-4075-bdff-9920bc2bf6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27ee3d0-37d5-4d50-afcf-192e3bcf34f5", "name": "network-vif-plugged", "status": "completed", "tag": "c09bbf4d-7168-4dc9-886a-e317c50cdc70"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:33.687531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-179762b1-97d0-47df-9064-d966dc4aa36c req-e7ff8c29-2d25-4075-bdff-9920bc2bf6a1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:33.688674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-179762b1-97d0-47df-9064-d966dc4aa36c req-e7ff8c29-2d25-4075-bdff-9920bc2bf6a1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:33.690966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-179762b1-97d0-47df-9064-d966dc4aa36c req-e7ff8c29-2d25-4075-bdff-9920bc2bf6a1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:33.710802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-179762b1-97d0-47df-9064-d966dc4aa36c req-e7ff8c29-2d25-4075-bdff-9920bc2bf6a1 service nova] Creating event network-vif-plugged:c09bbf4d-7168-4dc9-886a-e317c50cdc70 for instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 on n-h2-846470-15 Aug 24 04:00:33.719025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-179762b1-97d0-47df-9064-d966dc4aa36c req-e7ff8c29-2d25-4075-bdff-9920bc2bf6a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063111 Aug 24 04:00:33.720254 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2715/5183] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:33.818025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:33.818747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:33.832488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:33.833961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:33.838349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:33.842909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:33.842909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:33.842909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:34.209489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:34.251371 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0f8814b4-7587-441d-a2eb-65a766d07bc9 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1469 microversion: 2.1 time: 0.441894 Aug 24 04:00:34.252491 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2716/5184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:33 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:34.278903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1daa6158-b1c7-4367-9f6e-b8ace0e67b71 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10236fd820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:34.382275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:34.394732 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1daa6158-b1c7-4367-9f6e-b8ace0e67b71 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.125585 Aug 24 04:00:34.397221 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2717/5185] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:34 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:34.424279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:34.435149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:34.438293 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6978eb64-c6e3-42d9-aae9-f5e18a4ebfad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1721 microversion: 2.20 time: 0.888901 Aug 24 04:00:34.459273 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2469/5186] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:33 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1721 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:00:34.529739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2507b6de-f2e2-4880-9363-0088342b676a req-7f3ef13a-067a-470a-acee-6ae8a10a4bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fadac8d-c9cd-4c13-b590-74e9c7d11c65", "name": "network-vif-deleted", "tag": "d1413d4d-c4fd-4691-a8f3-68f0e29bf2b0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:34.642393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2507b6de-f2e2-4880-9363-0088342b676a req-7f3ef13a-067a-470a-acee-6ae8a10a4bdf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:34.651372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2507b6de-f2e2-4880-9363-0088342b676a req-7f3ef13a-067a-470a-acee-6ae8a10a4bdf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:34.668098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2507b6de-f2e2-4880-9363-0088342b676a req-7f3ef13a-067a-470a-acee-6ae8a10a4bdf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:34.763954 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2507b6de-f2e2-4880-9363-0088342b676a req-7f3ef13a-067a-470a-acee-6ae8a10a4bdf service nova] Creating event network-vif-deleted:d1413d4d-c4fd-4691-a8f3-68f0e29bf2b0 for instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 on n-h1-846470-15 Aug 24 04:00:34.799093 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2507b6de-f2e2-4880-9363-0088342b676a req-7f3ef13a-067a-470a-acee-6ae8a10a4bdf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276172 Aug 24 04:00:34.806600 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2718/5187] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:35.298466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:35.305457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:35.332134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:35.333445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:35.340768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:35.342465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:35.343500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:35.344510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:35.425062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e494fdf3-45ae-4065-b809-2a6470350335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023021ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:35.559264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:35.572396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:35.574810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:35.576087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lazy-loading 'fault' on Instance uuid 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:00:35.619481 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e494fdf3-45ae-4065-b809-2a6470350335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.212094 Aug 24 04:00:35.650457 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2719/5188] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:35 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:35.660443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:35.661717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:35.694587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:35.695476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:35.696301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:35.708401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:35.709418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:35.710220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:35.947284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:35.956050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defae7e13b6147e1a47d0bb87e994fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea97658e38d0407192f80952674a000c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:36.002603 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b0b206bd-b5f3-4f60-b7d9-4dc7a68b7ee1 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 200 len: 1304 microversion: 2.1 time: 0.714189 Aug 24 04:00:36.008771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:36.024629 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2470/5189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:35 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 1304 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:36.053385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:36.063131 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-43332ce3-5923-48b3-8ea1-dcbce2ac84d7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1654 microversion: 2.20 time: 0.410105 Aug 24 04:00:36.069585 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2720/5190] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:35 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1654 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:00:36.663250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf1417d3-ac31-4a1e-967e-479da3e07a31 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10344164c0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:36.822332 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cf1417d3-ac31-4a1e-967e-479da3e07a31 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.166629 Aug 24 04:00:36.823246 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2471/5191] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:36 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:36.878644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1e8debc1-46aa-4738-995e-d5284e3107f0 req-f5b9c3ca-1a72-41af-b4d8-81e4aa51c37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaceb98-646f-4cc9-b6d0-564c697b2537", "name": "network-vif-deleted", "tag": "b4cd305e-193b-42fa-834b-651256717f69"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:36.905806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e8debc1-46aa-4738-995e-d5284e3107f0 req-f5b9c3ca-1a72-41af-b4d8-81e4aa51c37e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:36.906285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e8debc1-46aa-4738-995e-d5284e3107f0 req-f5b9c3ca-1a72-41af-b4d8-81e4aa51c37e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:36.906717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1e8debc1-46aa-4738-995e-d5284e3107f0 req-f5b9c3ca-1a72-41af-b4d8-81e4aa51c37e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:36.941839 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1e8debc1-46aa-4738-995e-d5284e3107f0 req-f5b9c3ca-1a72-41af-b4d8-81e4aa51c37e service nova] Creating event network-vif-deleted:b4cd305e-193b-42fa-834b-651256717f69 for instance ebaceb98-646f-4cc9-b6d0-564c697b2537 on n-h1-846470-15 Aug 24 04:00:36.950497 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1e8debc1-46aa-4738-995e-d5284e3107f0 req-f5b9c3ca-1a72-41af-b4d8-81e4aa51c37e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075456 Aug 24 04:00:36.955290 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2721/5192] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:00:37.048790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:37.049804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] [instance: 8fadac8d-c9cd-4c13-b590-74e9c7d11c65] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:37.062493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:37.070679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:37.071145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:37.071950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:37.072416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:37.072849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:37.119957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:37.120713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:37.147913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:37.166602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:37.167454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:37.171330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:37.171873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:37.172318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:37.205575 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] HTTP exception thrown: Instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 could not be found. Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Request method failure captured: Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 HTTP/1.1 Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaJF-uSREF1E4Thea661YRXpcbvRzOhjKtzBRpuo0fJFDyahWiq88jpPQhsAGxHkbFqr0YVyiiD_MiILTN3e40SSkfobybMV4PamB0hTiY_0JGu3sJNnSAaO_iB0Qeur39ssop2hCkwmtO5vw1lEVzmIYihDnmNBrHV1bJaEdXf1jUk Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: ea97658e38d0407192f80952674a000c Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesNegativeTest-926784778 Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea97658e38d0407192f80952674a000c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea97658e38d0407192f80952674a000c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea97658e38d0407192f80952674a000c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea97658e38d0407192f80952674a000c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesNegativeTest-926784778 Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: ea97658e38d0407192f80952674a000c Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesNegativeTest-926784778 Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesNegativeTest-926784778-project Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: defae7e13b6147e1a47d0bb87e994fc6 Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesNegativeTest-926784778-project Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 could not be found. Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '8fadac8d-c9cd-4c13-b590-74e9c7d11c65'} Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 could not be found. Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 could not be found. Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:37.209562 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:37.213547 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:37.213547 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:37.213547 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:37.213547 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:37.213547 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:37.213547 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 could not be found. Aug 24 04:00:37.213547 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:37.220818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] Returning 404 to user: Instance 8fadac8d-c9cd-4c13-b590-74e9c7d11c65 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:37.226089 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ee2c6c8-501a-400b-94a1-b3a5cc19ec00 tempest-VolumesNegativeTest-926784778 tempest-VolumesNegativeTest-926784778-project] 10.222.0.58 "GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65" status: 404 len: 111 microversion: 2.1 time: 0.181459 Aug 24 04:00:37.231035 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2472/5193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:37 2022] GET /compute/v2.1/servers/8fadac8d-c9cd-4c13-b590-74e9c7d11c65 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:37.355508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:37.386821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:37.388024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:37.390325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lazy-loading 'fault' on Instance uuid ebaceb98-646f-4cc9-b6d0-564c697b2537 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:00:37.838060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87a14f00-34a9-4d3e-9aad-68e2a04c27cf tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102acc9d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:37.885676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:37.928887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:37.939912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:37.946310 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3f62dcf5-0c0a-43df-a718-97d1c4e42877 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 200 len: 1371 microversion: 2.20 time: 0.852143 Aug 24 04:00:37.961258 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2722/5194] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:37 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 1371 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:00:38.328332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:38.331805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:38.351429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:38.352590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:38.355598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:38.357322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:38.362040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:38.365317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:38.398394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc HTTP/1.1 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1d08b0fd-813e-439c-acca-a34994d9fccc'} Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:38.402037 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.410870 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.423119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:38.426649 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65ce71ba-5b71-4853-adae-df72aa3f87d5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 404 len: 111 microversion: 2.1 time: 0.109596 Aug 24 04:00:38.437706 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2723/5195] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:38 2022] DELETE /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:00:38.449538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:38.450624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 1d08b0fd-813e-439c-acca-a34994d9fccc] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:38.467759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:38.471297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:38.472600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:38.474675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:38.482834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:38.499514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:38.584406 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc HTTP/1.1 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1d08b0fd-813e-439c-acca-a34994d9fccc'} Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:38.586908 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.590866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:38.590866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:38.590866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:38.590866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:38.590866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:38.590866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. Aug 24 04:00:38.590866 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:38.592424 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87a14f00-34a9-4d3e-9aad-68e2a04c27cf tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.758224 Aug 24 04:00:38.593093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 1d08b0fd-813e-439c-acca-a34994d9fccc could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:38.594820 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59c523df-7439-4c09-9c6d-aaa23fcc9754 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc" status: 404 len: 111 microversion: 2.1 time: 0.155343 Aug 24 04:00:38.596584 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2724/5196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:38 2022] GET /compute/v2.1/servers/1d08b0fd-813e-439c-acca-a34994d9fccc => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:38.604613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2473/5197] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:37 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:39.007363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:39.008885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:39.044701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:39.045266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:39.045758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:39.054116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:39.054691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:39.057488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:39.091777 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] HTTP exception thrown: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Request method failure captured: Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 HTTP/1.1 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaEbMxkhRNv442u5Bjz1vlJnphzL6my461OjZdAZVx-35PKzFyDW43B_SSSJhKVay0CPpdkAqZ0kPxVGn5QOIcuo0krN42dWSgXOEtU2lkBooDSeJW-Ba86YyiHmkB3MwouvCvl0lqD0SUHPVkPzmUhVsXpr0HEykkQgAOcefYbsn64 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: fc82859254e34a42902e5b72a6580362 Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'ebaceb98-646f-4cc9-b6d0-564c697b2537'} Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:39.104989 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:39.108649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:39.108649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:39.108649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:39.108649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:39.108649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:39.108649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:39.108649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:00:39.108649 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:39.110809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Returning 404 to user: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:39.112061 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b85c02df-0160-4bc4-a505-24e16cb7f4df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 404 len: 111 microversion: 2.20 time: 0.118553 Aug 24 04:00:39.113084 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2725/5198] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:38 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:00:39.122855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a64065d0-6893-46cf-b48b-26b2faa671df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '.version_select at 0x7f102ae93ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:39.161307 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a64065d0-6893-46cf-b48b-26b2faa671df tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822020799" status: 204 len: 0 microversion: 2.20 time: 0.043481 Aug 24 04:00:39.162023 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2474/5199] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 04:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822020799 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 04:00:39.615555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-21fd43d3-b7a2-460f-a007-fba4a381ae6a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023697ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:40.438397 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-21fd43d3-b7a2-460f-a007-fba4a381ae6a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.827613 Aug 24 04:00:40.439353 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2726/5200] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:39 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:40.762622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffb28994-f5cd-45b5-b4b4-145f604dc2c3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'create', calling method: .version_select at 0x7f102b39a040>, body: {"keypair": {"name": "tempest-keypair-1483181479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN62BfH+gHbRJlcu3VO50E84WiYMDb9ql8Jgy6fi5FN6OcWhTkaXDvvysxgvykgqmSPuo89b8Eu0hx4qdUqdIpaMuLS7BxuzsasD0STkxxiUIOoS6184hoCKtQoK22SB2Q=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:40.783851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ffb28994-f5cd-45b5-b4b4-145f604dc2c3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Getting quotas for project bf93478ba0a74d2a8c3b7bbae86cbd69. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:00:40.790394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ffb28994-f5cd-45b5-b4b4-145f604dc2c3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Getting quotas for user fc82859254e34a42902e5b72a6580362 and project bf93478ba0a74d2a8c3b7bbae86cbd69. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:00:40.835582 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffb28994-f5cd-45b5-b4b4-145f604dc2c3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.076604 Aug 24 04:00:40.861285 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2475/5201] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 24 04:00:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 04:00:41.466744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05118142-f04a-4cb8-a72b-19b2d23a16de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10235619d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:41.662291 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05118142-f04a-4cb8-a72b-19b2d23a16de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.210305 Aug 24 04:00:41.663925 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2727/5202] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:41 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:42.682544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-571cbeea-3b07-4e6e-8b11-dee4bbaaceb2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102b10dca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:42.906492 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-571cbeea-3b07-4e6e-8b11-dee4bbaaceb2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.227827 Aug 24 04:00:42.907418 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2476/5203] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:42 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:43.947933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e07a6e4-d73b-49c9-bc0f-b3946b83e744 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1021c76040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:44.052539 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e07a6e4-d73b-49c9-bc0f-b3946b83e744 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.125166 Aug 24 04:00:44.060280 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2728/5204] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:43 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:44.678334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-538900436", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3f89937-69ed-45e1-92ee-4bebfe7fadf3"}], "security_groups": [{"name": "tempest-securitygroup--1549155709"}], "key_name": "tempest-keypair-1483181479", "user_data": "}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:45.070519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b4f7b64-d8e4-4dbb-a7ca-917d2fd5c502 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10230d9f70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:45.109526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] validate_networks() for [('b3f89937-69ed-45e1-92ee-4bebfe7fadf3', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:00:45.215618 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b4f7b64-d8e4-4dbb-a7ca-917d2fd5c502 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.144960 Aug 24 04:00:45.227042 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2729/5205] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:45 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:45.844051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:45.844999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:45.864807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:45.869020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:45.870959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:45.872049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:45.877291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:45.878217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:45.905832 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee HTTP/1.1 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '51814e8b-04b9-4f0a-a8eb-9a1ec11813ee'} Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:45.912676 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:45.918117 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:45.920178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:45.921694 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba1f981a-46c6-4876-aa74-093f13df6fcd tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 404 len: 111 microversion: 2.1 time: 0.083360 Aug 24 04:00:45.925623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2730/5206] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:45 2022] DELETE /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:45.930828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:45.932238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:45.944058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:45.944861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:45.945540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:45.946868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:45.948317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:45.949082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:46.004794 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee HTTP/1.1 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '51814e8b-04b9-4f0a-a8eb-9a1ec11813ee'} Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:46.008697 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 51814e8b-04b9-4f0a-a8eb-9a1ec11813ee could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7305a145-87fa-4e85-91bc-d70c8d25e263 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee" status: 404 len: 111 microversion: 2.1 time: 0.083338 Aug 24 04:00:46.016431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2731/5207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:45 2022] GET /compute/v2.1/servers/51814e8b-04b9-4f0a-a8eb-9a1ec11813ee => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:46.025848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:46.028026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:46.039501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:46.040043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:46.046189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:46.048389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:46.048948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:46.049408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:46.106021 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 HTTP/1.1 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '180c32a3-8b5e-41e5-bcf7-1940851e3804'} Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:46.107693 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.111793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:46.115340 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9246382e-9890-45be-8e60-fac24eb81bb2 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 404 len: 111 microversion: 2.1 time: 0.093371 Aug 24 04:00:46.116849 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2732/5208] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:46 2022] DELETE /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:46.127951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:46.128886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: 180c32a3-8b5e-41e5-bcf7-1940851e3804] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:46.145974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:46.146732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:46.149696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:46.154414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:46.155355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:46.156031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:46.190536 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 HTTP/1.1 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '180c32a3-8b5e-41e5-bcf7-1940851e3804'} Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:46.192216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance 180c32a3-8b5e-41e5-bcf7-1940851e3804 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-78553149-b998-4f43-9fe8-8c74e1b92416 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804" status: 404 len: 111 microversion: 2.1 time: 0.073411 Aug 24 04:00:46.199592 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2733/5209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:46 2022] GET /compute/v2.1/servers/180c32a3-8b5e-41e5-bcf7-1940851e3804 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:46.232892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75b2cebe-cbd1-412d-a230-bdc0b6095785 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10235a1160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:46.359072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:00:46.359560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:00:46.360010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:00:46.360624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:00:46.361538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:00:46.379220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75b2cebe-cbd1-412d-a230-bdc0b6095785 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.148677 Aug 24 04:00:46.380237 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2734/5210] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:46 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:46.392559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:46.394284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:46.395518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:46.396932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:46.403428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:46.404128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:46.464232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Getting quotas for project bf93478ba0a74d2a8c3b7bbae86cbd69. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:00:46.481496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Getting quotas for user fc82859254e34a42902e5b72a6580362 and project bf93478ba0a74d2a8c3b7bbae86cbd69. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:00:46.537034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:00:46.542534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:00:46.650866 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fd9942f3-40cb-4041-aa5e-9949586b7abf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.974741 Aug 24 04:00:46.658790 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2477/5211] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 04:00:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 04:00:46.664539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62f90cfc-c5d2-4568-904a-1f93f290373a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:46.665665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-62f90cfc-c5d2-4568-904a-1f93f290373a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:46.777481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62f90cfc-c5d2-4568-904a-1f93f290373a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:46.803357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62f90cfc-c5d2-4568-904a-1f93f290373a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:46.805624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62f90cfc-c5d2-4568-904a-1f93f290373a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:46.807076 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-62f90cfc-c5d2-4568-904a-1f93f290373a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1281 microversion: 2.20 time: 0.146867 Aug 24 04:00:46.808763 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2735/5212] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:46 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1281 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:00:47.395007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5054e6b-9999-400e-bdd3-d64b980d30fd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102afaa040>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:47.499128 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5054e6b-9999-400e-bdd3-d64b980d30fd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.108000 Aug 24 04:00:47.507016 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2478/5213] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:47 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:47.834190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d929535-effb-4f84-a67d-ff19ae3ca361 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:47.834827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d929535-effb-4f84-a67d-ff19ae3ca361 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:47.992531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d929535-effb-4f84-a67d-ff19ae3ca361 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:48.010460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d929535-effb-4f84-a67d-ff19ae3ca361 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:48.018709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4d929535-effb-4f84-a67d-ff19ae3ca361 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:48.024773 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d929535-effb-4f84-a67d-ff19ae3ca361 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1281 microversion: 2.20 time: 0.196365 Aug 24 04:00:48.045129 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2736/5214] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:47 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:00:48.514968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d1b81d82-10d3-4601-9ca6-4721ef12b436 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1034359940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:48.604701 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d1b81d82-10d3-4601-9ca6-4721ef12b436 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.093517 Aug 24 04:00:48.609852 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2479/5215] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:48 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:49.058895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:49.060012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:49.095925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:49.098525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:49.099247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:49.104990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:49.105881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:49.106622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:49.291207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:49.306803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:49.309971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:49.314909 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a6fa6931-c76d-494d-9ade-d30493efec22 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1285 microversion: 2.20 time: 0.259157 Aug 24 04:00:49.332826 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2737/5216] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:49 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:00:49.625206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-68c6309b-3c7b-4046-accc-168f8522118a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10343e79d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:49.750989 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-68c6309b-3c7b-4046-accc-168f8522118a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.129095 Aug 24 04:00:49.761064 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2480/5217] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:49 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:50.362169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:50.367460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:50.425232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:50.426870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:50.427556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:50.428746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:50.429438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:50.430055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:50.539369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:50.780745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c9863de5-256e-44c1-bfde-bdc4452371ae tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10343ee0d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:50.953721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:50.969097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:50.970322 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c9863de5-256e-44c1-bfde-bdc4452371ae tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.198660 Aug 24 04:00:50.975870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:50.978472 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d3e320ca-d14f-4cde-9d25-dad274d7ca13 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1341 microversion: 2.20 time: 0.641345 Aug 24 04:00:50.984200 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2481/5218] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:50 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:51.010224 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2738/5219] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:50 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1341 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:00:51.985118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcd06692-cd16-4c1b-b6d4-73b224f0fbea tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102acc68b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:52.040360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:52.046027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:52.102821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:52.115395 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dcd06692-cd16-4c1b-b6d4-73b224f0fbea tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.134027 Aug 24 04:00:52.117497 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2482/5220] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:51 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:52.121742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:52.122854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:52.124296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:52.125203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:52.126034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:53.135604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-20bffcd5-9804-44b3-a88d-702808fffe5d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a756820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:53.317832 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-20bffcd5-9804-44b3-a88d-702808fffe5d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.189808 Aug 24 04:00:53.319163 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2483/5221] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:53 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:53.332230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:53.349709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:53.360333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:53.367939 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0d2a424-5642-44c4-a77d-2282658baaf6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 1.336255 Aug 24 04:00:53.371657 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2739/5222] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:52 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:00:54.333962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc8bac24-ffd6-4b34-b57f-6048af2bde34 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102afaa3a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:54.417479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:54.418227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:54.471006 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc8bac24-ffd6-4b34-b57f-6048af2bde34 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.142217 Aug 24 04:00:54.471621 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2484/5223] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:54 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:54.474672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:54.483403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:54.487801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:54.488801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:54.489314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:54.489774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:55.488282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fddac168-284e-4445-8abb-377a679302a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102adaed30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:55.606401 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fddac168-284e-4445-8abb-377a679302a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.123663 Aug 24 04:00:55.607010 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2485/5224] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:55 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:55.697781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:55.711596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-90855c45-f417-42d0-b329-39a7a7e3489d req-1db829b7-b185-4633-9394-3ecd6bc0c3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d", "tag": "2916b737-8e19-4065-b9f3-463597555a67"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:55.748814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-90855c45-f417-42d0-b329-39a7a7e3489d req-1db829b7-b185-4633-9394-3ecd6bc0c3ea service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:55.749090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:55.749319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-90855c45-f417-42d0-b329-39a7a7e3489d req-1db829b7-b185-4633-9394-3ecd6bc0c3ea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:55.757396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-90855c45-f417-42d0-b329-39a7a7e3489d req-1db829b7-b185-4633-9394-3ecd6bc0c3ea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:55.757692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:55.774592 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f8859ee-9214-4008-91ec-52dc818cdea1 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 1.367030 Aug 24 04:00:55.781884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2740/5225] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:54 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:00:55.826141 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-90855c45-f417-42d0-b329-39a7a7e3489d req-1db829b7-b185-4633-9394-3ecd6bc0c3ea service nova] Creating event network-changed:2916b737-8e19-4065-b9f3-463597555a67 for instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d on n-h1-846470-15 Aug 24 04:00:55.858904 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-90855c45-f417-42d0-b329-39a7a7e3489d req-1db829b7-b185-4633-9394-3ecd6bc0c3ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155678 Aug 24 04:00:55.865412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2486/5226] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:00:56.005797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:56.006587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:56.052437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.053635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.056947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.058842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.071175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.072459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.193493 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 HTTP/1.1 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c16d8242-aae4-4be3-9f15-f083a4815337'} Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:56.203105 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.209514 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.214754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:56.217916 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14a2fcc3-d244-44cf-b9c4-9cea91ecddb5 tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 404 len: 111 microversion: 2.1 time: 0.219356 Aug 24 04:00:56.219225 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2741/5227] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:55 2022] DELETE /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:56.228496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:56.229318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] [instance: c16d8242-aae4-4be3-9f15-f083a4815337] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:56.245945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.246475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.246931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.253641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.257665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.260987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.312886 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] HTTP exception thrown: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Request method failure captured: Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 HTTP/1.1 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBZ_s38Rw30_wDcwnXYrdGf8vni7savZqGfq5Di_U86vycskWniw7hC-5okLmnchb-0fUw1nztElWinj7dk1i2OUd5QJwLnVRxtxadGRZCSOHqbczlN9x40OpkibCF3arEdu2YcZOIJhkHQ8bWcBmNOZt1DCEtS4pvrEbG2NWHYn4ZaU Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd5b7dab3ce34ee7a7280eb670023a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: fd5b7dab3ce34ee7a7280eb670023a03 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-960332920 Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cf384a2eab3649a2ad4f5eec8d8c6b0a Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeNegativeTest-960332920-project Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'c16d8242-aae4-4be3-9f15-f083a4815337'} Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:56.320362 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.325392 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:56.325392 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:56.325392 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:56.325392 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:56.325392 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:56.325392 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. Aug 24 04:00:56.325392 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:00:56.333653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] Returning 404 to user: Instance c16d8242-aae4-4be3-9f15-f083a4815337 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:56.337601 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27f7f2c1-f717-49d1-833a-98775389bf8c tempest-AttachVolumeNegativeTest-960332920 tempest-AttachVolumeNegativeTest-960332920-project] 10.222.0.58 "GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337" status: 404 len: 111 microversion: 2.1 time: 0.113620 Aug 24 04:00:56.348431 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2487/5228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:56 2022] GET /compute/v2.1/servers/c16d8242-aae4-4be3-9f15-f083a4815337 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:56.626354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16fe1de2-4b88-42c6-8e75-b7a889c85ca7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022fd7280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:56.819883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:56.820723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:56.851801 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16fe1de2-4b88-42c6-8e75-b7a889c85ca7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.232869 Aug 24 04:00:56.865226 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2742/5229] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:56 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:56.868158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:56.878403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=10 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:56.884869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.896852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.898661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.903625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.904399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.909038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:57.685859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:57.710831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:57.730440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:57.732505 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc66cbef-4847-44f3-8cf1-f5b7c4597514 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 0.928882 Aug 24 04:00:57.748399 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2488/5230] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:56 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:00:57.885717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-132cd7de-29fd-40c5-a3d9-f1f7ea20cdb2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10235a1160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:58.049138 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-132cd7de-29fd-40c5-a3d9-f1f7ea20cdb2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.170658 Aug 24 04:00:58.052566 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2743/5231] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:57 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:58.761356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:58.768893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:58.777228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.781538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.787238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.787775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:58.788499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.788988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.789425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:59.086438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-28174e36-eb7f-48de-9ed7-d26828d5de25 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022771790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:59.096940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.200079 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-28174e36-eb7f-48de-9ed7-d26828d5de25 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.123935 Aug 24 04:00:59.200595 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2744/5232] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:59 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:59.250984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:59.259054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.265546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:59.268877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:59.272387 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2df463be-3695-4564-9137-7b5ab5a56008 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 0.518772 Aug 24 04:00:59.273715 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2489/5233] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:00:58 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:01:00.220013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58a5ea32-afe7-4631-a49e-74f0e5ced845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022fd7430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:00.304041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:00.305469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:00.342914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:00.344044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:00.352465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:00.353507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:00.360509 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58a5ea32-afe7-4631-a49e-74f0e5ced845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.149015 Aug 24 04:01:00.366550 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2745/5234] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:00 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:00.384019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:00.384686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:00.877206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:00.917780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:00.922937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:00.925902 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fa4177e5-b192-4f99-ae84-638662cc0bd5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 0.627915 Aug 24 04:01:00.928783 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2490/5235] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:01:00 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:01:01.381995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c2854de-e619-4a96-97f5-378f8f6e87db tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102315edc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:01.494386 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9c2854de-e619-4a96-97f5-378f8f6e87db tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.116250 Aug 24 04:01:01.499720 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2746/5236] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:01 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:01.974720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:01.975339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:02.000370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:02.000370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:02.000881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:02.001554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:02.002035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:02.002502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:02.533908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:02.538228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-25984ee8-5f1a-4743-a455-ee4ba656c2db tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10231f7940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:02.555327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:02.559191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:02.562080 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-14e480a9-79ea-469a-89c9-83599080c600 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 0.591080 Aug 24 04:01:02.564699 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2491/5237] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:01:01 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:01:02.690261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-25984ee8-5f1a-4743-a455-ee4ba656c2db tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.172235 Aug 24 04:01:02.693595 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2747/5238] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:02 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:03.596123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:03.597301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:03.640069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:03.644902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:03.645727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:03.647059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:03.647919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:03.655090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:03.711053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4ab54be2-87e5-43cc-b437-d14daef96f0c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022fd71f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:03.851020 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4ab54be2-87e5-43cc-b437-d14daef96f0c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.147994 Aug 24 04:01:03.866952 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2748/5239] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:03 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:04.399985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:04.427393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:04.434521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:04.440007 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8651f01d-37df-48b3-a626-dabe0ae09e3a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 0.856664 Aug 24 04:01:04.460103 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2492/5240] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:01:03 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:01:04.880780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60620268-0de9-447f-a324-dbb201e9c0e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022771940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:04.984982 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60620268-0de9-447f-a324-dbb201e9c0e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.110197 Aug 24 04:01:04.996456 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2749/5241] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:04 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:05.483598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:05.484982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:05.499603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:05.509072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:05.514132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:05.515746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:05.524210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:05.527160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:06.008153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8834a7af-fba4-4562-8143-dc0cda8ca23f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102315e5e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:06.025078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=51 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:06.130696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8834a7af-fba4-4562-8143-dc0cda8ca23f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1414 microversion: 2.1 time: 0.133281 Aug 24 04:01:06.145253 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2750/5242] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:05 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:06.373109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:06.400173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:06.404287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:06.408920 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4729cdd3-98aa-4bb1-a035-fd158f67823d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 0.929284 Aug 24 04:01:06.411609 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2493/5243] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:01:05 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:01:07.140831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=16 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.180745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dea67644-22ab-40c9-8dc5-5361ce33496a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102acc6b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:07.364606 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dea67644-22ab-40c9-8dc5-5361ce33496a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1423 microversion: 2.1 time: 0.213133 Aug 24 04:01:07.377983 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2494/5244] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:07 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1423 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:07.388449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43c0bd06-e464-4113-b882-a973c0eb2af7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102adaeca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:07.491895 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-43c0bd06-e464-4113-b882-a973c0eb2af7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 200 len: 1423 microversion: 2.1 time: 0.108119 Aug 24 04:01:07.493194 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2495/5245] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:07 2022] GET /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:07.518880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:07.528348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:07.547240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:07.551654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:07.560890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:07.562303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:07.564681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:07.566343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:07.738562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d66de151-2ebd-49ea-94c8-50a0d060a57c req-a43a7d3b-37f2-474c-a562-5d815baab509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d", "name": "network-vif-plugged", "status": "completed", "tag": "2916b737-8e19-4065-b9f3-463597555a67"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:07.786361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d66de151-2ebd-49ea-94c8-50a0d060a57c req-a43a7d3b-37f2-474c-a562-5d815baab509 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:07.787603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d66de151-2ebd-49ea-94c8-50a0d060a57c req-a43a7d3b-37f2-474c-a562-5d815baab509 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:07.788669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d66de151-2ebd-49ea-94c8-50a0d060a57c req-a43a7d3b-37f2-474c-a562-5d815baab509 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:07.841146 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d66de151-2ebd-49ea-94c8-50a0d060a57c req-a43a7d3b-37f2-474c-a562-5d815baab509 service nova] Creating event network-vif-plugged:2916b737-8e19-4065-b9f3-463597555a67 for instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d on n-h1-846470-15 Aug 24 04:01:07.872599 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d66de151-2ebd-49ea-94c8-50a0d060a57c req-a43a7d3b-37f2-474c-a562-5d815baab509 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.741497 Aug 24 04:01:07.875815 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2751/5246] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:07.892526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a8f9d9a-ff1f-4a4d-972a-3ba902281569 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022771040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:09.025040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:09.046232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:09.050552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:09.111913 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-724f5dd1-bc60-4a2e-bca5-a2d07b2d5438 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 1.600550 Aug 24 04:01:09.124973 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2496/5247] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:01:07 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:01:09.412602 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a8f9d9a-ff1f-4a4d-972a-3ba902281569 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 204 len: 0 microversion: 2.1 time: 1.530938 Aug 24 04:01:09.413249 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2752/5248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:07 2022] DELETE /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 0 bytes in 1537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:09.423844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:09.424541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:09.446537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:09.448412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:09.449006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:09.453203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:09.455026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:09.455596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:09.587060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:01:09.839725 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a475a8c-d8ad-42ce-a36b-19485f9d7e4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 204 len: 0 microversion: 2.1 time: 0.417514 Aug 24 04:01:09.849055 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2497/5249] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:01:09 2022] DELETE /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:10.159556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:10.177676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:10.210803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:10.211597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:10.217200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:10.218630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:10.219484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:10.237846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-238260951", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "08e2a024-b48a-4e15-b943-96256a726160"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:10.241211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:10.444635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] validate_networks() for [('08e2a024-b48a-4e15-b943-96256a726160', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:01:10.632831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:10.647454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:10.648998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:10.650170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4ccbdd19-456a-424a-b1bc-b8751ee3b224 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1407 microversion: 2.20 time: 0.502182 Aug 24 04:01:10.651275 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2753/5250] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:01:10 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:01:11.607587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ca777b89-7814-4e2e-9a56-e887128d1987 req-16d141ff-38f6-43f0-8f0d-a17a8528755f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27ee3d0-37d5-4d50-afcf-192e3bcf34f5", "name": "network-vif-unplugged", "status": "completed", "tag": "c09bbf4d-7168-4dc9-886a-e317c50cdc70"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:11.633018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ca777b89-7814-4e2e-9a56-e887128d1987 req-16d141ff-38f6-43f0-8f0d-a17a8528755f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.636095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ca777b89-7814-4e2e-9a56-e887128d1987 req-16d141ff-38f6-43f0-8f0d-a17a8528755f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.637195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ca777b89-7814-4e2e-9a56-e887128d1987 req-16d141ff-38f6-43f0-8f0d-a17a8528755f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:11.665048 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ca777b89-7814-4e2e-9a56-e887128d1987 req-16d141ff-38f6-43f0-8f0d-a17a8528755f service nova] Creating event network-vif-unplugged:c09bbf4d-7168-4dc9-886a-e317c50cdc70 for instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 on n-h2-846470-15 Aug 24 04:01:11.675738 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ca777b89-7814-4e2e-9a56-e887128d1987 req-16d141ff-38f6-43f0-8f0d-a17a8528755f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075715 Aug 24 04:01:11.677616 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2754/5251] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:11.705207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:11.707058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:11.720697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.721732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.722489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:11.723809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.724809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.726065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.106008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:12.165870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:12.195263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:12.207010 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0b2c7490-bb68-4701-a36d-84d1a06234a8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1598 microversion: 2.20 time: 0.517706 Aug 24 04:01:12.209118 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2755/5252] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:01:11 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1598 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:01:12.230779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:12.231424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:12.243187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.243990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.244811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.245762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.246457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.247094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.485667 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-34bfdd60-84ed-44ce-9e9a-3a535f5b6138 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.258882 Aug 24 04:01:12.486467 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2756/5253] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 24 04:01:12 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/os-interface => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:01:12.703036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:01:12.703641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:01:12.703906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:01:12.704243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:01:12.704656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:01:12.728972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.729476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.729921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.730761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.731227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.731658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.810110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Getting quotas for project 0dfa4e35f2154b4eb506e4336a3c4f16. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:01:12.819006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Getting quotas for user 5a56bbc01292446d81fbd60f13104da9 and project 0dfa4e35f2154b4eb506e4336a3c4f16. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:01:12.851557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:01:12.854197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:01:13.077886 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-084d0b6a-898e-41cb-b5a8-7eec8de56f2e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.850426 Aug 24 04:01:13.087166 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2498/5254] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:01:13.102167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7723b997-f9d4-485b-a9fe-b63197a3c935 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:13.103486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7723b997-f9d4-485b-a9fe-b63197a3c935 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:13.277751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7723b997-f9d4-485b-a9fe-b63197a3c935 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:13.295962 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7723b997-f9d4-485b-a9fe-b63197a3c935 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1207 microversion: 2.1 time: 0.197169 Aug 24 04:01:13.298168 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2757/5255] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:13 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1207 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:14.158821 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:01:14.159492 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:01:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:01:14.337522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6d496af9-f856-4559-89c2-08ee8db70b36 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:14.340176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6d496af9-f856-4559-89c2-08ee8db70b36 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:14.743205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6d496af9-f856-4559-89c2-08ee8db70b36 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:14.754052 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6d496af9-f856-4559-89c2-08ee8db70b36 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1207 microversion: 2.1 time: 0.422404 Aug 24 04:01:14.759066 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2758/5256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:14 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1207 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:14.988461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-38aebf70-c91d-447f-8c33-aa2f2a519522 req-b2efb9e9-916a-4d35-9ffd-2621f1c05018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27ee3d0-37d5-4d50-afcf-192e3bcf34f5", "name": "network-vif-deleted", "tag": "c09bbf4d-7168-4dc9-886a-e317c50cdc70"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:15.050109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-38aebf70-c91d-447f-8c33-aa2f2a519522 req-b2efb9e9-916a-4d35-9ffd-2621f1c05018 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:15.050992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-38aebf70-c91d-447f-8c33-aa2f2a519522 req-b2efb9e9-916a-4d35-9ffd-2621f1c05018 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:15.057078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-38aebf70-c91d-447f-8c33-aa2f2a519522 req-b2efb9e9-916a-4d35-9ffd-2621f1c05018 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:15.107853 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-38aebf70-c91d-447f-8c33-aa2f2a519522 req-b2efb9e9-916a-4d35-9ffd-2621f1c05018 service nova] Creating event network-vif-deleted:c09bbf4d-7168-4dc9-886a-e317c50cdc70 for instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 on n-h2-846470-15 Aug 24 04:01:15.116064 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-38aebf70-c91d-447f-8c33-aa2f2a519522 req-b2efb9e9-916a-4d35-9ffd-2621f1c05018 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.937172 Aug 24 04:01:15.119567 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2499/5257] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:15.783394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:15.784844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:15.795405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:15.834093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:15.835096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:15.836219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:15.841328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:15.842197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.215017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:16.230017 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bee3bb19-492f-4a04-b4a8-f9ac7c139845 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1267 microversion: 2.1 time: 0.450348 Aug 24 04:01:16.262254 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2759/5258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:15 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1267 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:16.390856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4a1cf771-e706-49fe-9b68-54a4f6427255 req-87ef3d21-efa1-4d5e-a61d-1f140258412c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d", "tag": "2916b737-8e19-4065-b9f3-463597555a67"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:16.427220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a1cf771-e706-49fe-9b68-54a4f6427255 req-87ef3d21-efa1-4d5e-a61d-1f140258412c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.427987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a1cf771-e706-49fe-9b68-54a4f6427255 req-87ef3d21-efa1-4d5e-a61d-1f140258412c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.428709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a1cf771-e706-49fe-9b68-54a4f6427255 req-87ef3d21-efa1-4d5e-a61d-1f140258412c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.445218 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4a1cf771-e706-49fe-9b68-54a4f6427255 req-87ef3d21-efa1-4d5e-a61d-1f140258412c service nova] Creating event network-changed:2916b737-8e19-4065-b9f3-463597555a67 for instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d on n-h1-846470-15 Aug 24 04:01:16.453102 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4a1cf771-e706-49fe-9b68-54a4f6427255 req-87ef3d21-efa1-4d5e-a61d-1f140258412c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074399 Aug 24 04:01:16.454453 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2500/5259] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:17.269786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:17.270964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:17.288152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:17.288894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:17.289477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:17.290570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:17.291181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:17.291845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:17.409054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:17.421650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5603f514-f590-4392-ad85-e3d1590c9abb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1265 microversion: 2.1 time: 0.156986 Aug 24 04:01:17.437497 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2760/5260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:17 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:18.451045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:18.456212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:18.516144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:18.516686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:18.517185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:18.518124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:18.519252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:18.520386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:19.040224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:19.064175 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90d713d4-63f3-406d-a50f-67a6a74209be tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1265 microversion: 2.1 time: 0.619006 Aug 24 04:01:19.079860 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2501/5261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:18 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1265 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:20.086068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:20.086671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:20.127914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:20.129284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:20.135214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:20.143039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:20.146804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:20.149656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:20.805694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:20.880712 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42552365-796f-412a-b2bb-a134fbe353a2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1307 microversion: 2.1 time: 0.797462 Aug 24 04:01:20.888488 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2761/5262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:20 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1307 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:21.884651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8db3149d-d61b-40d3-af83-4696cee20dcf req-e24dcc94-289b-45df-8763-360c410edfff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc588d8-05ad-4497-b035-04613b1bc49d", "tag": "0c235937-5717-4ac5-96f5-48e34e08f03c"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:21.925883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:21.926529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:21.946214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:21.946755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:21.947199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:21.947991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:21.948455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:21.948918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:21.974790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8db3149d-d61b-40d3-af83-4696cee20dcf req-e24dcc94-289b-45df-8763-360c410edfff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:21.980537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8db3149d-d61b-40d3-af83-4696cee20dcf req-e24dcc94-289b-45df-8763-360c410edfff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:21.980537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8db3149d-d61b-40d3-af83-4696cee20dcf req-e24dcc94-289b-45df-8763-360c410edfff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:22.120230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8db3149d-d61b-40d3-af83-4696cee20dcf req-e24dcc94-289b-45df-8763-360c410edfff service nova] Creating event network-changed:0c235937-5717-4ac5-96f5-48e34e08f03c for instance 9fc588d8-05ad-4497-b035-04613b1bc49d on n-h2-846470-15 Aug 24 04:01:22.145660 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8db3149d-d61b-40d3-af83-4696cee20dcf req-e24dcc94-289b-45df-8763-360c410edfff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267404 Aug 24 04:01:22.147088 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2502/5263] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:23.129717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:23.144678 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c71722c1-ab04-4d73-8ffa-720f83575ffd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1307 microversion: 2.1 time: 1.223055 Aug 24 04:01:23.145214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2762/5264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:21 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1307 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:24.216049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:24.218794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:24.242323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:24.248024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:24.260529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:24.264236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:24.265552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:24.270998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:24.272293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:24.277048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:24.982471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:25.006990 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d1c0ab91-c96a-4fb3-aefd-ee44eeac9235 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1307 microversion: 2.1 time: 0.811974 Aug 24 04:01:25.007724 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2503/5265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:24 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1307 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:26.057336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:26.059042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:26.073916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:26.076253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:26.084496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:26.085364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:26.086412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:26.087118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:26.087801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:26.598740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:26.612465 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4dce83b0-ff51-4cfc-9d2c-992265704b4a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1307 microversion: 2.1 time: 0.559193 Aug 24 04:01:26.613586 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2763/5266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:26 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1307 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:27.638480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:27.639871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:27.653156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.654090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.654705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.655815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.656451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.657202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.978732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:27.997679 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d6292e9-fadb-41d6-a653-792068ead2b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1307 microversion: 2.1 time: 0.360064 Aug 24 04:01:27.998585 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2504/5267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:27 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:29.039415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:29.040841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:29.057012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:29.060376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:29.061098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:29.062024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:29.093317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:29.093778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:29.608731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:29.619681 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a8aca00c-e884-4e8d-9e1b-b5af4eccbfa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1307 microversion: 2.1 time: 0.584023 Aug 24 04:01:29.620847 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2764/5268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:29 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1307 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:30.354152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2d9ed153-aad2-417e-b4f6-bcbd0ed2acca req-443ac427-cb21-4cd4-9974-a0fc01e48dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc588d8-05ad-4497-b035-04613b1bc49d", "name": "network-vif-plugged", "status": "completed", "tag": "0c235937-5717-4ac5-96f5-48e34e08f03c"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:30.390667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:30.397809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2d9ed153-aad2-417e-b4f6-bcbd0ed2acca req-443ac427-cb21-4cd4-9974-a0fc01e48dca service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:30.398329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2d9ed153-aad2-417e-b4f6-bcbd0ed2acca req-443ac427-cb21-4cd4-9974-a0fc01e48dca service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:30.398783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2d9ed153-aad2-417e-b4f6-bcbd0ed2acca req-443ac427-cb21-4cd4-9974-a0fc01e48dca service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:30.402143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:30.413395 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2d9ed153-aad2-417e-b4f6-bcbd0ed2acca req-443ac427-cb21-4cd4-9974-a0fc01e48dca service nova] Creating event network-vif-plugged:0c235937-5717-4ac5-96f5-48e34e08f03c for instance 9fc588d8-05ad-4497-b035-04613b1bc49d on n-h2-846470-15 Aug 24 04:01:30.420138 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2d9ed153-aad2-417e-b4f6-bcbd0ed2acca req-443ac427-cb21-4cd4-9974-a0fc01e48dca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072260 Aug 24 04:01:30.421503 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2505/5269] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:30.645522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:30.647859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:30.673372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:30.678301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:30.679841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:30.684805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:30.686421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:30.694736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:31.133347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:31.146335 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7479090-d98d-434f-b81f-7311d53dea07 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1307 microversion: 2.1 time: 0.508926 Aug 24 04:01:31.173350 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2765/5270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:30 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1307 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:32.180747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:32.189224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:32.204065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.204847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.205823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.209171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.211625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.213141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.617822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:32.650729 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52a92349-c5da-44db-9d47-241cc9af9c4b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1307 microversion: 2.1 time: 0.477649 Aug 24 04:01:32.663702 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2506/5271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:32 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1307 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:33.675513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:33.676386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:33.692394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:33.693618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:33.694588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:33.696244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:33.697231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:33.699417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:33.946813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:33.958573 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-413c30e8-d080-4f08-9742-a252344741a3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1487 microversion: 2.1 time: 0.287620 Aug 24 04:01:33.972469 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2766/5272] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:33 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1487 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:33.983572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-271be400-caf9-4ca9-9c94-ba7593b130cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:33.995695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-271be400-caf9-4ca9-9c94-ba7593b130cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:33.997137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-271be400-caf9-4ca9-9c94-ba7593b130cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:33.998189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-271be400-caf9-4ca9-9c94-ba7593b130cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:34.064277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-271be400-caf9-4ca9-9c94-ba7593b130cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Going to try to stop instance {{(pid=122535) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 04:01:34.153320 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-271be400-caf9-4ca9-9c94-ba7593b130cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d/action" status: 202 len: 0 microversion: 2.1 time: 0.173776 Aug 24 04:01:34.159386 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2507/5273] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:01:33 2022] POST /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:01:34.168230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:34.168906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:34.177711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:34.178292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:34.178810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:34.179644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:34.180212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:34.181195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:34.600990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:34.613016 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-39a1ce12-3b43-4c6d-a6f4-3f9b0f1c16cb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.449011 Aug 24 04:01:34.626849 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2767/5274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:34 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:35.640682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:35.641505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:35.665267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:35.666297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:35.666950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:35.667932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:35.668576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:35.670179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:36.049648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:36.062068 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-42b9993c-a056-4d3d-b600-6177a709a832 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.429844 Aug 24 04:01:36.096674 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2508/5275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:35 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:37.115400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:37.116367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:37.130854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=37 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:37.133542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:37.136529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:37.141298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:37.143407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:37.145376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:37.145859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:37.208243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=77 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:37.822433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:37.868433 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-202f889d-308d-45c3-96bb-a2a4aeb69a0d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.767333 Aug 24 04:01:37.882211 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2768/5276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:37 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:38.898492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:38.899154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:38.909701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:38.910167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:38.910605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:38.911318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:38.911807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:38.912230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:39.259966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:39.284828 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9a1f35b5-ad35-47a8-91a3-c3c1872ff568 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.390573 Aug 24 04:01:39.285439 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2509/5277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:38 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:40.319532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:40.320298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:40.336427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:40.337212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:40.338530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:40.339841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:40.340659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:40.341345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:40.769041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:40.777733 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-606236c1-48d8-4d7d-b91e-f6e670f5eb78 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.463257 Aug 24 04:01:40.782873 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2769/5278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:40 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:41.816828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:41.817705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:41.845510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:41.846958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:41.847534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:41.848611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:41.849245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:41.853588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:42.403314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:42.443356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bac9a831-2036-4cea-89cf-c5acf65587d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.637019 Aug 24 04:01:42.445549 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2510/5279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:41 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:43.468801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:43.469703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:43.477041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:43.478043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:43.478950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:43.480088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:43.480869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:43.481509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:43.820394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:43.833068 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6aa9d7f6-796a-4e6e-8f3a-96afcec979cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.370394 Aug 24 04:01:43.844588 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2770/5280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:43 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:44.865681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:44.866995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:44.880855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:44.881443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:44.881833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:44.888286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:44.889151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:44.895491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:45.275114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:45.286227 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ec7b970-f103-4fc3-b679-5f255525a234 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.424945 Aug 24 04:01:45.288834 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2511/5281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:44 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:46.316912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:46.320197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:46.348700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:46.349839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:46.350788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:46.352406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:46.353803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:46.355030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:46.719535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:46.760818 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d25bc7c-f1f8-4d8e-b080-b202b8b815b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.454170 Aug 24 04:01:46.772615 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2771/5282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:46 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:47.793739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:47.797529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:47.818228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:47.819531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:47.821380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:47.824183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:47.824941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:47.825724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:48.095388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:48.124048 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-86035a92-68d9-466d-8110-2b548c4ea5ff tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.341985 Aug 24 04:01:48.124645 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2512/5283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:47 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:49.148928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:49.149713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:49.168039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:49.171297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:49.175350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:49.176729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:49.180472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:49.181277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:49.562765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:49.572171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa0e6189-ae81-480d-8531-8c4d60369d93 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.429060 Aug 24 04:01:49.574455 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2772/5284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:49 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:50.597462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:50.598115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:50.622229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:50.622843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:50.623301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:50.624108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:50.624573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:50.625051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:50.898740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:50.926973 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f795f45e-1df9-43f8-9347-bdd931aed335 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.335240 Aug 24 04:01:50.927886 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2513/5285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:50 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:51.958818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:51.959706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:51.975841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:51.976712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:51.980825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:51.981829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:51.984636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:51.984636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:52.290848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:52.303768 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ab64d2b-986f-4ec7-a7be-b8a24501f739 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.349216 Aug 24 04:01:52.305838 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2773/5286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:51 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:53.329218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:53.330563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:53.352341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:53.352900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:53.353386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:53.365764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:53.366703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:53.370478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:53.633796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:53.655587 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01154c98-c307-4d21-a71a-9fbe0983ab08 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.332554 Aug 24 04:01:53.663848 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2514/5287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:53 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:54.701094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:54.702599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:54.720261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:54.720763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:54.721203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:54.724014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:54.724503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:54.724941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:55.136691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:55.149922 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1b6a33b7-53d7-409a-be04-ad2eb4f1ff46 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.456847 Aug 24 04:01:55.169205 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2774/5288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:54 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:56.174704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:56.176017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:56.189854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:56.196597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:56.197451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:56.204639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:56.205364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:56.206617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:56.711305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:56.720408 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0690670a-7268-4139-80bb-06d993211b2b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 0.550139 Aug 24 04:01:56.721529 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2515/5289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:56 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:57.750575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:57.752612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:57.769735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:57.773076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:57.775986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:57.776956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:57.782835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:57.783701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:58.768618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:58.785363 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67d8fe13-c2ee-4b94-ae83-9f2b519d2a20 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1497 microversion: 2.1 time: 1.041407 Aug 24 04:01:58.788954 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2775/5290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:57 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1497 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:59.814971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:59.816454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:59.849312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:59.850676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:59.852318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:59.853493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:59.854813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:59.856313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:00.255581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:00.267334 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3cd79243-e903-4acb-986f-73f839277733 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 200 len: 1474 microversion: 2.1 time: 0.460247 Aug 24 04:02:00.291706 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2516/5291] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:59 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 1474 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:00.306032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1433229485"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:00.312617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:00.321266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:00.322072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:00.323097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:00.324062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:00.324727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:00.325509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:00.693674 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd46c64c-9e1e-4c97-b413-6bc11c678fb0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d/action" status: 202 len: 0 microversion: 2.1 time: 0.391628 Aug 24 04:02:00.697856 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2776/5292] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:02:00 2022] POST /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 24 04:02:00.707153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2eb7d67f-791b-42ad-b44f-da90687e6c1e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a6fddc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:00.805193 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2eb7d67f-791b-42ad-b44f-da90687e6c1e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.101862 Aug 24 04:02:00.806840 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2517/5293] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:00 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:01.823777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e2f1d9fe-a96a-4cab-980f-135abf6e39b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023613ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:01.913352 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e2f1d9fe-a96a-4cab-980f-135abf6e39b5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.093409 Aug 24 04:02:01.914698 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2777/5294] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:01 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:02.930518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fee5f76a-b0d6-4d32-820f-b777c455fe18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102adae4c0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:03.018169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fee5f76a-b0d6-4d32-820f-b777c455fe18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.092968 Aug 24 04:02:03.018757 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2518/5295] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:02 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:04.035756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-834bd69f-e6d1-4b1e-b722-d22740e42dd1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022f77dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:04.139629 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-834bd69f-e6d1-4b1e-b722-d22740e42dd1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.109437 Aug 24 04:02:04.144803 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2778/5296] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:04 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:05.159475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50768afa-5d71-42b9-8107-91a5adaadb91 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102b5591f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:05.281296 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50768afa-5d71-42b9-8107-91a5adaadb91 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.125721 Aug 24 04:02:05.282238 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2519/5297] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:05 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:06.303496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c4ea156-8c32-48de-8575-8ceb859a547a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10230f0ca0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:06.469504 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c4ea156-8c32-48de-8575-8ceb859a547a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.170903 Aug 24 04:02:06.473363 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2779/5298] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:06 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:07.491162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-acfabd60-bd3f-462e-b964-f2bc5da940ef tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a780940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:07.594845 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-acfabd60-bd3f-462e-b964-f2bc5da940ef tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.107772 Aug 24 04:02:07.597587 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2520/5299] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:07 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:08.216672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-54375071-8ba4-4850-8c0a-9b9201ba8784 req-f9f79d82-a3b0-4a91-b445-3299cd1942ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc588d8-05ad-4497-b035-04613b1bc49d", "name": "network-vif-plugged", "status": "completed", "tag": "0c235937-5717-4ac5-96f5-48e34e08f03c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:08.241263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=18 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:08.257115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-54375071-8ba4-4850-8c0a-9b9201ba8784 req-f9f79d82-a3b0-4a91-b445-3299cd1942ec service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:08.264838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-54375071-8ba4-4850-8c0a-9b9201ba8784 req-f9f79d82-a3b0-4a91-b445-3299cd1942ec service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:08.266276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-54375071-8ba4-4850-8c0a-9b9201ba8784 req-f9f79d82-a3b0-4a91-b445-3299cd1942ec service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:08.270993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:08.317871 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-54375071-8ba4-4850-8c0a-9b9201ba8784 req-f9f79d82-a3b0-4a91-b445-3299cd1942ec service nova] Creating event network-vif-plugged:0c235937-5717-4ac5-96f5-48e34e08f03c for instance 9fc588d8-05ad-4497-b035-04613b1bc49d on n-h2-846470-15 Aug 24 04:02:08.333505 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-54375071-8ba4-4850-8c0a-9b9201ba8784 req-f9f79d82-a3b0-4a91-b445-3299cd1942ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123111 Aug 24 04:02:08.339430 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2780/5300] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:08.616039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-70b49bcf-dcf8-40fe-8268-9f1d331ebd5f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102adae310>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:08.695124 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-70b49bcf-dcf8-40fe-8268-9f1d331ebd5f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.084132 Aug 24 04:02:08.704889 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2521/5301] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:08 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:09.741896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-055521d4-d98e-4ae1-978f-f9056f0b6978 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023021ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:09.861717 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-055521d4-d98e-4ae1-978f-f9056f0b6978 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.145430 Aug 24 04:02:09.869352 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2781/5302] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:09 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:10.884487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=23 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:10.886454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:10.893529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be797b15-cb7c-49e7-8627-9e2b653000a8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1034382820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:10.985096 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be797b15-cb7c-49e7-8627-9e2b653000a8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.102406 Aug 24 04:02:10.990090 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2522/5303] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:10 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:12.006301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3dd33424-a8aa-4baa-b8b8-d20adbf544d7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022edd9d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:12.182472 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3dd33424-a8aa-4baa-b8b8-d20adbf544d7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.178756 Aug 24 04:02:12.183119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2782/5304] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:12 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:13.205574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-64f895f0-2c06-42a8-9bb7-a10925859fbc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1034243790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:13.371764 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-64f895f0-2c06-42a8-9bb7-a10925859fbc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.176207 Aug 24 04:02:13.372644 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2523/5305] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:13 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:14.417829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a1988a15-81e9-4f2b-acae-bc48f1b3ac52 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022ec4040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:14.495633 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a1988a15-81e9-4f2b-acae-bc48f1b3ac52 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.085514 Aug 24 04:02:14.498386 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2783/5306] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:14 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:15.514293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58af67b4-941a-43f1-8860-a2b3ae63cefd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10343fe430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:15.614542 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58af67b4-941a-43f1-8860-a2b3ae63cefd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.104536 Aug 24 04:02:15.618556 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2524/5307] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:15 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:16.634257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a48cf72f-621b-4ec0-8cd4-6daaf6f2c1e9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022f1daf0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:16.769191 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a48cf72f-621b-4ec0-8cd4-6daaf6f2c1e9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.129146 Aug 24 04:02:16.773379 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2784/5308] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:16 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:17.786921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8e16aeb4-6a36-4dad-9c5f-5abdb8c56916 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1034382820>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:17.921012 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8e16aeb4-6a36-4dad-9c5f-5abdb8c56916 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.138614 Aug 24 04:02:17.924676 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2525/5309] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:17 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:18.936996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:18.937840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:18.942541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93f62848-4b08-46a6-840d-c85cad813102 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022e60790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:19.054282 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93f62848-4b08-46a6-840d-c85cad813102 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.118889 Aug 24 04:02:19.054884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2785/5310] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:18 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:20.084868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-762fc15c-61c5-4a23-8a64-7bd73b605bca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a6be430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:20.203713 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-762fc15c-61c5-4a23-8a64-7bd73b605bca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.134276 Aug 24 04:02:20.204306 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2526/5311] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:20 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:21.223508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66b895da-3b8e-4856-ac42-19481ce23287 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022f773a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:21.328727 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66b895da-3b8e-4856-ac42-19481ce23287 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.112974 Aug 24 04:02:21.331317 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2786/5312] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:21 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:22.354355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-960b6d8b-4299-46eb-9dc0-dc66155d6dcd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102afe5310>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:22.493408 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-960b6d8b-4299-46eb-9dc0-dc66155d6dcd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.149928 Aug 24 04:02:22.494963 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2527/5313] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:22 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:23.527401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75d2bfba-fcee-40cf-8b60-c87e6db38e50 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1034226ca0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:23.681253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75d2bfba-fcee-40cf-8b60-c87e6db38e50 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.167827 Aug 24 04:02:23.683068 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2787/5314] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:23 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:24.650186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:24.651121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:24.701848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c01df9c-84f4-4079-994d-43de36152ff2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022771e50>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:24.714785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:24.715313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.047s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:24.715862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:24.725296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:24.725823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:24.726348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:24.865095 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7ed07549-5918-44b7-a063-b7b594fe833d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/ips" status: 200 len: 151 microversion: 2.20 time: 0.220315 Aug 24 04:02:24.874337 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2528/5315] 10.222.0.58 () {60 vars in 1289 bytes} [Wed Aug 24 04:02:24 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/ips => generated 151 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:02:24.926099 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c01df9c-84f4-4079-994d-43de36152ff2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.222041 Aug 24 04:02:24.928046 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2788/5316] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:24 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:25.944255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7aca4cef-8d60-4a3a-9e13-7f183598767e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102adaeee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:26.144444 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7aca4cef-8d60-4a3a-9e13-7f183598767e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.204875 Aug 24 04:02:26.145090 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2529/5317] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:25 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:27.176690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c951cfb3-af09-474c-80bf-c43c3d06b47f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023021ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:27.369283 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c951cfb3-af09-474c-80bf-c43c3d06b47f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.202193 Aug 24 04:02:27.375256 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2789/5318] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:27 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:28.388716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-471c98de-7f1c-4361-8b47-4d841757a89b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f103044a280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:28.573002 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-471c98de-7f1c-4361-8b47-4d841757a89b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.190282 Aug 24 04:02:28.574327 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2530/5319] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:28 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:29.591074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-79080191-1354-41a1-b111-818947d909c9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022e7b430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:29.716312 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-79080191-1354-41a1-b111-818947d909c9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.130563 Aug 24 04:02:29.720973 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2790/5320] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:29 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:29.845353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:29.846015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:29.881930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:29.882445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:29.882892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:29.883634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:29.895382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:29.897441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:29.985767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lazy-loading 'flavor' on Instance uuid 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:02:30.745906 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84ae5080-b982-4785-b21c-4fef791eb499 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/action" status: 202 len: 0 microversion: 2.20 time: 0.898141 Aug 24 04:02:30.745906 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2531/5321] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 04:02:29 2022] POST /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/action => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:02:30.749092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-03617cbe-6f47-41c8-9bca-98ee696b2745 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023021d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:30.795126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:30.810938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:30.822414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:30.841167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:30.842462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:30.844913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:30.851609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:30.857478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:30.894526 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-03617cbe-6f47-41c8-9bca-98ee696b2745 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.154291 Aug 24 04:02:30.897395 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2791/5322] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:30 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:31.881604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:31.897497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:31.901947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:31.904917 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41bd34de-8522-48d4-ae0c-b895dc1c7a60 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 1.127743 Aug 24 04:02:31.907765 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2532/5323] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:30 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:31.920044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f61f09dd-1b78-4418-a0d7-1946ffe13eeb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1034411700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:32.020122 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f61f09dd-1b78-4418-a0d7-1946ffe13eeb tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.112337 Aug 24 04:02:32.021520 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2792/5324] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:31 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:32.939946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:32.972998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:32.997835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:33.004514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:33.005165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:33.006128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:33.006631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:33.007308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:33.039262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65b61c38-618f-4cf1-8f7f-358f5e2a541a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022ec4dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:33.165185 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65b61c38-618f-4cf1-8f7f-358f5e2a541a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.131952 Aug 24 04:02:33.165788 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2793/5325] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:33 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:33.686894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:33.703429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:33.711006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:33.717757 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a6d8090a-c210-4bcd-9c54-1e111d1c864f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 0.786664 Aug 24 04:02:33.718646 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2533/5326] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:32 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:34.188658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4132b8e4-ff56-4a0d-b164-b3db65d8390e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022dbd820>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:34.278514 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4132b8e4-ff56-4a0d-b164-b3db65d8390e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1414 microversion: 2.1 time: 0.100149 Aug 24 04:02:34.280518 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2794/5327] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:34 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:34.744980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:34.745608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:34.762947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:34.763964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:34.764836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:34.766609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:34.767821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:34.768549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:35.275895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:35.307969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcfd3eb0-ff72-4dfc-a7b2-9cfbcf52bf7a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022ec4a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:35.316723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:35.334054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:35.337269 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e04b5e9-d5ab-4f60-954f-bae660927e58 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 0.596283 Aug 24 04:02:35.347126 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2534/5328] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:34 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:35.427234 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcfd3eb0-ff72-4dfc-a7b2-9cfbcf52bf7a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1423 microversion: 2.1 time: 0.135021 Aug 24 04:02:35.427950 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2795/5329] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:35 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1423 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:35.446792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc2fb786-52cb-4a96-aece-3d8ea37e5fd7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f103433a790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:35.559172 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc2fb786-52cb-4a96-aece-3d8ea37e5fd7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 200 len: 1423 microversion: 2.1 time: 0.118228 Aug 24 04:02:35.561506 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2535/5330] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:02:35 2022] GET /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 1423 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:35.584886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d815772-a159-4a8d-9da5-17ad5d0e720d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022dbd5e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:36.378944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:36.379731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:36.400963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:36.403037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:36.404720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:36.406556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:36.407648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:36.408658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:36.739612 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d815772-a159-4a8d-9da5-17ad5d0e720d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 204 len: 0 microversion: 2.1 time: 1.165877 Aug 24 04:02:36.740650 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2796/5331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:35 2022] DELETE /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:02:36.753556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:36.756479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:36.775313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:36.776420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:36.777161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:36.778391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:36.779228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:36.779951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:36.813390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:02:36.989753 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96f07f93-08a0-42a9-8123-6b6d1084998c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 204 len: 0 microversion: 2.1 time: 0.242625 Aug 24 04:02:37.006552 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2797/5332] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:02:36 2022] DELETE /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:02:37.059347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:37.081572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:37.087077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:37.097015 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0e1abfa5-6e4a-4fb7-b7ca-fe77720cefc5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 0.724506 Aug 24 04:02:37.098589 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2536/5333] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:36 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:37.202676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1129998359", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "08e2a024-b48a-4e15-b943-96256a726160"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:37.331924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] validate_networks() for [('08e2a024-b48a-4e15-b943-96256a726160', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:02:38.012818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ef43a234-307b-4bed-9e42-173543195e16 req-e2cb418c-5187-4add-92dd-754b39a8a946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc588d8-05ad-4497-b035-04613b1bc49d", "name": "network-vif-unplugged", "status": "completed", "tag": "0c235937-5717-4ac5-96f5-48e34e08f03c"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:38.053340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ef43a234-307b-4bed-9e42-173543195e16 req-e2cb418c-5187-4add-92dd-754b39a8a946 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.056241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ef43a234-307b-4bed-9e42-173543195e16 req-e2cb418c-5187-4add-92dd-754b39a8a946 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.057117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ef43a234-307b-4bed-9e42-173543195e16 req-e2cb418c-5187-4add-92dd-754b39a8a946 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.124888 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ef43a234-307b-4bed-9e42-173543195e16 req-e2cb418c-5187-4add-92dd-754b39a8a946 service nova] Creating event network-vif-unplugged:0c235937-5717-4ac5-96f5-48e34e08f03c for instance 9fc588d8-05ad-4497-b035-04613b1bc49d on n-h2-846470-15 Aug 24 04:02:38.155411 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ef43a234-307b-4bed-9e42-173543195e16 req-e2cb418c-5187-4add-92dd-754b39a8a946 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148001 Aug 24 04:02:38.156950 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2537/5334] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:38.165260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:38.166385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:38.176354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.177117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.177778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.178780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.180000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.189830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.857577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:02:38.858293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:02:38.858580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:02:38.859069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:02:38.859396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:02:38.910142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.911172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.913405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.919266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.921536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.922004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:39.015577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Getting quotas for project 0dfa4e35f2154b4eb506e4336a3c4f16. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:02:39.023832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Getting quotas for user 5a56bbc01292446d81fbd60f13104da9 and project 0dfa4e35f2154b4eb506e4336a3c4f16. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:02:39.030140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:39.045908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:02:39.049413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:02:39.052483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:39.055054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:39.061798 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72b4282a-980e-46e0-8cd6-24e9e1723462 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 0.903054 Aug 24 04:02:39.077796 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2538/5335] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:38 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:39.176110 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [7066c2fc-b0e4-41c5-bb1b-0ca479a634e9] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:02:40.106420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:40.107598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:40.137503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:40.138246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:40.139234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:40.140417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:40.148993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:40.149884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:40.188848 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [7066c2fc-b0e4-41c5-bb1b-0ca479a634e9] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 32848. Aug 24 04:02:40.209434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-574effc3-a1c0-43f0-bf2d-b78596b364ca tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.007933 Aug 24 04:02:40.221629 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2798/5336] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:02:40.242539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-54cc2238-a2e3-4c48-bb7c-a2b67ffe3701 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:40.248219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-54cc2238-a2e3-4c48-bb7c-a2b67ffe3701 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:40.610732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54cc2238-a2e3-4c48-bb7c-a2b67ffe3701 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:40.633702 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-54cc2238-a2e3-4c48-bb7c-a2b67ffe3701 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1208 microversion: 2.1 time: 0.408976 Aug 24 04:02:40.655437 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2799/5337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:40 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1208 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:40.778407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-3860d543-5edb-4ae7-9cb7-f612621ec139 req-95869ce8-33ba-424c-a03e-76ce576c215f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc588d8-05ad-4497-b035-04613b1bc49d", "name": "network-vif-deleted", "tag": "0c235937-5717-4ac5-96f5-48e34e08f03c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:40.828062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3860d543-5edb-4ae7-9cb7-f612621ec139 req-95869ce8-33ba-424c-a03e-76ce576c215f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:40.829385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3860d543-5edb-4ae7-9cb7-f612621ec139 req-95869ce8-33ba-424c-a03e-76ce576c215f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:40.830129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-3860d543-5edb-4ae7-9cb7-f612621ec139 req-95869ce8-33ba-424c-a03e-76ce576c215f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:40.877258 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-3860d543-5edb-4ae7-9cb7-f612621ec139 req-95869ce8-33ba-424c-a03e-76ce576c215f service nova] Creating event network-vif-deleted:0c235937-5717-4ac5-96f5-48e34e08f03c for instance 9fc588d8-05ad-4497-b035-04613b1bc49d on n-h2-846470-15 Aug 24 04:02:40.926115 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-3860d543-5edb-4ae7-9cb7-f612621ec139 req-95869ce8-33ba-424c-a03e-76ce576c215f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150707 Aug 24 04:02:40.928611 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2800/5338] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:02:41.139191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:41.161189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:41.164287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:41.174247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ee83b4d-c24e-4234-9ffc-db7e9221e99e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 1.076666 Aug 24 04:02:41.175223 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2539/5339] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:40 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:02:41.672558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:41.674595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:41.687705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:41.688640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:41.689266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:41.690269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:41.691056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:41.691899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:41.798711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:41.810131 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a67dbae-d52a-4923-98ea-583bea3a30c5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1212 microversion: 2.1 time: 0.143775 Aug 24 04:02:41.813917 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2801/5340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:41 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1212 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:42.212730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:42.217500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:42.253801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:42.257107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:42.257929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:42.264041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:42.267176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:42.268476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:42.737539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:42.753297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:42.762867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:42.768497 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-025ed8e7-4cb3-4678-b02a-b8753e5160c8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1744 microversion: 2.20 time: 0.568916 Aug 24 04:02:42.770021 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2540/5341] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:42 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1744 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:42.842634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:42.845129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:42.869772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:42.869772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:42.869772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:42.870252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:42.879347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:42.881366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:43.145226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:43.164293 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d006367c-ade1-4aff-a981-bb93d95213af tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1266 microversion: 2.1 time: 0.322888 Aug 24 04:02:43.167466 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2802/5342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:42 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:43.825636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:43.830850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:43.856648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:43.858127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:43.858916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:43.860515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:43.861423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:43.862348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:44.197080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:44.198005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:44.223926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:44.224539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:44.225049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:44.228618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:44.231157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:44.248149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:44.398569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:44.417646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:44.419748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:44.421691 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f88fcc0-6606-44e9-9a82-31ac986540c7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1744 microversion: 2.20 time: 0.606416 Aug 24 04:02:44.423041 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2541/5343] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:43 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1744 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:45.059702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:45.070752 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-843f92d6-2596-40af-b274-2032a65a343e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1266 microversion: 2.1 time: 0.882601 Aug 24 04:02:45.090589 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2803/5344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:44 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1266 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:45.471959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:45.473975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:45.488989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:45.490339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:45.491433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:45.511041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:45.514485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:45.515530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:46.106823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:46.110338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:46.132544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:46.139628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:46.154960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:46.156609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:46.156985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:46.158165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:46.159244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:46.183109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:46.189657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:46.199997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5e47658-f709-4f96-94c1-d794382162e6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1744 microversion: 2.20 time: 0.734867 Aug 24 04:02:46.200787 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2542/5345] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:45 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1744 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:46.216356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7cec1caa-6678-4eb6-8bd5-d7de854e1cce req-c75d0fe5-a8dc-4c07-bf52-69c537ca3ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d", "name": "network-vif-plugged", "status": "completed", "tag": "2916b737-8e19-4065-b9f3-463597555a67"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:46.244739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7cec1caa-6678-4eb6-8bd5-d7de854e1cce req-c75d0fe5-a8dc-4c07-bf52-69c537ca3ab0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:46.246972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7cec1caa-6678-4eb6-8bd5-d7de854e1cce req-c75d0fe5-a8dc-4c07-bf52-69c537ca3ab0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:46.248385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7cec1caa-6678-4eb6-8bd5-d7de854e1cce req-c75d0fe5-a8dc-4c07-bf52-69c537ca3ab0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:46.299012 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7cec1caa-6678-4eb6-8bd5-d7de854e1cce req-c75d0fe5-a8dc-4c07-bf52-69c537ca3ab0 service nova] Creating event network-vif-plugged:2916b737-8e19-4065-b9f3-463597555a67 for instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d on n-h1-846470-15 Aug 24 04:02:46.306852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7cec1caa-6678-4eb6-8bd5-d7de854e1cce req-c75d0fe5-a8dc-4c07-bf52-69c537ca3ab0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103427 Aug 24 04:02:46.308680 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2543/5346] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:46.751479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:46.770318 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-50203685-1c6b-4fef-9ce8-785e1dd0205b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 0.677680 Aug 24 04:02:46.772324 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2804/5347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:46 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:47.240806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:47.252183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:47.271136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:47.272295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:47.273250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:47.274762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:47.276102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:47.276846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:47.797054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:47.798217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:47.829459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:47.832350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:47.833198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:47.834320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:47.840644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:47.841418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:48.165216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:48.187401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:48.201389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:48.203547 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6c7a40b-629c-43db-9348-9e417c262488 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1744 microversion: 2.20 time: 0.975748 Aug 24 04:02:48.215959 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2544/5348] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:47 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1744 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:48.301626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:48.330515 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c6a1130-685d-4e18-a5d9-eb4f9703ec7c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 0.539607 Aug 24 04:02:48.331449 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2805/5349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:47 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:48.407775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bdbba050-1fcb-4099-bac9-dff5b7aad048 req-ae809f5f-d79e-4548-83f4-c24669606b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb47c2cb-c09d-4985-a5e5-0982540f9295", "tag": "8c4cde42-d7e9-4dd4-af73-74eee1e1024e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:48.444448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bdbba050-1fcb-4099-bac9-dff5b7aad048 req-ae809f5f-d79e-4548-83f4-c24669606b4b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:48.445464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bdbba050-1fcb-4099-bac9-dff5b7aad048 req-ae809f5f-d79e-4548-83f4-c24669606b4b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:48.445996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bdbba050-1fcb-4099-bac9-dff5b7aad048 req-ae809f5f-d79e-4548-83f4-c24669606b4b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:48.500470 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bdbba050-1fcb-4099-bac9-dff5b7aad048 req-ae809f5f-d79e-4548-83f4-c24669606b4b service nova] Creating event network-changed:8c4cde42-d7e9-4dd4-af73-74eee1e1024e for instance cb47c2cb-c09d-4985-a5e5-0982540f9295 on n-h2-846470-15 Aug 24 04:02:48.511622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bdbba050-1fcb-4099-bac9-dff5b7aad048 req-ae809f5f-d79e-4548-83f4-c24669606b4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108585 Aug 24 04:02:48.517412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2545/5350] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:49.238869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:49.241121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:49.256392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:49.285367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.286067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.286750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.287910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.288519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.288982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.358639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:49.359366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:49.403722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.404550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.405269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.418487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.419436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.420192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.803902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:49.841605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:49.852292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:49.854114 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ec5d2ca4-8b84-4fcf-9fc8-1a4e2825ebd6 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.628072 Aug 24 04:02:49.881931 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2806/5351] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:49 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:50.230674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:50.253724 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a10c3a7-67be-486a-afa9-5d9b4f7a65dc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 0.902589 Aug 24 04:02:50.262505 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2546/5352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:49 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:50.910914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:50.917775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:50.940619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:50.945052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:50.945847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:50.946414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:50.950363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:50.951177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:50.959836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.304188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:51.304836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:51.322601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:51.323347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:51.324235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.325588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:51.326315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:51.327005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.531570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:51.551768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:51.554701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:51.558546 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a398047-8110-4eeb-b17b-a45245f1d087 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.665746 Aug 24 04:02:51.563186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2807/5353] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:50 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:51.669984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:51.676544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:51.686278 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cae23045-3776-4756-a0ae-6942c8ce00a6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 0.395667 Aug 24 04:02:51.687551 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2547/5354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:51 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:52.594783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:52.609322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:52.643638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:52.644351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:52.644834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:52.646432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:52.646432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:52.646432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:52.720582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:52.724683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:52.734643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=35 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:52.736963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:52.737937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:52.738556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:52.739609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:52.740279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:52.740862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:53.149718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:53.164650 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b12a0f9-f6e9-4d15-b0e0-f5dde2f28a1f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 0.456884 Aug 24 04:02:53.165604 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2548/5355] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:52 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:53.534474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:53.553268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:53.557899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:53.561943 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c2948617-3142-498e-a39b-482f754ed106 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.977504 Aug 24 04:02:53.591981 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2808/5356] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:52 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:54.199789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:54.201082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:54.227068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:54.231632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:54.232293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:54.233249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:54.235798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:54.236662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:54.601156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:54.601788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:54.647098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:54.649190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:54.650005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:54.654752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:54.657078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:54.659991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:55.794581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:55.807639 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16bcc7fc-8d4b-4cd7-8773-d4d2da6ad95f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 1.615334 Aug 24 04:02:55.830184 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2549/5357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:54 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:56.008476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:56.086561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:56.110668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:56.116760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f60cd8b3-4218-441a-9621-433de8690477 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 1.519614 Aug 24 04:02:56.120094 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2809/5358] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:54 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:02:56.908462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:56.910796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:56.925902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:56.926834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:56.928325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:56.929937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:56.930866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:56.931534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:57.142725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:57.143605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:57.176044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:57.176824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:57.181324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:57.182693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:57.188260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:57.189392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:57.561798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:57.594155 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6456eea1-8d67-41e8-b863-766d15bb1fa4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 0.690864 Aug 24 04:02:57.612911 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2550/5359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:56 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:57.720873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:57.775898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:57.780252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:57.796887 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b5aaf803-4694-409d-9bcc-1da9ee9d4254 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.659808 Aug 24 04:02:57.805709 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2810/5360] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:57 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:02:58.638803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:58.640211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:58.655403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:58.669500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:58.675154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:58.686369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:58.688152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:58.689230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:58.834031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:58.834972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:58.866943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:58.872053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:58.873271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:58.874790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:58.875204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:58.876504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:59.535716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:59.591653 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d606924c-bc6d-4cf4-9267-0ffe8f6ac236 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 0.958636 Aug 24 04:02:59.593546 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2551/5361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:58 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:59.606191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-dd19f62c-68e7-42a5-8113-de2c90e8659b req-cad6652c-375d-4b05-9e1a-ce1010a14f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb47c2cb-c09d-4985-a5e5-0982540f9295", "name": "network-vif-plugged", "status": "completed", "tag": "8c4cde42-d7e9-4dd4-af73-74eee1e1024e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:59.729363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dd19f62c-68e7-42a5-8113-de2c90e8659b req-cad6652c-375d-4b05-9e1a-ce1010a14f81 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:59.730337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dd19f62c-68e7-42a5-8113-de2c90e8659b req-cad6652c-375d-4b05-9e1a-ce1010a14f81 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:59.730337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dd19f62c-68e7-42a5-8113-de2c90e8659b req-cad6652c-375d-4b05-9e1a-ce1010a14f81 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:59.766833 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-dd19f62c-68e7-42a5-8113-de2c90e8659b req-cad6652c-375d-4b05-9e1a-ce1010a14f81 service nova] Creating event network-vif-plugged:8c4cde42-d7e9-4dd4-af73-74eee1e1024e for instance cb47c2cb-c09d-4985-a5e5-0982540f9295 on n-h2-846470-15 Aug 24 04:02:59.798524 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-dd19f62c-68e7-42a5-8113-de2c90e8659b req-cad6652c-375d-4b05-9e1a-ce1010a14f81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202579 Aug 24 04:02:59.799521 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2552/5362] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:00.282319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:00.286309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:00.346096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:00.362449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:00.376673 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce265bf4-781f-47be-8ae9-46e27eb96c98 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 1.547466 Aug 24 04:03:00.399776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2811/5363] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:02:58 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:00.621905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:00.622627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:00.656333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:00.656906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:00.657371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:00.665095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:00.665743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:00.666202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:01.431519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:01.432118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:01.435582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:01.481863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:01.482892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:01.485140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:01.486769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:01.487891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:01.497701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:01.801918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:01.870994 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c99ec6d-d778-46b4-8c70-7882e2f492ec tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1308 microversion: 2.1 time: 1.255385 Aug 24 04:03:01.909845 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2553/5364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:00 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1308 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:02.254635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:02.271636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:02.280250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:02.281817 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0163894c-a61e-454d-a9ba-b4f7f7dc7969 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.855268 Aug 24 04:03:02.282474 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2812/5365] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:01 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:02.946691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:02.949429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:02.968257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:02.969234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:02.972213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:02.975651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:02.977782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:02.979007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:03.341365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:03.343480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:03.396661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:03.397420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:03.397919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:03.398702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:03.399215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:03.400459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:03.431378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:03.447510 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aa6b59ff-70ce-46db-8d7c-67af863645de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1488 microversion: 2.1 time: 0.509544 Aug 24 04:03:03.460577 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2554/5366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:02 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1488 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:03.472062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:03.472877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:03.479986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:03.481234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:03.482322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:03.483359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:03.484176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:03.484854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:03.516279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lazy-loading 'flavor' on Instance uuid cb47c2cb-c09d-4985-a5e5-0982540f9295 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:03:03.658542 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2ae40f3-a0e7-4872-ada6-6d5b169dbac5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295/action" status: 202 len: 0 microversion: 2.1 time: 0.189136 Aug 24 04:03:03.663237 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2555/5367] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:03:03 2022] POST /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:03:03.706972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:03.720061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:03.761154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:03.762794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:03.764116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:03.765681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:03.766596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:03.771568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:04.286578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:04.310047 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6b07163-f6d3-4168-b689-2c60c1a036e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1496 microversion: 2.1 time: 0.633049 Aug 24 04:03:04.311951 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2556/5368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:03 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1496 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:05.121621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:05.167723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:05.172903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:05.193545 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86739a2d-2f4f-4089-b009-e42b7cb76129 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 1.875224 Aug 24 04:03:05.218257 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2813/5369] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:03 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:05.338571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:05.339532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:05.360110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:05.360532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:05.361183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:05.362155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:05.362829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:05.363502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:05.782693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:05.799316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f05538a0-85d5-4ce9-8f80-9ff78f792317 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 200 len: 1479 microversion: 2.1 time: 0.466455 Aug 24 04:03:05.803383 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2557/5370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:05 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 1479 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:05.835688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1058094613"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:05.842789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:05.885504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:05.891274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:05.891274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:05.913965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:05.916632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:05.917470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:06.244023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:06.245403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:06.269442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:06.271178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:06.276394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:06.279536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:06.281302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:06.282249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:06.574209 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a8231a3d-eabd-4327-833a-119d59613b99 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295/action" status: 202 len: 0 microversion: 2.1 time: 0.742224 Aug 24 04:03:06.577366 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2814/5371] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:03:05 2022] POST /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 04:03:06.600907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-615deb60-fcff-4e2b-b88c-915fcf6215ef tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022fd79d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:06.725035 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-615deb60-fcff-4e2b-b88c-915fcf6215ef tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.140859 Aug 24 04:03:06.725996 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2815/5372] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:06 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:07.679539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:07.734193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:07.743583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-146296d5-5d9b-43c6-a3d0-544223461ff9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10235619d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:07.745391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:07.753224 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7abbc9e6-04b6-49ab-baae-2de43eed3475 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 1.512725 Aug 24 04:03:07.756548 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2558/5373] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:06 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:07.929997 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-146296d5-5d9b-43c6-a3d0-544223461ff9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.192625 Aug 24 04:03:07.939272 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2816/5374] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:07 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:08.806388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:08.807170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:08.847207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:08.847739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:08.857107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:08.864588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:08.866662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:08.871578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:08.949342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9b30a8e-106c-4225-b82b-594b18dbe120 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022ec4a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:09.122221 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9b30a8e-106c-4225-b82b-594b18dbe120 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.179350 Aug 24 04:03:09.127754 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2817/5375] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:08 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:09.575298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:09.607205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:09.611446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:09.615553 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-017c1dbd-930e-4294-a1a7-d1c129f4917c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.815832 Aug 24 04:03:09.620411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2559/5376] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:08 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:10.141342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75c99ba2-a695-49ad-99ef-88e2149744d5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1023613ee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:10.320343 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75c99ba2-a695-49ad-99ef-88e2149744d5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.185030 Aug 24 04:03:10.321002 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2818/5377] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:10 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:10.661493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:10.662138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:10.673650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:10.674149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:10.686359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:10.687605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:10.688357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:10.688980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:10.901129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-733263839", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "09be518a-fd78-4ae8-a434-e6f84f0b027a"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:11.118501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] validate_networks() for [('09be518a-fd78-4ae8-a434-e6f84f0b027a', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:03:11.302587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:11.319725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:11.323158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:11.325754 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-563f811a-63ec-4133-844c-57bdf248a437 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.678024 Aug 24 04:03:11.344965 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2560/5378] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:10 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:11.361285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b99c37b-a636-4edb-961a-0c1819b8b5e0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102acc9430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:11.439398 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1b99c37b-a636-4edb-961a-0c1819b8b5e0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.092589 Aug 24 04:03:11.440105 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2561/5379] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:11 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:12.370889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:12.372534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:12.389743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:12.390760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:12.391370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:12.393013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:12.397169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:12.398276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:12.887359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:12.896788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:12.909850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:12.911417 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27a6b558-4127-4bd1-8b1e-4bb9a4ba4fdd tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.546299 Aug 24 04:03:12.921010 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2562/5380] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:12 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:12.949318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2cbc884b-686d-452a-8a02-64d7f0a58c3e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a780ee0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:13.138409 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2cbc884b-686d-452a-8a02-64d7f0a58c3e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.211075 Aug 24 04:03:13.139406 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2563/5381] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:12 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:13.680976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:03:13.681837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:03:13.682323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:03:13.683139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:03:13.683574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:03:13.740675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:13.747608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:13.758248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:13.758248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:13.758248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:13.758973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:13.880308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Getting quotas for project 6bc901a671a749b2b6c1b76024f949f4. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:03:13.897856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Getting quotas for user 4352e99c3c244ae085a0cd417f8ed32f and project 6bc901a671a749b2b6c1b76024f949f4. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:03:13.935398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:03:13.950677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:13.951306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:13.956396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:03:13.990890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:13.994781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:13.995846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:13.998969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:13.999437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:13.999921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:14.198967 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca57aa3f-3d29-47bb-b7b0-e126bdcfbe4b tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.305542 Aug 24 04:03:14.203297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2819/5382] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:03:14.217384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-84093404-cb03-40ef-83a3-1031ea6af7f5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022e89160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:14.929191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:14.938979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:14.945983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:14.949479 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6eed857e-1a84-4c0b-b46a-5dbc2a421803 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 1.006603 Aug 24 04:03:14.959717 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2564/5383] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:13 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:14.976617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1bb90e9a-7446-4cfb-8fd2-4f004493f514 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:14.981922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1bb90e9a-7446-4cfb-8fd2-4f004493f514 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:15.265122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1bb90e9a-7446-4cfb-8fd2-4f004493f514 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:15.277549 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1bb90e9a-7446-4cfb-8fd2-4f004493f514 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1218 microversion: 2.1 time: 0.315886 Aug 24 04:03:15.283354 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2565/5384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:14 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1218 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:15.300533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-561626aa-7942-4ac1-9349-456120b08fd5 req-ad2b9c12-d284-49ae-9d01-358cc3af412f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb47c2cb-c09d-4985-a5e5-0982540f9295", "name": "network-vif-plugged", "status": "completed", "tag": "8c4cde42-d7e9-4dd4-af73-74eee1e1024e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:15.379783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-561626aa-7942-4ac1-9349-456120b08fd5 req-ad2b9c12-d284-49ae-9d01-358cc3af412f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:15.382254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-561626aa-7942-4ac1-9349-456120b08fd5 req-ad2b9c12-d284-49ae-9d01-358cc3af412f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:15.383017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-561626aa-7942-4ac1-9349-456120b08fd5 req-ad2b9c12-d284-49ae-9d01-358cc3af412f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:15.433664 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-561626aa-7942-4ac1-9349-456120b08fd5 req-ad2b9c12-d284-49ae-9d01-358cc3af412f service nova] Creating event network-vif-plugged:8c4cde42-d7e9-4dd4-af73-74eee1e1024e for instance cb47c2cb-c09d-4985-a5e5-0982540f9295 on n-h2-846470-15 Aug 24 04:03:15.449587 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-561626aa-7942-4ac1-9349-456120b08fd5 req-ad2b9c12-d284-49ae-9d01-358cc3af412f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159487 Aug 24 04:03:15.452822 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2566/5385] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:15.811018 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-84093404-cb03-40ef-83a3-1031ea6af7f5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 1.605500 Aug 24 04:03:15.811825 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2820/5386] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:14 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:15.994409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:15.995418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:16.026823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:16.027348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:16.027861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:16.029185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:16.030075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:16.050797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:16.111072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:16.334488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:16.335233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:16.358637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:16.359266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:16.360901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:16.363954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:16.366449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:16.369353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:16.644386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:16.662841 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2dd1c1dc-49a2-4460-80a5-3858cc4d1649 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1270 microversion: 2.1 time: 0.334129 Aug 24 04:03:16.671907 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2821/5387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:16 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1270 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:16.835396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-096135fe-927b-445d-b996-2ce8b0867384 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022771700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:16.900245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:16.939805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:16.949744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:16.953057 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f07de75e-1d68-4f5d-80d2-810add4fa320 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1739 microversion: 2.20 time: 0.964649 Aug 24 04:03:16.954689 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2567/5388] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:15 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1739 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:16.965180 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-096135fe-927b-445d-b996-2ce8b0867384 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.141393 Aug 24 04:03:16.969831 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2822/5389] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:16 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:17.692134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:17.693098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:17.712515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:17.713702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:17.725288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:17.733990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:17.734903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:17.735567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:17.984356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:17.985142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:18.005290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:18.006211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:18.006933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:18.007969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:18.009365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:18.010050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:18.326346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:18.339652 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-65435d10-3082-4a89-ba6a-40be5e579c1f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1276 microversion: 2.1 time: 0.651323 Aug 24 04:03:18.343801 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2568/5390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:17 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1276 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:18.380885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-39e8ba55-bff0-44cd-8417-853c9da59134 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102b610160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:18.473628 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-39e8ba55-bff0-44cd-8417-853c9da59134 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.111364 Aug 24 04:03:18.475647 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2569/5391] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:18 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:18.737940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:18.748416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:18.750842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:18.752512 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dd9eeab4-8565-4095-a45a-d0717fecb4cc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1721 microversion: 2.20 time: 0.773427 Aug 24 04:03:18.753980 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2823/5392] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:17 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1721 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:19.367469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:19.368881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:19.387686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:19.390971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:19.391471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:19.392352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:19.392835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:19.395049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:19.490231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-099410af-19e0-4d15-a3e5-15eb06b5ea1b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022771700>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:19.588221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:19.606106 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d424660-10a3-4d45-8464-8e7b99bbf4e3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1276 microversion: 2.1 time: 0.240763 Aug 24 04:03:19.607960 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2570/5393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:19 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:19.626254 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-099410af-19e0-4d15-a3e5-15eb06b5ea1b tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.140168 Aug 24 04:03:19.632903 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2824/5394] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:19 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:19.780342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:19.781300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:19.789567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:19.790383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:19.791380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:19.792517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:19.793211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:19.793848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:20.372038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-91d0633a-b9ce-4993-82a2-010135809253 req-0a90f1e3-7f95-492b-ad72-0bc40be27701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d", "name": "network-vif-unplugged", "status": "completed", "tag": "2916b737-8e19-4065-b9f3-463597555a67"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:20.398255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:20.404360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-91d0633a-b9ce-4993-82a2-010135809253 req-0a90f1e3-7f95-492b-ad72-0bc40be27701 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:20.405851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-91d0633a-b9ce-4993-82a2-010135809253 req-0a90f1e3-7f95-492b-ad72-0bc40be27701 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:20.406578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-91d0633a-b9ce-4993-82a2-010135809253 req-0a90f1e3-7f95-492b-ad72-0bc40be27701 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:20.424329 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-91d0633a-b9ce-4993-82a2-010135809253 req-0a90f1e3-7f95-492b-ad72-0bc40be27701 service nova] Creating event network-vif-unplugged:2916b737-8e19-4065-b9f3-463597555a67 for instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d on n-h1-846470-15 Aug 24 04:03:20.426194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:20.427868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:20.429221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e53d4378-4277-4866-9aa5-35f658cf9519 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1721 microversion: 2.20 time: 0.652929 Aug 24 04:03:20.434851 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-91d0633a-b9ce-4993-82a2-010135809253 req-0a90f1e3-7f95-492b-ad72-0bc40be27701 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069634 Aug 24 04:03:20.440111 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2571/5395] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:19 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1721 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:20.452278 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2825/5396] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:20.638929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:20.640648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:20.656130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:20.659188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e835066b-01f8-4612-a202-fa91b8b99bcd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022ec4a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:20.661327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:20.662987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:20.664195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:20.668483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:20.670702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:20.784077 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e835066b-01f8-4612-a202-fa91b8b99bcd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.128647 Aug 24 04:03:20.785165 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2826/5397] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:20 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:20.848237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:20.870788 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-00492bf2-55bc-420e-915f-2e95962da224 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1276 microversion: 2.1 time: 0.234996 Aug 24 04:03:20.873515 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2572/5398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:20 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:21.466272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:21.469239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:21.495956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:21.496736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:21.502220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:21.503286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:21.503964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:21.504559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:21.801592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8993525d-2301-4110-8f81-5c307bb91854 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a6f0160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:21.907631 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8993525d-2301-4110-8f81-5c307bb91854 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.110026 Aug 24 04:03:21.908551 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2573/5399] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:21 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:21.921403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:21.923178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:21.926821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:21.946843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:21.947293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:21.948307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:21.948981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:21.950343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:21.950479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:21.951106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:21.951794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:21.960153 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8e6c0c84-1208-4098-8d75-292d64370bde tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1721 microversion: 2.20 time: 0.501225 Aug 24 04:03:21.969201 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2827/5400] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:21 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1721 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:22.334531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:22.358596 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8aba40a6-5aca-4c99-b1b9-01e5e7041ecf tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 0.448005 Aug 24 04:03:22.361674 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2574/5401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:21 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:22.928367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a177dffb-fc00-49de-b546-04c113a70bd3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f10342c9b80>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:22.995713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:22.996341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:22.999535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=48 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:23.039077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:23.044442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:23.044953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:23.045696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:23.046176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:23.046602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:23.081607 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a177dffb-fc00-49de-b546-04c113a70bd3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.150154 Aug 24 04:03:23.084168 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2828/5402] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:22 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:23.398433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:23.400969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:23.427608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:23.440331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:23.441463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:23.442370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:23.442876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:23.443578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:23.781763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:23.820590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:23.825207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:23.830475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:23.842796 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e810145-45f8-4169-8582-2c9fcf25617a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1724 microversion: 2.20 time: 0.850051 Aug 24 04:03:23.845702 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2575/5403] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:22 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1724 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:23.872053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33004951-40d8-4961-b12d-65bf350a22cd"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:23.874770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:23.897726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:23.899623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:23.901785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:23.903081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:23.906302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:23.911798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:23.917091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:24.202681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:24.239046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f60fe921-9c78-4b7e-af16-d48515c34fb7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 0.856341 Aug 24 04:03:24.244879 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2829/5404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:23 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:24.250170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eeae9e92-a5ed-4cae-a247-d50445798de0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022e7b280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:24.371181 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eeae9e92-a5ed-4cae-a247-d50445798de0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.124936 Aug 24 04:03:24.377052 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2830/5405] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:24 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:24.963529 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb56b514-5d8f-4d76-8942-963751cf255b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.096903 Aug 24 04:03:24.972983 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2576/5406] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 24 04:03:23 2022] POST /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/os-volume_attachments => generated 188 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:03:25.096814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6b25f1d5-5fb4-43f2-824e-b0ef2e0b7cec req-ddeb525d-509c-4387-b701-f4a42245a433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c57722-51bb-47ca-8044-865e060980f8", "tag": "e7eac776-e2c6-4b1f-bb7b-29f677fead49"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:25.130589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6b25f1d5-5fb4-43f2-824e-b0ef2e0b7cec req-ddeb525d-509c-4387-b701-f4a42245a433 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:25.133677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6b25f1d5-5fb4-43f2-824e-b0ef2e0b7cec req-ddeb525d-509c-4387-b701-f4a42245a433 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:25.137549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6b25f1d5-5fb4-43f2-824e-b0ef2e0b7cec req-ddeb525d-509c-4387-b701-f4a42245a433 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:25.168408 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6b25f1d5-5fb4-43f2-824e-b0ef2e0b7cec req-ddeb525d-509c-4387-b701-f4a42245a433 service nova] Creating event network-changed:e7eac776-e2c6-4b1f-bb7b-29f677fead49 for instance e1c57722-51bb-47ca-8044-865e060980f8 on n-h1-846470-15 Aug 24 04:03:25.176157 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6b25f1d5-5fb4-43f2-824e-b0ef2e0b7cec req-ddeb525d-509c-4387-b701-f4a42245a433 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098631 Aug 24 04:03:25.177477 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2831/5407] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:25.272441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:25.273264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:25.279630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:25.298059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:25.298696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:25.300235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:25.307926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:25.308738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:25.309340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:25.387192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:25.391206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:25.411057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:25.411806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:25.412362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:25.413211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:25.413777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:25.414307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:26.284462 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4d6f38e2-f9a5-4a51-ab67-f8053b882f7b tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/os-volume_attachments/33004951-40d8-4961-b12d-65bf350a22cd" status: 202 len: 0 microversion: 2.20 time: 0.903741 Aug 24 04:03:26.287986 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2832/5408] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 24 04:03:25 2022] DELETE /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/os-volume_attachments/33004951-40d8-4961-b12d-65bf350a22cd => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:03:26.303802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60cc3257-4f42-44a6-b96e-d4410cc0c76f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102367e670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:26.478567 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60cc3257-4f42-44a6-b96e-d4410cc0c76f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.188941 Aug 24 04:03:26.481947 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2833/5409] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:26 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:26.498517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:26.500741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:26.532561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:26.536259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:26.537426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:26.540654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:26.543060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:26.544483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:26.675031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122536) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 04:03:26.892065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:26.895641 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-88e86f67-9f89-42d2-917f-61468c04e588 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "POST /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/action" status: 202 len: 0 microversion: 2.20 time: 0.409862 Aug 24 04:03:26.898365 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2834/5410] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 04:03:26 2022] POST /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:03:26.912879 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-80d9e5d2-e8c8-4106-8356-9feec020a357 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 1.636235 Aug 24 04:03:26.917959 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2577/5411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:25 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:26.949470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:26.950440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:26.983534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:26.993469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:26.999377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:27.002355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:27.003167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:27.006844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:27.505040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4f870e6-34f7-4c7a-acb5-aceb3746f2d5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a6d2940>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:27.794330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:27.807593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:27.813720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:27.816109 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96dafec3-a356-4bfd-bc9b-22a0d3fbc9c5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1672 microversion: 2.20 time: 0.910055 Aug 24 04:03:27.828967 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2835/5412] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:26 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1672 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:27.951187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:27.953183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:27.970751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:27.971261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:27.971728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:27.972467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:27.972928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:27.983256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:28.053901 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4f870e6-34f7-4c7a-acb5-aceb3746f2d5 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.549006 Aug 24 04:03:28.055078 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2578/5413] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:27 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:28.059115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:28.409498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:28.424789 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c876971-37b8-427c-816d-8cada229bdf7 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 0.481567 Aug 24 04:03:28.439927 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2836/5414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:27 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:28.843412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:28.844997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:28.862454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:28.864886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:28.867014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:28.868441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:28.870085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:28.871688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:29.077269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1deaa71c-8d18-495f-8c06-e31e13f41a10 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102311a8b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:29.180298 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1deaa71c-8d18-495f-8c06-e31e13f41a10 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.107108 Aug 24 04:03:29.181003 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2837/5415] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:29 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:29.453110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:29.455622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:29.474575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:29.474932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:29.475451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:29.476199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:29.476666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:29.477464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:29.504047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:29.515853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:29.531291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:29.535427 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b06d6f55-06ed-4175-baa2-cd89bf110cd7 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1672 microversion: 2.20 time: 0.697373 Aug 24 04:03:29.536377 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2579/5416] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:28 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1672 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:30.072339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:30.091796 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ad5364e0-d752-4c40-be5a-aaa3738d85b0 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 0.642607 Aug 24 04:03:30.095503 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2838/5417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:29 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:30.199066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93bd9877-1801-4616-a977-649669482d73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1029e73b80>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:30.425981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-93bd9877-1801-4616-a977-649669482d73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.232618 Aug 24 04:03:30.429488 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2580/5418] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:30 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:30.566317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:30.567135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:30.599863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:30.600761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:30.603846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:30.604821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:30.608384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:30.611711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:31.126955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:31.128001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:31.152978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:31.153771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:31.154540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:31.155651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:31.156396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:31.157066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:31.190770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:31.215095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:31.218571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:31.223594 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b19937ac-0880-4818-8d4c-4f00021cf313 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.665275 Aug 24 04:03:31.245055 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2839/5419] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:30 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:31.446895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c65a722-3114-48f9-8f7d-636ab9cc2b4c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022f77040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:31.616886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c65a722-3114-48f9-8f7d-636ab9cc2b4c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.174436 Aug 24 04:03:31.622328 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2840/5420] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:31 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:31.943380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:31.972330 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cdccc244-0188-4be6-b599-986b64f22316 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 0.851794 Aug 24 04:03:31.976869 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2581/5421] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:31 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:32.266371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:32.267156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:32.288878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:32.300245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:32.301637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:32.302105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:32.304141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:32.306755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:32.307327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:32.650425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f440f839-3608-4380-845e-ee6cf80fbb39 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a08eca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:32.895631 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f440f839-3608-4380-845e-ee6cf80fbb39 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.258154 Aug 24 04:03:32.912685 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2582/5422] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:32 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:03:33.002544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:33.003436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:33.032662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:33.033933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:33.034683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:33.035862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:33.036779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:33.038205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:33.793569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:33.817066 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f5f5c12-dbcc-4bf0-97f7-0273e55d2c1a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 0.822165 Aug 24 04:03:33.818510 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2583/5423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:32 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:33.922199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-308bd3aa-7b1d-4025-b717-3d2e65ce6383 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1029f453a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:34.062880 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-308bd3aa-7b1d-4025-b717-3d2e65ce6383 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.146684 Aug 24 04:03:34.064450 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2584/5424] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:33 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:34.110575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:34.134884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:34.139960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:34.141902 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-819d5f2b-b94c-47a8-a54a-75525ec7d6b8 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.880674 Aug 24 04:03:34.159137 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2841/5425] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:32 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:34.415525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0651002a-4e50-4efc-a2b2-a82bac31cf66 req-531aaf86-4912-451f-811d-352361b7eda1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d", "tag": "2916b737-8e19-4065-b9f3-463597555a67"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:34.491964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0651002a-4e50-4efc-a2b2-a82bac31cf66 req-531aaf86-4912-451f-811d-352361b7eda1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:34.493131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0651002a-4e50-4efc-a2b2-a82bac31cf66 req-531aaf86-4912-451f-811d-352361b7eda1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:34.493898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0651002a-4e50-4efc-a2b2-a82bac31cf66 req-531aaf86-4912-451f-811d-352361b7eda1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:34.534416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0651002a-4e50-4efc-a2b2-a82bac31cf66 req-531aaf86-4912-451f-811d-352361b7eda1 service nova] Creating event network-changed:2916b737-8e19-4065-b9f3-463597555a67 for instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d on n-h2-846470-15 Aug 24 04:03:34.554196 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0651002a-4e50-4efc-a2b2-a82bac31cf66 req-531aaf86-4912-451f-811d-352361b7eda1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142197 Aug 24 04:03:34.559310 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2585/5426] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:34.839579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:34.840251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:34.862241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:34.863065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:34.863733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:34.864676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:34.868236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:34.869373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:35.083822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49468bbc-0bb6-4313-b4af-9cf6a1177123 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1029f459d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:35.201986 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49468bbc-0bb6-4313-b4af-9cf6a1177123 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.125491 Aug 24 04:03:35.212627 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2586/5427] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:35 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:35.226396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:35.229517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:35.250505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:35.251126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:35.251650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:35.253901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:35.255397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:35.267385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:35.725540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:35.768720 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76ae8a8c-3110-4e3c-9c50-da686b7a0d95 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 0.933907 Aug 24 04:03:35.783954 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2842/5428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:34 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:35.797681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2c78eb60-7e1f-4fe4-bfc9-19f1a86817e4 req-d39ded5c-67c0-475e-8d6b-e3ce4e9ba211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c57722-51bb-47ca-8044-865e060980f8", "name": "network-vif-plugged", "status": "completed", "tag": "e7eac776-e2c6-4b1f-bb7b-29f677fead49"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:35.836321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2c78eb60-7e1f-4fe4-bfc9-19f1a86817e4 req-d39ded5c-67c0-475e-8d6b-e3ce4e9ba211 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:35.838526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2c78eb60-7e1f-4fe4-bfc9-19f1a86817e4 req-d39ded5c-67c0-475e-8d6b-e3ce4e9ba211 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:35.840258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2c78eb60-7e1f-4fe4-bfc9-19f1a86817e4 req-d39ded5c-67c0-475e-8d6b-e3ce4e9ba211 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:35.871602 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2c78eb60-7e1f-4fe4-bfc9-19f1a86817e4 req-d39ded5c-67c0-475e-8d6b-e3ce4e9ba211 service nova] Creating event network-vif-plugged:e7eac776-e2c6-4b1f-bb7b-29f677fead49 for instance e1c57722-51bb-47ca-8044-865e060980f8 on n-h1-846470-15 Aug 24 04:03:35.884272 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2c78eb60-7e1f-4fe4-bfc9-19f1a86817e4 req-d39ded5c-67c0-475e-8d6b-e3ce4e9ba211 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096934 Aug 24 04:03:35.886679 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2843/5429] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:36.220060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7329873-37b3-4356-8d20-b0b64a857a70 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1022e89ca0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:36.283053 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7329873-37b3-4356-8d20-b0b64a857a70 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 0.067880 Aug 24 04:03:36.283652 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2844/5430] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:36 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:36.596123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:36.613055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:36.628069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:36.631166 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5ff0202-380d-40e9-9264-accfcdc70eaf tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.416898 Aug 24 04:03:36.632038 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2587/5431] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:35 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:36.706495 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:03:36.706776 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:03:36.792018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:36.792977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:36.806064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:36.806894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:36.807647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:36.809206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:36.809560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:36.811382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:37.148287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:37.160613 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2754ab83-6f42-4ba1-ae88-527e623592da tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1318 microversion: 2.1 time: 0.373955 Aug 24 04:03:37.176385 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2845/5432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:36 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:37.306184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45fcaf49-e305-4fb3-928d-235670a26291 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a6b5550>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:37.655828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:37.658102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:37.685582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:37.687285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:37.688031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:37.689003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:37.689681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:37.690935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:38.280566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:38.327513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:38.331395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:38.350568 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b12fb36b-d79b-4545-9c83-8c0465469e6e tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.698989 Aug 24 04:03:38.351613 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2846/5433] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:37 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:38.369374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:38.374970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:38.406835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:38.427856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:38.431347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:38.435873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:38.445870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:38.452072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:38.939082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:38.958354 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5072114e-fc6a-44d5-8848-4ebdc742e45a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1507 microversion: 2.1 time: 0.605016 Aug 24 04:03:38.986587 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2847/5434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:38 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:39.396108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:39.398419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:39.438877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:39.439724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:39.440715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:39.442024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:39.442853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:39.443592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:40.500268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:40.519047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:40.530235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:40.531586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8a01060c-e803-4381-a209-8e1d9f2d4dea tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.148986 Aug 24 04:03:40.534353 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2848/5435] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:39 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:41.584601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:41.596603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:41.651157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:41.654780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:41.655838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:41.657238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:41.658569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:41.661082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:42.170551 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45fcaf49-e305-4fb3-928d-235670a26291 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1440 microversion: 2.1 time: 4.871159 Aug 24 04:03:42.183919 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2588/5436] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:37 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1440 bytes in 4886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:42.519641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:42.620392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:42.629507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:42.634960 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-12c6c240-e88c-4410-8fdc-3d9d7eaabe1c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.055123 Aug 24 04:03:42.639961 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2849/5437] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:41 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:43.228664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a704d01b-aaae-4258-8c7f-d79ecc9f06d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a6f09d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:43.350324 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a704d01b-aaae-4258-8c7f-d79ecc9f06d1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1449 microversion: 2.1 time: 0.163782 Aug 24 04:03:43.351237 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2589/5438] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:43 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:43.375430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8fbf8370-3fae-4857-9d1a-90e793ca4cf7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102315e160>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:43.530098 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8fbf8370-3fae-4857-9d1a-90e793ca4cf7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 200 len: 1449 microversion: 2.1 time: 0.165043 Aug 24 04:03:43.536742 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2850/5439] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:43 2022] GET /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:03:43.551083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6dfe24af-419a-4e08-bbc1-6af7c33a33fd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102acc9d30>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:43.695245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:43.697241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:43.708218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:43.709258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:43.709917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:43.711225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:43.712485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:43.713118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:44.433093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:44.456037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:44.458283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:44.460978 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-64e0a0ff-0dd7-49a5-af32-02d3cc639584 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.776053 Aug 24 04:03:44.461662 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2851/5440] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:43 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:45.247624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=15 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:45.495021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:45.496134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:45.525486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:45.526686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:45.528625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:45.530936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:45.532548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:45.535379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:45.861734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6dfe24af-419a-4e08-bbc1-6af7c33a33fd tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 204 len: 0 microversion: 2.1 time: 2.314317 Aug 24 04:03:45.863421 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2590/5441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:03:43 2022] DELETE /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 0 bytes in 2317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:03:45.880638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:45.890258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:45.925539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:45.930237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:45.935326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:45.954745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:45.959402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:45.962859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:46.168105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:03:46.175847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:46.350898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:46.410618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:46.427082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:46.432738 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dd5eba46-765e-4614-8cf9-1669dbe036d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.944280 Aug 24 04:03:46.437709 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2852/5442] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:45 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:46.553109 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ee14f47-3191-4552-88eb-8b698946bb88 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 204 len: 0 microversion: 2.1 time: 0.684133 Aug 24 04:03:46.560911 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2591/5443] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:03:45 2022] DELETE /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:03:46.847728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1529055688", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "08e2a024-b48a-4e15-b943-96256a726160"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:47.137590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7f06cf57-8af1-4a91-93ca-ed95eebc8a89 req-192647c6-bf5d-420d-9730-8f269a3ec105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb47c2cb-c09d-4985-a5e5-0982540f9295", "name": "network-vif-unplugged", "status": "completed", "tag": "8c4cde42-d7e9-4dd4-af73-74eee1e1024e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:47.153222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7f06cf57-8af1-4a91-93ca-ed95eebc8a89 req-192647c6-bf5d-420d-9730-8f269a3ec105 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:47.154320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7f06cf57-8af1-4a91-93ca-ed95eebc8a89 req-192647c6-bf5d-420d-9730-8f269a3ec105 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:47.155455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7f06cf57-8af1-4a91-93ca-ed95eebc8a89 req-192647c6-bf5d-420d-9730-8f269a3ec105 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:47.185497 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7f06cf57-8af1-4a91-93ca-ed95eebc8a89 req-192647c6-bf5d-420d-9730-8f269a3ec105 service nova] Creating event network-vif-unplugged:8c4cde42-d7e9-4dd4-af73-74eee1e1024e for instance cb47c2cb-c09d-4985-a5e5-0982540f9295 on n-h2-846470-15 Aug 24 04:03:47.202057 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7f06cf57-8af1-4a91-93ca-ed95eebc8a89 req-192647c6-bf5d-420d-9730-8f269a3ec105 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064224 Aug 24 04:03:47.204829 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2592/5444] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:03:47.477005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:47.479657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:47.497379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:47.498648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:47.499558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:47.500971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:47.502297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:47.503874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:47.947132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:48.036184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:48.040713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:48.049919 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-590b70f1-0d92-41b2-bc8d-9ef951f21e41 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.581987 Aug 24 04:03:48.091163 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2593/5445] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:47 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:49.120973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:49.122900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:49.178590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:49.183094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:49.194275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:49.201694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:49.203619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:49.205508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:50.435199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:50.487881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:50.513068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:50.522903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5bd9f58-2888-450f-b79b-9c4c082288da tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.408588 Aug 24 04:03:50.543788 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2594/5446] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:49 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:03:51.600536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:51.603061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:51.636084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:51.636598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:51.637050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:51.637794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:51.638270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:51.638926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:53.303232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:53.352736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:53.358088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:53.364763 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05f375fd-b527-47a7-9fd5-3213669fa823 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.771641 Aug 24 04:03:53.365368 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2595/5447] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:51 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:53.373367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2d761b5b-4e90-4359-9514-94047542a1c8 req-1acf857b-91ba-4c37-b255-1ce75e8050c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb47c2cb-c09d-4985-a5e5-0982540f9295", "name": "network-vif-deleted", "tag": "8c4cde42-d7e9-4dd4-af73-74eee1e1024e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:03:53.482434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2d761b5b-4e90-4359-9514-94047542a1c8 req-1acf857b-91ba-4c37-b255-1ce75e8050c8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:53.495773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2d761b5b-4e90-4359-9514-94047542a1c8 req-1acf857b-91ba-4c37-b255-1ce75e8050c8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:53.496903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2d761b5b-4e90-4359-9514-94047542a1c8 req-1acf857b-91ba-4c37-b255-1ce75e8050c8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:53.549534 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2d761b5b-4e90-4359-9514-94047542a1c8 req-1acf857b-91ba-4c37-b255-1ce75e8050c8 service nova] Creating event network-vif-deleted:8c4cde42-d7e9-4dd4-af73-74eee1e1024e for instance cb47c2cb-c09d-4985-a5e5-0982540f9295 on n-h2-846470-15 Aug 24 04:03:53.599399 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2d761b5b-4e90-4359-9514-94047542a1c8 req-1acf857b-91ba-4c37-b255-1ce75e8050c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229144 Aug 24 04:03:53.613623 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2596/5448] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:03:54.432240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:54.434841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:54.512272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:54.514447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:54.517735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:54.521720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:54.528326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:54.529903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:56.371283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=70 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:56.503380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:56.524505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:56.528730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:56.546144 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c1b590e-abc3-452b-8304-1e3616c3a0ad tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 2.127841 Aug 24 04:03:56.567084 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2597/5449] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:54 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:56.985794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=21 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:57.575548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:57.576566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:57.592398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:57.602603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:57.606993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:57.608311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:57.609418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:57.610141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:58.614926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:58.630641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:58.638795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:03:58.643079 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8bee2a42-52bc-4dba-aefe-bc27b550d1b3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.072203 Aug 24 04:03:58.661372 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2598/5450] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:57 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:03:59.688653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:03:59.697886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:03:59.732891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:59.739612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:59.741724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:03:59.745052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:03:59.751289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:03:59.761367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:00.198900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] validate_networks() for [('08e2a024-b48a-4e15-b943-96256a726160', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:04:00.897604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:00.923942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:00.928249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:00.932553 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-28858285-4cf9-4e85-bb1e-cd12b242d12d tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.257734 Aug 24 04:04:00.934902 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2599/5451] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:03:59 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:01.189707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:04:01.190780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:04:01.191943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:04:01.192912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:04:01.193796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:04:01.213948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:01.216333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:01.217378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:01.218710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:01.224758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:01.225887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:01.267056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Getting quotas for project 0dfa4e35f2154b4eb506e4336a3c4f16. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:04:01.293200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Getting quotas for user 5a56bbc01292446d81fbd60f13104da9 and project 0dfa4e35f2154b4eb506e4336a3c4f16. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:04:01.330845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:04:01.347269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:04:01.517853 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4261310-8f37-458d-bd82-b0be5680a936 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.670719 Aug 24 04:04:01.518991 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2853/5452] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 14680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:04:01.543590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-71591868-2dcd-4c16-bbe7-75786703a3f9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:01.543813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-71591868-2dcd-4c16-bbe7-75786703a3f9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:01.722221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71591868-2dcd-4c16-bbe7-75786703a3f9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:01.764915 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-71591868-2dcd-4c16-bbe7-75786703a3f9 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1208 microversion: 2.1 time: 0.233735 Aug 24 04:04:01.771303 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2600/5453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:01 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1208 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:01.961517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:01.962077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:01.974576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:01.975086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:01.975531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:01.988269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:01.988867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:01.989333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:02.809324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:02.810048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:02.819999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:02.820732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:02.821351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:02.822118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:02.822971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:02.823986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:02.925215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:02.937265 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d30f8061-7332-49bb-82a1-925673997b09 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1212 microversion: 2.1 time: 0.134750 Aug 24 04:04:02.951702 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2601/5454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:02 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1212 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:03.234207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:03.253202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:03.260996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:03.262957 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2dd2c1ee-359d-47e3-9956-093f6e481ede tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.305691 Aug 24 04:04:03.264195 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2854/5455] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:04:01 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:03.982625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:03.983775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:04.037977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:04.038502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:04.040353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:04.041931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:04.043335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:04.044325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:04.216046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:04.227912 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5709aa21-ea70-444d-a3d6-4a49757587c8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1212 microversion: 2.1 time: 0.253292 Aug 24 04:04:04.229654 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2602/5456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:03 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1212 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:04.307419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:04.308361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:04.324312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:04.324899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:04.325440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:04.326271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:04.326794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:04.327362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:04.613553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:04.626291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:04.628364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:04.630073 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44dbf66d-1d0e-481b-b51a-0874b268329c tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.327191 Aug 24 04:04:04.631271 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2855/5457] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:04:04 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:05.250506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:05.252226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:05.275112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:05.275112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:05.275586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:05.276153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:05.276634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:05.277064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:05.485161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:05.508276 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9fe54d64-e8fc-4d29-ad28-f3956d92cfbe tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1204 microversion: 2.1 time: 0.260843 Aug 24 04:04:05.514016 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2603/5458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:05 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1204 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:05.663015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:05.664136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:05.679051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:05.685683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:05.688095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:05.688981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:05.690645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:05.691534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:06.073231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:06.085138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:06.087732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:06.089913 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44b91641-404d-4a70-ae68-49443562179a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.431799 Aug 24 04:04:06.091053 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2856/5459] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:04:05 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:06.541177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:06.541806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:06.552134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:06.552671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:06.553420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:06.556137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:06.556965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:06.558919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:06.978696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:06.998153 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0503809e-8b71-44b0-a068-af88066d8ea1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1266 microversion: 2.1 time: 0.468477 Aug 24 04:04:07.005540 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2604/5460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:06 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:07.138049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:07.147107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:07.161537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:07.164544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:07.165379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:07.174698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:07.176964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:07.177690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:07.955792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:07.975953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:07.982829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:07.988874 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-01159169-23d6-47a1-b0ca-5211b87443a2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.857989 Aug 24 04:04:07.989990 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2857/5461] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:04:07 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:08.025689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:08.026603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:08.035520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:08.036398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:08.037017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:08.038000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:08.038846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:08.039743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:08.186554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:08.215234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef04e3fb-9c45-4e9d-aa46-7ab0125fae3a tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1266 microversion: 2.1 time: 0.196783 Aug 24 04:04:08.216342 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2605/5462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:08 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:08.720398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ba2a20aa-b2c7-41d8-9963-b19f54ee083b req-dce457ca-b171-4a1c-935d-730e9fdde326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d", "name": "network-vif-plugged", "status": "completed", "tag": "2916b737-8e19-4065-b9f3-463597555a67"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:08.757800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ba2a20aa-b2c7-41d8-9963-b19f54ee083b req-dce457ca-b171-4a1c-935d-730e9fdde326 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:08.758503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ba2a20aa-b2c7-41d8-9963-b19f54ee083b req-dce457ca-b171-4a1c-935d-730e9fdde326 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:08.760124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ba2a20aa-b2c7-41d8-9963-b19f54ee083b req-dce457ca-b171-4a1c-935d-730e9fdde326 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:08.797143 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ba2a20aa-b2c7-41d8-9963-b19f54ee083b req-dce457ca-b171-4a1c-935d-730e9fdde326 service nova] Creating event network-vif-plugged:2916b737-8e19-4065-b9f3-463597555a67 for instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d on n-h2-846470-15 Aug 24 04:04:08.816099 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ba2a20aa-b2c7-41d8-9963-b19f54ee083b req-dce457ca-b171-4a1c-935d-730e9fdde326 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100408 Aug 24 04:04:08.818418 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2858/5463] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:04:09.019982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:09.021133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:09.059034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:09.064937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:09.083251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:09.086253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:09.087268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:09.091074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:09.250483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:09.251312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:09.283753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:09.290658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:09.294051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:09.301692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:09.307430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:09.309508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:10.047078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:10.067932 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d92ae4a2-e0fd-4afc-986d-1ef82afa254d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 0.822741 Aug 24 04:04:10.069657 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2859/5464] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:09 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:10.782652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:10.814273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:10.817223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:10.819546 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-95cf39f9-0a7e-438c-ad16-c8e807a010e3 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 1.804980 Aug 24 04:04:10.821995 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2606/5465] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:04:09 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:11.110842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:11.112080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:11.126327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:11.126947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:11.127444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:11.128296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:11.128977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:11.129922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:11.246096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:11.309291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:11.460771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:11.486638 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-156202b6-6583-4103-9b09-cc0e0f5644b0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 0.384151 Aug 24 04:04:11.499973 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2860/5466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:11 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:11.853090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:11.855473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:11.871717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:11.875551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:11.876616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:11.877517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:11.878710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:11.879644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:11.880420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:12.326933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:12.355083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:12.371617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:12.375617 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f10a9c13-8868-4868-8f15-071fc22d311f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.527356 Aug 24 04:04:12.391765 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2607/5467] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:04:11 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:12.511547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:12.512262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:12.541084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:12.541652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:12.542097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:12.542823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:12.543286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:12.543750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:12.603140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-85b1c11c-46cf-44d6-aa7d-a3ce38ee7bad req-8ab4cdef-647c-486a-8891-7d7bbb307efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d9771e-ce61-44f5-bd28-06f7ab597b93", "tag": "e6a6268d-332c-45c2-a5ef-668ac8e9ede9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:12.660513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-85b1c11c-46cf-44d6-aa7d-a3ce38ee7bad req-8ab4cdef-647c-486a-8891-7d7bbb307efd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:12.664423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-85b1c11c-46cf-44d6-aa7d-a3ce38ee7bad req-8ab4cdef-647c-486a-8891-7d7bbb307efd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:12.667112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-85b1c11c-46cf-44d6-aa7d-a3ce38ee7bad req-8ab4cdef-647c-486a-8891-7d7bbb307efd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:12.703748 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-85b1c11c-46cf-44d6-aa7d-a3ce38ee7bad req-8ab4cdef-647c-486a-8891-7d7bbb307efd service nova] Creating event network-changed:e6a6268d-332c-45c2-a5ef-668ac8e9ede9 for instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 on n-h2-846470-15 Aug 24 04:04:12.742688 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-85b1c11c-46cf-44d6-aa7d-a3ce38ee7bad req-8ab4cdef-647c-486a-8891-7d7bbb307efd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143329 Aug 24 04:04:12.751389 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2608/5468] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:04:13.048668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:13.065655 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-83a1e033-9e35-4d50-9f6f-525be45c4611 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 0.559098 Aug 24 04:04:13.068574 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2861/5469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:12 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:13.416478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:13.417431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:13.444856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:13.447940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:13.450750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:13.452228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:13.452895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:13.455251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:14.061272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:14.067639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:14.088662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:14.090251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:14.095644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:14.097849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:14.104448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a184a2d-8055-4048-8d99-aaa80bce3818 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1730 microversion: 2.20 time: 0.699476 Aug 24 04:04:14.107632 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2609/5470] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:04:13 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1730 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:14.125799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:14.128825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:14.129419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:14.132452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:14.134599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:14.137850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:14.570819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:14.587315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f75431b-3e60-4488-8421-f8ff7e11d96c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 0.503026 Aug 24 04:04:14.590348 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2862/5471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:14 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:15.137648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:15.139530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:15.170524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:15.171768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:15.180833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:15.184362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:15.186381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:15.188058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:15.620956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:15.623792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:15.646349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:15.650301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:15.651642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:15.653505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:15.655036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:15.656065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:15.917048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:15.962808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:16.000017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:16.000017 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69fb39dc-e45c-4736-bf36-d295f56602c2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1717 microversion: 2.20 time: 0.867150 Aug 24 04:04:16.003030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2610/5472] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:04:15 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1717 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:04:16.391523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:16.391523 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e09fc1aa-5716-4a8e-95cb-f4c3ed6ddad8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 0.765925 Aug 24 04:04:16.391523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2863/5473] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:15 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:04:17.402516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:17.403647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:17.438161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:17.455758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:17.463076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:17.464184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:17.465970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:17.467445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:17.469458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:18.709300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:18.743409 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-005b3112-05d2-474d-9629-a7747d4ad15f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 1.347702 Aug 24 04:04:18.767487 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2611/5474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:17 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:19.780568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:19.781430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:19.797562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:19.805274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:19.805920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:19.806750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:19.807236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:19.807690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:21.346140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:21.378827 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0274f28-e741-4e28-9ec5-7f350d4ce87e tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 1.604078 Aug 24 04:04:21.379996 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2864/5475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:19 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:22.424852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:22.427956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:22.443246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:22.450849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:22.452442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:22.453497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:22.454259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:22.457377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:22.909572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:22.955558 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-234051e1-2f62-409d-8beb-685ae51b3bf4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 0.526662 Aug 24 04:04:22.969351 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2612/5476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:22 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:23.994771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:23.996985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:24.012850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:24.015417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:24.019415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:24.020458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:24.021176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:24.021822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:24.053028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-960954d1-fc94-4fc0-a2bc-037971dc792b req-dd881295-41ce-451f-a9d6-b4835f34cfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d9771e-ce61-44f5-bd28-06f7ab597b93", "name": "network-vif-plugged", "status": "completed", "tag": "e6a6268d-332c-45c2-a5ef-668ac8e9ede9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:24.078106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-960954d1-fc94-4fc0-a2bc-037971dc792b req-dd881295-41ce-451f-a9d6-b4835f34cfe5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:24.082228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-960954d1-fc94-4fc0-a2bc-037971dc792b req-dd881295-41ce-451f-a9d6-b4835f34cfe5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:24.085755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-960954d1-fc94-4fc0-a2bc-037971dc792b req-dd881295-41ce-451f-a9d6-b4835f34cfe5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:24.131367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-960954d1-fc94-4fc0-a2bc-037971dc792b req-dd881295-41ce-451f-a9d6-b4835f34cfe5 service nova] Creating event network-vif-plugged:e6a6268d-332c-45c2-a5ef-668ac8e9ede9 for instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 on n-h2-846470-15 Aug 24 04:04:24.164467 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-960954d1-fc94-4fc0-a2bc-037971dc792b req-dd881295-41ce-451f-a9d6-b4835f34cfe5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114345 Aug 24 04:04:24.172369 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2613/5477] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:04:25.063363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:25.102239 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bdef7da-5ba0-4338-83ca-be76cad9e727 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 1.110269 Aug 24 04:04:25.125143 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2865/5478] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:23 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:26.137770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:26.139955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:26.178689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:26.179394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:26.179899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:26.180698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:26.181492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:26.182140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:26.811176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:26.826919 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a29b0b03-44c2-4c3f-b410-575cf43b6a73 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1308 microversion: 2.1 time: 0.697061 Aug 24 04:04:26.844610 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2614/5479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:26 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1308 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:27.861668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:27.862466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:27.879597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:27.883573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:27.885365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:27.886713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:27.889755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:27.891979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:27.893534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:27.967809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=71 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:28.294753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:28.313797 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ef25b9e-ac5f-4c5f-ab9f-2ebe686ec835 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1488 microversion: 2.1 time: 0.459255 Aug 24 04:04:28.321936 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2866/5480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:27 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1488 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:28.342568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-342572762"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:28.345326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:28.368917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:28.373175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:28.373991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:28.374866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:28.376185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:28.376746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:28.804372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d927f34-06a8-4588-8795-7cae123b8771", "device": "/dev/sdb"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:28.819576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:28.846224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:28.848340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:28.848868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:28.853622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:28.856087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:28.858243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:28.866870 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a9a2123b-9974-485b-8a56-51453a4913c3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "POST /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93/action" status: 202 len: 0 microversion: 2.1 time: 0.528317 Aug 24 04:04:28.872321 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2615/5481] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:04:28 2022] POST /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 04:04:28.884283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a62c4696-dfc2-4980-8474-97ca63672fc0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a08edc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:29.032221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a62c4696-dfc2-4980-8474-97ca63672fc0 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47" status: 200 len: 1413 microversion: 2.1 time: 0.152734 Aug 24 04:04:29.040190 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2616/5482] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:04:28 2022] GET /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47 => generated 1413 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:29.078541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f0c7c646-62ae-438f-8cda-fd8bf01f3db4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1029da14c0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:29.187435 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f0c7c646-62ae-438f-8cda-fd8bf01f3db4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47" status: 200 len: 1413 microversion: 2.1 time: 0.138205 Aug 24 04:04:29.191483 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2617/5483] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:04:29 2022] GET /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47 => generated 1413 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:04:29.208702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67bde3c7-0ba7-44cb-91e1-2ab4bc6418ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a08e8b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:29.553812 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67bde3c7-0ba7-44cb-91e1-2ab4bc6418ad tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47" status: 204 len: 0 microversion: 2.1 time: 0.350160 Aug 24 04:04:29.556494 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2618/5484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:29 2022] DELETE /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:04:29.571553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37ffdc42-b343-46ae-a13e-ab988bd5cc52 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f1029da11f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:29.608415 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86a7f45f-cfba-4315-809c-9997b570c452 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "POST /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811707 Aug 24 04:04:29.613067 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-37ffdc42-b343-46ae-a13e-ab988bd5cc52 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Image not found. Aug 24 04:04:29.613391 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2867/5485] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:04:28 2022] POST /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37ffdc42-b343-46ae-a13e-ab988bd5cc52 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47 HTTP/1.1 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '396b1634-a184-4f95-87a2-b53d94a84c47'} Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 396b1634-a184-4f95-87a2-b53d94a84c47 Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 04:04:29.644684 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 396b1634-a184-4f95-87a2-b53d94a84c47 could not be found. Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37ffdc42-b343-46ae-a13e-ab988bd5cc52 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37ffdc42-b343-46ae-a13e-ab988bd5cc52 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47" status: 404 len: 62 microversion: 2.1 time: 0.082501 Aug 24 04:04:29.649780 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2619/5486] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 04:04:29 2022] GET /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:04:29.661050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:29.661270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:29.679184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:29.682909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:29.683576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:29.684433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:29.684925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:29.689655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:30.184633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:30.233065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9da61499-458d-4d4c-a9dd-2de308c98c84 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1500 microversion: 2.1 time: 0.578223 Aug 24 04:04:30.234733 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2868/5487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:29 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1500 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:31.284019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:31.286741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:31.318826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:31.319386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:31.320049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:31.320945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:31.321426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:31.321861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:31.743546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:31.765294 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-66092af9-b8b4-4c96-a6a2-99f05facdb8d tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1500 microversion: 2.1 time: 0.483292 Aug 24 04:04:31.766395 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2620/5488] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:31 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1500 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:32.799296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:32.800806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:32.821713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:32.823986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:32.825893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:32.826894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:32.828908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:32.829846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:33.195062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:33.209180 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb1e8c03-1c24-4824-842d-0750c9f8a661 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1506 microversion: 2.1 time: 0.421468 Aug 24 04:04:33.210146 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2869/5489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:32 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:34.173230 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:04:34.174184 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:04:34.236605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:34.237225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:34.253711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:34.254605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:34.256527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:34.259634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:34.262116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:34.262856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:34.534937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:34.552136 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-96119c9c-e1c2-49b4-b317-16007917ac18 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1506 microversion: 2.1 time: 0.318302 Aug 24 04:04:34.553924 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2621/5490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:34 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:34.661143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1c06cba5-308d-40d5-a04b-0908a797d254 req-c661be05-fffd-4d99-89e3-3f7c2f14db8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d9771e-ce61-44f5-bd28-06f7ab597b93", "name": "network-vif-plugged", "status": "completed", "tag": "e6a6268d-332c-45c2-a5ef-668ac8e9ede9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:34.706954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1c06cba5-308d-40d5-a04b-0908a797d254 req-c661be05-fffd-4d99-89e3-3f7c2f14db8b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:34.708373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1c06cba5-308d-40d5-a04b-0908a797d254 req-c661be05-fffd-4d99-89e3-3f7c2f14db8b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:34.710091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1c06cba5-308d-40d5-a04b-0908a797d254 req-c661be05-fffd-4d99-89e3-3f7c2f14db8b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:34.732757 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1c06cba5-308d-40d5-a04b-0908a797d254 req-c661be05-fffd-4d99-89e3-3f7c2f14db8b service nova] Creating event network-vif-plugged:e6a6268d-332c-45c2-a5ef-668ac8e9ede9 for instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 on n-h2-846470-15 Aug 24 04:04:34.743114 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1c06cba5-308d-40d5-a04b-0908a797d254 req-c661be05-fffd-4d99-89e3-3f7c2f14db8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085686 Aug 24 04:04:34.745319 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2870/5491] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:04:35.576403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:35.578940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:35.592108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:35.593440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:35.594445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:35.595923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:35.597392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:35.599730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:36.016896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:36.042389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-966bb91c-96f2-4223-84de-9a56fb1d08a7 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1506 microversion: 2.1 time: 0.470252 Aug 24 04:04:36.048684 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2622/5492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:35 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:37.078526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:37.096104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:37.108037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:37.109238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:37.110194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:37.111839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:37.112839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:37.113781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:37.478308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:37.497031 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be876842-077c-4c00-83a5-80978bbcaea8 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1506 microversion: 2.1 time: 0.422453 Aug 24 04:04:37.498280 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2871/5493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:37 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:38.533949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:38.534732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:38.543089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:38.544006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:38.544735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:38.545768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:38.546751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:38.547491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:38.877796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:38.895866 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b69bdd1d-25d3-400b-856e-7700fab072e2 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1488 microversion: 2.1 time: 0.365291 Aug 24 04:04:38.897145 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2623/5494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:38 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1488 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:38.919176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:38.920389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:38.934495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:38.935168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:38.935897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:38.936778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:38.937506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:38.938083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:38.977011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:04:39.185170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-844382e1-4a74-456f-a6cb-f38f343ac98f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 204 len: 0 microversion: 2.1 time: 0.271265 Aug 24 04:04:39.190997 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2872/5495] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:04:38 2022] DELETE /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:04:39.207217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f47cdfbb-869a-4cad-b03a-74a092962537 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a6be790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:39.285194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f47cdfbb-869a-4cad-b03a-74a092962537 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Image not found. Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f47cdfbb-869a-4cad-b03a-74a092962537 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47 HTTP/1.1 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '396b1634-a184-4f95-87a2-b53d94a84c47'} Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 396b1634-a184-4f95-87a2-b53d94a84c47 to delete Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 396b1634-a184-4f95-87a2-b53d94a84c47 could not be found. Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:39.287079 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:04:39.292930 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:39.295618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f47cdfbb-869a-4cad-b03a-74a092962537 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:39.296995 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f47cdfbb-869a-4cad-b03a-74a092962537 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47" status: 404 len: 62 microversion: 2.1 time: 0.095730 Aug 24 04:04:39.298013 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2624/5496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:39 2022] DELETE /compute/v2.1/images/396b1634-a184-4f95-87a2-b53d94a84c47 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 04:04:39.313229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:39.313892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:39.323188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:39.324152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:39.324880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:39.325722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:39.326410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:39.327114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:39.393541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:04:39.509154 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.compute.api [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Instance is already in deleting state, ignoring this request Aug 24 04:04:39.510637 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e8afb2f8-687c-4d11-bcd9-dc90b7210bc1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 204 len: 0 microversion: 2.1 time: 0.204092 Aug 24 04:04:39.511552 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2873/5497] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:04:39 2022] DELETE /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:04:39.552459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:39.556930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:39.571522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:39.572990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:39.572990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:39.576845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:39.577368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:39.577948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:39.832069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:39.858655 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d8e807fb-d454-47fd-aacb-fcd14fc5b8de tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1494 microversion: 2.1 time: 0.332160 Aug 24 04:04:39.867602 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2625/5498] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:39 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1494 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:40.664883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-22cc07ae-ba83-436f-b7fe-ef6e4558079c req-5c295d2d-3a13-4de5-80e9-2ecb11740c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d9771e-ce61-44f5-bd28-06f7ab597b93", "name": "network-vif-unplugged", "status": "completed", "tag": "e6a6268d-332c-45c2-a5ef-668ac8e9ede9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:40.680465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-22cc07ae-ba83-436f-b7fe-ef6e4558079c req-5c295d2d-3a13-4de5-80e9-2ecb11740c6e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:40.680975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-22cc07ae-ba83-436f-b7fe-ef6e4558079c req-5c295d2d-3a13-4de5-80e9-2ecb11740c6e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:40.681526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-22cc07ae-ba83-436f-b7fe-ef6e4558079c req-5c295d2d-3a13-4de5-80e9-2ecb11740c6e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:40.699981 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-22cc07ae-ba83-436f-b7fe-ef6e4558079c req-5c295d2d-3a13-4de5-80e9-2ecb11740c6e service nova] Creating event network-vif-unplugged:e6a6268d-332c-45c2-a5ef-668ac8e9ede9 for instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 on n-h2-846470-15 Aug 24 04:04:40.707511 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-22cc07ae-ba83-436f-b7fe-ef6e4558079c req-5c295d2d-3a13-4de5-80e9-2ecb11740c6e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057025 Aug 24 04:04:40.708840 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2874/5499] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:04:40.893339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:40.894495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:40.940213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:40.946556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:40.951720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:40.952738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:40.953271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:40.955517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:41.658509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:41.711156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-751692a8-de2e-4837-bd13-e05bff5ea5e6 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1494 microversion: 2.1 time: 0.823838 Aug 24 04:04:41.712340 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2626/5500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:40 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1494 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:42.737383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:42.738668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:42.750322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:42.751194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:42.752293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:42.753527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:42.754167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:42.754758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:43.368529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a56bbc01292446d81fbd60f13104da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfa4e35f2154b4eb506e4336a3c4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:43.388353 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5569801-a43a-4cd0-b23e-4eae826e36b4 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 200 len: 1452 microversion: 2.1 time: 0.653655 Aug 24 04:04:43.408986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-afd32062-35da-44eb-95a9-93a03b2dadf8 req-29c32baa-b1e2-441f-b2fa-75bdb02c7958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d9771e-ce61-44f5-bd28-06f7ab597b93", "name": "network-vif-deleted", "tag": "e6a6268d-332c-45c2-a5ef-668ac8e9ede9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:43.439334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afd32062-35da-44eb-95a9-93a03b2dadf8 req-29c32baa-b1e2-441f-b2fa-75bdb02c7958 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:43.440759 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2875/5501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:42 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 1452 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:43.441138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afd32062-35da-44eb-95a9-93a03b2dadf8 req-29c32baa-b1e2-441f-b2fa-75bdb02c7958 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:43.442257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afd32062-35da-44eb-95a9-93a03b2dadf8 req-29c32baa-b1e2-441f-b2fa-75bdb02c7958 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:43.481414 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-afd32062-35da-44eb-95a9-93a03b2dadf8 req-29c32baa-b1e2-441f-b2fa-75bdb02c7958 service nova] Creating event network-vif-deleted:e6a6268d-332c-45c2-a5ef-668ac8e9ede9 for instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 on n-h2-846470-15 Aug 24 04:04:43.521448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-afd32062-35da-44eb-95a9-93a03b2dadf8 req-29c32baa-b1e2-441f-b2fa-75bdb02c7958 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118117 Aug 24 04:04:43.530103 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2627/5502] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:04:44.434048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:44.435114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 10d9771e-ce61-44f5-bd28-06f7ab597b93] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:44.464575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.465716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.466445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.470044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.470845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.471570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.516296 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 could not be found. Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 HTTP/1.1 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 could not be found. Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '10d9771e-ce61-44f5-bd28-06f7ab597b93'} Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 could not be found. Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 could not be found. Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.524823 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.530081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.530081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.530081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:44.530081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:44.530081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 could not be found. Aug 24 04:04:44.530081 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.530081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Instance 10d9771e-ce61-44f5-bd28-06f7ab597b93 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:44.530603 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0914a2fb-feeb-4bad-9994-a7a42743e449 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93" status: 404 len: 111 microversion: 2.1 time: 0.105941 Aug 24 04:04:44.536105 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2876/5503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:44 2022] GET /compute/v2.1/servers/10d9771e-ce61-44f5-bd28-06f7ab597b93 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:04:44.543254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3112d099-30f8-44a9-8d42-2985f40be146 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102a6f0160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:44.576491 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3112d099-30f8-44a9-8d42-2985f40be146 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Image not found. Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3112d099-30f8-44a9-8d42-2985f40be146 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded HTTP/1.1 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded'} Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded to delete Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded could not be found. Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.578572 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3112d099-30f8-44a9-8d42-2985f40be146 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3112d099-30f8-44a9-8d42-2985f40be146 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded" status: 404 len: 62 microversion: 2.1 time: 0.044287 Aug 24 04:04:44.583755 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2628/5504] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:44 2022] DELETE /compute/v2.1/images/7f89fdbf-69f8-4a66-8aa8-5ad2f6259ded => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:04:44.593243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:44.593756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:44.602888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.603394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.604006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.604862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.605400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.605843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.626367 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 HTTP/1.1 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'cb47c2cb-c09d-4985-a5e5-0982540f9295'} Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:44.628462 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.634227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:44.637202 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d6843f4e-7b66-4577-a256-f6eccd96c473 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 404 len: 111 microversion: 2.1 time: 0.047242 Aug 24 04:04:44.638953 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2877/5505] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:04:44 2022] DELETE /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:04:44.656356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:44.658973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: cb47c2cb-c09d-4985-a5e5-0982540f9295] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:44.671789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.672874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.673623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.674752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.675624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.676211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.715140 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 HTTP/1.1 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'cb47c2cb-c09d-4985-a5e5-0982540f9295'} Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.718071 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.723749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.723749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.723749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:44.723749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:44.723749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. Aug 24 04:04:44.723749 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.725610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Instance cb47c2cb-c09d-4985-a5e5-0982540f9295 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:44.727567 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-213fbc2d-f5cb-408f-aa79-beb231802c5c tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295" status: 404 len: 111 microversion: 2.1 time: 0.083447 Aug 24 04:04:44.728868 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2629/5506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:44 2022] GET /compute/v2.1/servers/cb47c2cb-c09d-4985-a5e5-0982540f9295 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:04:44.742224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a987e48-ca27-49e9-874a-0605fee9b6cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f102273d5e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:44.778770 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-7a987e48-ca27-49e9-874a-0605fee9b6cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Image not found. Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a987e48-ca27-49e9-874a-0605fee9b6cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 HTTP/1.1 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: exception: Image not found. Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '10078c82-a549-42fe-b3d7-483d9aabac30'} Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 10078c82-a549-42fe-b3d7-483d9aabac30 to delete Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 10078c82-a549-42fe-b3d7-483d9aabac30 could not be found. Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.780622 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a987e48-ca27-49e9-874a-0605fee9b6cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Image not found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a987e48-ca27-49e9-874a-0605fee9b6cc tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30" status: 404 len: 62 microversion: 2.1 time: 0.047174 Aug 24 04:04:44.786130 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2878/5507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:44 2022] DELETE /compute/v2.1/images/10078c82-a549-42fe-b3d7-483d9aabac30 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:04:44.796483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:44.797569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:44.839183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.840835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.841408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.842527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.843798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.844458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.887853 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d HTTP/1.1 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '9fc588d8-05ad-4497-b035-04613b1bc49d'} Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:44.889879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a9ce9dc-b098-4270-a6df-e7af5ec90479 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 404 len: 111 microversion: 2.1 time: 0.101955 Aug 24 04:04:44.897057 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2630/5508] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:04:44 2022] DELETE /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:04:44.907288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:44.908680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: 9fc588d8-05ad-4497-b035-04613b1bc49d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:44.921079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.922206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.922794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.923916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:44.924833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:44.926473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:44.964355 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d HTTP/1.1 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9fc588d8-05ad-4497-b035-04613b1bc49d'} Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.966651 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:44.973580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:44.973580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:44.973580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:44.973580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:44.973580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. Aug 24 04:04:44.973580 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:44.973580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Instance 9fc588d8-05ad-4497-b035-04613b1bc49d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:44.975476 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-450171b8-1f7d-4fab-8705-d27fe62b99f1 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d" status: 404 len: 111 microversion: 2.1 time: 0.071861 Aug 24 04:04:44.976077 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2879/5509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:44 2022] GET /compute/v2.1/servers/9fc588d8-05ad-4497-b035-04613b1bc49d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:04:44.993212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3349055c-0e52-49e4-998e-3465ab10da40 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '.version_select at 0x7f103044a280>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:45.035553 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3349055c-0e52-49e4-998e-3465ab10da40 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Image not found. Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3349055c-0e52-49e4-998e-3465ab10da40 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 HTTP/1.1 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '7e6ce7fe-1104-4a6d-978a-dca48a803e67'} Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7e6ce7fe-1104-4a6d-978a-dca48a803e67 to delete Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e6ce7fe-1104-4a6d-978a-dca48a803e67 could not be found. Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.038681 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3349055c-0e52-49e4-998e-3465ab10da40 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3349055c-0e52-49e4-998e-3465ab10da40 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67" status: 404 len: 62 microversion: 2.1 time: 0.058008 Aug 24 04:04:45.043440 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2631/5510] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:44 2022] DELETE /compute/v2.1/images/7e6ce7fe-1104-4a6d-978a-dca48a803e67 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:04:45.061084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:45.061906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:45.081247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:45.084642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:45.090465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:45.091815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:45.092746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:45.093644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:45.132414 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 HTTP/1.1 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd27ee3d0-37d5-4d50-afcf-192e3bcf34f5'} Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:45.137590 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-52516d56-16ef-4948-80ec-4f34f2901d2f tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 404 len: 111 microversion: 2.1 time: 0.091209 Aug 24 04:04:45.142964 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2880/5511] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:04:45 2022] DELETE /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:04:45.159271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:45.160788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] [instance: d27ee3d0-37d5-4d50-afcf-192e3bcf34f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:45.176188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:45.177062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:45.177922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:45.178981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:45.180397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:45.181157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:45.220537 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] HTTP exception thrown: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Request method failure captured: Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 HTTP/1.1 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaI_-BolFD6vAil7khZ2k4IvLhuKj7PHbbtTw4M31mDMXoZgL6cZzMH8yOeqTrwBbt6m3owGWpHhSqAnZ9ty2XkQ2EPjskXLwMo0QIKT4Scs_s1E4o0WN1Hv3ycrIJnxct_oHMZLxMBkexpN53LGR_tt0K0oMBldOe30ICFt6TQKLkg Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0dfa4e35f2154b4eb506e4336a3c4f16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0dfa4e35f2154b4eb506e4336a3c4f16 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesTestJSON-1289388941 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 5a56bbc01292446d81fbd60f13104da9 Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesTestJSON-1289388941-project Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd27ee3d0-37d5-4d50-afcf-192e3bcf34f5'} Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.224669 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:45.230309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:45.230309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:45.230309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:45.230309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:45.230309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. Aug 24 04:04:45.230309 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:04:45.240623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] Returning 404 to user: Instance d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:45.242858 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ec42770-ecac-41a7-87b2-bb8c9c2ea7d3 tempest-ImagesTestJSON-1289388941 tempest-ImagesTestJSON-1289388941-project] 10.222.0.58 "GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5" status: 404 len: 111 microversion: 2.1 time: 0.094592 Aug 24 04:04:45.267924 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2632/5512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:45 2022] GET /compute/v2.1/servers/d27ee3d0-37d5-4d50-afcf-192e3bcf34f5 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:05:01.254107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:01.264999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:01.799029 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a4e1942-5235-4af9-848f-3a0aae97e5cd tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] 10.222.0.58 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.561939 Aug 24 04:05:01.800883 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2881/5513] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 24 04:05:01 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 565 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 04:05:01.815834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77f10f0d-05eb-40ac-addc-04dbb25c0875 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Calling method '.version_select at 0x7f102a6b5e50>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:01.832596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=29 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:01.835353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:01.890807 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-77f10f0d-05eb-40ac-addc-04dbb25c0875 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] HTTP exception thrown: Image not found. Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77f10f0d-05eb-40ac-addc-04dbb25c0875 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Request method failure captured: Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaNsl8QJd9rZW4cZXUL1JMsApubK76gJpQbW9hfTzOrDDXn8wGAor4sl2hSMNzSKKNrgq-th6hRlc9NAqWaxCEcyUeps7qMsO_Xk9_FJEbCoUp1CPLdoQ9fjjnTeLUSqIzLzQSavKQWo_IztNoad_z8BUqDrh_97A_PHsvrSW6yNZO0 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_949d95e909624034a840189aab0a2add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/949d95e909624034a840189aab0a2add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 985f7551d00946299cb7f169120e50a7 Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '-1'} Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:01.909133 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:05:01.917603 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:01.924209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77f10f0d-05eb-40ac-addc-04dbb25c0875 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:01.924209 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-77f10f0d-05eb-40ac-addc-04dbb25c0875 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] 10.222.0.58 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.113955 Aug 24 04:05:01.928232 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2633/5514] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 24 04:05:01 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:05:01.949889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59a8797e-160f-4868-b886-1174cc05f7b1 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Calling method '.version_select at 0x7f1022db8790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:02.028434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-59a8797e-160f-4868-b886-1174cc05f7b1 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] HTTP exception thrown: Image not found. Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59a8797e-160f-4868-b886-1174cc05f7b1 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Request method failure captured: Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/images/253badcc-bac7-47f0-b062-03654121689j HTTP/1.1 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaNsl8QJd9rZW4cZXUL1JMsApubK76gJpQbW9hfTzOrDDXn8wGAor4sl2hSMNzSKKNrgq-th6hRlc9NAqWaxCEcyUeps7qMsO_Xk9_FJEbCoUp1CPLdoQ9fjjnTeLUSqIzLzQSavKQWo_IztNoad_z8BUqDrh_97A_PHsvrSW6yNZO0 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_949d95e909624034a840189aab0a2add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/949d95e909624034a840189aab0a2add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 985f7551d00946299cb7f169120e50a7 Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: exception: Image not found. Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '253badcc-bac7-47f0-b062-03654121689j'} Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 253badcc-bac7-47f0-b062-03654121689j to delete Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 253badcc-bac7-47f0-b062-03654121689j could not be found. Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.031329 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.036189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59a8797e-160f-4868-b886-1174cc05f7b1 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Returning 404 to user: Image not found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:02.037771 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59a8797e-160f-4868-b886-1174cc05f7b1 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] 10.222.0.58 "DELETE /compute/v2.1/images/253badcc-bac7-47f0-b062-03654121689j" status: 404 len: 62 microversion: 2.1 time: 0.100503 Aug 24 04:05:02.038785 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2882/5515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:01 2022] DELETE /compute/v2.1/images/253badcc-bac7-47f0-b062-03654121689j => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:05:02.049329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d388aab5-3804-4259-99dd-c35564db25a6 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Calling method '.version_select at 0x7f102a6f0160>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:02.458218 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-d388aab5-3804-4259-99dd-c35564db25a6 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] HTTP exception thrown: Image not found. Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d388aab5-3804-4259-99dd-c35564db25a6 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Request method failure captured: Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/images/aa58bdfb-7e75-4f71-86f7-4a34a092214d1 HTTP/1.1 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaNsl8QJd9rZW4cZXUL1JMsApubK76gJpQbW9hfTzOrDDXn8wGAor4sl2hSMNzSKKNrgq-th6hRlc9NAqWaxCEcyUeps7qMsO_Xk9_FJEbCoUp1CPLdoQ9fjjnTeLUSqIzLzQSavKQWo_IztNoad_z8BUqDrh_97A_PHsvrSW6yNZO0 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_949d95e909624034a840189aab0a2add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/949d95e909624034a840189aab0a2add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 985f7551d00946299cb7f169120e50a7 Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'aa58bdfb-7e75-4f71-86f7-4a34a092214d1'} Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aa58bdfb-7e75-4f71-86f7-4a34a092214d1 to delete Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa58bdfb-7e75-4f71-86f7-4a34a092214d1 could not be found. Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.460641 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d388aab5-3804-4259-99dd-c35564db25a6 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d388aab5-3804-4259-99dd-c35564db25a6 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] 10.222.0.58 "DELETE /compute/v2.1/images/aa58bdfb-7e75-4f71-86f7-4a34a092214d1" status: 404 len: 62 microversion: 2.1 time: 0.417634 Aug 24 04:05:02.471022 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2634/5516] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:05:02 2022] DELETE /compute/v2.1/images/aa58bdfb-7e75-4f71-86f7-4a34a092214d1 => generated 62 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:05:02.476228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4926851c-84fc-4b7a-9a02-7bfe84e5c32d tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Calling method '.version_select at 0x7f1021d2e1f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:02.515241 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4926851c-84fc-4b7a-9a02-7bfe84e5c32d tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] HTTP exception thrown: Image not found. Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4926851c-84fc-4b7a-9a02-7bfe84e5c32d tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Request method failure captured: Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/images/tempest-invalid-1378983477 HTTP/1.1 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaNsl8QJd9rZW4cZXUL1JMsApubK76gJpQbW9hfTzOrDDXn8wGAor4sl2hSMNzSKKNrgq-th6hRlc9NAqWaxCEcyUeps7qMsO_Xk9_FJEbCoUp1CPLdoQ9fjjnTeLUSqIzLzQSavKQWo_IztNoad_z8BUqDrh_97A_PHsvrSW6yNZO0 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_949d95e909624034a840189aab0a2add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/949d95e909624034a840189aab0a2add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 985f7551d00946299cb7f169120e50a7 Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: exception: Image not found. Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'tempest-invalid-1378983477'} Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1378983477 to delete Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1378983477 could not be found. Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.524480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4926851c-84fc-4b7a-9a02-7bfe84e5c32d tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Returning 404 to user: Image not found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4926851c-84fc-4b7a-9a02-7bfe84e5c32d tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] 10.222.0.58 "DELETE /compute/v2.1/images/tempest-invalid-1378983477" status: 404 len: 62 microversion: 2.1 time: 0.056942 Aug 24 04:05:02.533270 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2883/5517] 10.222.0.58 () {58 vars in 1206 bytes} [Wed Aug 24 04:05:02 2022] DELETE /compute/v2.1/images/tempest-invalid-1378983477 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:05:02.540332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f398ca5a-3008-4967-83d0-47df1b7fa176 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Calling method '.version_select at 0x7f1029da2430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:02.577147 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f398ca5a-3008-4967-83d0-47df1b7fa176 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] HTTP exception thrown: Image not found. Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f398ca5a-3008-4967-83d0-47df1b7fa176 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Request method failure captured: Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/images/ac25331c-5857-47f1-87df-82b74855165f HTTP/1.1 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaNsl8QJd9rZW4cZXUL1JMsApubK76gJpQbW9hfTzOrDDXn8wGAor4sl2hSMNzSKKNrgq-th6hRlc9NAqWaxCEcyUeps7qMsO_Xk9_FJEbCoUp1CPLdoQ9fjjnTeLUSqIzLzQSavKQWo_IztNoad_z8BUqDrh_97A_PHsvrSW6yNZO0 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_949d95e909624034a840189aab0a2add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/949d95e909624034a840189aab0a2add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/949d95e909624034a840189aab0a2add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 949d95e909624034a840189aab0a2add Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 985f7551d00946299cb7f169120e50a7 Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1540963083-project Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: exception: Image not found. Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'ac25331c-5857-47f1-87df-82b74855165f'} Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac25331c-5857-47f1-87df-82b74855165f to delete Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac25331c-5857-47f1-87df-82b74855165f could not be found. Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.578956 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f398ca5a-3008-4967-83d0-47df1b7fa176 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] Returning 404 to user: Image not found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f398ca5a-3008-4967-83d0-47df1b7fa176 tempest-ImagesDeleteNegativeTestJSON-1540963083 tempest-ImagesDeleteNegativeTestJSON-1540963083-project] 10.222.0.58 "DELETE /compute/v2.1/images/ac25331c-5857-47f1-87df-82b74855165f" status: 404 len: 62 microversion: 2.1 time: 0.048293 Aug 24 04:05:02.590651 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2635/5518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:02 2022] DELETE /compute/v2.1/images/ac25331c-5857-47f1-87df-82b74855165f => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:05:16.516111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:16.517549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:16.565128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:16.565920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:16.566718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:16.569525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:16.570788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:16.571527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:16.870258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lazy-loading 'services' on Instance uuid e1c57722-51bb-47ca-8044-865e060980f8 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:05:17.056583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7021cf41-bb96-4da5-8575-75ae177f2f4a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8/os-volume_attachments/0d927f34-06a8-4588-8795-7cae123b8771" status: 202 len: 0 microversion: 2.1 time: 0.551522 Aug 24 04:05:17.057544 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2884/5519] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:05:16 2022] DELETE /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8/os-volume_attachments/0d927f34-06a8-4588-8795-7cae123b8771 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:05:20.360163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-62f71716-e25f-453b-9806-d6d7f9d32cf8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f1029da2430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1484260482", "description": "tempest-description-1958761958"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:21.236536 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-62f71716-e25f-453b-9806-d6d7f9d32cf8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.232745 Aug 24 04:05:21.238530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2636/5520] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:05:20 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:21.263466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8cdc2df1-dd35-465c-b528-59361697a2af tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f1022e89790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1436734592", "description": "tempest-description-1736356554"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:21.935531 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8cdc2df1-dd35-465c-b528-59361697a2af tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.687715 Aug 24 04:05:21.936474 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2885/5521] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:05:21 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:22.040259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1930024912", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "109a50fb-7ca0-4446-8ec3-9ded435ad919"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:22.247413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] validate_networks() for [('109a50fb-7ca0-4446-8ec3-9ded435ad919', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:05:23.973135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:23.980805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:23.989858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:23.990981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:23.991595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:23.992964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:23.993596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:23.994182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:24.033813 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a7855b1-ce93-4b72-bfca-aa6962032942 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.067717 Aug 24 04:05:24.041804 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2886/5522] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 24 04:05:23 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:24.238977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:24.240263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:24.256329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:24.257315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:24.258022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:24.259261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:24.260330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:24.260959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:24.298450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:05:24.500330 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16bbeac6-3de8-4faf-a015-313e7e9b61ca tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 204 len: 0 microversion: 2.20 time: 0.264943 Aug 24 04:05:24.502896 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2887/5523] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 04:05:24 2022] DELETE /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 04:05:24.525825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:24.530336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:24.548533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:24.551065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:24.553262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:24.555256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:24.558315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:24.559015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:24.932966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:24.960620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:24.964889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:24.971993 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32501728-0f93-4806-b7da-a07459cbbceb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 0.460041 Aug 24 04:05:24.978692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2888/5524] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:05:24 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:05:25.851743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:05:25.853573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:05:25.854827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:05:25.855921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:05:25.856942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:05:25.896256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:25.900633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:25.908371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:25.910350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:25.911318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:25.916359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:26.017297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:26.027773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:26.035556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Getting quotas for project c7652c5998da4f4388a604ac5d94ce51. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:05:26.062757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Getting quotas for user c7a99d0109e6412a9bc78fa3326ea0cc and project c7652c5998da4f4388a604ac5d94ce51. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:05:26.073928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:26.074959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:26.076031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:26.079493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:26.083745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:26.088945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:26.117416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:05:26.132574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:05:26.298844 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ddb55181-8f16-46a2-80f4-5e6ecbaa6b33 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.267511 Aug 24 04:05:26.305660 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2637/5525] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:05:26.323965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87d11f38-c507-4720-9787-83c6b69f6bda tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:26.333241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-87d11f38-c507-4720-9787-83c6b69f6bda tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:26.667512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:26.686371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:26.688560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:26.689923 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c1ef39c-6eae-4076-839f-3eb72a02dbfc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 0.682116 Aug 24 04:05:26.695813 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2889/5526] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:05:26 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:05:26.823532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-87d11f38-c507-4720-9787-83c6b69f6bda tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:26.855789 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87d11f38-c507-4720-9787-83c6b69f6bda tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1216 microversion: 2.1 time: 0.532470 Aug 24 04:05:26.867712 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2638/5527] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:26 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1216 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:27.747080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:27.748352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:27.764372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:27.767400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:27.769013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:27.773793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:27.775785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:27.777157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:27.887796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:27.889756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:27.943170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:27.945801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:27.946858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:27.954881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:27.962128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:27.966949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:28.398434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:28.430988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:28.436532 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-61804d4a-d00e-4f9d-9754-3c357ff0bea0 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1220 microversion: 2.1 time: 0.557002 Aug 24 04:05:28.437402 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2639/5528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:27 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1220 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:05:28.495060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:28.500693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:28.505939 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3fadfe9-58ba-45f2-85dc-fca266894bbb tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1723 microversion: 2.20 time: 0.771736 Aug 24 04:05:28.519776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2890/5529] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:05:27 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1723 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:05:29.032969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:29.034804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:29.055709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.059785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.060719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.063266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.091401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.092382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.139579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:05:29.389885 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-add89792-d00f-42ce-a319-09ccb75a425c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 204 len: 0 microversion: 2.1 time: 0.360803 Aug 24 04:05:29.390333 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2640/5530] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:05:29 2022] DELETE /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:05:29.413405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:29.414050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:29.434028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.434515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.442752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.451337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.451337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.452543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.461351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:29.462355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:29.474807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.480036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.480856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.481483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.481950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.482364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.873572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:29.885418 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2d6ca1cb-5cd9-4d5e-bbce-8f19779b0c3a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1286 microversion: 2.1 time: 0.428857 Aug 24 04:05:29.886728 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2641/5531] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:29 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1286 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:29.922214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:29.923140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:29.937719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.940497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.940860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:29.941759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:29.942279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:29.942815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.207040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:30.234174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:30.243020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:30.253421 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d669df13-ef84-4507-ac6b-e08fba15af34 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1655 microversion: 2.20 time: 0.349693 Aug 24 04:05:30.262720 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2642/5532] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:05:29 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1655 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:05:30.503295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:30.531447 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7f9c91e6-3de5-4fb7-9d40-9d981acb8fa1 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1513 microversion: 2.1 time: 1.135736 Aug 24 04:05:30.532955 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2891/5533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:29 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1513 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:30.910467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-250d312f-af25-45f0-98dc-28cd210d554a req-36b22df7-30a0-4d2b-9a94-8aa605db1d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d", "name": "network-vif-deleted", "tag": "2916b737-8e19-4065-b9f3-463597555a67"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:30.918707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:30.927192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:30.943956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-250d312f-af25-45f0-98dc-28cd210d554a req-36b22df7-30a0-4d2b-9a94-8aa605db1d25 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.948927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-250d312f-af25-45f0-98dc-28cd210d554a req-36b22df7-30a0-4d2b-9a94-8aa605db1d25 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.953456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-250d312f-af25-45f0-98dc-28cd210d554a req-36b22df7-30a0-4d2b-9a94-8aa605db1d25 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.970179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.971586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.972686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.974549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:30.975795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:30.977261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:30.998404 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-250d312f-af25-45f0-98dc-28cd210d554a req-36b22df7-30a0-4d2b-9a94-8aa605db1d25 service nova] Creating event network-vif-deleted:2916b737-8e19-4065-b9f3-463597555a67 for instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d on n-h2-846470-15 Aug 24 04:05:31.041346 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-250d312f-af25-45f0-98dc-28cd210d554a req-36b22df7-30a0-4d2b-9a94-8aa605db1d25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145527 Aug 24 04:05:31.055650 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2643/5534] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:31.309504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:31.313119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:31.341884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:31.344569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:31.345344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:31.349672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:31.350569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:31.351514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:31.447431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:31.447961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:31.451912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:31.452608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lazy-loading 'fault' on Instance uuid 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:05:31.497721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:31.551549 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59d81efb-2456-42bd-88c2-b1544b0c39a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1274 microversion: 2.1 time: 0.644982 Aug 24 04:05:31.552519 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2892/5535] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:30 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1274 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:31.586236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:31.586905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:31.604481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:31.606095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:31.630462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:31.633090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:31.639619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:31.648863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:31.721182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:31.739419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:31.749374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc82859254e34a42902e5b72a6580362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93478ba0a74d2a8c3b7bbae86cbd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:31.751814 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-12f1a265-099b-4cd8-97c0-1abced5e03d2 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 200 len: 1371 microversion: 2.20 time: 0.470066 Aug 24 04:05:31.753581 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2644/5536] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:05:31 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 1371 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:05:32.384543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:32.405992 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df017e50-4089-44b2-92ef-4c461bca5c9a tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1513 microversion: 2.1 time: 0.852390 Aug 24 04:05:32.412295 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2893/5537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:31 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1513 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:32.575777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:32.577310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:32.620975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:32.622931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:32.624813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:32.637744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:32.638312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:32.639337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:32.784593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:32.785855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:32.812623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:32.822202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:32.827152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:32.834544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:32.843005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:32.843758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:32.899603 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] HTTP exception thrown: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Request method failure captured: Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d HTTP/1.1 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaEbMxkhRNv442u5Bjz1vlJnphzL6my461OjZdAZVx-35PKzFyDW43B_SSSJhKVay0CPpdkAqZ0kPxVGn5QOIcuo0krN42dWSgXOEtU2lkBooDSeJW-Ba86YyiHmkB3MwouvCvl0lqD0SUHPVkPzmUhVsXpr0HEykkQgAOcefYbsn64 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: fc82859254e34a42902e5b72a6580362 Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d'} Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:32.904033 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Returning 404 to user: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10fbabab-006f-4c40-acbe-121f7065d33f tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 404 len: 111 microversion: 2.20 time: 0.135762 Aug 24 04:05:32.919151 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2894/5538] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:05:32 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:05:32.934365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1235d4a6-fb7d-4dbc-91f0-99dabfcbee93 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '.version_select at 0x7f102273d5e0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:33.006667 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1235d4a6-fb7d-4dbc-91f0-99dabfcbee93 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483181479" status: 204 len: 0 microversion: 2.20 time: 0.084395 Aug 24 04:05:33.007059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2895/5539] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 24 04:05:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483181479 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 04:05:33.441010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:33.443149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:33.470555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:33.476653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:33.479739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:33.483843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:33.486155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:33.489431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:33.588041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:33.609525 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8f37eedd-0b79-4259-b707-5f91b6439168 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 1.038423 Aug 24 04:05:33.610553 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2645/5540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:32 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:05:33.719415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:33.747000 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-897254dc-f818-4329-87cb-894ca9323201 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 200 len: 1471 microversion: 2.1 time: 0.311960 Aug 24 04:05:33.757947 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2896/5541] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:33 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:33.790798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-96a1833d-3dc6-4b32-a579-9c5892df02be req-32b8383c-4763-4f0a-aa93-b53274481226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c57722-51bb-47ca-8044-865e060980f8", "name": "network-vif-deleted", "tag": "e7eac776-e2c6-4b1f-bb7b-29f677fead49"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:33.838372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-96a1833d-3dc6-4b32-a579-9c5892df02be req-32b8383c-4763-4f0a-aa93-b53274481226 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:33.840683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-96a1833d-3dc6-4b32-a579-9c5892df02be req-32b8383c-4763-4f0a-aa93-b53274481226 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:33.843947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-96a1833d-3dc6-4b32-a579-9c5892df02be req-32b8383c-4763-4f0a-aa93-b53274481226 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:33.889232 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-96a1833d-3dc6-4b32-a579-9c5892df02be req-32b8383c-4763-4f0a-aa93-b53274481226 service nova] Creating event network-vif-deleted:e7eac776-e2c6-4b1f-bb7b-29f677fead49 for instance e1c57722-51bb-47ca-8044-865e060980f8 on n-h1-846470-15 Aug 24 04:05:33.907715 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-96a1833d-3dc6-4b32-a579-9c5892df02be req-32b8383c-4763-4f0a-aa93-b53274481226 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125916 Aug 24 04:05:33.913317 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2646/5542] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:34.642640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:34.644052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:34.660228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:34.662209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:34.664200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:34.667869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:34.672806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:34.673331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:34.787435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:34.789388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: e1c57722-51bb-47ca-8044-865e060980f8] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:34.800635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:34.801672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:34.806866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:34.808709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:34.809764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:34.810268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:34.830900 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] HTTP exception thrown: Instance e1c57722-51bb-47ca-8044-865e060980f8 could not be found. Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Request method failure captured: Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 HTTP/1.1 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaJ9g-kism3zTnoZK_zMGC79VpmTPuxvPoAbTGlYQrSVui_0CMOQtvCpb0n1fVbonRWyRIu2WZAPfKZoECAWvx31RBfMAdwA-XX_EZFqBX8pTUGNcKzVcDGJwqK2LsEpfq2TdzDliaK1J9PVnshavROf9FvecgdNgRqQdc8RDFVKjFo Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 6bc901a671a749b2b6c1b76024f949f4 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1197213825 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6bc901a671a749b2b6c1b76024f949f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6bc901a671a749b2b6c1b76024f949f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6bc901a671a749b2b6c1b76024f949f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6bc901a671a749b2b6c1b76024f949f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesSnapshotTestJSON-1197213825 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 6bc901a671a749b2b6c1b76024f949f4 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1197213825 Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesSnapshotTestJSON-1197213825-project Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 4352e99c3c244ae085a0cd417f8ed32f Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesSnapshotTestJSON-1197213825-project Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e1c57722-51bb-47ca-8044-865e060980f8 could not be found. Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e1c57722-51bb-47ca-8044-865e060980f8'} Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c57722-51bb-47ca-8044-865e060980f8 could not be found. Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c57722-51bb-47ca-8044-865e060980f8 could not be found. Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:34.833752 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:34.839143 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:34.839143 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:34.839143 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:34.839143 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:34.839143 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:34.839143 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c57722-51bb-47ca-8044-865e060980f8 could not be found. Aug 24 04:05:34.839143 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:34.841018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Returning 404 to user: Instance e1c57722-51bb-47ca-8044-865e060980f8 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:34.842403 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a2fa63a7-a2e7-496e-b933-5aa63e3488a5 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8" status: 404 len: 111 microversion: 2.1 time: 0.060003 Aug 24 04:05:34.843466 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2647/5543] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:34 2022] GET /compute/v2.1/servers/e1c57722-51bb-47ca-8044-865e060980f8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:05:35.418713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:35.431923 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af3e246e-8888-4d76-bcac-6991636c8ef6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 0.794295 Aug 24 04:05:35.433481 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2897/5544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:34 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:36.460763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:36.462007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:36.482931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:36.488806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:36.491576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:36.495238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:36.497288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:36.497818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:36.501917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:36.669297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d5433c5d-b56a-4f63-b425-b9b94d3d72d8 req-ec5643f0-7c61-40f6-bd4a-f964ec738ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b906bd-c500-49f5-9e8d-5950a01ab0aa", "tag": "4cd7dcd4-65cb-4e81-8300-90fc8b842f1d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:36.689162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d5433c5d-b56a-4f63-b425-b9b94d3d72d8 req-ec5643f0-7c61-40f6-bd4a-f964ec738ba3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:36.695030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d5433c5d-b56a-4f63-b425-b9b94d3d72d8 req-ec5643f0-7c61-40f6-bd4a-f964ec738ba3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:36.696048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d5433c5d-b56a-4f63-b425-b9b94d3d72d8 req-ec5643f0-7c61-40f6-bd4a-f964ec738ba3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:36.728244 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d5433c5d-b56a-4f63-b425-b9b94d3d72d8 req-ec5643f0-7c61-40f6-bd4a-f964ec738ba3 service nova] Creating event network-changed:4cd7dcd4-65cb-4e81-8300-90fc8b842f1d for instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa on n-h2-846470-15 Aug 24 04:05:36.744251 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d5433c5d-b56a-4f63-b425-b9b94d3d72d8 req-ec5643f0-7c61-40f6-bd4a-f964ec738ba3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090734 Aug 24 04:05:36.758178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2898/5545] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 04:05:36.846861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:37.210791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:37.239084 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aa48cffd-5879-4b6b-8760-29816e02c134 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 0.787097 Aug 24 04:05:37.248062 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2648/5546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:36 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:38.270537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:38.271546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:38.303441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:38.304239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:38.304846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:38.305643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:38.306153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:38.306630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:39.165689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:39.188707 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5bcca28a-a1cc-43ae-9282-20ad4adbb8b3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 0.925517 Aug 24 04:05:39.204367 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2899/5547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:38 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:40.260331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:40.261587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:40.279511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:40.281854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:40.282319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:40.283128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:40.283717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:40.286033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:40.646446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:40.681302 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a27447a-078c-461a-b277-6d092453dac7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 0.465877 Aug 24 04:05:40.710153 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2649/5548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:40 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:41.718779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:41.724912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:41.768424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:41.773868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:41.775837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:41.777720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:41.780805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:41.781743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:42.245268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:42.287152 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-40668030-7b34-4df0-a1d0-9723e3c417a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 0.569113 Aug 24 04:05:42.292656 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2900/5549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:41 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:42.980703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:42.981618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:43.014199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:43.018845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:43.019443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:43.029807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:43.030468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:43.031856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:43.098762 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] HTTP exception thrown: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Request method failure captured: Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d HTTP/1.1 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaEbMxkhRNv442u5Bjz1vlJnphzL6my461OjZdAZVx-35PKzFyDW43B_SSSJhKVay0CPpdkAqZ0kPxVGn5QOIcuo0krN42dWSgXOEtU2lkBooDSeJW-Ba86YyiHmkB3MwouvCvl0lqD0SUHPVkPzmUhVsXpr0HEykkQgAOcefYbsn64 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: fc82859254e34a42902e5b72a6580362 Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d'} Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:05:43.119802 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.129219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Returning 404 to user: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:43.140310 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d38b432-504e-414a-8b16-046bd4d1736a tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 404 len: 111 microversion: 2.20 time: 0.166661 Aug 24 04:05:43.144397 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2650/5550] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 04:05:42 2022] DELETE /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:05:43.152321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:43.153026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:43.188538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:43.189489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:43.190388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:43.191740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:43.192628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:43.196615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:43.238894 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] HTTP exception thrown: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Request method failure captured: Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d HTTP/1.1 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaEbMxkhRNv442u5Bjz1vlJnphzL6my461OjZdAZVx-35PKzFyDW43B_SSSJhKVay0CPpdkAqZ0kPxVGn5QOIcuo0krN42dWSgXOEtU2lkBooDSeJW-Ba86YyiHmkB3MwouvCvl0lqD0SUHPVkPzmUhVsXpr0HEykkQgAOcefYbsn64 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: fc82859254e34a42902e5b72a6580362 Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d'} Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.242216 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:43.250747 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.250747 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:43.250747 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:43.250747 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:43.250747 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:43.250747 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:43.250747 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. Aug 24 04:05:43.250747 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:43.253581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Returning 404 to user: Instance 5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:43.255562 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90ac6350-dc75-43e5-bfa9-da4477aea4bc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d" status: 404 len: 111 microversion: 2.20 time: 0.109033 Aug 24 04:05:43.257504 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2901/5551] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:05:43 2022] GET /compute/v2.1/servers/5b93a915-0e2a-4c20-b9ee-8af5cf8cf31d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:05:43.316776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:43.317418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:43.345755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:43.348706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:43.349257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:43.352521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:43.357793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:43.361446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:44.684749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:44.705982 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e103f279-2f3d-40a0-94d3-6a6545ba8397 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 1.391916 Aug 24 04:05:44.711229 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2651/5552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:43 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:45.757056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:45.758181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:45.815191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:45.827196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:45.830563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:45.831493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:45.832018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:45.838796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:45.922223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:46.415592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:46.430575 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-00cd8fda-97d7-4b7f-a623-a31c3291c6e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 0.687519 Aug 24 04:05:46.439706 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2902/5553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:45 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:47.110356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9aea5808-6a79-42c0-a21d-af6ed1026b9f req-c5b63224-29d0-4058-86f2-2ab56e103f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b906bd-c500-49f5-9e8d-5950a01ab0aa", "name": "network-vif-plugged", "status": "completed", "tag": "4cd7dcd4-65cb-4e81-8300-90fc8b842f1d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:47.136209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9aea5808-6a79-42c0-a21d-af6ed1026b9f req-c5b63224-29d0-4058-86f2-2ab56e103f29 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:47.137138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9aea5808-6a79-42c0-a21d-af6ed1026b9f req-c5b63224-29d0-4058-86f2-2ab56e103f29 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:47.137762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9aea5808-6a79-42c0-a21d-af6ed1026b9f req-c5b63224-29d0-4058-86f2-2ab56e103f29 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:47.172368 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9aea5808-6a79-42c0-a21d-af6ed1026b9f req-c5b63224-29d0-4058-86f2-2ab56e103f29 service nova] Creating event network-vif-plugged:4cd7dcd4-65cb-4e81-8300-90fc8b842f1d for instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa on n-h2-846470-15 Aug 24 04:05:47.184249 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9aea5808-6a79-42c0-a21d-af6ed1026b9f req-c5b63224-29d0-4058-86f2-2ab56e103f29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078208 Aug 24 04:05:47.185133 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2652/5554] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:47.464328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:47.467219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:47.483966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:47.495612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:47.498500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:47.499806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:47.502374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:47.506652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:47.536055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:48.124737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:48.135324 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90bb1278-8173-45ed-8e39-6f0d063ee662 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 0.681238 Aug 24 04:05:48.136731 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2903/5555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:47 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:48.582633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1868126221", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "09be518a-fd78-4ae8-a434-e6f84f0b027a"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:48.674520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] validate_networks() for [('09be518a-fd78-4ae8-a434-e6f84f0b027a', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:05:49.161550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:49.162816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:49.185926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:49.187394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:49.188085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:49.189147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:49.190163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:49.190917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:49.622072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:49.635040 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e6994494-d16d-4068-b5ce-c0b6f225a56a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1316 microversion: 2.1 time: 0.480202 Aug 24 04:05:49.648303 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2904/5556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:49 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:49.991355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:05:49.991989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:05:49.992284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:05:49.992879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:05:49.993631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:05:50.022147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.022641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.023270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:50.024268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.034052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.042329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:50.049887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:50.059631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:50.110055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Getting quotas for project 6bc901a671a749b2b6c1b76024f949f4. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:05:50.123691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Getting quotas for user 4352e99c3c244ae085a0cd417f8ed32f and project 6bc901a671a749b2b6c1b76024f949f4. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:05:50.146177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:05:50.150398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:05:50.230224 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d9127efb-c9a7-4167-84f1-93087da3e18f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653540 Aug 24 04:05:50.231234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2653/5557] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:05:50.245073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68457b29-a445-415e-b4f5-7507ddbf64fd tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:50.245931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-68457b29-a445-415e-b4f5-7507ddbf64fd tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:50.357293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-68457b29-a445-415e-b4f5-7507ddbf64fd tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:50.380425 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-68457b29-a445-415e-b4f5-7507ddbf64fd tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1219 microversion: 2.1 time: 0.140499 Aug 24 04:05:50.384875 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2905/5558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:50 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:50.472229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:50.472735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:50.483703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.484198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.484635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:50.488599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.488599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.489050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:50.522114 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] HTTP exception thrown: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Request method failure captured: Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 HTTP/1.1 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaEbMxkhRNv442u5Bjz1vlJnphzL6my461OjZdAZVx-35PKzFyDW43B_SSSJhKVay0CPpdkAqZ0kPxVGn5QOIcuo0krN42dWSgXOEtU2lkBooDSeJW-Ba86YyiHmkB3MwouvCvl0lqD0SUHPVkPzmUhVsXpr0HEykkQgAOcefYbsn64 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: fc82859254e34a42902e5b72a6580362 Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'ebaceb98-646f-4cc9-b6d0-564c697b2537'} Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:05:50.531705 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.536670 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.540803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Returning 404 to user: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:50.540803 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cf91d1b6-3a31-4d48-b1c3-35a87ace5aa5 tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 404 len: 111 microversion: 2.20 time: 0.072813 Aug 24 04:05:50.541843 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2654/5559] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 04:05:50 2022] DELETE /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:05:50.552991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:50.553898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] [instance: ebaceb98-646f-4cc9-b6d0-564c697b2537] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:50.563100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.567105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.567869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:50.568440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.569074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.569833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:50.608269 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] HTTP exception thrown: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Request method failure captured: Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 HTTP/1.1 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaEbMxkhRNv442u5Bjz1vlJnphzL6my461OjZdAZVx-35PKzFyDW43B_SSSJhKVay0CPpdkAqZ0kPxVGn5QOIcuo0krN42dWSgXOEtU2lkBooDSeJW-Ba86YyiHmkB3MwouvCvl0lqD0SUHPVkPzmUhVsXpr0HEykkQgAOcefYbsn64 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf93478ba0a74d2a8c3b7bbae86cbd69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: bf93478ba0a74d2a8c3b7bbae86cbd69 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-426740268 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: fc82859254e34a42902e5b72a6580362 Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-426740268-project Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'ebaceb98-646f-4cc9-b6d0-564c697b2537'} Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.610534 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:05:50.614548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] Returning 404 to user: Instance ebaceb98-646f-4cc9-b6d0-564c697b2537 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:05:50.615131 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-62c9e868-2a86-465d-86c2-00a1b14839fc tempest-AttachVolumeShelveTestJSON-426740268 tempest-AttachVolumeShelveTestJSON-426740268-project] 10.222.0.58 "GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537" status: 404 len: 111 microversion: 2.20 time: 0.063413 Aug 24 04:05:50.619458 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2906/5560] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:05:50 2022] GET /compute/v2.1/servers/ebaceb98-646f-4cc9-b6d0-564c697b2537 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 04:05:50.659406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:50.662143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:50.671297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.675039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.681308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:50.684066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:50.685103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:50.685813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:51.030828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:51.053143 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a490b7ba-d060-42f7-8ff0-15aaad91c548 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1505 microversion: 2.1 time: 0.401983 Aug 24 04:05:51.054368 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2655/5561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:50 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:51.089272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1484260482"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:51.089825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:51.110822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:51.124686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:51.126149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:51.127107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:51.128817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:51.130902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:51.406233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:51.406956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:51.415491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:51.418953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:51.424665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:51.425742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:51.426410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:51.426844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:51.582360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:51.593389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3bb52d5d-14e1-4762-ab68-c600c1c4edad tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1223 microversion: 2.1 time: 0.191017 Aug 24 04:05:51.601614 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2656/5562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:51 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1223 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:51.982243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.network.security_group_api [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Adding security group ea7b2993-74e2-43e2-a92a-b7f207e753e2 to port 4cd7dcd4-65cb-4e81-8300-90fc8b842f1d Aug 24 04:05:52.653169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:52.659283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:52.681013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:52.681536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:52.681988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:52.683080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:52.688031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:52.688693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:52.921688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:52.941408 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cd53deaf-2f9a-400f-9963-fd81821da1d2 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1289 microversion: 2.1 time: 0.305548 Aug 24 04:05:52.945054 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2657/5563] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:52 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1289 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:05:53.317819 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d1367d8b-f212-4434-9b18-084f4996229d tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa/action" status: 202 len: 0 microversion: 2.1 time: 2.241804 Aug 24 04:05:53.320532 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2907/5564] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:05:51 2022] POST /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa/action => generated 0 bytes in 2245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:05:53.340862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1436734592"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:53.343422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:53.378660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:53.384346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:53.387771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:53.396222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:53.398464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:53.399585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:53.717383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2fe9bd56-96ee-4905-803b-02c4036c3182 req-7b55ac56-e551-4aac-9a1b-1d5fc42e1440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b906bd-c500-49f5-9e8d-5950a01ab0aa", "tag": "4cd7dcd4-65cb-4e81-8300-90fc8b842f1d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:53.758032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2fe9bd56-96ee-4905-803b-02c4036c3182 req-7b55ac56-e551-4aac-9a1b-1d5fc42e1440 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:53.758843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2fe9bd56-96ee-4905-803b-02c4036c3182 req-7b55ac56-e551-4aac-9a1b-1d5fc42e1440 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:53.763890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2fe9bd56-96ee-4905-803b-02c4036c3182 req-7b55ac56-e551-4aac-9a1b-1d5fc42e1440 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:53.798838 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2fe9bd56-96ee-4905-803b-02c4036c3182 req-7b55ac56-e551-4aac-9a1b-1d5fc42e1440 service nova] Creating event network-changed:4cd7dcd4-65cb-4e81-8300-90fc8b842f1d for instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa on n-h2-846470-15 Aug 24 04:05:53.814521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2fe9bd56-96ee-4905-803b-02c4036c3182 req-7b55ac56-e551-4aac-9a1b-1d5fc42e1440 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.474194 Aug 24 04:05:53.816952 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2908/5565] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:05:53.972259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:53.974908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:53.996999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:53.998647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:54.000197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:54.002759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:54.004552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:54.007831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:54.078198 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.network.security_group_api [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Adding security group 5d91909a-41e6-4892-bedc-7150909a7dc5 to port 4cd7dcd4-65cb-4e81-8300-90fc8b842f1d Aug 24 04:05:54.327833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:54.352266 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d466610b-d9d8-4057-abeb-91a8f627d172 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1277 microversion: 2.1 time: 0.382257 Aug 24 04:05:54.353701 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2909/5566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:53 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1277 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:55.386921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:55.388378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:55.399369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:55.412049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:55.412796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:55.413808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:55.414780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:55.415321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:55.739701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:55.756561 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-06fae82b-5cef-408b-a6f9-fa69739c3209 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 0.373511 Aug 24 04:05:55.765000 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2910/5567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:55 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:56.780233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:56.784633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:56.802913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:56.805064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:56.807229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:56.809659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:56.810332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:56.812208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:57.057842 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ce828608-6a7a-4169-a46e-9a20b556768e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa/action" status: 202 len: 0 microversion: 2.1 time: 3.731882 Aug 24 04:05:57.062332 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2658/5568] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:05:53 2022] POST /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa/action => generated 0 bytes in 3738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:05:57.068889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:57.069503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:57.087979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:57.089943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:57.091700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:57.092710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:57.097196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:57.097719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:57.334180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:57.366132 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fcd4b3bc-4a03-410a-aef3-158d36d3e08c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 0.590451 Aug 24 04:05:57.382943 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2911/5569] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:56 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:57.410595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ed25db8f-b134-461b-bcd0-75c9c930a2a5 req-46098c02-cb44-4cab-9daa-6b508a3b19e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b906bd-c500-49f5-9e8d-5950a01ab0aa", "tag": "4cd7dcd4-65cb-4e81-8300-90fc8b842f1d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:57.455453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ed25db8f-b134-461b-bcd0-75c9c930a2a5 req-46098c02-cb44-4cab-9daa-6b508a3b19e7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:57.456582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ed25db8f-b134-461b-bcd0-75c9c930a2a5 req-46098c02-cb44-4cab-9daa-6b508a3b19e7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:57.457560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ed25db8f-b134-461b-bcd0-75c9c930a2a5 req-46098c02-cb44-4cab-9daa-6b508a3b19e7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:57.500389 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ed25db8f-b134-461b-bcd0-75c9c930a2a5 req-46098c02-cb44-4cab-9daa-6b508a3b19e7 service nova] Creating event network-changed:4cd7dcd4-65cb-4e81-8300-90fc8b842f1d for instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa on n-h2-846470-15 Aug 24 04:05:57.524426 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ed25db8f-b134-461b-bcd0-75c9c930a2a5 req-46098c02-cb44-4cab-9daa-6b508a3b19e7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138539 Aug 24 04:05:57.525491 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2912/5570] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:58.100231 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-99c78c7c-49c3-45c7-ad29-860b18982326 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 1.036332 Aug 24 04:05:58.101145 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2659/5571] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 24 04:05:57 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa/os-security-groups => generated 1159 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:05:58.131226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47d149b7-ecf5-4ff4-87a1-84c39aedfbe2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f1022dbd1f0>, body: {"security_group": {"name": " tempest-securitygroup -1626302849 ", "description": "tempest-description-152029877"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:05:58.410883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:05:58.412126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:05:58.423015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:58.429759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:58.430706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:58.434224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:05:58.436936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:05:58.442986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:05:58.999889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:05:59.029651 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc5a0801-d087-41ef-b13f-7aeea4cf5177 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 0.620764 Aug 24 04:05:59.040050 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2660/5572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:05:58 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:05:59.762686 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47d149b7-ecf5-4ff4-87a1-84c39aedfbe2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.635813 Aug 24 04:05:59.765242 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2913/5573] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:05:58 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:05:59.783164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a745cb4-ca6d-4d31-aacb-47ebed0c44e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029d4d5e0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:00.058751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:00.073234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:00.074366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:00.083980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:00.085198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:00.085661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:00.095854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:00.095854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:00.095854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:00.139210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:00.337757 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a745cb4-ca6d-4d31-aacb-47ebed0c44e9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7" status: 200 len: 223 microversion: 2.1 time: 0.563375 Aug 24 04:06:00.342631 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2661/5574] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 04:05:59 2022] GET /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7 => generated 223 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:06:00.358341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0ac816c6-3d65-4c33-a523-393417c5cdbf req-f2ef91f6-1395-4193-95ab-e80a6324dfbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c456cc13-5a77-49e1-8ac2-d8ba7e67c713", "tag": "5891281b-c5f2-4f9e-9a5f-2821686a416c"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:00.382794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:00.392339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0ac816c6-3d65-4c33-a523-393417c5cdbf req-f2ef91f6-1395-4193-95ab-e80a6324dfbd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:00.393459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0ac816c6-3d65-4c33-a523-393417c5cdbf req-f2ef91f6-1395-4193-95ab-e80a6324dfbd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:00.394280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0ac816c6-3d65-4c33-a523-393417c5cdbf req-f2ef91f6-1395-4193-95ab-e80a6324dfbd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:00.427389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0ac816c6-3d65-4c33-a523-393417c5cdbf req-f2ef91f6-1395-4193-95ab-e80a6324dfbd service nova] Creating event network-changed:5891281b-c5f2-4f9e-9a5f-2821686a416c for instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 on n-h1-846470-15 Aug 24 04:06:00.443830 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0ac816c6-3d65-4c33-a523-393417c5cdbf req-f2ef91f6-1395-4193-95ab-e80a6324dfbd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097131 Aug 24 04:06:00.448929 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2662/5575] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:00.466892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50085435-c4da-4b2c-b213-78a094ade2c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029da1ca0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:01.719978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:01.760360 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9f5055a8-810a-44bb-b8b2-afbe255390f3 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 1.690696 Aug 24 04:06:01.776073 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2914/5576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:00 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:01.782989 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50085435-c4da-4b2c-b213-78a094ade2c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7" status: 202 len: 0 microversion: 2.1 time: 1.331428 Aug 24 04:06:01.792498 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2663/5577] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:00 2022] DELETE /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7 => generated 0 bytes in 1338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:01.800930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f55821e8-59b2-4463-be1a-c3f56bc4e570 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f10226c8430>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:01.920364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-f55821e8-59b2-4463-be1a-c3f56bc4e570 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:01.921164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-f55821e8-59b2-4463-be1a-c3f56bc4e570 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group 12f23d89-616c-431a-82a0-ff57757a0ea7 not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:01.921748 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f55821e8-59b2-4463-be1a-c3f56bc4e570 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:01.921748 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-ed8b4417-0b72-47e2-8f6f-aa593c508401'] Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f55821e8-59b2-4463-be1a-c3f56bc4e570 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7 HTTP/1.1 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-ed8b4417-0b72-47e2-8f6f-aa593c508401'] Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '12f23d89-616c-431a-82a0-ff57757a0ea7'} Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:01.924175 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8b4417-0b72-47e2-8f6f-aa593c508401'] Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8b4417-0b72-47e2-8f6f-aa593c508401'] Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8b4417-0b72-47e2-8f6f-aa593c508401'] Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8b4417-0b72-47e2-8f6f-aa593c508401'] Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f55821e8-59b2-4463-be1a-c3f56bc4e570 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-ed8b4417-0b72-47e2-8f6f-aa593c508401'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:01.936840 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f55821e8-59b2-4463-be1a-c3f56bc4e570 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7" status: 404 len: 194 microversion: 2.1 time: 0.131770 Aug 24 04:06:01.945600 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2915/5578] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 04:06:01 2022] GET /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7 => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:01.946034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-412b3984-5964-4559-a967-ca0d78df3ca5 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f1029d4d670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-441979772", "description": "tempest-description-1666139220"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:02.611265 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-412b3984-5964-4559-a967-ca0d78df3ca5 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.676541 Aug 24 04:06:02.613788 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2664/5579] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:06:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:06:02.660909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-663fd17c-77bc-4604-b163-04b79631ba81 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f102273d430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1478873627", "description": "tempest-description-2056581162"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:03.503463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:03.504803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:03.542054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:03.542959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:03.549104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:03.552130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:03.561705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:03.562167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:04.075445 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-663fd17c-77bc-4604-b163-04b79631ba81 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.436845 Aug 24 04:06:04.091294 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2916/5580] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:06:02 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:04.109730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7a88d17-310e-41b5-bf83-71e06a6d2d7f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f10341e6b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1818417255", "description": "tempest-description-557988775"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:05.048465 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7a88d17-310e-41b5-bf83-71e06a6d2d7f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.945116 Aug 24 04:06:05.049592 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2917/5581] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:06:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:05.110021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0af861b4-5bcc-4083-a0e8-2d2da6c241bf tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1022771a60>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:05.706004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:05.764577 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d054177e-d89b-400d-ac81-7fac1712a674 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 2.958672 Aug 24 04:06:05.778129 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2665/5582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:02 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 2983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:06.829192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:06.830450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:06.907464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:06.908628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:06.911643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:06.915973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:06.918311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:06.925147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:06.964790 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0af861b4-5bcc-4083-a0e8-2d2da6c241bf tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 1.899535 Aug 24 04:06:06.972018 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2918/5583] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 04:06:05 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:06.991552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8d0afa8-bc5a-4eab-b348-24488d70abb3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f102279cdc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:07.715172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:07.741529 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8419eb22-0912-4ef0-acac-2191f927ecdc tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 0.927012 Aug 24 04:06:07.772208 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2666/5584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:06 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:08.797867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:08.802512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:08.811107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8d0afa8-bc5a-4eab-b348-24488d70abb3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d8b71443-48ea-4563-836f-4e2ea96f7ef6" status: 202 len: 0 microversion: 2.1 time: 1.825608 Aug 24 04:06:08.822312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2919/5585] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:06 2022] DELETE /compute/v2.1/os-security-groups/d8b71443-48ea-4563-836f-4e2ea96f7ef6 => generated 0 bytes in 1839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:08.843565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:08.845125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:08.852646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:08.854867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:08.855180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c9b5ed5-ac79-430c-ae30-9fd821c8d346 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1022d8e670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:08.863086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:08.864227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:09.024422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-6c9b5ed5-ac79-430c-ae30-9fd821c8d346 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:09.025803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-6c9b5ed5-ac79-430c-ae30-9fd821c8d346 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:09.026898 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6c9b5ed5-ac79-430c-ae30-9fd821c8d346 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:09.026898 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-e9cc97be-1610-4592-8256-59ff29f2d5c9'] Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c9b5ed5-ac79-430c-ae30-9fd821c8d346 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/os-security-groups/d8b71443-48ea-4563-836f-4e2ea96f7ef6 HTTP/1.1 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-e9cc97be-1610-4592-8256-59ff29f2d5c9'] Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd8b71443-48ea-4563-836f-4e2ea96f7ef6'} Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:09.032334 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9cc97be-1610-4592-8256-59ff29f2d5c9'] Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9cc97be-1610-4592-8256-59ff29f2d5c9'] Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9cc97be-1610-4592-8256-59ff29f2d5c9'] Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9cc97be-1610-4592-8256-59ff29f2d5c9'] Aug 24 04:06:09.040193 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:09.050233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c9b5ed5-ac79-430c-ae30-9fd821c8d346 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:09.050233 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-e9cc97be-1610-4592-8256-59ff29f2d5c9'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:09.052247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c9b5ed5-ac79-430c-ae30-9fd821c8d346 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/d8b71443-48ea-4563-836f-4e2ea96f7ef6" status: 404 len: 194 microversion: 2.1 time: 0.218695 Aug 24 04:06:09.061773 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2920/5586] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 04:06:08 2022] GET /compute/v2.1/os-security-groups/d8b71443-48ea-4563-836f-4e2ea96f7ef6 => generated 194 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:09.088328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05fffe6c-90ef-49ae-979b-3fb502d581a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1022dbd4c0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:09.462720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:09.496910 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9b862443-f950-4bd3-a3bd-e99d1eab1f2f tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 0.707869 Aug 24 04:06:09.530135 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2667/5587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:08 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:09.864344 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05fffe6c-90ef-49ae-979b-3fb502d581a8 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/1e29fcb9-06ed-4a86-81ae-2ca54414e134" status: 202 len: 0 microversion: 2.1 time: 0.800247 Aug 24 04:06:09.872795 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2921/5588] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:09 2022] DELETE /compute/v2.1/os-security-groups/1e29fcb9-06ed-4a86-81ae-2ca54414e134 => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:09.883764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1913983b-e221-424f-863e-535519f0ad82 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029e3c040>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:10.087657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-1913983b-e221-424f-863e-535519f0ad82 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:10.088640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.security_group_api [None req-1913983b-e221-424f-863e-535519f0ad82 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 not found {{(pid=122535) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:10.089487 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1913983b-e221-424f-863e-535519f0ad82 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:10.089487 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-3a9a68a1-ee79-4023-99ac-b5734d1faf04'] Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1913983b-e221-424f-863e-535519f0ad82 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-security-groups/1e29fcb9-06ed-4a86-81ae-2ca54414e134 HTTP/1.1 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: exception: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-3a9a68a1-ee79-4023-99ac-b5734d1faf04'] Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '1e29fcb9-06ed-4a86-81ae-2ca54414e134'} Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:10.093307 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a9a68a1-ee79-4023-99ac-b5734d1faf04'] Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a9a68a1-ee79-4023-99ac-b5734d1faf04'] Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a9a68a1-ee79-4023-99ac-b5734d1faf04'] Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a9a68a1-ee79-4023-99ac-b5734d1faf04'] Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1913983b-e221-424f-863e-535519f0ad82 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-3a9a68a1-ee79-4023-99ac-b5734d1faf04'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:10.098505 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1913983b-e221-424f-863e-535519f0ad82 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/1e29fcb9-06ed-4a86-81ae-2ca54414e134" status: 404 len: 194 microversion: 2.1 time: 0.221053 Aug 24 04:06:10.102347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2668/5589] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 04:06:09 2022] GET /compute/v2.1/os-security-groups/1e29fcb9-06ed-4a86-81ae-2ca54414e134 => generated 194 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:10.108904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=23 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:10.114905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-02b51d07-c32b-44c3-b6e9-6428c40f7ce7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f10227719d0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:10.932940 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-02b51d07-c32b-44c3-b6e9-6428c40f7ce7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678" status: 202 len: 0 microversion: 2.1 time: 0.820024 Aug 24 04:06:10.948999 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2922/5590] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:10 2022] DELETE /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678 => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:10.991178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:10.998764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:11.030890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:11.031307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:11.038311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:11.039132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:11.039632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:11.040188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:11.185092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-55ed5359-faeb-4618-a1c8-a5dff7cdeb28 req-01eeb53d-6406-41e0-92b7-cfde64fcefc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cc13-5a77-49e1-8ac2-d8ba7e67c713", "name": "network-vif-plugged", "status": "completed", "tag": "5891281b-c5f2-4f9e-9a5f-2821686a416c"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:11.215246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-55ed5359-faeb-4618-a1c8-a5dff7cdeb28 req-01eeb53d-6406-41e0-92b7-cfde64fcefc2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:11.220948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-55ed5359-faeb-4618-a1c8-a5dff7cdeb28 req-01eeb53d-6406-41e0-92b7-cfde64fcefc2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:11.221884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-55ed5359-faeb-4618-a1c8-a5dff7cdeb28 req-01eeb53d-6406-41e0-92b7-cfde64fcefc2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:11.276606 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-55ed5359-faeb-4618-a1c8-a5dff7cdeb28 req-01eeb53d-6406-41e0-92b7-cfde64fcefc2 service nova] Creating event network-vif-plugged:5891281b-c5f2-4f9e-9a5f-2821686a416c for instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 on n-h1-846470-15 Aug 24 04:06:11.301528 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-55ed5359-faeb-4618-a1c8-a5dff7cdeb28 req-01eeb53d-6406-41e0-92b7-cfde64fcefc2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.033297 Aug 24 04:06:11.306522 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2669/5591] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:11.321642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9286bf47-0cf5-433c-a06d-f18e985e3902 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029d230d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:11.433848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-9286bf47-0cf5-433c-a06d-f18e985e3902 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:11.442737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.security_group_api [None req-9286bf47-0cf5-433c-a06d-f18e985e3902 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group 34876e75-cae3-4d00-8f0e-d7b41198a678 not found {{(pid=122535) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:11.448617 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-9286bf47-0cf5-433c-a06d-f18e985e3902 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:11.448617 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-073c20ea-6549-4120-ba6f-e90ecc1d71b5'] Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9286bf47-0cf5-433c-a06d-f18e985e3902 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678 HTTP/1.1 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: exception: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-073c20ea-6549-4120-ba6f-e90ecc1d71b5'] Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '34876e75-cae3-4d00-8f0e-d7b41198a678'} Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:11.454334 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-073c20ea-6549-4120-ba6f-e90ecc1d71b5'] Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-073c20ea-6549-4120-ba6f-e90ecc1d71b5'] Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-073c20ea-6549-4120-ba6f-e90ecc1d71b5'] Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-073c20ea-6549-4120-ba6f-e90ecc1d71b5'] Aug 24 04:06:11.460492 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:11.467371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9286bf47-0cf5-433c-a06d-f18e985e3902 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:11.467371 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-073c20ea-6549-4120-ba6f-e90ecc1d71b5'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:11.470266 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9286bf47-0cf5-433c-a06d-f18e985e3902 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678" status: 404 len: 194 microversion: 2.1 time: 0.157625 Aug 24 04:06:11.471152 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2670/5592] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 04:06:11 2022] GET /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678 => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:11.495947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9bc82172-7de2-4e9c-bc4e-0dfd8357a91e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f102acc9c10>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:11.648377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:11.672114 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e43ae8b-f1f9-475a-89a3-b998a9936a94 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 0.699932 Aug 24 04:06:11.676244 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2923/5593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:10 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:12.282557 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9bc82172-7de2-4e9c-bc4e-0dfd8357a91e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.805087 Aug 24 04:06:12.286164 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2671/5594] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 24 04:06:11 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:06:12.312354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca8f849c-9dfb-485d-a4b0-a46b64947bcf tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f10226de5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-484408927", "description": "tempest-description-1615866916"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:12.723720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:12.725030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:12.754058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:12.756840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:12.760380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:12.762182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:12.763214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:12.764262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:13.112240 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca8f849c-9dfb-485d-a4b0-a46b64947bcf tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.813625 Aug 24 04:06:13.113984 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2924/5595] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:06:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:13.140465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9205a40d-1d37-44c8-a769-21b4833b19c3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f10227553a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1386202831", "description": "tempest-description-1204820157"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:13.631599 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9205a40d-1d37-44c8-a769-21b4833b19c3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.494246 Aug 24 04:06:13.632591 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2925/5596] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:06:13 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:06:13.714895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:13.767326 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fd818caa-1cfe-44d3-bdb9-25fd44fbbe60 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1319 microversion: 2.1 time: 1.050933 Aug 24 04:06:13.773226 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2672/5597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:12 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1319 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:14.119593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-325054342", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "109a50fb-7ca0-4446-8ec3-9ded435ad919"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:14.334344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] validate_networks() for [('109a50fb-7ca0-4446-8ec3-9ded435ad919', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:06:14.810493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:14.819899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:14.856392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:14.859970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:14.864364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:14.866844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:14.868114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:14.869049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:15.264406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:15.281685 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f0e6c9bd-9de8-4167-912a-7cb2aceb36a4 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1508 microversion: 2.1 time: 0.480458 Aug 24 04:06:15.283535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2673/5598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:14 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:15.326153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1923d347-f4b9-4759-bf20-ef7aa4e8ac27", "device": "/dev/sdb"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:15.331291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:15.347932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:15.348806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:15.349770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:15.351485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:15.352306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:15.353014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:15.842658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:06:15.848461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:06:15.850654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:06:15.854606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:06:15.858625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:06:15.890402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:15.891241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:15.892102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:15.893394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:15.894207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:15.894919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:15.977244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Getting quotas for project c7652c5998da4f4388a604ac5d94ce51. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:06:15.995840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Getting quotas for user c7a99d0109e6412a9bc78fa3326ea0cc and project c7652c5998da4f4388a604ac5d94ce51. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:06:16.024888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:06:16.029819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:06:16.207916 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-043d4e1a-b598-4e09-bc59-b46b00bf2ae9 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "POST /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896728 Aug 24 04:06:16.220514 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2674/5599] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:06:15 2022] POST /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:06:16.241204 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0c3bdd7-c63b-4edd-aa81-d76bacc849ce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.129263 Aug 24 04:06:16.244248 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2926/5600] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:06:16.258480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9a62d77f-2e6e-41e8-b7a4-a43d9aaf7994 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:16.259054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9a62d77f-2e6e-41e8-b7a4-a43d9aaf7994 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:16.413436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9a62d77f-2e6e-41e8-b7a4-a43d9aaf7994 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:16.431564 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9a62d77f-2e6e-41e8-b7a4-a43d9aaf7994 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1215 microversion: 2.1 time: 0.179173 Aug 24 04:06:16.452013 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2675/5601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:16 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1215 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:17.462694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:17.463535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:17.493835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:17.498681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:17.505470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:17.505470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:17.505470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:17.512948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:17.542980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=59 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:17.814206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:17.830189 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a689bc2-4613-4346-8055-5a74ed042d21 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1219 microversion: 2.1 time: 0.374550 Aug 24 04:06:17.830805 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2927/5602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:17 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1219 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:18.862092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:18.863178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:18.922550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:18.924502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:18.928985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:18.930596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:18.931718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:18.934530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:19.345239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:19.360530 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6d00e3cc-a5a6-47fe-a98d-7f47ab503984 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1275 microversion: 2.1 time: 0.507209 Aug 24 04:06:19.364847 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2676/5603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:18 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1275 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:20.396345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:20.400053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:20.435946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:20.444942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:20.446320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:20.448371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:20.449120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:20.451814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:20.609225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:20.621504 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e498a53-9c52-4102-9e04-1aeeeb517b8c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1273 microversion: 2.1 time: 0.235340 Aug 24 04:06:20.639252 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2928/5604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:20 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:21.645893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:21.646794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:21.651955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:21.669366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:21.670807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:21.675331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:21.677324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:21.678678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:21.680618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:21.706574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:23.039222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:23.055523 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7cca3664-304a-4ae5-a839-6dd8844d5f6c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1273 microversion: 2.1 time: 1.413911 Aug 24 04:06:23.056315 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2677/5605] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:21 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1273 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:24.092270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:24.093141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:24.108583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:24.109559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:24.110119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:24.111026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:24.111767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:24.112480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:25.002969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:25.016527 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-09d4b517-7bc7-4916-bb67-c7944bb38278 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1315 microversion: 2.1 time: 0.928588 Aug 24 04:06:25.032141 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2929/5606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:24 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:26.037496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:26.038325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:26.041339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:26.047047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:26.081353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:26.081858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:26.082306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:26.097484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:26.104224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:26.104730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:26.431509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:26.499461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-333667c1-9f74-48d0-90fb-3bca2fea5bcd req-efd0df01-5f22-458d-ab31-760d2d0b48ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8894e855-6035-4327-9342-f7578ecca217", "tag": "8bae2e16-7e97-4a3e-848d-eafe753ad537"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:26.592651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-333667c1-9f74-48d0-90fb-3bca2fea5bcd req-efd0df01-5f22-458d-ab31-760d2d0b48ff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:26.593199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-333667c1-9f74-48d0-90fb-3bca2fea5bcd req-efd0df01-5f22-458d-ab31-760d2d0b48ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:26.593650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-333667c1-9f74-48d0-90fb-3bca2fea5bcd req-efd0df01-5f22-458d-ab31-760d2d0b48ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:26.662307 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-333667c1-9f74-48d0-90fb-3bca2fea5bcd req-efd0df01-5f22-458d-ab31-760d2d0b48ff service nova] Creating event network-changed:8bae2e16-7e97-4a3e-848d-eafe753ad537 for instance 8894e855-6035-4327-9342-f7578ecca217 on n-h2-846470-15 Aug 24 04:06:26.678970 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-333667c1-9f74-48d0-90fb-3bca2fea5bcd req-efd0df01-5f22-458d-ab31-760d2d0b48ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.864274 Aug 24 04:06:26.681865 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2678/5607] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:26.910024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:26.928730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ad205601-8407-42b8-abd3-a1d316f52fc4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1315 microversion: 2.1 time: 0.893469 Aug 24 04:06:26.944881 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2930/5608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:26 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:06:27.972047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:27.976587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:28.009631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:28.010739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:28.011528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:28.012885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:28.013978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:28.014591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:28.396583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:28.430518 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5edae76-682c-470e-9334-2c368b9df646 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1315 microversion: 2.1 time: 0.476347 Aug 24 04:06:28.431558 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2679/5609] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:27 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:29.469531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:29.471274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:29.480752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:29.481648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:29.482333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:29.483840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:29.484589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:29.485513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:29.761381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:29.776966 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d41ad8c0-e31b-4873-b21d-e4b16252e143 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1315 microversion: 2.1 time: 0.312583 Aug 24 04:06:29.796197 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2931/5610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:29 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:30.815651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:30.819595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:30.856136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:30.863613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:30.867318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:30.872960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:30.877054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:30.880182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:31.662528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-aabc84b2-6d24-4593-8e8a-1ad50ac6e778 req-d0310111-99b8-407c-b08f-589124d04b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8894e855-6035-4327-9342-f7578ecca217", "name": "network-vif-plugged", "status": "completed", "tag": "8bae2e16-7e97-4a3e-848d-eafe753ad537"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:31.680268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:31.699318 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41073a64-957b-44fd-bbef-4e3f6efcb27e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1315 microversion: 2.1 time: 0.891553 Aug 24 04:06:31.699454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aabc84b2-6d24-4593-8e8a-1ad50ac6e778 req-d0310111-99b8-407c-b08f-589124d04b66 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:31.699866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aabc84b2-6d24-4593-8e8a-1ad50ac6e778 req-d0310111-99b8-407c-b08f-589124d04b66 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:31.700598 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2680/5611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:30 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:31.706303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-aabc84b2-6d24-4593-8e8a-1ad50ac6e778 req-d0310111-99b8-407c-b08f-589124d04b66 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:31.727337 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-aabc84b2-6d24-4593-8e8a-1ad50ac6e778 req-d0310111-99b8-407c-b08f-589124d04b66 service nova] Creating event network-vif-plugged:8bae2e16-7e97-4a3e-848d-eafe753ad537 for instance 8894e855-6035-4327-9342-f7578ecca217 on n-h2-846470-15 Aug 24 04:06:31.744087 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-aabc84b2-6d24-4593-8e8a-1ad50ac6e778 req-d0310111-99b8-407c-b08f-589124d04b66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082546 Aug 24 04:06:31.746802 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2932/5612] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:32.723292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:32.725652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:32.740711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:32.741623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:32.742297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:32.744423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:32.751161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:32.753588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:33.049223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:33.064985 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be6c2025-e4c2-4d4b-b15b-2d475d36705e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1315 microversion: 2.1 time: 0.345291 Aug 24 04:06:33.068565 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2681/5613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:32 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:34.129420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:34.131759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:34.175346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:34.176264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:34.177490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:34.179180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:34.180303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:34.181308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:34.856877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:34.882589 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3f3da5d7-380f-448d-bed3-0206e8b4c1a2 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1503 microversion: 2.1 time: 0.762351 Aug 24 04:06:34.892229 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2933/5614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:34 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1503 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:34.932451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-484408927"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:34.933418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:34.948762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:34.949607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:34.950656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:34.952184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:34.953210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:34.954196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:35.370382 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.network.security_group_api [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Adding security group 8b595604-ef06-4fab-b8f0-420aeccfb633 to port 8bae2e16-7e97-4a3e-848d-eafe753ad537 Aug 24 04:06:36.296512 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0cd91995-6557-49f5-91e7-c51963d98bad tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217/action" status: 202 len: 0 microversion: 2.1 time: 1.371772 Aug 24 04:06:36.309091 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2682/5615] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:06:34 2022] POST /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217/action => generated 0 bytes in 1386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:36.316615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7484f352-5cc5-43ce-a0de-17f5083a740c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f10341e6940>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:36.429724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-94c61ec4-4993-4b2e-83cc-78367424e540 req-392d56d6-a899-484a-9012-30e085c9d43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8894e855-6035-4327-9342-f7578ecca217", "tag": "8bae2e16-7e97-4a3e-848d-eafe753ad537"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:36.485418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-94c61ec4-4993-4b2e-83cc-78367424e540 req-392d56d6-a899-484a-9012-30e085c9d43e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:36.487980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-94c61ec4-4993-4b2e-83cc-78367424e540 req-392d56d6-a899-484a-9012-30e085c9d43e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:36.493648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-94c61ec4-4993-4b2e-83cc-78367424e540 req-392d56d6-a899-484a-9012-30e085c9d43e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:36.557112 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-94c61ec4-4993-4b2e-83cc-78367424e540 req-392d56d6-a899-484a-9012-30e085c9d43e service nova] Creating event network-changed:8bae2e16-7e97-4a3e-848d-eafe753ad537 for instance 8894e855-6035-4327-9342-f7578ecca217 on n-h2-846470-15 Aug 24 04:06:36.579702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-94c61ec4-4993-4b2e-83cc-78367424e540 req-392d56d6-a899-484a-9012-30e085c9d43e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158648 Aug 24 04:06:36.586793 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2683/5616] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:06:37.004373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-7484f352-5cc5-43ce-a0de-17f5083a740c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8b595604-ef06-4fab-b8f0-420aeccfb633 in use.", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:37.005721 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-7484f352-5cc5-43ce-a0de-17f5083a740c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security Group 8b595604-ef06-4fab-b8f0-420aeccfb633 in use. Aug 24 04:06:37.005721 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-e4ab1469-7c04-40ce-83c3-f3b790bf4ea5'] Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7484f352-5cc5-43ce-a0de-17f5083a740c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-security-groups/8b595604-ef06-4fab-b8f0-420aeccfb633 HTTP/1.1 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: exception: Security Group 8b595604-ef06-4fab-b8f0-420aeccfb633 in use. Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-e4ab1469-7c04-40ce-83c3-f3b790bf4ea5'] Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8b595604-ef06-4fab-b8f0-420aeccfb633'} Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:37.008753 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8b595604-ef06-4fab-b8f0-420aeccfb633 in use. Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4ab1469-7c04-40ce-83c3-f3b790bf4ea5'] Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8b595604-ef06-4fab-b8f0-420aeccfb633 in use. Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4ab1469-7c04-40ce-83c3-f3b790bf4ea5'] Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8b595604-ef06-4fab-b8f0-420aeccfb633 in use. Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4ab1469-7c04-40ce-83c3-f3b790bf4ea5'] Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8b595604-ef06-4fab-b8f0-420aeccfb633 in use. Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4ab1469-7c04-40ce-83c3-f3b790bf4ea5'] Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7484f352-5cc5-43ce-a0de-17f5083a740c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 400 to user: Security Group 8b595604-ef06-4fab-b8f0-420aeccfb633 in use. Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-e4ab1469-7c04-40ce-83c3-f3b790bf4ea5'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7484f352-5cc5-43ce-a0de-17f5083a740c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8b595604-ef06-4fab-b8f0-420aeccfb633" status: 400 len: 185 microversion: 2.1 time: 0.702605 Aug 24 04:06:37.017768 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2934/5617] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:36 2022] DELETE /compute/v2.1/os-security-groups/8b595604-ef06-4fab-b8f0-420aeccfb633 => generated 185 bytes in 704 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:06:37.032685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:37.046271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:37.081199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:37.085297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:37.086459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:37.087907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:37.096170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:37.099722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:37.327382 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-00b50e9a-c2d9-4f37-94e4-29e7baba9a42 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217/action" status: 202 len: 0 microversion: 2.1 time: 0.307722 Aug 24 04:06:37.329330 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2684/5618] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:06:37 2022] POST /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:37.342055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:37.344383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:37.380799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:37.382215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:37.383438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:37.384999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:37.386989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:37.388752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:38.153111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:38.174162 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f6c7f56-071c-4b62-92e9-da2a270575bd tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1573 microversion: 2.1 time: 0.839476 Aug 24 04:06:38.179344 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2935/5619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:37 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1573 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:39.199299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:39.201416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:39.228642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:39.229248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:39.230756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:39.231629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:39.232362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:39.233000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:40.586254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:40.607782 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a90f4cc-8c42-4e0f-8e9c-7ffc25052742 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1573 microversion: 2.1 time: 1.408162 Aug 24 04:06:40.619224 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2685/5620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:39 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1573 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:41.642572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:41.643514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:41.671049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:41.673819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:41.674740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:41.675551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:41.677511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:41.678928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:41.679768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:42.420932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:42.433356 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3c1a7b80-461a-44ea-b799-767480317ab4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1578 microversion: 2.1 time: 0.796932 Aug 24 04:06:42.434581 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2936/5621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:41 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1578 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:43.482179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:43.483129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:43.495002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:43.496211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:43.497006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:43.498636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:43.499489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:43.500412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:43.842033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:43.861820 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53621ca4-ff56-41b3-95c2-c3ac13fd723e tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1571 microversion: 2.1 time: 0.390245 Aug 24 04:06:43.872144 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2686/5622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:43 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1571 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:43.917123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1386202831"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:43.917925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:43.951573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:43.952346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:43.954302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:43.956215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:43.957282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:43.969954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:44.885894 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.network.security_group_api [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Adding security group 73a86f20-255f-4b2f-9618-c22222c9b09e to port 8bae2e16-7e97-4a3e-848d-eafe753ad537 Aug 24 04:06:45.876517 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-94d901ee-f99c-4364-a26c-e107318b878f tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217/action" status: 202 len: 0 microversion: 2.1 time: 1.966985 Aug 24 04:06:45.878021 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2937/5623] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:06:43 2022] POST /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217/action => generated 0 bytes in 1969 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:06:45.901598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c229963f-5f7e-4749-8a73-78b3e47449b4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f102a6d2dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:45.912198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-67569b80-2025-4031-932a-cae2c5a44ed2 req-ae1bf1d3-a873-48a4-a204-e55060edda6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8894e855-6035-4327-9342-f7578ecca217", "tag": "8bae2e16-7e97-4a3e-848d-eafe753ad537"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:45.992031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-67569b80-2025-4031-932a-cae2c5a44ed2 req-ae1bf1d3-a873-48a4-a204-e55060edda6c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:45.993414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-67569b80-2025-4031-932a-cae2c5a44ed2 req-ae1bf1d3-a873-48a4-a204-e55060edda6c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:45.996239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-67569b80-2025-4031-932a-cae2c5a44ed2 req-ae1bf1d3-a873-48a4-a204-e55060edda6c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:46.069783 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-67569b80-2025-4031-932a-cae2c5a44ed2 req-ae1bf1d3-a873-48a4-a204-e55060edda6c service nova] Creating event network-changed:8bae2e16-7e97-4a3e-848d-eafe753ad537 for instance 8894e855-6035-4327-9342-f7578ecca217 on n-h2-846470-15 Aug 24 04:06:46.082288 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-67569b80-2025-4031-932a-cae2c5a44ed2 req-ae1bf1d3-a873-48a4-a204-e55060edda6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190015 Aug 24 04:06:46.091991 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2938/5624] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:06:47.096008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-c229963f-5f7e-4749-8a73-78b3e47449b4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 73a86f20-255f-4b2f-9618-c22222c9b09e in use.", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:47.097956 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-c229963f-5f7e-4749-8a73-78b3e47449b4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security Group 73a86f20-255f-4b2f-9618-c22222c9b09e in use. Aug 24 04:06:47.097956 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-caf2ac71-1f2b-4569-a82d-1388d4aab169'] Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c229963f-5f7e-4749-8a73-78b3e47449b4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-security-groups/73a86f20-255f-4b2f-9618-c22222c9b09e HTTP/1.1 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: exception: Security Group 73a86f20-255f-4b2f-9618-c22222c9b09e in use. Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-caf2ac71-1f2b-4569-a82d-1388d4aab169'] Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '73a86f20-255f-4b2f-9618-c22222c9b09e'} Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:47.103374 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 73a86f20-255f-4b2f-9618-c22222c9b09e in use. Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caf2ac71-1f2b-4569-a82d-1388d4aab169'] Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 73a86f20-255f-4b2f-9618-c22222c9b09e in use. Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caf2ac71-1f2b-4569-a82d-1388d4aab169'] Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 73a86f20-255f-4b2f-9618-c22222c9b09e in use. Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caf2ac71-1f2b-4569-a82d-1388d4aab169'] Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 73a86f20-255f-4b2f-9618-c22222c9b09e in use. Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caf2ac71-1f2b-4569-a82d-1388d4aab169'] Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c229963f-5f7e-4749-8a73-78b3e47449b4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 400 to user: Security Group 73a86f20-255f-4b2f-9618-c22222c9b09e in use. Aug 24 04:06:47.117662 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-caf2ac71-1f2b-4569-a82d-1388d4aab169'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:47.144214 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c229963f-5f7e-4749-8a73-78b3e47449b4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/73a86f20-255f-4b2f-9618-c22222c9b09e" status: 400 len: 185 microversion: 2.1 time: 1.231805 Aug 24 04:06:47.145823 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2687/5625] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:45 2022] DELETE /compute/v2.1/os-security-groups/73a86f20-255f-4b2f-9618-c22222c9b09e => generated 185 bytes in 1264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:06:47.160839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:47.174289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:47.206263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:47.217223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:47.218467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:47.221418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:47.228462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:47.229744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:47.316542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:06:47.641655 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-17203119-ffda-4768-8210-9c0a1c09b1da tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 204 len: 0 microversion: 2.1 time: 0.486906 Aug 24 04:06:47.642316 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2939/5626] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:06:47 2022] DELETE /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:06:47.660805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:47.661525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:47.680146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:47.680783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:47.681229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:47.681957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:47.682420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:47.682854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:48.137387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:48.149934 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1491cfb6-6d4b-4ad9-a1de-001c43dbae3c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1646 microversion: 2.1 time: 0.502158 Aug 24 04:06:48.153019 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2688/5627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:47 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1646 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:49.179955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:49.180781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:49.204473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:49.209928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:49.210387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:49.211154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:49.211854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:49.212086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:49.226270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:49.789012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:49.814166 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e9642f28-aed8-49e0-a3bf-a5a0e1db1be6 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1646 microversion: 2.1 time: 0.639377 Aug 24 04:06:49.814762 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2940/5628] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:49 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1646 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:50.888999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:50.889631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:50.932166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:50.934004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:50.934810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:50.938560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:50.955706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:50.960382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:50.978711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-23f86b5c-ea3b-4595-ab35-bb3cd2a29fcb req-14c1b088-5508-43c3-ab0c-0d5a07ebb34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8894e855-6035-4327-9342-f7578ecca217", "name": "network-vif-deleted", "tag": "8bae2e16-7e97-4a3e-848d-eafe753ad537"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:51.032872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-23f86b5c-ea3b-4595-ab35-bb3cd2a29fcb req-14c1b088-5508-43c3-ab0c-0d5a07ebb34c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:51.039929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-23f86b5c-ea3b-4595-ab35-bb3cd2a29fcb req-14c1b088-5508-43c3-ab0c-0d5a07ebb34c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:51.040751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-23f86b5c-ea3b-4595-ab35-bb3cd2a29fcb req-14c1b088-5508-43c3-ab0c-0d5a07ebb34c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:51.137938 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-23f86b5c-ea3b-4595-ab35-bb3cd2a29fcb req-14c1b088-5508-43c3-ab0c-0d5a07ebb34c service nova] Creating event network-vif-deleted:8bae2e16-7e97-4a3e-848d-eafe753ad537 for instance 8894e855-6035-4327-9342-f7578ecca217 on n-h2-846470-15 Aug 24 04:06:51.165191 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-23f86b5c-ea3b-4595-ab35-bb3cd2a29fcb req-14c1b088-5508-43c3-ab0c-0d5a07ebb34c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189204 Aug 24 04:06:51.171113 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2941/5629] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:06:51.274049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:51.283528 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d70b9d87-8128-41ec-94c9-9fdb1f9d54f1 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 200 len: 1300 microversion: 2.1 time: 0.449536 Aug 24 04:06:51.304372 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2689/5630] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:50 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 1300 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:06:52.315482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:52.318850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:52.354825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:52.357950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:52.359311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:52.362688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:52.365764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:52.367822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:52.404074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 HTTP/1.1 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8894e855-6035-4327-9342-f7578ecca217'} Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:52.410092 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:52.415977 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:52.415977 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:52.415977 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:52.415977 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:52.415977 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:52.415977 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:52.415977 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:52.418134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:52.431091 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9106c322-0bd6-4cc3-b125-6445ccd84a5c tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 404 len: 111 microversion: 2.1 time: 0.110982 Aug 24 04:06:52.432306 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2942/5631] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:52 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:52.443574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4edd8c1-dabe-45cb-a584-09c5f3af6093 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029d2ba60>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:53.051001 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4edd8c1-dabe-45cb-a584-09c5f3af6093 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8b595604-ef06-4fab-b8f0-420aeccfb633" status: 202 len: 0 microversion: 2.1 time: 0.614005 Aug 24 04:06:53.052818 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2690/5632] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:52 2022] DELETE /compute/v2.1/os-security-groups/8b595604-ef06-4fab-b8f0-420aeccfb633 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:53.072644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8d47586-4287-4f82-8108-9a972a7c6253 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f10226e2f70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:54.391280 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8d47586-4287-4f82-8108-9a972a7c6253 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/73a86f20-255f-4b2f-9618-c22222c9b09e" status: 202 len: 0 microversion: 2.1 time: 1.333008 Aug 24 04:06:54.396205 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2943/5633] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:53 2022] DELETE /compute/v2.1/os-security-groups/73a86f20-255f-4b2f-9618-c22222c9b09e => generated 0 bytes in 1339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:54.432012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a375a176-67e7-4b5c-8ad8-89ce38a8923a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'create', calling method: .version_select at 0x7f103421b310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1063735001", "description": "tempest-description-919682505"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:54.932100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a375a176-67e7-4b5c-8ad8-89ce38a8923a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.523735 Aug 24 04:06:54.941724 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2691/5634] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 24 04:06:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:54.947985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-905eb806-4a3e-41d5-972f-2c1b97b5c7f3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Action: 'update', calling method: .version_select at 0x7f10226e2d30>, body: {"security_group": {"name": "tempest-sg-hth-392527717", "description": "tempest-description-hth-1183967766"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:06:55.476316 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-905eb806-4a3e-41d5-972f-2c1b97b5c7f3 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/3173e5f7-41a8-4169-bfc3-16a4208f604d" status: 200 len: 217 microversion: 2.1 time: 0.532920 Aug 24 04:06:55.480353 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2944/5635] 10.222.0.58 () {60 vars in 1290 bytes} [Wed Aug 24 04:06:54 2022] PUT /compute/v2.1/os-security-groups/3173e5f7-41a8-4169-bfc3-16a4208f604d => generated 217 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:55.506414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a962224-5fe3-427f-b91f-1417f3f618b4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029f3adc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:55.623556 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a962224-5fe3-427f-b91f-1417f3f618b4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/3173e5f7-41a8-4169-bfc3-16a4208f604d" status: 200 len: 217 microversion: 2.1 time: 0.124834 Aug 24 04:06:55.624253 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2692/5636] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 04:06:55 2022] GET /compute/v2.1/os-security-groups/3173e5f7-41a8-4169-bfc3-16a4208f604d => generated 217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:06:55.640699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b8e68c1-6cb4-4b45-b3bf-a37c5d04539b tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1022f7c790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:55.921630 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b8e68c1-6cb4-4b45-b3bf-a37c5d04539b tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/3173e5f7-41a8-4169-bfc3-16a4208f604d" status: 202 len: 0 microversion: 2.1 time: 0.285776 Aug 24 04:06:55.921932 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2945/5637] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:55 2022] DELETE /compute/v2.1/os-security-groups/3173e5f7-41a8-4169-bfc3-16a4208f604d => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:06:55.932265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:55.933227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:55.936600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=24 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:55.942924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:55.943465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:55.943988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:55.944724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:55.945185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:55.945614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:55.953353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:55.966456 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 HTTP/1.1 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '8894e855-6035-4327-9342-f7578ecca217'} Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:06:55.968653 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:55.973081 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:55.975536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:55.976690 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-43b24109-c649-4c1b-bdb0-bbd25f9090be tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 404 len: 111 microversion: 2.1 time: 0.049759 Aug 24 04:06:55.977813 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2693/5638] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:06:55 2022] DELETE /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:55.986237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:55.986851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: 8894e855-6035-4327-9342-f7578ecca217] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:55.995100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:55.996107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:55.996208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:55.996940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:55.997422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:55.998424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:56.019431 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 HTTP/1.1 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8894e855-6035-4327-9342-f7578ecca217'} Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.021636 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.025905 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.025905 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:56.025905 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:56.025905 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:56.025905 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:56.025905 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. Aug 24 04:06:56.025905 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.028228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Instance 8894e855-6035-4327-9342-f7578ecca217 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:56.029421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f8625d0-8408-4d61-8fc3-2b449e767b55 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217" status: 404 len: 111 microversion: 2.1 time: 0.047292 Aug 24 04:06:56.030366 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2946/5639] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:55 2022] GET /compute/v2.1/servers/8894e855-6035-4327-9342-f7578ecca217 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:06:56.039156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea877bdf-749a-4861-8206-82f26e773d2a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029d2b0d0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:56.123770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-ea877bdf-749a-4861-8206-82f26e773d2a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 73a86f20-255f-4b2f-9618-c22222c9b09e does not exist", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:56.125247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.security_group_api [None req-ea877bdf-749a-4861-8206-82f26e773d2a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group 73a86f20-255f-4b2f-9618-c22222c9b09e not found {{(pid=122535) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:56.126340 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-ea877bdf-749a-4861-8206-82f26e773d2a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group 73a86f20-255f-4b2f-9618-c22222c9b09e does not exist Aug 24 04:06:56.126340 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-4aa9eacd-1305-48ae-adf2-2cd5e744d3b8'] Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea877bdf-749a-4861-8206-82f26e773d2a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-security-groups/73a86f20-255f-4b2f-9618-c22222c9b09e HTTP/1.1 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: exception: Security group 73a86f20-255f-4b2f-9618-c22222c9b09e does not exist Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-4aa9eacd-1305-48ae-adf2-2cd5e744d3b8'] Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '73a86f20-255f-4b2f-9618-c22222c9b09e'} Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:56.131902 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 73a86f20-255f-4b2f-9618-c22222c9b09e does not exist Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4aa9eacd-1305-48ae-adf2-2cd5e744d3b8'] Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 73a86f20-255f-4b2f-9618-c22222c9b09e does not exist Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4aa9eacd-1305-48ae-adf2-2cd5e744d3b8'] Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 73a86f20-255f-4b2f-9618-c22222c9b09e does not exist Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4aa9eacd-1305-48ae-adf2-2cd5e744d3b8'] Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 73a86f20-255f-4b2f-9618-c22222c9b09e does not exist Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4aa9eacd-1305-48ae-adf2-2cd5e744d3b8'] Aug 24 04:06:56.140209 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.149214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea877bdf-749a-4861-8206-82f26e773d2a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group 73a86f20-255f-4b2f-9618-c22222c9b09e does not exist Aug 24 04:06:56.149214 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-4aa9eacd-1305-48ae-adf2-2cd5e744d3b8'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:56.153817 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea877bdf-749a-4861-8206-82f26e773d2a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/73a86f20-255f-4b2f-9618-c22222c9b09e" status: 404 len: 194 microversion: 2.1 time: 0.116999 Aug 24 04:06:56.158656 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2694/5640] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:56 2022] DELETE /compute/v2.1/os-security-groups/73a86f20-255f-4b2f-9618-c22222c9b09e => generated 194 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:56.178816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39845f48-c02f-43bf-9d29-0d47af0168c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f10226e28b0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:56.242801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-39845f48-c02f-43bf-9d29-0d47af0168c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b595604-ef06-4fab-b8f0-420aeccfb633 does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:56.244352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-39845f48-c02f-43bf-9d29-0d47af0168c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group 8b595604-ef06-4fab-b8f0-420aeccfb633 not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:56.244352 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-39845f48-c02f-43bf-9d29-0d47af0168c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group 8b595604-ef06-4fab-b8f0-420aeccfb633 does not exist Aug 24 04:06:56.244352 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-4ce98015-257c-449e-8137-1ac7abc0f249'] Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39845f48-c02f-43bf-9d29-0d47af0168c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-security-groups/8b595604-ef06-4fab-b8f0-420aeccfb633 HTTP/1.1 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group 8b595604-ef06-4fab-b8f0-420aeccfb633 does not exist Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-4ce98015-257c-449e-8137-1ac7abc0f249'] Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8b595604-ef06-4fab-b8f0-420aeccfb633'} Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:56.245943 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b595604-ef06-4fab-b8f0-420aeccfb633 does not exist Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ce98015-257c-449e-8137-1ac7abc0f249'] Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b595604-ef06-4fab-b8f0-420aeccfb633 does not exist Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ce98015-257c-449e-8137-1ac7abc0f249'] Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b595604-ef06-4fab-b8f0-420aeccfb633 does not exist Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ce98015-257c-449e-8137-1ac7abc0f249'] Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b595604-ef06-4fab-b8f0-420aeccfb633 does not exist Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ce98015-257c-449e-8137-1ac7abc0f249'] Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39845f48-c02f-43bf-9d29-0d47af0168c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group 8b595604-ef06-4fab-b8f0-420aeccfb633 does not exist Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-4ce98015-257c-449e-8137-1ac7abc0f249'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-39845f48-c02f-43bf-9d29-0d47af0168c7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8b595604-ef06-4fab-b8f0-420aeccfb633" status: 404 len: 194 microversion: 2.1 time: 0.082915 Aug 24 04:06:56.260434 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2947/5641] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:56 2022] DELETE /compute/v2.1/os-security-groups/8b595604-ef06-4fab-b8f0-420aeccfb633 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:56.269946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-166ed367-fc9e-45e6-9e3c-e606b7cc1c66 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029d6faf0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:56.721279 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:06:56.722125 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:06:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678 (ip 10.222.0.58) !!! Aug 24 04:06:56.986507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-166ed367-fc9e-45e6-9e3c-e606b7cc1c66 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:56.987114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.security_group_api [None req-166ed367-fc9e-45e6-9e3c-e606b7cc1c66 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group 34876e75-cae3-4d00-8f0e-d7b41198a678 not found {{(pid=122535) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:56.988732 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-166ed367-fc9e-45e6-9e3c-e606b7cc1c66 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:56.988732 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-ea545706-d803-4ab0-a7e2-b754f57b5856'] Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-166ed367-fc9e-45e6-9e3c-e606b7cc1c66 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678 HTTP/1.1 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: exception: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-ea545706-d803-4ab0-a7e2-b754f57b5856'] Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '34876e75-cae3-4d00-8f0e-d7b41198a678'} Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:56.991364 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea545706-d803-4ab0-a7e2-b754f57b5856'] Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea545706-d803-4ab0-a7e2-b754f57b5856'] Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea545706-d803-4ab0-a7e2-b754f57b5856'] Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea545706-d803-4ab0-a7e2-b754f57b5856'] Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-166ed367-fc9e-45e6-9e3c-e606b7cc1c66 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group 34876e75-cae3-4d00-8f0e-d7b41198a678 does not exist Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-ea545706-d803-4ab0-a7e2-b754f57b5856'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-166ed367-fc9e-45e6-9e3c-e606b7cc1c66 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678" status: 404 len: 194 microversion: 2.1 time: 0.739852 Aug 24 04:06:56.996155 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2695/5642] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:56 2022] DELETE /compute/v2.1/os-security-groups/34876e75-cae3-4d00-8f0e-d7b41198a678 => generated 194 bytes in 742 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:57.003601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-767452f7-b881-40c2-9b0f-7e4fa4fed802 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f102204c310>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:57.059720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-767452f7-b881-40c2-9b0f-7e4fa4fed802 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:57.060361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-767452f7-b881-40c2-9b0f-7e4fa4fed802 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:57.061015 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-767452f7-b881-40c2-9b0f-7e4fa4fed802 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:57.061015 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-43ca79a6-9014-490e-9e17-85b3497d8258'] Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-767452f7-b881-40c2-9b0f-7e4fa4fed802 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-security-groups/1e29fcb9-06ed-4a86-81ae-2ca54414e134 HTTP/1.1 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-43ca79a6-9014-490e-9e17-85b3497d8258'] Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1e29fcb9-06ed-4a86-81ae-2ca54414e134'} Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:57.063695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43ca79a6-9014-490e-9e17-85b3497d8258'] Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43ca79a6-9014-490e-9e17-85b3497d8258'] Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43ca79a6-9014-490e-9e17-85b3497d8258'] Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43ca79a6-9014-490e-9e17-85b3497d8258'] Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-767452f7-b881-40c2-9b0f-7e4fa4fed802 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group 1e29fcb9-06ed-4a86-81ae-2ca54414e134 does not exist Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-43ca79a6-9014-490e-9e17-85b3497d8258'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-767452f7-b881-40c2-9b0f-7e4fa4fed802 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/1e29fcb9-06ed-4a86-81ae-2ca54414e134" status: 404 len: 194 microversion: 2.1 time: 0.067072 Aug 24 04:06:57.069083 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2948/5643] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:56 2022] DELETE /compute/v2.1/os-security-groups/1e29fcb9-06ed-4a86-81ae-2ca54414e134 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:57.079279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9150f161-3b10-41a4-8aca-5dfcb0f8ceef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f1029d6f1f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:57.188793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG neutronclient.v2_0.client [None req-9150f161-3b10-41a4-8aca-5dfcb0f8ceef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist", "detail": ""}} {{(pid=122535) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:57.189395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.security_group_api [None req-9150f161-3b10-41a4-8aca-5dfcb0f8ceef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 not found {{(pid=122535) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:57.189916 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-9150f161-3b10-41a4-8aca-5dfcb0f8ceef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:57.189916 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-cd608ba0-9bc3-4864-a023-aed523d3709f'] Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9150f161-3b10-41a4-8aca-5dfcb0f8ceef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-security-groups/d8b71443-48ea-4563-836f-4e2ea96f7ef6 HTTP/1.1 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: exception: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-cd608ba0-9bc3-4864-a023-aed523d3709f'] Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd8b71443-48ea-4563-836f-4e2ea96f7ef6'} Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:57.192208 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd608ba0-9bc3-4864-a023-aed523d3709f'] Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd608ba0-9bc3-4864-a023-aed523d3709f'] Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd608ba0-9bc3-4864-a023-aed523d3709f'] Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd608ba0-9bc3-4864-a023-aed523d3709f'] Aug 24 04:06:57.197514 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.201743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9150f161-3b10-41a4-8aca-5dfcb0f8ceef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group d8b71443-48ea-4563-836f-4e2ea96f7ef6 does not exist Aug 24 04:06:57.201743 n-d-846470-15 devstack@n-api.service[122535]: Neutron server returns request_ids: ['req-cd608ba0-9bc3-4864-a023-aed523d3709f'] {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:57.202403 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9150f161-3b10-41a4-8aca-5dfcb0f8ceef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d8b71443-48ea-4563-836f-4e2ea96f7ef6" status: 404 len: 194 microversion: 2.1 time: 0.131163 Aug 24 04:06:57.203139 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2696/5644] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:57 2022] DELETE /compute/v2.1/os-security-groups/d8b71443-48ea-4563-836f-4e2ea96f7ef6 => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:57.212457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1efcdbea-f63f-43be-8fa8-9c69d5eb94ef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f10227713a0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:57.252914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG neutronclient.v2_0.client [None req-1efcdbea-f63f-43be-8fa8-9c69d5eb94ef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist", "detail": ""}} {{(pid=122536) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 04:06:57.253726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.security_group_api [None req-1efcdbea-f63f-43be-8fa8-9c69d5eb94ef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Neutron security group 12f23d89-616c-431a-82a0-ff57757a0ea7 not found {{(pid=122536) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 04:06:57.254446 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-1efcdbea-f63f-43be-8fa8-9c69d5eb94ef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:57.254446 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-91ea1c05-717d-4391-984a-0846d1331eb0'] Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1efcdbea-f63f-43be-8fa8-9c69d5eb94ef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7 HTTP/1.1 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: exception: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-91ea1c05-717d-4391-984a-0846d1331eb0'] Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '12f23d89-616c-431a-82a0-ff57757a0ea7'} Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 04:06:57.257306 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91ea1c05-717d-4391-984a-0846d1331eb0'] Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91ea1c05-717d-4391-984a-0846d1331eb0'] Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91ea1c05-717d-4391-984a-0846d1331eb0'] Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91ea1c05-717d-4391-984a-0846d1331eb0'] Aug 24 04:06:57.262018 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:06:57.266011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1efcdbea-f63f-43be-8fa8-9c69d5eb94ef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Security group 12f23d89-616c-431a-82a0-ff57757a0ea7 does not exist Aug 24 04:06:57.266011 n-d-846470-15 devstack@n-api.service[122536]: Neutron server returns request_ids: ['req-91ea1c05-717d-4391-984a-0846d1331eb0'] {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:06:57.268163 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1efcdbea-f63f-43be-8fa8-9c69d5eb94ef tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7" status: 404 len: 194 microversion: 2.1 time: 0.060397 Aug 24 04:06:57.271851 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2949/5645] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:06:57 2022] DELETE /compute/v2.1/os-security-groups/12f23d89-616c-431a-82a0-ff57757a0ea7 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:57.278670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:57.279361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:57.294468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:57.294468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:57.294931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:57.295883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:57.296188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:57.296767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:57.413678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:06:57.664453 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-82a4b81d-32c2-43a8-8b78-a03a15d58dce tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 204 len: 0 microversion: 2.1 time: 0.390305 Aug 24 04:06:57.665594 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2697/5646] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:06:57 2022] DELETE /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:06:57.677266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:57.678208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:57.694444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:57.711842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:57.717051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:57.718724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:57.720341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:57.720968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:58.526933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:06:58.552872 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e82315c8-e593-49d0-bffe-e0914e5963e7 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1649 microversion: 2.1 time: 0.881840 Aug 24 04:06:58.558756 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2950/5647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:57 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1649 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:06:59.244712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:59.247480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:59.267267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:59.268643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:59.269697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:59.272177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:59.275432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:59.276546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:59.537187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lazy-loading 'services' on Instance uuid c456cc13-5a77-49e1-8ac2-d8ba7e67c713 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:06:59.580868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:06:59.581503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:06:59.605180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:59.610758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:59.611878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:59.620133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:06:59.623351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:06:59.627282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:06:59.752330 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d7f1b515-aa0d-4ba9-98aa-8fbc13fde833 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713/os-volume_attachments/1923d347-f4b9-4759-bf20-ef7aa4e8ac27" status: 202 len: 0 microversion: 2.1 time: 0.523658 Aug 24 04:06:59.753731 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2698/5648] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:06:59 2022] DELETE /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713/os-volume_attachments/1923d347-f4b9-4759-bf20-ef7aa4e8ac27 => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:07:00.191175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:00.201730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca316ebd-6658-44d4-8709-f8a30b2244b9 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1649 microversion: 2.1 time: 0.626862 Aug 24 04:07:00.220694 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2951/5649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:06:59 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1649 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:07:01.086147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ac7fff41-9e37-4859-a91a-ee76736bb90e req-ae2ac388-ebe1-4b07-9df3-c2edaccb6028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b906bd-c500-49f5-9e8d-5950a01ab0aa", "name": "network-vif-deleted", "tag": "4cd7dcd4-65cb-4e81-8300-90fc8b842f1d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:01.115140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ac7fff41-9e37-4859-a91a-ee76736bb90e req-ae2ac388-ebe1-4b07-9df3-c2edaccb6028 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:01.122295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ac7fff41-9e37-4859-a91a-ee76736bb90e req-ae2ac388-ebe1-4b07-9df3-c2edaccb6028 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:01.123295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ac7fff41-9e37-4859-a91a-ee76736bb90e req-ae2ac388-ebe1-4b07-9df3-c2edaccb6028 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:01.192228 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ac7fff41-9e37-4859-a91a-ee76736bb90e req-ae2ac388-ebe1-4b07-9df3-c2edaccb6028 service nova] Creating event network-vif-deleted:4cd7dcd4-65cb-4e81-8300-90fc8b842f1d for instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa on n-h2-846470-15 Aug 24 04:07:01.205145 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ac7fff41-9e37-4859-a91a-ee76736bb90e req-ae2ac388-ebe1-4b07-9df3-c2edaccb6028 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124701 Aug 24 04:07:01.212298 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2699/5650] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:07:01.229788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:01.230619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:01.248378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:01.248955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:01.256477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:01.257394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:01.258453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:01.258968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:01.434136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a99d0109e6412a9bc78fa3326ea0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7652c5998da4f4388a604ac5d94ce51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:01.443984 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef00558f-afc9-4a24-9fbf-8f02c57705a4 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 200 len: 1301 microversion: 2.1 time: 0.218152 Aug 24 04:07:01.447450 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2952/5651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:01 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 1301 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:02.481675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:02.483928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] [instance: b0b906bd-c500-49f5-9e8d-5950a01ab0aa] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:02.502401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:02.503783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:02.508579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:02.510342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:02.511524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:02.516315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:02.564925 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] HTTP exception thrown: Instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa could not be found. Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Request method failure captured: Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa HTTP/1.1 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaN_zj8thxX5ARQPv-MWoGmsqYY9Ha_n0dTI7nrw0zjVsD10GWfZTZK37RO63OhpVln1yRMQQ9L3biElse15Cjjy7H2scLfB6UK8rZI6oopTxGlUweRhAnH2y3GfwhutJvF4Z4xCxPkZ4VZruFforZ9Fv86LJaKJ4hl_ka-Z7_C8z08 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7652c5998da4f4388a604ac5d94ce51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: c7652c5998da4f4388a604ac5d94ce51 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597297528 Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7a99d0109e6412a9bc78fa3326ea0cc Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-SecurityGroupsTestJSON-597297528-project Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa could not be found. Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'b0b906bd-c500-49f5-9e8d-5950a01ab0aa'} Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa could not be found. Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa could not be found. Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:07:02.569866 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:07:02.577592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:02.577592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:07:02.577592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:07:02.577592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:07:02.577592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:07:02.577592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa could not be found. Aug 24 04:07:02.577592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:07:02.581893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Returning 404 to user: Instance b0b906bd-c500-49f5-9e8d-5950a01ab0aa could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:07:02.583962 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-894a881d-8849-413f-8760-c132f35ebb12 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa" status: 404 len: 111 microversion: 2.1 time: 0.118597 Aug 24 04:07:02.585714 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2700/5652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:02 2022] GET /compute/v2.1/servers/b0b906bd-c500-49f5-9e8d-5950a01ab0aa => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:07:02.594609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-379dca5d-5c6b-4c2e-9345-ac332b7a6787 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f102367e670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:03.042561 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-379dca5d-5c6b-4c2e-9345-ac332b7a6787 tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5d91909a-41e6-4892-bedc-7150909a7dc5" status: 202 len: 0 microversion: 2.1 time: 0.452169 Aug 24 04:07:03.044135 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2953/5653] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:07:02 2022] DELETE /compute/v2.1/os-security-groups/5d91909a-41e6-4892-bedc-7150909a7dc5 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:07:03.053332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c9a118ee-fba2-4a68-8bc9-7546b334c79a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] Calling method '.version_select at 0x7f102a797af0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:03.648319 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c9a118ee-fba2-4a68-8bc9-7546b334c79a tempest-SecurityGroupsTestJSON-597297528 tempest-SecurityGroupsTestJSON-597297528-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ea7b2993-74e2-43e2-a92a-b7f207e753e2" status: 202 len: 0 microversion: 2.1 time: 0.598667 Aug 24 04:07:03.651215 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2701/5654] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 24 04:07:03 2022] DELETE /compute/v2.1/os-security-groups/ea7b2993-74e2-43e2-a92a-b7f207e753e2 => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:07:11.582051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:11.582726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:11.588520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:11.590542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=29 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:11.597935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:11.598829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:11.599944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:11.601054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:11.602301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:11.602995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:11.641513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:07:11.965650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e355b5dc-5ff1-40f4-84d8-20c2b94e783d tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 204 len: 0 microversion: 2.1 time: 0.389102 Aug 24 04:07:11.969266 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2954/5655] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:07:11 2022] DELETE /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:07:11.986278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:12.008833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:12.061009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:12.062810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:12.063531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:12.069870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:12.070636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:12.073505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:12.498242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:12.539073 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c4a46ed-a40d-4eb3-806f-b07252539329 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1514 microversion: 2.1 time: 0.555867 Aug 24 04:07:12.559711 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2702/5656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:11 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1514 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:13.577230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:13.578583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:13.609116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:13.609629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:13.610071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:13.611071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:13.616570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:13.618274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:13.913747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:13.925646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7917c48c-4a0f-4772-8e70-b3f9c50f3c54 tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1514 microversion: 2.1 time: 0.353557 Aug 24 04:07:13.929623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2955/5657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:13 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1514 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:14.951779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:14.953214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:14.969063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:14.969565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:14.972233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:14.980644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:14.981700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:14.982188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:15.091507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-90dcaeac-1ec2-4c7b-a343-b817fed6b473 req-9d8b7c5f-afda-4002-a1fb-fd9377f20905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cc13-5a77-49e1-8ac2-d8ba7e67c713", "name": "network-vif-deleted", "tag": "5891281b-c5f2-4f9e-9a5f-2821686a416c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:15.131982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-90dcaeac-1ec2-4c7b-a343-b817fed6b473 req-9d8b7c5f-afda-4002-a1fb-fd9377f20905 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:15.132776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-90dcaeac-1ec2-4c7b-a343-b817fed6b473 req-9d8b7c5f-afda-4002-a1fb-fd9377f20905 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:15.143166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-90dcaeac-1ec2-4c7b-a343-b817fed6b473 req-9d8b7c5f-afda-4002-a1fb-fd9377f20905 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:15.198319 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-90dcaeac-1ec2-4c7b-a343-b817fed6b473 req-9d8b7c5f-afda-4002-a1fb-fd9377f20905 service nova] Creating event network-vif-deleted:5891281b-c5f2-4f9e-9a5f-2821686a416c for instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 on n-h1-846470-15 Aug 24 04:07:15.218075 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-90dcaeac-1ec2-4c7b-a343-b817fed6b473 req-9d8b7c5f-afda-4002-a1fb-fd9377f20905 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138266 Aug 24 04:07:15.221907 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2956/5658] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:07:15.274050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352e99c3c244ae085a0cd417f8ed32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc901a671a749b2b6c1b76024f949f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:15.290887 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a0dceb1e-e7e1-4d68-8b0b-99c777af897e tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 200 len: 1472 microversion: 2.1 time: 0.342694 Aug 24 04:07:15.297335 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2703/5659] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:14 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:16.322060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:16.322884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] [instance: c456cc13-5a77-49e1-8ac2-d8ba7e67c713] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:16.364384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:16.366446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:16.368266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:16.375563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:16.377860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:16.382379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:16.460986 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] HTTP exception thrown: Instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 could not be found. Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Request method failure captured: Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 HTTP/1.1 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaJ9g-kism3zTnoZK_zMGC79VpmTPuxvPoAbTGlYQrSVui_0CMOQtvCpb0n1fVbonRWyRIu2WZAPfKZoECAWvx31RBfMAdwA-XX_EZFqBX8pTUGNcKzVcDGJwqK2LsEpfq2TdzDliaK1J9PVnshavROf9FvecgdNgRqQdc8RDFVKjFo Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 6bc901a671a749b2b6c1b76024f949f4 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1197213825 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6bc901a671a749b2b6c1b76024f949f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6bc901a671a749b2b6c1b76024f949f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6bc901a671a749b2b6c1b76024f949f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6bc901a671a749b2b6c1b76024f949f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesSnapshotTestJSON-1197213825 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 6bc901a671a749b2b6c1b76024f949f4 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1197213825 Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesSnapshotTestJSON-1197213825-project Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 4352e99c3c244ae085a0cd417f8ed32f Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesSnapshotTestJSON-1197213825-project Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 could not be found. Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c456cc13-5a77-49e1-8ac2-d8ba7e67c713'} Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 could not be found. Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 could not be found. Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:07:16.473206 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:07:16.482592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:07:16.482592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:07:16.482592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:07:16.482592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:07:16.482592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:07:16.482592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 could not be found. Aug 24 04:07:16.482592 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:07:16.486928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] Returning 404 to user: Instance c456cc13-5a77-49e1-8ac2-d8ba7e67c713 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:07:16.491715 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e991161-890b-4338-b873-1eee4c85566c tempest-VolumesSnapshotTestJSON-1197213825 tempest-VolumesSnapshotTestJSON-1197213825-project] 10.222.0.58 "GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713" status: 404 len: 111 microversion: 2.1 time: 0.175302 Aug 24 04:07:16.493127 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2957/5660] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:16 2022] GET /compute/v2.1/servers/c456cc13-5a77-49e1-8ac2-d8ba7e67c713 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:07:32.256251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:32.257446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:32.636762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-866974781", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "45d656b7-187d-4c51-a270-cd89211164bb"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:32.825010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] validate_networks() for [('45d656b7-187d-4c51-a270-cd89211164bb', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:07:34.591781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:07:34.592798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:07:34.594519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:07:34.596947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:07:34.601570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:07:34.653014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:34.660359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:34.666411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:34.667686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:34.668523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:34.669222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:34.766329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Getting quotas for project b160be74f6774ad49d154165e6244cc2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:07:34.797317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Getting quotas for user d54961361bd741c89aff920f93b6d88b and project b160be74f6774ad49d154165e6244cc2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:07:34.855822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Going to run 3 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:07:34.861477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:07:34.923936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 947d39dc-a4d2-4c5e-a2a0-40508f3009b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=db67c8d8-4c5c-4e94-b890-481ba6ce351d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:07:35.149263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=947d39dc-a4d2-4c5e-a2a0-40508f3009b7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:07:35.279416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c05b1c5-4ad6-4762-a270-35d54bd55cfc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.030169 Aug 24 04:07:35.287497 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2704/5661] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:07:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:07:35.293447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:35.302929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:35.304484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'deleted': False, 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:07:35.309142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:35.310463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:35.346268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:35.354263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:35.355541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:35.366375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:35.366990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:35.367523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:35.421712 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-27aad567-3d8a-42df-932a-f9ebac984598 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.131800 Aug 24 04:07:35.436934 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2958/5662] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 04:07:35 2022] GET /compute/v2.1/servers => generated 1015 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:35.450701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9f8ff2c8-0e82-48b4-96c5-9cd71061b646 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:35.456785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9f8ff2c8-0e82-48b4-96c5-9cd71061b646 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:35.669848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9f8ff2c8-0e82-48b4-96c5-9cd71061b646 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:35.696098 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9f8ff2c8-0e82-48b4-96c5-9cd71061b646 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1222 microversion: 2.1 time: 0.244327 Aug 24 04:07:35.699230 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2705/5663] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:35 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:36.736366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-38bd42ae-c20b-4fbf-93fd-00333a026fc0 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:36.744607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-38bd42ae-c20b-4fbf-93fd-00333a026fc0 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:37.080853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-38bd42ae-c20b-4fbf-93fd-00333a026fc0 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:37.120017 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-38bd42ae-c20b-4fbf-93fd-00333a026fc0 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1222 microversion: 2.1 time: 0.381306 Aug 24 04:07:37.122215 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2959/5664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:36 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1222 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:38.166240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d535a87-3a46-4021-90b8-0d47d9f784cc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:38.181803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d535a87-3a46-4021-90b8-0d47d9f784cc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:38.686164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d535a87-3a46-4021-90b8-0d47d9f784cc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:38.715204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d535a87-3a46-4021-90b8-0d47d9f784cc tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1222 microversion: 2.1 time: 0.567683 Aug 24 04:07:38.721892 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2706/5665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:38 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1222 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:07:39.764312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:39.795983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:39.891791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:39.894606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:39.908668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:39.918918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:39.932368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:39.933275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:40.502212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:40.563105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3c2cb6ba-6a1c-4df5-8e49-d35c2d0b8b51 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1274 microversion: 2.1 time: 0.821178 Aug 24 04:07:40.568860 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2960/5666] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:39 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1274 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:41.611308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:41.612276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:41.638779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:41.639567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:41.640221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:41.641119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:41.641773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:41.649331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:44.019578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:44.034859 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a25b42a-0972-48c0-8425-36c1ae4bb9e5 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1282 microversion: 2.1 time: 2.431285 Aug 24 04:07:44.040446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2707/5667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:41 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1282 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:45.109034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:45.111156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:45.143612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:45.155645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:45.165039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:45.167068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:45.168367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:45.169486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:45.392268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:45.488391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:45.508090 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-04c94492-4c41-4ba9-bab5-669cce7fe638 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1280 microversion: 2.1 time: 0.407835 Aug 24 04:07:45.525270 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2961/5668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:45 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1280 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:46.542079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:46.542694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:46.547704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:46.563876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:46.574986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:46.575462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:46.584224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:46.584903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:46.585372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:47.099800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:47.115612 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7514a475-5a96-49d7-86f9-a3af28b73d2e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1280 microversion: 2.1 time: 0.576956 Aug 24 04:07:47.120153 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2708/5669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:46 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1280 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:48.149147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:48.150941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:48.175220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:48.185734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:48.192318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:48.197330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:48.205303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:48.211315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:48.212027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:48.520190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:48.528170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be7978f7-1dcc-4e49-9de4-bab47c17fa93 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1280 microversion: 2.1 time: 0.384286 Aug 24 04:07:48.541492 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2962/5670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:48 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1280 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:49.566166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:49.567507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:49.570682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=10 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:49.598114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:49.598650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:49.599100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:49.599859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:49.600329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:49.600894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:49.832227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:49.853948 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f3679bcc-984c-4114-a366-769db8b8f320 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1280 microversion: 2.1 time: 0.291779 Aug 24 04:07:49.854942 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2709/5671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:49 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:50.885153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:50.886417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:50.918990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:50.922022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:50.928065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:50.932068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:50.932813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:50.934350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:51.131251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:51.147587 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d93653e5-9af0-4e7f-9d66-446cd5a712b7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1280 microversion: 2.1 time: 0.269210 Aug 24 04:07:51.149088 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2963/5672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:50 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:51.544410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3c552a08-c7cd-4b3e-83e0-9ae11ba819a6 req-d99d46f2-6f36-4073-b5dd-fb660925fbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947d39dc-a4d2-4c5e-a2a0-40508f3009b7", "tag": "def38ce4-a811-4145-87bb-0beb2b1ff6f6"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:51.573759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3c552a08-c7cd-4b3e-83e0-9ae11ba819a6 req-d99d46f2-6f36-4073-b5dd-fb660925fbe6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:51.582750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3c552a08-c7cd-4b3e-83e0-9ae11ba819a6 req-d99d46f2-6f36-4073-b5dd-fb660925fbe6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:51.583516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3c552a08-c7cd-4b3e-83e0-9ae11ba819a6 req-d99d46f2-6f36-4073-b5dd-fb660925fbe6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:51.631938 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3c552a08-c7cd-4b3e-83e0-9ae11ba819a6 req-d99d46f2-6f36-4073-b5dd-fb660925fbe6 service nova] Creating event network-changed:def38ce4-a811-4145-87bb-0beb2b1ff6f6 for instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 on n-h1-846470-15 Aug 24 04:07:51.649615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3c552a08-c7cd-4b3e-83e0-9ae11ba819a6 req-d99d46f2-6f36-4073-b5dd-fb660925fbe6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109086 Aug 24 04:07:51.650554 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2710/5673] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:07:52.185496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:52.186383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:52.208937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:52.209520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:52.209980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:52.211031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:52.220137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:52.220901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:53.501360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:53.536219 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7a651a1-a41a-49d4-8a86-c19753365f3d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 1.354776 Aug 24 04:07:53.537292 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2964/5674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:52 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:07:54.198567 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:07:54.199237 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:07:54.582452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:54.595387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:54.618069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:54.619282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:54.621332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:54.623116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:54.624452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:54.625969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:55.874258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:55.885930 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c8c23df-d286-4455-872e-c7e9045e7d79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 1.313617 Aug 24 04:07:55.901596 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2711/5675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:54 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:07:56.249385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6b1c6880-9b86-4a1a-a0e4-66218a91456f req-00b907d1-7fc0-4e00-a847-41539f80e947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b078da3-7334-4789-8011-1449b39457e0", "tag": "dffff413-d33d-47bf-8b65-1234d80adda0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:56.333911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6b1c6880-9b86-4a1a-a0e4-66218a91456f req-00b907d1-7fc0-4e00-a847-41539f80e947 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:56.334802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6b1c6880-9b86-4a1a-a0e4-66218a91456f req-00b907d1-7fc0-4e00-a847-41539f80e947 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:56.335621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6b1c6880-9b86-4a1a-a0e4-66218a91456f req-00b907d1-7fc0-4e00-a847-41539f80e947 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:56.422489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6b1c6880-9b86-4a1a-a0e4-66218a91456f req-00b907d1-7fc0-4e00-a847-41539f80e947 service nova] Creating event network-changed:dffff413-d33d-47bf-8b65-1234d80adda0 for instance 3b078da3-7334-4789-8011-1449b39457e0 on n-h2-846470-15 Aug 24 04:07:56.452197 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6b1c6880-9b86-4a1a-a0e4-66218a91456f req-00b907d1-7fc0-4e00-a847-41539f80e947 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209494 Aug 24 04:07:56.456734 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2965/5676] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:07:56.913908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:07:56.915005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:07:56.977292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:56.978159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:56.978958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:56.994030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:56.994944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:56.995767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:58.748970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-bf768592-b99a-4519-b87b-8db124bd9d37 req-1c603708-f2a1-499d-a426-cade4607b035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db67c8d8-4c5c-4e94-b890-481ba6ce351d", "tag": "da984eb2-f6a2-446a-b022-c74e6c1875b9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:07:58.800052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bf768592-b99a-4519-b87b-8db124bd9d37 req-1c603708-f2a1-499d-a426-cade4607b035 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:07:58.801112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bf768592-b99a-4519-b87b-8db124bd9d37 req-1c603708-f2a1-499d-a426-cade4607b035 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:07:58.801931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bf768592-b99a-4519-b87b-8db124bd9d37 req-1c603708-f2a1-499d-a426-cade4607b035 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:07:58.850007 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bf768592-b99a-4519-b87b-8db124bd9d37 req-1c603708-f2a1-499d-a426-cade4607b035 service nova] Creating event network-changed:da984eb2-f6a2-446a-b022-c74e6c1875b9 for instance db67c8d8-4c5c-4e94-b890-481ba6ce351d on n-h2-846470-15 Aug 24 04:07:58.865023 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-bf768592-b99a-4519-b87b-8db124bd9d37 req-1c603708-f2a1-499d-a426-cade4607b035 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120257 Aug 24 04:07:58.874437 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2966/5677] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:07:59.886399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:07:59.896418 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79595046-59b9-4d67-913f-f0f9548d8c77 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 2.990148 Aug 24 04:07:59.897041 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2712/5678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:07:56 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 2992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:08:00.794014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-05cc89c0-cc47-4aad-a294-19b170f155b8 req-66994463-bfd1-4385-9f0c-d8470640fcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947d39dc-a4d2-4c5e-a2a0-40508f3009b7", "name": "network-vif-plugged", "status": "completed", "tag": "def38ce4-a811-4145-87bb-0beb2b1ff6f6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:00.830253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-05cc89c0-cc47-4aad-a294-19b170f155b8 req-66994463-bfd1-4385-9f0c-d8470640fcb3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:00.836666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-05cc89c0-cc47-4aad-a294-19b170f155b8 req-66994463-bfd1-4385-9f0c-d8470640fcb3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:00.837698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-05cc89c0-cc47-4aad-a294-19b170f155b8 req-66994463-bfd1-4385-9f0c-d8470640fcb3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:00.911613 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-05cc89c0-cc47-4aad-a294-19b170f155b8 req-66994463-bfd1-4385-9f0c-d8470640fcb3 service nova] Creating event network-vif-plugged:def38ce4-a811-4145-87bb-0beb2b1ff6f6 for instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 on n-h1-846470-15 Aug 24 04:08:00.926434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:00.928599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:00.938908 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-05cc89c0-cc47-4aad-a294-19b170f155b8 req-66994463-bfd1-4385-9f0c-d8470640fcb3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148431 Aug 24 04:08:00.941339 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2967/5679] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:00.946173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:00.956531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:00.957516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:00.958576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:00.959329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:00.960082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:01.470529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:01.553787 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be55fb5d-f358-44d3-adc3-fe048451bea8 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 0.633668 Aug 24 04:08:01.571714 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2713/5680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:00 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:02.588836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:02.588836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:02.616971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:02.619692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:02.622985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:02.626013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:02.628128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:02.629835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:03.035070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:03.044623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-747f5a35-2b93-4511-b106-47d2ee7604fb tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 0.467005 Aug 24 04:08:03.061998 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2968/5681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:02 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:04.077601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:04.078663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:04.083919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=9 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:04.118660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:04.120065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:04.121100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:04.122813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:04.123933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:04.124968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:04.178267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=41 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:04.562784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:04.577711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b50c2ba1-d754-4c39-bff3-c73b0fc5c59d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 0.507563 Aug 24 04:08:04.578986 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2714/5682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:04 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:05.605733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:05.606772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:05.650426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=25 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:05.656092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:05.656688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:05.659855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:05.661441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:05.665630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:05.666353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:05.678178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=45 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:06.559067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:06.568590 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-885c856a-1c9e-48c2-a7f3-4dfe5659f73d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 0.970304 Aug 24 04:08:06.578623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2969/5683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:05 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:07.611002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:07.611920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:07.669663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:07.672686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-52ce49ca-3b33-4277-a0d8-6232314ee1d6 req-cc2a3580-5a62-41d8-90ad-cb7cd8f6c01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b078da3-7334-4789-8011-1449b39457e0", "name": "network-vif-plugged", "status": "completed", "tag": "dffff413-d33d-47bf-8b65-1234d80adda0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:07.677164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:07.681765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:07.688366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:07.689926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:07.696222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:07.722305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-52ce49ca-3b33-4277-a0d8-6232314ee1d6 req-cc2a3580-5a62-41d8-90ad-cb7cd8f6c01d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:07.739291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-52ce49ca-3b33-4277-a0d8-6232314ee1d6 req-cc2a3580-5a62-41d8-90ad-cb7cd8f6c01d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:07.745547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-52ce49ca-3b33-4277-a0d8-6232314ee1d6 req-cc2a3580-5a62-41d8-90ad-cb7cd8f6c01d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:07.809325 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-52ce49ca-3b33-4277-a0d8-6232314ee1d6 req-cc2a3580-5a62-41d8-90ad-cb7cd8f6c01d service nova] Creating event network-vif-plugged:dffff413-d33d-47bf-8b65-1234d80adda0 for instance 3b078da3-7334-4789-8011-1449b39457e0 on n-h2-846470-15 Aug 24 04:08:07.856469 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-52ce49ca-3b33-4277-a0d8-6232314ee1d6 req-cc2a3580-5a62-41d8-90ad-cb7cd8f6c01d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184761 Aug 24 04:08:07.873578 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2970/5684] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:08.308666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:08.326920 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8caa8b5-5792-4488-bdc9-20249c764d23 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 0.721655 Aug 24 04:08:08.328754 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2715/5685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:07 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:09.376245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:09.383474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:09.433045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:09.437740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:09.445519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:09.449404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:09.454059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:09.456613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:10.520268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:10.564335 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20be67dd-874d-481a-902b-0100778d897b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1322 microversion: 2.1 time: 1.190861 Aug 24 04:08:10.564335 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2971/5686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:09 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1322 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:11.367235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e3ed2ddd-24be-4105-8c30-3ba76a88f2c6 req-2b1d07fe-a267-468d-821e-38dafb3417d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db67c8d8-4c5c-4e94-b890-481ba6ce351d", "name": "network-vif-plugged", "status": "completed", "tag": "da984eb2-f6a2-446a-b022-c74e6c1875b9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:11.409895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e3ed2ddd-24be-4105-8c30-3ba76a88f2c6 req-2b1d07fe-a267-468d-821e-38dafb3417d1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:11.411472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e3ed2ddd-24be-4105-8c30-3ba76a88f2c6 req-2b1d07fe-a267-468d-821e-38dafb3417d1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:11.418710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e3ed2ddd-24be-4105-8c30-3ba76a88f2c6 req-2b1d07fe-a267-468d-821e-38dafb3417d1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:11.488072 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e3ed2ddd-24be-4105-8c30-3ba76a88f2c6 req-2b1d07fe-a267-468d-821e-38dafb3417d1 service nova] Creating event network-vif-plugged:da984eb2-f6a2-446a-b022-c74e6c1875b9 for instance db67c8d8-4c5c-4e94-b890-481ba6ce351d on n-h2-846470-15 Aug 24 04:08:11.517055 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e3ed2ddd-24be-4105-8c30-3ba76a88f2c6 req-2b1d07fe-a267-468d-821e-38dafb3417d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154288 Aug 24 04:08:11.520000 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2716/5687] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:11.601020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:11.606325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:11.678826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:11.681620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:11.697274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:11.703382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:11.713027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:11.717547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:12.358504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:12.387297 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-796b8f74-5d7f-401c-85ba-e6d98ced5e79 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 200 len: 1514 microversion: 2.1 time: 0.795753 Aug 24 04:08:12.413518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:12.415838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 947d39dc-a4d2-4c5e-a2a0-40508f3009b7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:12.420313 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2972/5688] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:11 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 1514 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:12.432162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:12.433193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:12.433892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:12.436213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:12.439960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:12.440845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:13.023338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:13.039260 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79120590-ad7b-4c9f-aed5-15fddad397f2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7" status: 200 len: 1515 microversion: 2.1 time: 0.630233 Aug 24 04:08:13.040964 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2717/5689] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:12 2022] GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7 => generated 1515 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:13.061880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:13.063547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:13.071870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:13.072771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:13.073705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:13.074679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:13.075406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:13.076106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:13.816731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:13.827884 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d64e62d3-6f00-4841-ba52-ebdd44570d0d tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 200 len: 1322 microversion: 2.1 time: 0.769817 Aug 24 04:08:13.844357 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2973/5690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:13 2022] GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 1322 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:14.867042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:14.870364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:14.900666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:14.905943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:14.908234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:14.909297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:14.911963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:14.912735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:15.459444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:15.472225 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4452b94-2dfe-4960-ad00-ca0246612c7b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 200 len: 1514 microversion: 2.1 time: 0.618851 Aug 24 04:08:15.482046 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2718/5691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:14 2022] GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 1514 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:15.537066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:15.537701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:15.547720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:15.548229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:15.548679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:15.549479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:15.549944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:15.550376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:15.634981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:08:15.966394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1dd93267-3738-41ab-b1bf-ce94d5769536 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 204 len: 0 microversion: 2.1 time: 0.454479 Aug 24 04:08:15.971304 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2974/5692] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:08:15 2022] DELETE /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:08:15.991761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:15.992532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:16.012513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:16.013046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:16.013573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:16.014327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:16.014791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:16.015425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:18.436784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:18.497501 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c1a4fac0-aa5a-40cf-98f4-6702ecf49ee2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 200 len: 1520 microversion: 2.1 time: 2.513123 Aug 24 04:08:18.530594 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2719/5693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:15 2022] GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 1520 bytes in 2547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:19.558136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:19.561361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:19.595874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:19.597518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:19.602349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:19.604250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:19.609377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:19.610572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:19.801772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:19.823456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b59204e8-e2d3-4e91-b8ea-fde6782efa6c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 200 len: 1478 microversion: 2.1 time: 0.272556 Aug 24 04:08:19.828956 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2975/5694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:19 2022] GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 1478 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:20.129388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2efe98ed-df92-40e5-b4f5-f32ea3efe9ec req-6085f315-a0b3-4b29-b2f3-1ff5aa01f5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db67c8d8-4c5c-4e94-b890-481ba6ce351d", "name": "network-vif-deleted", "tag": "da984eb2-f6a2-446a-b022-c74e6c1875b9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:20.215779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2efe98ed-df92-40e5-b4f5-f32ea3efe9ec req-6085f315-a0b3-4b29-b2f3-1ff5aa01f5b4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:20.250035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2efe98ed-df92-40e5-b4f5-f32ea3efe9ec req-6085f315-a0b3-4b29-b2f3-1ff5aa01f5b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:20.251731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2efe98ed-df92-40e5-b4f5-f32ea3efe9ec req-6085f315-a0b3-4b29-b2f3-1ff5aa01f5b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:20.408755 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2efe98ed-df92-40e5-b4f5-f32ea3efe9ec req-6085f315-a0b3-4b29-b2f3-1ff5aa01f5b4 service nova] Creating event network-vif-deleted:da984eb2-f6a2-446a-b022-c74e6c1875b9 for instance db67c8d8-4c5c-4e94-b890-481ba6ce351d on n-h2-846470-15 Aug 24 04:08:20.575480 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2efe98ed-df92-40e5-b4f5-f32ea3efe9ec req-6085f315-a0b3-4b29-b2f3-1ff5aa01f5b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.411658 Aug 24 04:08:20.577368 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2720/5695] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:08:20.875698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:20.875698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:20.913766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:20.914961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:20.915429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:20.922135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:20.927746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:20.928504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:21.130843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:21.138732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:21.139593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:21.142979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lazy-loading 'fault' on Instance uuid db67c8d8-4c5c-4e94-b890-481ba6ce351d {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:08:21.509981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:21.545257 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac15ef33-d97f-484a-b6b3-a4ecf8d9a431 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 200 len: 1312 microversion: 2.1 time: 0.687760 Aug 24 04:08:21.579879 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2976/5696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:20 2022] GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 1312 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:22.590044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:22.591513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:22.624742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:22.625554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:22.626374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:22.633800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:22.637711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:22.640859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:22.706318 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] HTTP exception thrown: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Request method failure captured: Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d HTTP/1.1 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaQDm0OpTjw5ZW-ijOmfji7P4cLTs5nfuw7NcjeyCxRpxDXdvhUU_a0S2rXFgmKwS1NjnW976nqOqLAgYJzWGu7w9k58XPZf-rBgk4R0JOjk4JkLmBS1V2WyzEw5aNR7IWVJDrhZq8UuY7AwajOorW6uohHT34WWFekBVHVGrPdY0l8 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b160be74f6774ad49d154165e6244cc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d54961361bd741c89aff920f93b6d88b Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'db67c8d8-4c5c-4e94-b890-481ba6ce351d'} Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:22.733397 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:22.738671 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:22.738671 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:22.738671 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:22.738671 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:22.738671 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:08:22.738671 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:08:22.738671 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:22.738671 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:22.741933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Returning 404 to user: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:22.743488 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cda75685-6640-432a-99f3-8b334cc315c7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 404 len: 111 microversion: 2.1 time: 0.175285 Aug 24 04:08:22.757294 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2721/5697] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:22 2022] GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:08:22.762947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:22.783754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:22.790920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:08:22.823233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:22.825870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:22.826700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:22.831882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:22.833226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:22.841087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:23.100047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66078c80-ff82-4bc7-ab37-3cb3b83cb911 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.341063 Aug 24 04:08:23.100675 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2977/5698] 10.222.0.58 () {58 vars in 1230 bytes} [Wed Aug 24 04:08:22 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:08:23.117625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b699b28e-410f-4d53-a816-70ca680c4362 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b699b28e-410f-4d53-a816-70ca680c4362 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Request method failure captured: Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaQDm0OpTjw5ZW-ijOmfji7P4cLTs5nfuw7NcjeyCxRpxDXdvhUU_a0S2rXFgmKwS1NjnW976nqOqLAgYJzWGu7w9k58XPZf-rBgk4R0JOjk4JkLmBS1V2WyzEw5aNR7IWVJDrhZq8UuY7AwajOorW6uohHT34WWFekBVHVGrPdY0l8 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b160be74f6774ad49d154165e6244cc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d54961361bd741c89aff920f93b6d88b Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: action_args: {} Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 04:08:23.135202 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b699b28e-410f-4d53-a816-70ca680c4362 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b699b28e-410f-4d53-a816-70ca680c4362 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.026890 Aug 24 04:08:23.142050 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2722/5699] 10.222.0.58 () {58 vars in 1182 bytes} [Wed Aug 24 04:08:23 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:08:23.151618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:23.185365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:23.186863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'deleted': False, 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:08:23.196892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:23.199128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:23.200721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:23.206331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:23.208465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:23.209510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:23.292312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.multi_cell_list [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 04:08:23.400379 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2d3837ed-7f55-4879-a4d1-f437d7a48776 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.253607 Aug 24 04:08:23.404646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2978/5700] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 04:08:23 2022] GET /compute/v2.1/servers => generated 681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:23.422780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:23.434213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:23.434697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.servers [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Removing options 'limit' from query {{(pid=122535) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 04:08:23.435623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'deleted': False, 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:08:23.481858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:23.494838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:23.495740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:23.497404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:23.505145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:23.522634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:23.617231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 04:08:23.775061 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf85fa61-cbeb-43ee-80dd-edafee701e5b tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.356403 Aug 24 04:08:23.786609 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2723/5701] 10.222.0.58 () {58 vars in 1144 bytes} [Wed Aug 24 04:08:23 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:23.801060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a07ca81-e7c1-4aa2-a6b7-351e300790bf tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a07ca81-e7c1-4aa2-a6b7-351e300790bf tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Request method failure captured: Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaQDm0OpTjw5ZW-ijOmfji7P4cLTs5nfuw7NcjeyCxRpxDXdvhUU_a0S2rXFgmKwS1NjnW976nqOqLAgYJzWGu7w9k58XPZf-rBgk4R0JOjk4JkLmBS1V2WyzEw5aNR7IWVJDrhZq8UuY7AwajOorW6uohHT34WWFekBVHVGrPdY0l8 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b160be74f6774ad49d154165e6244cc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d54961361bd741c89aff920f93b6d88b Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: action_args: {} Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi '-1' Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 04:08:23.812272 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 04:08:23.826010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.834369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a07ca81-e7c1-4aa2-a6b7-351e300790bf tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:23.835253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a07ca81-e7c1-4aa2-a6b7-351e300790bf tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.038532 Aug 24 04:08:23.837059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2979/5702] 10.222.0.58 () {58 vars in 1142 bytes} [Wed Aug 24 04:08:23 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:08:23.865010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28ae0a76-04ed-47c9-937b-379508a0cd5e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28ae0a76-04ed-47c9-937b-379508a0cd5e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Request method failure captured: Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaQDm0OpTjw5ZW-ijOmfji7P4cLTs5nfuw7NcjeyCxRpxDXdvhUU_a0S2rXFgmKwS1NjnW976nqOqLAgYJzWGu7w9k58XPZf-rBgk4R0JOjk4JkLmBS1V2WyzEw5aNR7IWVJDrhZq8UuY7AwajOorW6uohHT34WWFekBVHVGrPdY0l8 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b160be74f6774ad49d154165e6244cc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d54961361bd741c89aff920f93b6d88b Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: action_args: {} Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi 'testing' Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 04:08:23.870885 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 04:08:23.879264 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:23.884782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28ae0a76-04ed-47c9-937b-379508a0cd5e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:23.888921 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-28ae0a76-04ed-47c9-937b-379508a0cd5e tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.041166 Aug 24 04:08:23.891380 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2724/5703] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 04:08:23 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:08:23.915803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-22d45686-8c63-42b5-863f-ec1bce278e98 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:23.934875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-22d45686-8c63-42b5-863f-ec1bce278e98 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:23.940065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-22d45686-8c63-42b5-863f-ec1bce278e98 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:08:23.963052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.compute.servers [None req-22d45686-8c63-42b5-863f-ec1bce278e98 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Flavor 'non_existing_flavor' could not be found {{(pid=122536) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 24 04:08:23.964690 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-22d45686-8c63-42b5-863f-ec1bce278e98 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.066778 Aug 24 04:08:23.965563 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2980/5704] 10.222.0.58 () {58 vars in 1178 bytes} [Wed Aug 24 04:08:23 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:08:23.980682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:23.991920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:23.997687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:08:24.027595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:24.028413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:24.034154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:24.035507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:24.036411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:24.037098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:24.262476 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-258335ac-7c71-4da4-8012-4ae621c20eca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.285160 Aug 24 04:08:24.268582 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2725/5705] 10.222.0.58 () {58 vars in 1174 bytes} [Wed Aug 24 04:08:23 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:08:24.290380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:24.320342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:24.322686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:08:24.344788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:24.354895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:24.357701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:24.360725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:24.370685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:24.372087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:24.654385 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-158e56e4-256d-4d7c-896f-d2272870daa7 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.372377 Aug 24 04:08:24.656594 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2981/5706] 10.222.0.58 () {58 vars in 1184 bytes} [Wed Aug 24 04:08:24 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:08:24.693607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:24.720973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:24.725733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'deleted': False, 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:08:24.760593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:24.764781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:24.765813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:24.769049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:24.772524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:24.777666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:24.950182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 04:08:25.154485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:25.178408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:25.182937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:25.183835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:25.572629 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8798a91-d45d-4cad-bc4d-b31cbd4435ae tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.898719 Aug 24 04:08:25.573238 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2726/5707] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 04:08:24 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:08:25.631309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5fffce70-2c7a-4907-b48a-4e98fa0c550c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:25.681551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5fffce70-2c7a-4907-b48a-4e98fa0c550c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:25.694118 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5fffce70-2c7a-4907-b48a-4e98fa0c550c tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.075346 Aug 24 04:08:25.703497 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2982/5708] 10.222.0.58 () {58 vars in 1178 bytes} [Wed Aug 24 04:08:25 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:08:25.758467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:25.776273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:25.778366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Searching by: {'deleted': False, 'project_id': 'b160be74f6774ad49d154165e6244cc2'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:08:25.795404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:25.798728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:25.799462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:25.816816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:25.817697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:25.818171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:25.912883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 04:08:26.014183 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6212fb17-5e0e-4627-97aa-10f127508a38 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.291483 Aug 24 04:08:26.015091 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2727/5709] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 04:08:25 2022] GET /compute/v2.1/servers => generated 681 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:08:26.039210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:26.039843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:26.052639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:26.054553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:26.056186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:26.058533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:26.059925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:26.062008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:26.119078 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] HTTP exception thrown: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Request method failure captured: Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d HTTP/1.1 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaQDm0OpTjw5ZW-ijOmfji7P4cLTs5nfuw7NcjeyCxRpxDXdvhUU_a0S2rXFgmKwS1NjnW976nqOqLAgYJzWGu7w9k58XPZf-rBgk4R0JOjk4JkLmBS1V2WyzEw5aNR7IWVJDrhZq8UuY7AwajOorW6uohHT34WWFekBVHVGrPdY0l8 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b160be74f6774ad49d154165e6244cc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d54961361bd741c89aff920f93b6d88b Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'db67c8d8-4c5c-4e94-b890-481ba6ce351d'} Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:08:26.125561 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Returning 404 to user: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48fb3397-b7a2-464d-80f3-2e010094d092 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 404 len: 111 microversion: 2.1 time: 0.094077 Aug 24 04:08:26.136252 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2983/5710] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:08:26 2022] DELETE /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:08:26.140595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:26.141185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 947d39dc-a4d2-4c5e-a2a0-40508f3009b7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:26.158755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:26.159515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:26.159755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:26.160676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:26.161408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:26.162011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:26.295362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 947d39dc-a4d2-4c5e-a2a0-40508f3009b7] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:08:26.474519 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8cd9f504-c6b6-4161-82ad-a3c6a94c7a78 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7" status: 204 len: 0 microversion: 2.1 time: 0.337234 Aug 24 04:08:26.476984 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2728/5711] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:08:26 2022] DELETE /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:08:26.492818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:26.493601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:26.520130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:26.520629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:26.524024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:26.524966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:26.531613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:26.532809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:26.600538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:08:26.767979 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9d26de2-4c03-41b3-a46c-ed6faa21d4ca tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 204 len: 0 microversion: 2.1 time: 0.284810 Aug 24 04:08:26.771532 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2984/5712] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:08:26 2022] DELETE /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:08:26.781240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:26.782903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: db67c8d8-4c5c-4e94-b890-481ba6ce351d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:26.799202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:26.800718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:26.802431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:26.804055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:26.804790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:26.805499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:26.835948 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] HTTP exception thrown: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Request method failure captured: Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d HTTP/1.1 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaQDm0OpTjw5ZW-ijOmfji7P4cLTs5nfuw7NcjeyCxRpxDXdvhUU_a0S2rXFgmKwS1NjnW976nqOqLAgYJzWGu7w9k58XPZf-rBgk4R0JOjk4JkLmBS1V2WyzEw5aNR7IWVJDrhZq8UuY7AwajOorW6uohHT34WWFekBVHVGrPdY0l8 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b160be74f6774ad49d154165e6244cc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d54961361bd741c89aff920f93b6d88b Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'db67c8d8-4c5c-4e94-b890-481ba6ce351d'} Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.840178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:26.847329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.847329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:26.847329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:26.847329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:26.847329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:08:26.847329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:08:26.847329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. Aug 24 04:08:26.847329 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:26.850976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Returning 404 to user: Instance db67c8d8-4c5c-4e94-b890-481ba6ce351d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:26.852324 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b6496ae1-972e-4a1e-8a67-c5ee3ef91031 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d" status: 404 len: 111 microversion: 2.1 time: 0.076876 Aug 24 04:08:26.853509 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2729/5713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:26 2022] GET /compute/v2.1/servers/db67c8d8-4c5c-4e94-b890-481ba6ce351d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:08:26.876894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:26.880017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 947d39dc-a4d2-4c5e-a2a0-40508f3009b7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:26.998585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:27.006264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:27.009941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:27.010936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:27.015795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:27.016331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:27.593807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:27.605896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-39130f9d-c833-42d5-9663-16c79661d4d4 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7" status: 200 len: 1521 microversion: 2.1 time: 0.741041 Aug 24 04:08:27.609642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2985/5714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:26 2022] GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7 => generated 1521 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:28.629406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:28.631211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 947d39dc-a4d2-4c5e-a2a0-40508f3009b7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:28.662712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:28.663590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:28.665724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:28.669109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:28.673639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:28.680022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:30.205275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:30.228352 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c32c00ab-cac8-48b1-ae02-f747d3fcc3c2 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7" status: 200 len: 1521 microversion: 2.1 time: 1.605259 Aug 24 04:08:30.238691 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2730/5715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:28 2022] GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7 => generated 1521 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:30.349286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7cbf7e4b-41ed-4700-a9e7-abd66e5b811a req-f77bfe2d-262d-4d7a-a98c-522e190683bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b078da3-7334-4789-8011-1449b39457e0", "name": "network-vif-deleted", "tag": "dffff413-d33d-47bf-8b65-1234d80adda0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:30.431936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7cbf7e4b-41ed-4700-a9e7-abd66e5b811a req-f77bfe2d-262d-4d7a-a98c-522e190683bd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:30.432419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7cbf7e4b-41ed-4700-a9e7-abd66e5b811a req-f77bfe2d-262d-4d7a-a98c-522e190683bd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:30.432875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7cbf7e4b-41ed-4700-a9e7-abd66e5b811a req-f77bfe2d-262d-4d7a-a98c-522e190683bd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:30.486944 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7cbf7e4b-41ed-4700-a9e7-abd66e5b811a req-f77bfe2d-262d-4d7a-a98c-522e190683bd service nova] Creating event network-vif-deleted:dffff413-d33d-47bf-8b65-1234d80adda0 for instance 3b078da3-7334-4789-8011-1449b39457e0 on n-h2-846470-15 Aug 24 04:08:30.515121 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7cbf7e4b-41ed-4700-a9e7-abd66e5b811a req-f77bfe2d-262d-4d7a-a98c-522e190683bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167527 Aug 24 04:08:30.520622 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2986/5716] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:08:31.265712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:31.267078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 947d39dc-a4d2-4c5e-a2a0-40508f3009b7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:31.289616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:31.290049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:31.291834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:31.292731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:31.293433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:31.294067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:31.339928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:31.340823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:31.341488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:31.342481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lazy-loading 'fault' on Instance uuid 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:08:31.414603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54961361bd741c89aff920f93b6d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160be74f6774ad49d154165e6244cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:08:31.448356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c59101c7-4a8c-4d37-a2e2-bf1282e3ed45 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7" status: 200 len: 1312 microversion: 2.1 time: 0.186972 Aug 24 04:08:31.453821 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2731/5717] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:31 2022] GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:08:32.477921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:32.478643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 947d39dc-a4d2-4c5e-a2a0-40508f3009b7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:32.493770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:32.494263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:32.494936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:32.498032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:32.498758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:32.499388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:32.533623 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] HTTP exception thrown: Instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 could not be found. Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Request method failure captured: Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7 HTTP/1.1 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaQDm0OpTjw5ZW-ijOmfji7P4cLTs5nfuw7NcjeyCxRpxDXdvhUU_a0S2rXFgmKwS1NjnW976nqOqLAgYJzWGu7w9k58XPZf-rBgk4R0JOjk4JkLmBS1V2WyzEw5aNR7IWVJDrhZq8UuY7AwajOorW6uohHT34WWFekBVHVGrPdY0l8 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b160be74f6774ad49d154165e6244cc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d54961361bd741c89aff920f93b6d88b Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 could not be found. Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '947d39dc-a4d2-4c5e-a2a0-40508f3009b7'} Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 could not be found. Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 could not be found. Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.536442 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:32.540909 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.540909 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:32.540909 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:32.540909 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:32.540909 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:08:32.540909 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:08:32.540909 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 could not be found. Aug 24 04:08:32.540909 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.543014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Returning 404 to user: Instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:32.544153 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d7bd4a9-0aee-4ee0-880e-44bee2d1e788 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7" status: 404 len: 111 microversion: 2.1 time: 0.070871 Aug 24 04:08:32.544933 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2987/5718] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:32 2022] GET /compute/v2.1/servers/947d39dc-a4d2-4c5e-a2a0-40508f3009b7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:08:32.557935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:08:32.558989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] [instance: 3b078da3-7334-4789-8011-1449b39457e0] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:08:32.573907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:32.575015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:32.575965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:32.577212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:32.578235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:32.578926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:32.591276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a0ba4c6b-729a-4f45-90ed-d737e2bc31d9 req-b0e85a72-651e-4d94-99f5-7567043e1513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947d39dc-a4d2-4c5e-a2a0-40508f3009b7", "name": "network-vif-deleted", "tag": "def38ce4-a811-4145-87bb-0beb2b1ff6f6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:32.602110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a0ba4c6b-729a-4f45-90ed-d737e2bc31d9 req-b0e85a72-651e-4d94-99f5-7567043e1513 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:32.602888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a0ba4c6b-729a-4f45-90ed-d737e2bc31d9 req-b0e85a72-651e-4d94-99f5-7567043e1513 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:32.603480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a0ba4c6b-729a-4f45-90ed-d737e2bc31d9 req-b0e85a72-651e-4d94-99f5-7567043e1513 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:32.613705 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] HTTP exception thrown: Instance 3b078da3-7334-4789-8011-1449b39457e0 could not be found. Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Request method failure captured: Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 HTTP/1.1 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaQDm0OpTjw5ZW-ijOmfji7P4cLTs5nfuw7NcjeyCxRpxDXdvhUU_a0S2rXFgmKwS1NjnW976nqOqLAgYJzWGu7w9k58XPZf-rBgk4R0JOjk4JkLmBS1V2WyzEw5aNR7IWVJDrhZq8UuY7AwajOorW6uohHT34WWFekBVHVGrPdY0l8 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b160be74f6774ad49d154165e6244cc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b160be74f6774ad49d154165e6244cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b160be74f6774ad49d154165e6244cc2 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-853990469 Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d54961361bd741c89aff920f93b6d88b Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ListServersNegativeTestJSON-853990469-project Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 3b078da3-7334-4789-8011-1449b39457e0 could not be found. Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '3b078da3-7334-4789-8011-1449b39457e0'} Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b078da3-7334-4789-8011-1449b39457e0 could not be found. Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b078da3-7334-4789-8011-1449b39457e0 could not be found. Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.615893 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b078da3-7334-4789-8011-1449b39457e0 could not be found. Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:08:32.621150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] Returning 404 to user: Instance 3b078da3-7334-4789-8011-1449b39457e0 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:08:32.622586 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-550b44ff-1aa3-4895-b0c0-78ee8395af83 tempest-ListServersNegativeTestJSON-853990469 tempest-ListServersNegativeTestJSON-853990469-project] 10.222.0.58 "GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0" status: 404 len: 111 microversion: 2.1 time: 0.071879 Aug 24 04:08:32.623794 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a0ba4c6b-729a-4f45-90ed-d737e2bc31d9 req-b0e85a72-651e-4d94-99f5-7567043e1513 service nova] Creating event network-vif-deleted:def38ce4-a811-4145-87bb-0beb2b1ff6f6 for instance 947d39dc-a4d2-4c5e-a2a0-40508f3009b7 on n-h1-846470-15 Aug 24 04:08:32.624706 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2732/5719] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:08:32 2022] GET /compute/v2.1/servers/3b078da3-7334-4789-8011-1449b39457e0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:08:32.631167 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a0ba4c6b-729a-4f45-90ed-d737e2bc31d9 req-b0e85a72-651e-4d94-99f5-7567043e1513 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045056 Aug 24 04:08:32.632544 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2988/5720] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:08:57.751254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:57.753006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:57.756408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:57.757835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:58.136998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1648926995", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8b58a1bb-fec3-4983-ba1b-7b63eea26d20"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:08:58.297245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] validate_networks() for [('8b58a1bb-fec3-4983-ba1b-7b63eea26d20', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:08:59.579564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:08:59.580706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:08:59.581400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:08:59.582362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:08:59.582976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:08:59.617797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:59.618049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:59.618685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:59.619619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:08:59.620212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:08:59.620747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:08:59.650234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Getting quotas for project de654780261a47eb8776c56c66bdfae2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:08:59.671363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Getting quotas for user 720aaae2b46540a08b573d66dfa1b774 and project de654780261a47eb8776c56c66bdfae2. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:08:59.764886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Going to run 2 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:08:59.764886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:08:59.824372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:08:59.977247 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06093669-40db-45f1-afc5-babc90dd3ce8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232639 Aug 24 04:08:59.978043 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2733/5721] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:08:59.997926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:00.020478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:00.022386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Searching by: {'deleted': False, 'project_id': 'de654780261a47eb8776c56c66bdfae2'} {{(pid=122536) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:09:00.032815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:00.034649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:00.039343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:00.112306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:00.113792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:00.114573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:00.124244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:00.125072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:00.131455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:00.194300 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe15c590-7b32-4dd5-8437-a803bd672f57 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.203954 Aug 24 04:09:00.194905 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2989/5722] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 04:08:59 2022] GET /compute/v2.1/servers => generated 677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:00.209738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2f2d169f-2383-475b-aa95-9929ebc431cb tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:00.211152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2f2d169f-2383-475b-aa95-9929ebc431cb tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:00.399554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2f2d169f-2383-475b-aa95-9929ebc431cb tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:00.415465 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2f2d169f-2383-475b-aa95-9929ebc431cb tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1220 microversion: 2.1 time: 0.212103 Aug 24 04:09:00.417365 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2734/5723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:00 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1220 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:01.455216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:01.456785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:01.475587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:01.477006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:01.479092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:01.481288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:01.484475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:01.485257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:01.679295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:01.707133 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4d6ad01-9a38-4d91-802d-6508fe558480 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1224 microversion: 2.1 time: 0.256699 Aug 24 04:09:01.752411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2990/5724] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:01 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1224 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:02.808351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:02.809931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:02.910650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:02.916092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:02.916919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:02.922203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:02.926702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:02.927533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:03.848202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:03.883028 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0eaab786-e6c6-4108-8e28-e18ded6609f9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1280 microversion: 2.1 time: 1.084259 Aug 24 04:09:03.896291 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2735/5725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:02 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1280 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:04.928210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:04.929490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:04.942272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:04.946417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:04.947129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:04.948091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:04.950011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:04.950641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:05.103579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:05.117814 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2794e51a-1f34-40bc-b645-4460d425faa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1278 microversion: 2.1 time: 0.193150 Aug 24 04:09:05.118760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2991/5726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:04 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:06.141042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:06.141707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:06.162926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:06.174102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:06.174968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:06.175822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:06.176297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:06.182153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:07.257895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:07.273490 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6cbf1186-02f2-42ce-bdba-b86640f3eba6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 1.135986 Aug 24 04:09:07.293836 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2736/5727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:06 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:07.604045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e13fc826-7da7-4bb6-94ee-7c53c749070d req-980ca2ca-1165-428c-872c-a70f9af83b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a", "tag": "caebaf49-2a88-465f-853a-18cc726dfe6c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:07.641561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e13fc826-7da7-4bb6-94ee-7c53c749070d req-980ca2ca-1165-428c-872c-a70f9af83b22 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:07.644217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e13fc826-7da7-4bb6-94ee-7c53c749070d req-980ca2ca-1165-428c-872c-a70f9af83b22 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:07.646009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e13fc826-7da7-4bb6-94ee-7c53c749070d req-980ca2ca-1165-428c-872c-a70f9af83b22 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:07.693839 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e13fc826-7da7-4bb6-94ee-7c53c749070d req-980ca2ca-1165-428c-872c-a70f9af83b22 service nova] Creating event network-changed:caebaf49-2a88-465f-853a-18cc726dfe6c for instance e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a on n-h2-846470-15 Aug 24 04:09:07.715649 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e13fc826-7da7-4bb6-94ee-7c53c749070d req-980ca2ca-1165-428c-872c-a70f9af83b22 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117707 Aug 24 04:09:07.719516 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2992/5728] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:08.321548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:08.322895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:08.354528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:08.358519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:08.359940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:08.362256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:08.365218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:08.366665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:09.491723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:09.505901 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84a0f871-3551-4e75-9560-f1ad36fa9fee tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 1.200894 Aug 24 04:09:09.513077 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2737/5729] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:08 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:09.837087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c4813faf-2120-4991-8f46-1abc43f576f6 req-f90195f1-5e82-4b5e-b9d7-2e41ca1d01d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d6b02a-b805-4b2f-992f-299a4689e6c3", "tag": "6282430e-b6af-4be9-8b59-ce7d9a0d97d9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:09.870631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4813faf-2120-4991-8f46-1abc43f576f6 req-f90195f1-5e82-4b5e-b9d7-2e41ca1d01d6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:09.887982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4813faf-2120-4991-8f46-1abc43f576f6 req-f90195f1-5e82-4b5e-b9d7-2e41ca1d01d6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:09.892358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c4813faf-2120-4991-8f46-1abc43f576f6 req-f90195f1-5e82-4b5e-b9d7-2e41ca1d01d6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:09.931368 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c4813faf-2120-4991-8f46-1abc43f576f6 req-f90195f1-5e82-4b5e-b9d7-2e41ca1d01d6 service nova] Creating event network-changed:6282430e-b6af-4be9-8b59-ce7d9a0d97d9 for instance 41d6b02a-b805-4b2f-992f-299a4689e6c3 on n-h1-846470-15 Aug 24 04:09:09.944106 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c4813faf-2120-4991-8f46-1abc43f576f6 req-f90195f1-5e82-4b5e-b9d7-2e41ca1d01d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122422 Aug 24 04:09:09.947471 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2993/5730] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:10.533166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:10.535112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:10.546693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:10.549054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:10.553873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:10.555032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:10.556060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:10.557479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:10.558476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:10.559389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:10.827947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:10.842342 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-665456ad-44e0-48fe-adc6-bd02e0c8d42a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 0.315487 Aug 24 04:09:10.843376 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2738/5731] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:10 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:09:11.862695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:11.870828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:11.871993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:11.883224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:11.883741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:11.884417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:11.885309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:11.885939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:11.886537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:12.152276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:12.160746 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92475601-b976-4b2d-b759-843274c307ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 0.298913 Aug 24 04:09:12.161962 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2994/5732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:11 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:13.193838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:13.195007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:13.230926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:13.233747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:13.236344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:13.242443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:13.243619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:13.248162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:14.095202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:14.108622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-99c4fcd0-d2d1-4c25-bf9c-461341fb2b31 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 0.926622 Aug 24 04:09:14.110394 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2739/5733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:13 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:14.817609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d2a55e5e-fc7c-46eb-9181-a869cd1f9b71 req-f9ed0745-eafa-4d60-9130-e4220abe77bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a", "name": "network-vif-plugged", "status": "completed", "tag": "caebaf49-2a88-465f-853a-18cc726dfe6c"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:14.857664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2a55e5e-fc7c-46eb-9181-a869cd1f9b71 req-f9ed0745-eafa-4d60-9130-e4220abe77bc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:14.858727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2a55e5e-fc7c-46eb-9181-a869cd1f9b71 req-f9ed0745-eafa-4d60-9130-e4220abe77bc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:14.859304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2a55e5e-fc7c-46eb-9181-a869cd1f9b71 req-f9ed0745-eafa-4d60-9130-e4220abe77bc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:14.906667 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d2a55e5e-fc7c-46eb-9181-a869cd1f9b71 req-f9ed0745-eafa-4d60-9130-e4220abe77bc service nova] Creating event network-vif-plugged:caebaf49-2a88-465f-853a-18cc726dfe6c for instance e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a on n-h2-846470-15 Aug 24 04:09:14.922931 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d2a55e5e-fc7c-46eb-9181-a869cd1f9b71 req-f9ed0745-eafa-4d60-9130-e4220abe77bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109765 Aug 24 04:09:14.937445 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2995/5734] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:09:15.142803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:15.145439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:15.161370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:15.163022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:15.164213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:15.166269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:15.167466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:15.168897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:15.415656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:15.425806 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f6650fe0-1486-4668-a933-01a02056a5d0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 0.290933 Aug 24 04:09:15.440453 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2740/5735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:15 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:16.449406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:16.450897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:16.461847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:16.463584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:16.465072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:16.466815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:16.469323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:16.471021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:16.735426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:16.767148 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c59d58b-2b27-44cf-94ac-5c322af6c5b0 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 0.322344 Aug 24 04:09:16.769565 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2996/5736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:16 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:09:17.256152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4d048392-a614-40d0-97ca-95491f3ab893 req-83e85b98-78a0-47c7-82de-40f118eeb769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d6b02a-b805-4b2f-992f-299a4689e6c3", "name": "network-vif-plugged", "status": "completed", "tag": "6282430e-b6af-4be9-8b59-ce7d9a0d97d9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:17.314078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4d048392-a614-40d0-97ca-95491f3ab893 req-83e85b98-78a0-47c7-82de-40f118eeb769 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:17.317859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4d048392-a614-40d0-97ca-95491f3ab893 req-83e85b98-78a0-47c7-82de-40f118eeb769 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:17.321101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4d048392-a614-40d0-97ca-95491f3ab893 req-83e85b98-78a0-47c7-82de-40f118eeb769 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:17.374373 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4d048392-a614-40d0-97ca-95491f3ab893 req-83e85b98-78a0-47c7-82de-40f118eeb769 service nova] Creating event network-vif-plugged:6282430e-b6af-4be9-8b59-ce7d9a0d97d9 for instance 41d6b02a-b805-4b2f-992f-299a4689e6c3 on n-h1-846470-15 Aug 24 04:09:17.389533 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4d048392-a614-40d0-97ca-95491f3ab893 req-83e85b98-78a0-47c7-82de-40f118eeb769 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138510 Aug 24 04:09:17.392422 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2741/5737] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:17.794872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:17.800231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:17.826716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:17.828935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:17.833460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:17.835543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:17.838676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:17.844381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:18.146077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:18.161403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a7bda085-650f-4eb3-b879-dd78864d4edc tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 0.373783 Aug 24 04:09:18.162108 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2997/5738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:17 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:19.184346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:19.185036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:19.213926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:19.215340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:19.217803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:19.222166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:19.223796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:19.224493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:19.563275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:19.578491 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-43b6c548-6837-4138-9a00-fc725097d408 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1320 microversion: 2.1 time: 0.399096 Aug 24 04:09:19.581897 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2742/5739] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:19 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1320 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:20.603615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:20.605276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:20.624765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:20.626012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:20.628368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:20.628368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:20.628368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:20.630651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:20.925867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:20.977108 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b56b74a2-180a-4bfe-9cad-038129a43379 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 200 len: 1507 microversion: 2.1 time: 0.363259 Aug 24 04:09:20.985947 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2998/5740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:20 2022] GET /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:21.023194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:21.025336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:21.054084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:21.055197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:21.057312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:21.081722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:21.082691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:21.083351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:21.855299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:21.892079 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a1a0bc2-9f03-4086-985b-567b79fb7981 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a" status: 200 len: 1506 microversion: 2.1 time: 0.882977 Aug 24 04:09:21.893035 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2743/5741] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:21 2022] GET /compute/v2.1/servers/e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a => generated 1506 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:21.935173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:21.935766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:21.955633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:21.956631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:21.957516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:21.959631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:21.960859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:21.962848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:22.056164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:09:22.361216 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-421cd672-888b-42e4-88c5-a0a5f2422038 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a" status: 204 len: 0 microversion: 2.1 time: 0.437435 Aug 24 04:09:22.365546 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 2999/5742] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:09:21 2022] DELETE /compute/v2.1/servers/e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:09:22.378501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:22.380993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:22.415359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:22.418717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:22.424967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:22.430907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:22.435192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:22.439819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:22.544751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 41d6b02a-b805-4b2f-992f-299a4689e6c3] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:09:22.865140 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-129bd612-e02a-422e-910e-289ae96da663 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "DELETE /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3" status: 204 len: 0 microversion: 2.1 time: 0.489509 Aug 24 04:09:22.888914 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2744/5743] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:09:22 2022] DELETE /compute/v2.1/servers/41d6b02a-b805-4b2f-992f-299a4689e6c3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:09:23.202446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1857331255", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8b58a1bb-fec3-4983-ba1b-7b63eea26d20"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:23.441538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] validate_networks() for [('8b58a1bb-fec3-4983-ba1b-7b63eea26d20', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:09:25.320455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:09:25.322326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:09:25.324324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:09:25.325746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:09:25.326897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:09:25.360289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:25.361074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:25.364500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:25.390999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:25.395602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:25.399888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:25.478300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Getting quotas for project de654780261a47eb8776c56c66bdfae2. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:09:25.495736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Getting quotas for user 720aaae2b46540a08b573d66dfa1b774 and project de654780261a47eb8776c56c66bdfae2. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:09:25.554090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Going to run 2 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:09:25.571118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:09:25.630847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=1fe88868-e949-45c4-a27b-27513320b46d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:09:25.732676 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [7066c2fc-b0e4-41c5-bb1b-0ca479a634e9] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:09:26.440807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6efd325e-b7fe-4125-9706-fc13c3e5e2ba req-5198f920-c077-413c-b55a-5a812c88bcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a", "name": "network-vif-deleted", "tag": "caebaf49-2a88-465f-853a-18cc726dfe6c"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:26.472485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6efd325e-b7fe-4125-9706-fc13c3e5e2ba req-5198f920-c077-413c-b55a-5a812c88bcbe service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:26.474011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6efd325e-b7fe-4125-9706-fc13c3e5e2ba req-5198f920-c077-413c-b55a-5a812c88bcbe service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:26.474648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6efd325e-b7fe-4125-9706-fc13c3e5e2ba req-5198f920-c077-413c-b55a-5a812c88bcbe service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:26.539429 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6efd325e-b7fe-4125-9706-fc13c3e5e2ba req-5198f920-c077-413c-b55a-5a812c88bcbe service nova] Creating event network-vif-deleted:caebaf49-2a88-465f-853a-18cc726dfe6c for instance e18511fd-c5ee-4ed6-a4cb-8c4511f8df5a on n-h2-846470-15 Aug 24 04:09:26.561505 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6efd325e-b7fe-4125-9706-fc13c3e5e2ba req-5198f920-c077-413c-b55a-5a812c88bcbe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118243 Aug 24 04:09:26.567764 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2745/5744] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:09:26.740840 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [7066c2fc-b0e4-41c5-bb1b-0ca479a634e9] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41686. Aug 24 04:09:26.745654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-acb560ed-0d50-420f-b735-009a57b15460 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.555920 Aug 24 04:09:26.747191 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3000/5745] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:09:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 3559 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 24 04:09:26.756977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:26.762163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:26.770986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Searching by: {'deleted': False, 'project_id': 'de654780261a47eb8776c56c66bdfae2'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:09:26.818863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:26.819574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:26.820297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:26.821950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:26.823684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:26.824512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:26.892551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 04:09:26.989711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88ff1d3b-b24a-41bf-898b-a3db73c36ba9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.237961 Aug 24 04:09:26.991390 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2746/5746] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 04:09:26 2022] GET /compute/v2.1/servers => generated 1337 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:09:27.009382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0def0e8-c5c2-41dd-b1f1-0059a861928a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:27.010818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0def0e8-c5c2-41dd-b1f1-0059a861928a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:27.194805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0def0e8-c5c2-41dd-b1f1-0059a861928a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:27.208923 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0def0e8-c5c2-41dd-b1f1-0059a861928a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1218 microversion: 2.1 time: 0.206351 Aug 24 04:09:27.209752 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3001/5747] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:27 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:28.233575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1be6db14-a4f7-477a-b8e3-74e220a017c6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:28.234381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1be6db14-a4f7-477a-b8e3-74e220a017c6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:28.246088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:28.346342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1be6db14-a4f7-477a-b8e3-74e220a017c6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:28.355848 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1be6db14-a4f7-477a-b8e3-74e220a017c6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1218 microversion: 2.1 time: 0.126349 Aug 24 04:09:28.368006 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2747/5748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:28 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:28.650266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-177eb965-5a80-4256-988c-4e6f481e2e08 req-858a0737-2e06-42d9-9fe9-feaa4feacdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d6b02a-b805-4b2f-992f-299a4689e6c3", "name": "network-vif-deleted", "tag": "6282430e-b6af-4be9-8b59-ce7d9a0d97d9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:28.685535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-177eb965-5a80-4256-988c-4e6f481e2e08 req-858a0737-2e06-42d9-9fe9-feaa4feacdc2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:28.686025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-177eb965-5a80-4256-988c-4e6f481e2e08 req-858a0737-2e06-42d9-9fe9-feaa4feacdc2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:28.690483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-177eb965-5a80-4256-988c-4e6f481e2e08 req-858a0737-2e06-42d9-9fe9-feaa4feacdc2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:28.724060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-177eb965-5a80-4256-988c-4e6f481e2e08 req-858a0737-2e06-42d9-9fe9-feaa4feacdc2 service nova] Creating event network-vif-deleted:6282430e-b6af-4be9-8b59-ce7d9a0d97d9 for instance 41d6b02a-b805-4b2f-992f-299a4689e6c3 on n-h1-846470-15 Aug 24 04:09:28.742636 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-177eb965-5a80-4256-988c-4e6f481e2e08 req-858a0737-2e06-42d9-9fe9-feaa4feacdc2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096594 Aug 24 04:09:28.754850 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3002/5749] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:09:29.383936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:29.385499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:29.401811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:29.404575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:29.406246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:29.412467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:29.413412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:29.414037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:29.422235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:29.581185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:29.601932 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09b739b1-1ce7-49a1-abec-69697e8d36f6 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1270 microversion: 2.1 time: 0.221692 Aug 24 04:09:29.602597 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2748/5750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:29 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:09:30.625518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:30.626217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:30.630626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:30.646948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:30.648280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:30.652798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:30.654145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:30.654887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:30.655540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:30.801579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:30.815394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6224bb81-2109-48b6-a46a-31e92baec962 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1276 microversion: 2.1 time: 0.194723 Aug 24 04:09:30.816087 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3003/5751] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:30 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:31.838838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:31.841327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:31.850356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:31.851248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:31.851918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:31.853132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:31.853763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:31.854774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:32.265000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:32.288577 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53e47e67-330a-4124-9e46-c83ac09fefa2 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1276 microversion: 2.1 time: 0.454173 Aug 24 04:09:32.292609 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2749/5752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:31 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1276 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:33.319895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:33.324165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:33.339784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:33.342598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:33.345195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:33.347521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:33.355439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:33.365212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:33.379976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:34.102172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:34.113811 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6ee8a07f-3868-462b-8f78-153a3b0d7af7 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 0.799627 Aug 24 04:09:34.122116 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3004/5753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:33 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:35.144546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:35.147571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:35.177450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:35.178936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:35.179870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:35.181338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:35.182268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:35.183147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:35.464734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:35.470945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ec69c3a0-9622-446d-95e8-bf7d1662c2f3 req-79c16925-5922-4b7d-9964-de67349f017d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe88868-e949-45c4-a27b-27513320b46d", "tag": "13ad64a6-25e7-4864-80bc-25fbac94ca6e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:35.519251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ec69c3a0-9622-446d-95e8-bf7d1662c2f3 req-79c16925-5922-4b7d-9964-de67349f017d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:35.520145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ec69c3a0-9622-446d-95e8-bf7d1662c2f3 req-79c16925-5922-4b7d-9964-de67349f017d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:35.520912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ec69c3a0-9622-446d-95e8-bf7d1662c2f3 req-79c16925-5922-4b7d-9964-de67349f017d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:35.625497 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ec69c3a0-9622-446d-95e8-bf7d1662c2f3 req-79c16925-5922-4b7d-9964-de67349f017d service nova] Creating event network-changed:13ad64a6-25e7-4864-80bc-25fbac94ca6e for instance 1fe88868-e949-45c4-a27b-27513320b46d on n-h2-846470-15 Aug 24 04:09:35.641904 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ec69c3a0-9622-446d-95e8-bf7d1662c2f3 req-79c16925-5922-4b7d-9964-de67349f017d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178447 Aug 24 04:09:35.642968 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3005/5754] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:36.832761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:36.860318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:36.872271 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1ee6a195-4c81-4b77-8789-2d4a1fcf92ca tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 1.734194 Aug 24 04:09:36.877138 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2750/5755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:35 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:37.702669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5a562d6a-03c6-4f4d-b8df-b0e1d95b5f4b req-9fffafa0-c1bc-4458-a2b8-bb8698e9142e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab0466b1-d903-40c4-ac1c-1e52cfe8a51c", "tag": "78b004a3-ddf7-46b1-9577-3ade78ffc740"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:37.717920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:37.728026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5a562d6a-03c6-4f4d-b8df-b0e1d95b5f4b req-9fffafa0-c1bc-4458-a2b8-bb8698e9142e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:37.732439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5a562d6a-03c6-4f4d-b8df-b0e1d95b5f4b req-9fffafa0-c1bc-4458-a2b8-bb8698e9142e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:37.733153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5a562d6a-03c6-4f4d-b8df-b0e1d95b5f4b req-9fffafa0-c1bc-4458-a2b8-bb8698e9142e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:37.765942 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5a562d6a-03c6-4f4d-b8df-b0e1d95b5f4b req-9fffafa0-c1bc-4458-a2b8-bb8698e9142e service nova] Creating event network-changed:78b004a3-ddf7-46b1-9577-3ade78ffc740 for instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c on n-h1-846470-15 Aug 24 04:09:37.777340 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5a562d6a-03c6-4f4d-b8df-b0e1d95b5f4b req-9fffafa0-c1bc-4458-a2b8-bb8698e9142e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079494 Aug 24 04:09:37.781346 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3006/5756] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:37.898137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:37.898770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:37.913102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:37.914260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:37.916239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:37.920425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:37.921174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:37.921821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:38.354164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:39.517262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:39.548002 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-032927bc-24b1-4e6e-9d7a-fc25812d875b tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 1.654441 Aug 24 04:09:39.589321 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2751/5757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:37 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:40.140883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1228eb37-ae64-4912-a99d-637649b17117 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Action: 'create', calling method: .version_select at 0x7f102209faf0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-505763909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMPYYom97bieNNXNw82KiBeUfpsoR9f883mhwUsdak4s61pck1tTSyTonGbwCvUunz9frKADT3rHlLTZs2UJg3jg8bPN4lnN5ZW8kHRMhuwUf7kvkmgkZ28aNt/yGvYsA=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:40.191246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1228eb37-ae64-4912-a99d-637649b17117 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Getting quotas for project a16cf00b984a4713a273e24b8731314d. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:09:40.198959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1228eb37-ae64-4912-a99d-637649b17117 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Getting quotas for user 5ff47a8c9f334ea19cb42e30e3678d6c and project a16cf00b984a4713a273e24b8731314d. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:09:40.257588 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1228eb37-ae64-4912-a99d-637649b17117 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.618645 Aug 24 04:09:40.281575 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3007/5758] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:09:39 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:40.608727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:40.609469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:40.621694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:40.624279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:40.624805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:40.625620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:40.630383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:40.631488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:40.960260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:40.984508 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a596e533-5150-4215-ade1-e697010aee71 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 0.378765 Aug 24 04:09:40.986897 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2752/5759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:40 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:42.010842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:42.011848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:42.025662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:42.026044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:42.027486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:42.028496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:42.030442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:42.032476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:42.537192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:42.557528 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8986803d-6208-40a4-8458-8a1f3b72063a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 0.549522 Aug 24 04:09:42.580663 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3008/5760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:42 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:43.587646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:43.588300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:43.601562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:43.601860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:43.602303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:43.603142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:43.603641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:43.620170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:43.846371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:43.858447 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-941bc66f-7717-4331-90ed-7867ad37260c tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 0.274657 Aug 24 04:09:43.859844 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2753/5761] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:43 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:44.745983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a93beaad-c3bc-4c86-a936-0c9e5acc8311 req-24c342d7-c963-4ce8-a968-f47bb6e6114c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe88868-e949-45c4-a27b-27513320b46d", "name": "network-vif-plugged", "status": "completed", "tag": "13ad64a6-25e7-4864-80bc-25fbac94ca6e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:44.765570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a93beaad-c3bc-4c86-a936-0c9e5acc8311 req-24c342d7-c963-4ce8-a968-f47bb6e6114c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:44.766442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a93beaad-c3bc-4c86-a936-0c9e5acc8311 req-24c342d7-c963-4ce8-a968-f47bb6e6114c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:44.767051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a93beaad-c3bc-4c86-a936-0c9e5acc8311 req-24c342d7-c963-4ce8-a968-f47bb6e6114c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:44.783327 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a93beaad-c3bc-4c86-a936-0c9e5acc8311 req-24c342d7-c963-4ce8-a968-f47bb6e6114c service nova] Creating event network-vif-plugged:13ad64a6-25e7-4864-80bc-25fbac94ca6e for instance 1fe88868-e949-45c4-a27b-27513320b46d on n-h2-846470-15 Aug 24 04:09:44.793514 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a93beaad-c3bc-4c86-a936-0c9e5acc8311 req-24c342d7-c963-4ce8-a968-f47bb6e6114c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053508 Aug 24 04:09:44.794813 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3009/5762] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:44.883600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:44.884979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:44.897074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:44.897554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:44.902648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:44.903432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:44.904047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:44.904512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:45.273977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:45.292142 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bbad8a66-c136-4ee2-abab-511371545a9d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 0.412437 Aug 24 04:09:45.293498 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2754/5763] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:44 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:46.317035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:46.318876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:46.334364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:46.336241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:46.339198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:46.342134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:46.344509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:46.346377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:47.011931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2b73d266-34a0-466b-8633-c122f801c9e2 req-5c7c1f8f-89e2-47f9-b61a-9fa1b82695a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0466b1-d903-40c4-ac1c-1e52cfe8a51c", "name": "network-vif-plugged", "status": "completed", "tag": "78b004a3-ddf7-46b1-9577-3ade78ffc740"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:47.033641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:47.043354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b73d266-34a0-466b-8633-c122f801c9e2 req-5c7c1f8f-89e2-47f9-b61a-9fa1b82695a4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:47.044335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b73d266-34a0-466b-8633-c122f801c9e2 req-5c7c1f8f-89e2-47f9-b61a-9fa1b82695a4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:47.044950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b73d266-34a0-466b-8633-c122f801c9e2 req-5c7c1f8f-89e2-47f9-b61a-9fa1b82695a4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:47.048448 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-18be934b-c3f6-458f-8865-3c7b2d3e5fa9 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 0.738735 Aug 24 04:09:47.052154 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3010/5764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:46 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:47.092716 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2b73d266-34a0-466b-8633-c122f801c9e2 req-5c7c1f8f-89e2-47f9-b61a-9fa1b82695a4 service nova] Creating event network-vif-plugged:78b004a3-ddf7-46b1-9577-3ade78ffc740 for instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c on n-h1-846470-15 Aug 24 04:09:47.111358 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2b73d266-34a0-466b-8633-c122f801c9e2 req-5c7c1f8f-89e2-47f9-b61a-9fa1b82695a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116942 Aug 24 04:09:47.112874 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2755/5765] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:48.072582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:48.074066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:48.084157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:48.085161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:48.086204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:48.088868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:48.089773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:48.090492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:48.618709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:48.645186 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c9c6e7a-0bed-4c44-bb17-8f05e3183097 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1318 microversion: 2.1 time: 0.578093 Aug 24 04:09:48.657354 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3011/5766] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:48 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:49.680493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:49.682174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:49.700886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:49.713933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:49.714788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:49.716218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:49.719061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:49.722840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:50.086116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:50.110320 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-196256c3-7572-40e6-b22e-1188e51ccf7f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 200 len: 1505 microversion: 2.1 time: 0.435904 Aug 24 04:09:50.112781 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2756/5767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:49 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:50.132688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:50.133495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:50.183013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:50.184020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:50.200085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:50.200924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:50.216855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:50.218091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:50.224331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:50.697729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:50.708289 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4893a938-5a1d-4bb8-bdf5-a8255644e567 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d" status: 200 len: 1505 microversion: 2.1 time: 0.580538 Aug 24 04:09:50.709623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3012/5768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:50 2022] GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:50.731120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:50.732619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:50.751925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:50.756246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:50.759324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:50.762276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:50.763821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:50.766609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:50.874125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:09:51.097461 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dbbab309-f742-4b2d-ad12-65cc20d21c1a tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d" status: 204 len: 0 microversion: 2.1 time: 0.368721 Aug 24 04:09:51.103438 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2757/5769] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:09:50 2022] DELETE /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:09:51.110681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:51.111491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:51.126702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:51.127159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:51.127617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:51.128573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:51.133262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:51.133990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:51.185709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:09:51.325007 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-161e340e-3a70-4ca6-9609-738a1f7e729d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 204 len: 0 microversion: 2.1 time: 0.219601 Aug 24 04:09:51.328041 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3013/5770] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:09:51 2022] DELETE /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:09:51.348942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:51.353289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:51.370225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:51.372296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:51.372946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:51.373994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:51.374807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:51.375510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:51.623820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:51.634410 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1d2b1702-dabb-4580-9db4-932b75e8f2b8 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d" status: 200 len: 1511 microversion: 2.1 time: 0.299590 Aug 24 04:09:51.635835 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2758/5771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:51 2022] GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:52.667806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:52.680978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:52.722615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:52.730620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:52.731242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:52.736010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:52.740833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:52.741626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:53.161580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:53.173696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c71ad7f0-82ae-45df-8096-aa0dfc919b1f tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d" status: 200 len: 1511 microversion: 2.1 time: 0.515516 Aug 24 04:09:53.198217 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3014/5772] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:52 2022] GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d => generated 1511 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:54.208665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:54.210045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:54.232816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:54.233681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:54.241147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:54.242991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:54.245630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:54.247980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:55.007749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:55.024468 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cf893512-de01-4b9c-94c0-e0231c0598c1 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d" status: 200 len: 1511 microversion: 2.1 time: 0.826772 Aug 24 04:09:55.032046 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2759/5773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:54 2022] GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d => generated 1511 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:09:55.165092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1722461348-access_point-629585232", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "10252d59-209a-44bb-808c-c729faceb9ee"}], "key_name": "tempest-TestSecurityGroupsBasicOps-505763909", "security_groups": [{"name": "tempest-secgroup_access--396228246"}, {"name": "tempest-secgroup_general--1933082870"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:55.503377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4d8ef8ac-aa1e-492d-a3ac-4aaebe36e48b req-0038e3fc-e464-4446-bb64-c2a1d9226fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe88868-e949-45c4-a27b-27513320b46d", "name": "network-vif-deleted", "tag": "13ad64a6-25e7-4864-80bc-25fbac94ca6e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:55.538139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4d8ef8ac-aa1e-492d-a3ac-4aaebe36e48b req-0038e3fc-e464-4446-bb64-c2a1d9226fc8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:55.544459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4d8ef8ac-aa1e-492d-a3ac-4aaebe36e48b req-0038e3fc-e464-4446-bb64-c2a1d9226fc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:55.550686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4d8ef8ac-aa1e-492d-a3ac-4aaebe36e48b req-0038e3fc-e464-4446-bb64-c2a1d9226fc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:55.613239 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4d8ef8ac-aa1e-492d-a3ac-4aaebe36e48b req-0038e3fc-e464-4446-bb64-c2a1d9226fc8 service nova] Creating event network-vif-deleted:13ad64a6-25e7-4864-80bc-25fbac94ca6e for instance 1fe88868-e949-45c4-a27b-27513320b46d on n-h2-846470-15 Aug 24 04:09:55.629171 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4d8ef8ac-aa1e-492d-a3ac-4aaebe36e48b req-0038e3fc-e464-4446-bb64-c2a1d9226fc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130970 Aug 24 04:09:55.638795 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2760/5774] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:56.028169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] validate_networks() for [('10252d59-209a-44bb-808c-c729faceb9ee', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:09:56.060089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:56.061513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:56.120996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:56.121765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:56.124266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:56.133667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:56.136186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:56.139880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:56.255381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:56.257755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:56.258096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:56.258796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lazy-loading 'fault' on Instance uuid 1fe88868-e949-45c4-a27b-27513320b46d {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:09:56.395331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720aaae2b46540a08b573d66dfa1b774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de654780261a47eb8776c56c66bdfae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:56.418185 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6e6f9bd-423c-47c8-a0a8-effb63ddc442 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d" status: 200 len: 1308 microversion: 2.1 time: 0.371777 Aug 24 04:09:56.439253 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2761/5775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:56 2022] GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:09:57.456190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:57.459577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: 1fe88868-e949-45c4-a27b-27513320b46d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:57.508092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:57.509409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:57.512693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:57.514443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:57.520655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:57.525461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:57.594098 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] HTTP exception thrown: Instance 1fe88868-e949-45c4-a27b-27513320b46d could not be found. Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Request method failure captured: Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d HTTP/1.1 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaRZW3iTRsnVdyZxoyKu1-UfHc3frV8c7Wa3AUXjQEuh3wendmPevb9n0JP03Hmf2xXcDHap9Q25IfjO_VAeLZFnST656nPTfNKsEEw0Vr7CpSegLvdEzudXK-ka6iNBCP7_HG-lgLDRtPtIuLt2dOqXdRhpawxDZ6InKmUyO2xuQiA Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: de654780261a47eb8776c56c66bdfae2 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-MultipleCreateTestJSON-927007497 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de654780261a47eb8776c56c66bdfae2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de654780261a47eb8776c56c66bdfae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de654780261a47eb8776c56c66bdfae2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de654780261a47eb8776c56c66bdfae2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-MultipleCreateTestJSON-927007497 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: de654780261a47eb8776c56c66bdfae2 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-MultipleCreateTestJSON-927007497 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-MultipleCreateTestJSON-927007497-project Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 720aaae2b46540a08b573d66dfa1b774 Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-MultipleCreateTestJSON-927007497-project Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 1fe88868-e949-45c4-a27b-27513320b46d could not be found. Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '1fe88868-e949-45c4-a27b-27513320b46d'} Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe88868-e949-45c4-a27b-27513320b46d could not be found. Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe88868-e949-45c4-a27b-27513320b46d could not be found. Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:57.599829 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.605533 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:57.605533 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:57.605533 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:57.605533 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:09:57.605533 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:09:57.605533 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe88868-e949-45c4-a27b-27513320b46d could not be found. Aug 24 04:09:57.605533 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.610894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Returning 404 to user: Instance 1fe88868-e949-45c4-a27b-27513320b46d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:09:57.612625 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a24c3348-88d0-46ee-810b-44b71566329d tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d" status: 404 len: 111 microversion: 2.1 time: 0.167024 Aug 24 04:09:57.622161 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2762/5776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:57 2022] GET /compute/v2.1/servers/1fe88868-e949-45c4-a27b-27513320b46d => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:09:57.634225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:57.636175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] [instance: ab0466b1-d903-40c4-ac1c-1e52cfe8a51c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:57.653527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:57.655383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:57.657844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:57.662526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:57.665017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:57.666252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:57.760946 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] HTTP exception thrown: Instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c could not be found. Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Request method failure captured: Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c HTTP/1.1 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaRZW3iTRsnVdyZxoyKu1-UfHc3frV8c7Wa3AUXjQEuh3wendmPevb9n0JP03Hmf2xXcDHap9Q25IfjO_VAeLZFnST656nPTfNKsEEw0Vr7CpSegLvdEzudXK-ka6iNBCP7_HG-lgLDRtPtIuLt2dOqXdRhpawxDZ6InKmUyO2xuQiA Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: de654780261a47eb8776c56c66bdfae2 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-MultipleCreateTestJSON-927007497 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de654780261a47eb8776c56c66bdfae2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de654780261a47eb8776c56c66bdfae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de654780261a47eb8776c56c66bdfae2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de654780261a47eb8776c56c66bdfae2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-MultipleCreateTestJSON-927007497 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: de654780261a47eb8776c56c66bdfae2 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-MultipleCreateTestJSON-927007497 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-MultipleCreateTestJSON-927007497-project Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 720aaae2b46540a08b573d66dfa1b774 Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-MultipleCreateTestJSON-927007497-project Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c could not be found. Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'ab0466b1-d903-40c4-ac1c-1e52cfe8a51c'} Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c could not be found. Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c could not be found. Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:09:57.763648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c could not be found. Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] Returning 404 to user: Instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e78b0c33-e15f-4194-aa97-197136cc5265 tempest-MultipleCreateTestJSON-927007497 tempest-MultipleCreateTestJSON-927007497-project] 10.222.0.58 "GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c" status: 404 len: 111 microversion: 2.1 time: 0.141413 Aug 24 04:09:57.769234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2763/5777] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:57 2022] GET /compute/v2.1/servers/ab0466b1-d903-40c4-ac1c-1e52cfe8a51c => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:09:57.771952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d50a7446-3998-4f01-8794-0c1bf21dbcd0 req-17e0e42a-3dea-4e4e-b158-85eda32e178a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0466b1-d903-40c4-ac1c-1e52cfe8a51c", "name": "network-vif-deleted", "tag": "78b004a3-ddf7-46b1-9577-3ade78ffc740"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:09:57.782088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d50a7446-3998-4f01-8794-0c1bf21dbcd0 req-17e0e42a-3dea-4e4e-b158-85eda32e178a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:57.782572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d50a7446-3998-4f01-8794-0c1bf21dbcd0 req-17e0e42a-3dea-4e4e-b158-85eda32e178a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:57.783307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d50a7446-3998-4f01-8794-0c1bf21dbcd0 req-17e0e42a-3dea-4e4e-b158-85eda32e178a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:57.807413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:09:57.808080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:09:57.808649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:09:57.809246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:09:57.810749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:09:57.826181 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d50a7446-3998-4f01-8794-0c1bf21dbcd0 req-17e0e42a-3dea-4e4e-b158-85eda32e178a service nova] Creating event network-vif-deleted:78b004a3-ddf7-46b1-9577-3ade78ffc740 for instance ab0466b1-d903-40c4-ac1c-1e52cfe8a51c on n-h1-846470-15 Aug 24 04:09:57.829654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:57.834514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:57.835003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:57.836192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:09:57.836679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:09:57.838786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:09:57.842244 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d50a7446-3998-4f01-8794-0c1bf21dbcd0 req-17e0e42a-3dea-4e4e-b158-85eda32e178a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075034 Aug 24 04:09:57.854998 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2764/5778] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:09:57.925012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Getting quotas for project a16cf00b984a4713a273e24b8731314d. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:09:57.938186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Getting quotas for user 5ff47a8c9f334ea19cb42e30e3678d6c and project a16cf00b984a4713a273e24b8731314d. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:09:58.010492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:09:58.018507 n-d-846470-15 devstack@n-api.service[122536]: WARNING nova.utils [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1722461348-access_point-629585232 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1722461348-ac Aug 24 04:09:58.024663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:09:58.214200 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53e571da-1d24-404d-be70-45c82b1ce64a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 3.056896 Aug 24 04:09:58.220272 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3015/5779] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:09:55 2022] POST /compute/v2.1/servers => generated 457 bytes in 3064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:09:58.237260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f02692f5-c7e6-48a3-881b-bb6c28f52975 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:09:58.238599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f02692f5-c7e6-48a3-881b-bb6c28f52975 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:09:59.200628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f02692f5-c7e6-48a3-881b-bb6c28f52975 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:09:59.210317 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f02692f5-c7e6-48a3-881b-bb6c28f52975 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1293 microversion: 2.1 time: 0.980996 Aug 24 04:09:59.211181 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2765/5780] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:09:58 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1293 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:00.246639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:00.251038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:00.282443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:00.283179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:00.284092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:00.287078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:00.290801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:00.292003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:00.440219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:00.453602 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-858b8170-e031-4b26-917f-c824ba67f3cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1353 microversion: 2.1 time: 0.221131 Aug 24 04:10:00.477023 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3016/5781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:00 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:01.496903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:01.517790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:01.533086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:01.554079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:01.557246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:01.558175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:01.559993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:01.561110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:01.563083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:01.576097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:02.191081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:02.225287 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d899e92-5c8b-445a-bf2d-9ff06cb4999e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1351 microversion: 2.1 time: 0.745493 Aug 24 04:10:02.230802 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2766/5782] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:01 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1351 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:03.267408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:03.270423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:03.288551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:03.311854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:03.313144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:03.313802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:03.319461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:03.320473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:03.321628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:04.156468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:04.170868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:04.174978 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-767245fe-4384-44e7-9019-37beab14e33a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1470 microversion: 2.1 time: 0.915363 Aug 24 04:10:04.175602 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3017/5783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:03 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1470 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:05.216157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:05.222294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:05.250818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:05.250818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:05.250818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:05.254338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:05.255334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:05.255912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:05.789091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-72d8e20e-6c60-4e27-8a60-f1e60e59e284 req-708cbcb1-1c6b-4e67-ba19-241602e29712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4144b74-de37-49c8-892e-9b391c2f6cec", "tag": "1e994136-5d7d-45c2-803b-8f2e5182fc67"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:05.836248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-72d8e20e-6c60-4e27-8a60-f1e60e59e284 req-708cbcb1-1c6b-4e67-ba19-241602e29712 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:05.836874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-72d8e20e-6c60-4e27-8a60-f1e60e59e284 req-708cbcb1-1c6b-4e67-ba19-241602e29712 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:05.837594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-72d8e20e-6c60-4e27-8a60-f1e60e59e284 req-708cbcb1-1c6b-4e67-ba19-241602e29712 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:05.872841 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-72d8e20e-6c60-4e27-8a60-f1e60e59e284 req-708cbcb1-1c6b-4e67-ba19-241602e29712 service nova] Creating event network-changed:1e994136-5d7d-45c2-803b-8f2e5182fc67 for instance e4144b74-de37-49c8-892e-9b391c2f6cec on n-h2-846470-15 Aug 24 04:10:05.880158 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-72d8e20e-6c60-4e27-8a60-f1e60e59e284 req-708cbcb1-1c6b-4e67-ba19-241602e29712 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099722 Aug 24 04:10:05.881641 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3018/5784] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:10:06.538376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:06.555872 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea8466b6-d91a-4afb-a6bd-d9b0e82d8d7a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1470 microversion: 2.1 time: 1.354525 Aug 24 04:10:06.566962 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2767/5785] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:05 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1470 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:07.588493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:07.588990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:07.612516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:07.619445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:07.620331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:07.621394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:07.622199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:07.622973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:07.887977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:07.984498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:08.012224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:08.037562 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3a9f18a7-8037-4a59-b80b-e431f492ff66 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1470 microversion: 2.1 time: 0.458386 Aug 24 04:10:08.039118 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3019/5786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:07 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1470 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:09.075349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:09.079189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:09.152030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:09.154085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:09.154085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:09.154678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:09.158108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:09.158984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:09.217002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:10.428228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:10.441808 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7cf46e2d-8f98-47e0-84ef-e48d2c9d85bb tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1470 microversion: 2.1 time: 1.377521 Aug 24 04:10:10.457938 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2768/5787] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:09 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1470 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:11.466221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:11.466951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:11.476744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:11.477228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:11.477663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:11.478374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:11.478819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:11.479250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:11.973280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:11.986497 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7defb9b5-f479-467b-a96c-f28834cbeff3 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1470 microversion: 2.1 time: 0.524052 Aug 24 04:10:11.988153 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3020/5788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:11 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1470 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:13.024416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:13.025003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:13.036297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:13.038774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:13.042546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:13.045139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:13.047630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:13.049628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:13.388839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:13.406810 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-848513c1-d814-439a-9b2b-6262c76fabf9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1470 microversion: 2.1 time: 0.386863 Aug 24 04:10:13.428705 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2769/5789] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:13 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1470 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:14.450364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:14.451828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:14.495555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:14.496122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:14.496569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:14.501587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:14.503255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:14.503744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:14.927725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:14.936402 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7632a8e-514e-431f-a8e6-429acb03bd5d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1470 microversion: 2.1 time: 0.496252 Aug 24 04:10:14.944236 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3021/5790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:14 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1470 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:15.217404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-30ed469c-2603-495d-947e-a484bd98182f req-4df3f6d6-e620-4bb2-b492-649b2e49c8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4144b74-de37-49c8-892e-9b391c2f6cec", "name": "network-vif-plugged", "status": "completed", "tag": "1e994136-5d7d-45c2-803b-8f2e5182fc67"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:15.254451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30ed469c-2603-495d-947e-a484bd98182f req-4df3f6d6-e620-4bb2-b492-649b2e49c8bd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:15.259806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30ed469c-2603-495d-947e-a484bd98182f req-4df3f6d6-e620-4bb2-b492-649b2e49c8bd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:15.261125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30ed469c-2603-495d-947e-a484bd98182f req-4df3f6d6-e620-4bb2-b492-649b2e49c8bd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:15.287847 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-30ed469c-2603-495d-947e-a484bd98182f req-4df3f6d6-e620-4bb2-b492-649b2e49c8bd service nova] Creating event network-vif-plugged:1e994136-5d7d-45c2-803b-8f2e5182fc67 for instance e4144b74-de37-49c8-892e-9b391c2f6cec on n-h2-846470-15 Aug 24 04:10:15.302274 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-30ed469c-2603-495d-947e-a484bd98182f req-4df3f6d6-e620-4bb2-b492-649b2e49c8bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091892 Aug 24 04:10:15.306840 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2770/5791] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:10:15.969611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:15.970764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:15.997508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:16.007994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:16.008405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:16.009469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:16.010419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:16.011052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:16.732685 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:10:16.733681 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:10:16.988530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:17.007824 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-80bd0e4b-9977-42ae-8237-e96a3b258880 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1470 microversion: 2.1 time: 1.044869 Aug 24 04:10:17.009741 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3022/5792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:15 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1470 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:18.049545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:18.052365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:18.070997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:18.072135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:18.072940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:18.077679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:18.078940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:18.082808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:19.334961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:19.348389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a8951f43-ebef-4995-8e0a-80a4f61531a6 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1643 microversion: 2.1 time: 1.306267 Aug 24 04:10:19.349007 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2771/5793] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:18 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1643 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:19.371611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:19.372500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:19.388967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:19.390500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:19.392583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:19.395530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:19.396370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:19.397460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:20.005545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:20.025386 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6819600-c782-4b99-8386-4132f68278cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1643 microversion: 2.1 time: 0.659570 Aug 24 04:10:20.027217 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3023/5794] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:19 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1643 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:20.073164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:20.073812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:20.090549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:20.092049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:20.093096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:20.094367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:20.095199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:20.096015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:21.121591 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11ea8860-e038-463f-96f0-65a9622bc7e7 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1796 microversion: 2.1 time: 1.050764 Aug 24 04:10:21.152014 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2772/5795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:20 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1796 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:22.750020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1720568823", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:22.866430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] validate_networks() for None {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:10:25.050269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:10:25.051098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:10:25.052242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:10:25.053038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:10:25.075105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:10:25.120273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:25.121527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:25.122645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:25.124545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:25.125732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:25.126847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:25.195660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Getting quotas for project 7197c804d3ee419eb16ccd7c4d7d3ac6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:10:25.215257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Getting quotas for user cbb3469ab376483eab6f1d40586df4db and project 7197c804d3ee419eb16ccd7c4d7d3ac6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:10:25.235187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:10:25.246788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:10:25.390681 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66fff671-c02a-403e-9872-caf75d7008ae tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.644667 Aug 24 04:10:25.392027 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3024/5796] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:10:25.409637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3acc2a3f-9870-444d-a750-c16138649004 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:25.411004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3acc2a3f-9870-444d-a750-c16138649004 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:26.103064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3acc2a3f-9870-444d-a750-c16138649004 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:26.112481 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3acc2a3f-9870-444d-a750-c16138649004 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1214 microversion: 2.1 time: 0.711874 Aug 24 04:10:26.136605 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2773/5797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:25 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1214 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:27.167076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:27.168125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:27.194815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:27.196998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:27.198942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:27.200979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:27.202156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:27.203398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:27.394989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:27.414711 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3a7272a-a6ed-4e54-a73c-07228c2a3a75 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1266 microversion: 2.1 time: 0.246140 Aug 24 04:10:27.416098 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3025/5798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:27 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:10:28.444094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:28.444661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:28.462086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:28.463141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:28.464445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:28.466458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:28.468171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:28.469359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:28.934944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:28.947167 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50456f0a-f9d1-4e5e-b83b-955f9e8d9d6b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1272 microversion: 2.1 time: 0.511614 Aug 24 04:10:28.949007 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2774/5799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:28 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1272 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:29.154830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c9261e07-4a07-465f-94ad-6079873d2c82 req-2d98df7f-1a22-41dc-8414-30e0335b97c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4144b74-de37-49c8-892e-9b391c2f6cec", "tag": "1e994136-5d7d-45c2-803b-8f2e5182fc67"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:29.189970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c9261e07-4a07-465f-94ad-6079873d2c82 req-2d98df7f-1a22-41dc-8414-30e0335b97c7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:29.190274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c9261e07-4a07-465f-94ad-6079873d2c82 req-2d98df7f-1a22-41dc-8414-30e0335b97c7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:29.190471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c9261e07-4a07-465f-94ad-6079873d2c82 req-2d98df7f-1a22-41dc-8414-30e0335b97c7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:29.226015 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c9261e07-4a07-465f-94ad-6079873d2c82 req-2d98df7f-1a22-41dc-8414-30e0335b97c7 service nova] Creating event network-changed:1e994136-5d7d-45c2-803b-8f2e5182fc67 for instance e4144b74-de37-49c8-892e-9b391c2f6cec on n-h2-846470-15 Aug 24 04:10:29.242980 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c9261e07-4a07-465f-94ad-6079873d2c82 req-2d98df7f-1a22-41dc-8414-30e0335b97c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104395 Aug 24 04:10:29.248107 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3026/5800] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:10:29.707466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a4552f3-97c3-4758-abfd-b0b3bc03c832 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'create', calling method: .version_select at 0x7f1029cd6040>, body: {"keypair": {"name": "tempest-keypair-650904832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGS6P4nukiX52Bgv/VxlYv5VJGfX61sybd5ciIpImRgMKXn6w3PYJhqL7q9LLLIeyccv1Nz/1KwLFlNJl883QAapFgn+VK95nIo6XGZeM2/nppKoToaB3PIFLLjEHLTLYg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:29.758935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-5a4552f3-97c3-4758-abfd-b0b3bc03c832 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:10:29.792142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-5a4552f3-97c3-4758-abfd-b0b3bc03c832 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for user bbc89071f3d44e14ac21298ac15d7c33 and project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:10:29.889088 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a4552f3-97c3-4758-abfd-b0b3bc03c832 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.468277 Aug 24 04:10:29.897887 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2775/5801] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:10:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:10:29.990830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:29.998908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:30.015483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:30.016844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:30.018175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:30.021147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:30.022872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:30.024183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:30.354102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:30.389077 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d782fd4c-f449-43ff-8a6c-c20806b4314b tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1272 microversion: 2.1 time: 0.394799 Aug 24 04:10:30.390284 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3027/5802] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:29 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1272 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:31.421515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:31.423538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:31.431694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:31.433111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:31.433773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:31.434714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:31.435403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:31.437383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:32.721262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:32.726667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=48 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:32.758257 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae4306cc-9f08-479e-a3e3-7070e548cecd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 1.341637 Aug 24 04:10:32.759686 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2776/5803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:31 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:33.810186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:33.810988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:33.816122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:33.836221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:33.836722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:33.839818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:33.840647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:33.841131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:33.842430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:34.334092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:34.346754 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-177c2a67-2030-4827-a679-601f3dcabe50 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 0.548968 Aug 24 04:10:34.347867 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3028/5804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:33 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:34.490444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6ffd9a40-45a9-4278-90f5-d17bf2d7ea36 req-86df63a7-b531-40bc-a4f8-cf63af90fb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68df9462-21ba-4fc4-b7a7-024266cd6f03", "tag": "708f32e1-8a0b-4e0c-b26f-6be59487e78f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:34.506198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:34.508826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ffd9a40-45a9-4278-90f5-d17bf2d7ea36 req-86df63a7-b531-40bc-a4f8-cf63af90fb13 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:34.509626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ffd9a40-45a9-4278-90f5-d17bf2d7ea36 req-86df63a7-b531-40bc-a4f8-cf63af90fb13 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:34.510280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ffd9a40-45a9-4278-90f5-d17bf2d7ea36 req-86df63a7-b531-40bc-a4f8-cf63af90fb13 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:34.535392 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6ffd9a40-45a9-4278-90f5-d17bf2d7ea36 req-86df63a7-b531-40bc-a4f8-cf63af90fb13 service nova] Creating event network-changed:708f32e1-8a0b-4e0c-b26f-6be59487e78f for instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 on n-h1-846470-15 Aug 24 04:10:34.545233 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6ffd9a40-45a9-4278-90f5-d17bf2d7ea36 req-86df63a7-b531-40bc-a4f8-cf63af90fb13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061677 Aug 24 04:10:34.548124 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2777/5805] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:10:35.370557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:35.371415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:35.382009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:35.383204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:35.385365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:35.396493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:35.397045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:35.398170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:35.398922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:35.399366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:35.680671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:35.697633 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0511f231-0ab3-4e17-900b-eef57697e8dd tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 0.328344 Aug 24 04:10:35.702492 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3029/5806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:35 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:36.455521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-628758614", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84625d62-df37-416c-9910-28257ed66bfc"}], "security_groups": [{"name": "tempest-securitygroup--840627160"}], "key_name": "tempest-keypair-650904832", "user_data": "}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:36.725027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:36.725654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:36.729734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] validate_networks() for [('84625d62-df37-416c-9910-28257ed66bfc', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:10:36.751133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:36.751650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:36.752357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:36.753339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:36.753819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:36.754276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:36.804434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=62 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:37.031153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:37.054382 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8cdddffe-20c5-436e-8105-60524a200585 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 0.336059 Aug 24 04:10:37.057605 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3030/5807] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:36 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:38.087092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:38.088545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:38.098077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:38.098789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:38.099550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:38.100838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:38.101479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:38.102367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:38.320554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:38.336777 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2931dccd-af3c-4eb1-bb69-a3f98b2d7600 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 0.254781 Aug 24 04:10:38.337876 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3031/5808] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:38 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:38.676444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:10:38.677855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:10:38.678636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:10:38.679200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:10:38.679792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:10:38.706310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:38.706801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:38.707236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:38.710269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:38.711361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:38.711845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:38.742852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:10:38.755998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for user bbc89071f3d44e14ac21298ac15d7c33 and project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:10:38.785633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:10:38.788175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:10:38.897746 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-62268ec5-a7af-491f-b067-6b749f422803 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.455507 Aug 24 04:10:38.898799 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2778/5809] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:10:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 04:10:38.911439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16afd040-cd76-483f-ad9c-764b9141aeea tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:38.912398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16afd040-cd76-483f-ad9c-764b9141aeea tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:39.038990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-16afd040-cd76-483f-ad9c-764b9141aeea tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:39.051401 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16afd040-cd76-483f-ad9c-764b9141aeea tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1237 microversion: 2.1 time: 0.144901 Aug 24 04:10:39.052975 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3032/5810] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:38 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1237 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:39.366884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:39.367806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:39.396384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:39.396933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:39.397406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:39.398307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:39.398903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:39.399363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:39.821376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:39.862597 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2dd12132-f35a-4906-be9b-7ff86a8ab7d5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 0.503347 Aug 24 04:10:39.868048 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2779/5811] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:39 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:40.078869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:40.079932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:40.103164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:40.103697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:40.104127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:40.105009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:40.105599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:40.106084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:40.228246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:40.241595 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6da7c24-5986-4d02-a637-a20cabff4d5c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1233 microversion: 2.1 time: 0.170374 Aug 24 04:10:40.245772 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3033/5812] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:40 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1233 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:40.900258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:40.900887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:40.920225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:40.920797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:40.921268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:40.922004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:40.922467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:40.931182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:41.269146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:41.271207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:41.290484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:41.291200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:41.291920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:41.292937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:41.293556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:41.294148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:41.542233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:41.551474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-02f01ebf-e653-44d1-956c-3bd79d309e8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1295 microversion: 2.1 time: 0.287182 Aug 24 04:10:41.565181 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3034/5813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:41 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1295 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:10:41.622103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:41.633762 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d4d48f4-882c-4fd9-a9a6-31844a179470 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 0.737341 Aug 24 04:10:41.644958 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2780/5814] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:40 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:42.406970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-0a5b2cbb-9307-4fd8-9cf1-d8687d46a0ea req-82885adf-6443-4c81-a5e0-cf3a7c445816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68df9462-21ba-4fc4-b7a7-024266cd6f03", "name": "network-vif-plugged", "status": "completed", "tag": "708f32e1-8a0b-4e0c-b26f-6be59487e78f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:42.426613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0a5b2cbb-9307-4fd8-9cf1-d8687d46a0ea req-82885adf-6443-4c81-a5e0-cf3a7c445816 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:42.430901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0a5b2cbb-9307-4fd8-9cf1-d8687d46a0ea req-82885adf-6443-4c81-a5e0-cf3a7c445816 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:42.432315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0a5b2cbb-9307-4fd8-9cf1-d8687d46a0ea req-82885adf-6443-4c81-a5e0-cf3a7c445816 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:42.451564 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-0a5b2cbb-9307-4fd8-9cf1-d8687d46a0ea req-82885adf-6443-4c81-a5e0-cf3a7c445816 service nova] Creating event network-vif-plugged:708f32e1-8a0b-4e0c-b26f-6be59487e78f for instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 on n-h1-846470-15 Aug 24 04:10:42.458561 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-0a5b2cbb-9307-4fd8-9cf1-d8687d46a0ea req-82885adf-6443-4c81-a5e0-cf3a7c445816 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056204 Aug 24 04:10:42.459956 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3035/5815] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:10:42.593109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:42.593999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:42.616010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:42.616642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:42.618910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:42.619802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:42.622506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:42.624493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:42.674508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:42.675397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:42.690904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:42.693165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:42.693955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:42.696134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:42.698178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:42.698726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:42.982286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:42.992677 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9281b215-0dc9-427f-860a-f07725639157 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 0.325816 Aug 24 04:10:42.994022 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3036/5816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:42 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:10:43.064449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:43.074787 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a447e37-f937-4de5-a730-ec9bf6756a45 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1362 microversion: 2.1 time: 0.488463 Aug 24 04:10:43.077124 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2781/5817] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:42 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:44.021522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:44.022722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:44.035570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:44.036450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:44.037067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:44.040417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:44.041131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:44.041744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:44.098220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:44.099641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:44.111125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:44.113577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:44.114713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:44.116125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:44.118089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:44.122177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:44.437415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:44.457847 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c35c845e-a66f-4c8d-a4ec-c85452464190 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1314 microversion: 2.1 time: 0.440738 Aug 24 04:10:44.459354 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3037/5818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:44 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:44.465859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f33133b6-c9c7-44f5-9a0f-e5b0d531ae70 req-0a50c714-6c8f-4eb4-afa8-a9c3ac360316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:44.477129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f33133b6-c9c7-44f5-9a0f-e5b0d531ae70 req-0a50c714-6c8f-4eb4-afa8-a9c3ac360316 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:44.477995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f33133b6-c9c7-44f5-9a0f-e5b0d531ae70 req-0a50c714-6c8f-4eb4-afa8-a9c3ac360316 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:44.478677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f33133b6-c9c7-44f5-9a0f-e5b0d531ae70 req-0a50c714-6c8f-4eb4-afa8-a9c3ac360316 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:44.499553 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f33133b6-c9c7-44f5-9a0f-e5b0d531ae70 req-0a50c714-6c8f-4eb4-afa8-a9c3ac360316 service nova] Creating event network-changed:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:10:44.509127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f33133b6-c9c7-44f5-9a0f-e5b0d531ae70 req-0a50c714-6c8f-4eb4-afa8-a9c3ac360316 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047818 Aug 24 04:10:44.509829 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3038/5819] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:10:44.510023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:44.522860 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8cd82d7-98e4-40ef-9afa-131d0ecb144f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1362 microversion: 2.1 time: 0.429795 Aug 24 04:10:44.524222 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2782/5820] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:44 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:45.483706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:45.485100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:45.493142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:45.494114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:45.495008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:45.496299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:45.497085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:45.498560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:45.545641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:45.546457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:45.559317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:45.563934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:45.564909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:45.565930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:45.570422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:45.571149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:45.772219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:45.802100 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae609f4f-43a0-425f-bdc9-3ac5b0414d65 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1464 microversion: 2.1 time: 0.324287 Aug 24 04:10:45.830495 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3039/5821] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:45 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:45.853931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e9c91f7-4ab4-4637-b72d-6b90e502fcf8", "device": "/dev/sdb"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:45.858441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:45.890278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:45.892580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:45.894038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:45.895014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:45.896269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:45.897876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:45.937801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:45.952354 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-233dad66-0cc6-478a-8262-dc40c9e8ce4e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1362 microversion: 2.1 time: 0.410239 Aug 24 04:10:45.953576 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2783/5822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:45 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:10:46.269845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e77c531-0393-43e0-8a3c-7de1f2c9beba tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "POST /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417658 Aug 24 04:10:46.270860 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3040/5823] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:10:45 2022] POST /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:10:46.977332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:46.978030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:46.995304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:46.995982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:46.996755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:46.997570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:46.998255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:46.998904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:47.258461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:47.271142 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c418d772-3b1b-4ebb-8584-c68421151e3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1362 microversion: 2.1 time: 0.297275 Aug 24 04:10:47.272459 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2784/5824] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:46 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:48.295262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:48.296001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:48.312131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:48.313652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:48.314751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:48.315748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:48.316451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:48.317457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:48.567596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:48.577554 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b279daa8-0794-4b47-9113-ca784f3da2a9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1362 microversion: 2.1 time: 0.288153 Aug 24 04:10:48.578485 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3041/5825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:48 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:49.606130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:49.606753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:49.609839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:49.616037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=12 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:49.629825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:49.630319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:49.630788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:49.631502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:49.632079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:49.632511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:49.907135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:49.918549 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b81027d7-cbda-4fa5-a82d-95c3b142d093 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1362 microversion: 2.1 time: 0.318775 Aug 24 04:10:49.922450 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2785/5826] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:49 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:50.951354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:50.953594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:50.960974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:50.982289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:50.983741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:50.984711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:50.986248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:50.987276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:50.988205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:51.058959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d77dc6c1-d936-4c14-b378-4100c78cba41 req-b393fb46-9495-433d-b2fc-c174482ad004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "name": "network-vif-plugged", "status": "completed", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:51.139990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d77dc6c1-d936-4c14-b378-4100c78cba41 req-b393fb46-9495-433d-b2fc-c174482ad004 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:51.141528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d77dc6c1-d936-4c14-b378-4100c78cba41 req-b393fb46-9495-433d-b2fc-c174482ad004 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:51.147598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d77dc6c1-d936-4c14-b378-4100c78cba41 req-b393fb46-9495-433d-b2fc-c174482ad004 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:51.204099 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d77dc6c1-d936-4c14-b378-4100c78cba41 req-b393fb46-9495-433d-b2fc-c174482ad004 service nova] Creating event network-vif-plugged:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:10:51.210961 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d77dc6c1-d936-4c14-b378-4100c78cba41 req-b393fb46-9495-433d-b2fc-c174482ad004 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158374 Aug 24 04:10:51.215404 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2786/5827] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:10:51.289037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:51.304046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0122981-5240-4cb4-b292-4c08737b1e4a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1362 microversion: 2.1 time: 0.365882 Aug 24 04:10:51.317185 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3042/5828] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:50 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:52.348985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:52.350543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:52.368122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:52.369136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:52.369909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:52.371092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:52.371876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:52.373204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:52.687870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:52.713740 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5d88dfc7-37be-42fe-9b26-420d6d652bfc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1362 microversion: 2.1 time: 0.376893 Aug 24 04:10:52.714740 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2787/5829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:52 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:53.735944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:53.737457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:53.748265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:53.749223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:53.749833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:53.750617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:53.751432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:53.752523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:53.931261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:10:53.940995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a91cb06a-6f38-4248-b0ac-a8b18550d6e9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1549 microversion: 2.1 time: 0.209135 Aug 24 04:10:53.941720 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3043/5830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:10:53 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1549 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:10:53.964260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:10:53.964812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:10:53.972294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:53.972900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:53.973412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:53.974203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:53.974874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:53.975279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:54.067484 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9f48ef8c-d895-4653-9baa-02f4df642d24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107748 Aug 24 04:10:54.067981 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2788/5831] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:10:53 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:10:55.928495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2ff84774-71ed-4abe-b0ba-34e1c02aaffc req-5fc993b6-0bda-4046-ac39-f133d1652411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:10:55.940261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2ff84774-71ed-4abe-b0ba-34e1c02aaffc req-5fc993b6-0bda-4046-ac39-f133d1652411 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:10:55.941016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2ff84774-71ed-4abe-b0ba-34e1c02aaffc req-5fc993b6-0bda-4046-ac39-f133d1652411 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:10:55.941605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2ff84774-71ed-4abe-b0ba-34e1c02aaffc req-5fc993b6-0bda-4046-ac39-f133d1652411 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:10:55.956363 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2ff84774-71ed-4abe-b0ba-34e1c02aaffc req-5fc993b6-0bda-4046-ac39-f133d1652411 service nova] Creating event network-changed:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:10:55.963455 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2ff84774-71ed-4abe-b0ba-34e1c02aaffc req-5fc993b6-0bda-4046-ac39-f133d1652411 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352250 Aug 24 04:10:55.965454 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3044/5832] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:11:05.441575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:05.443544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=59 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:05.449250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-19779787", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "e8298a41-dba0-4da2-a66e-cc4a89574ff4"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:05.520738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] validate_networks() for [('e8298a41-dba0-4da2-a66e-cc4a89574ff4', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:11:05.978862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:11:05.979531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:11:05.980172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:11:05.980750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:11:05.981313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:11:05.994689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:05.995386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:05.996015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:05.997190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:05.997889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:05.998467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:06.039543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Getting quotas for project a54a2c40e6bc46aabdd356a0eda10a5a. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:11:06.046707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Getting quotas for user 713a0ef4abc54f319de5b6aae792570f and project a54a2c40e6bc46aabdd356a0eda10a5a. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:11:06.068729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:11:06.071482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:11:06.159894 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-803edaa1-81e2-4b33-bed5-d0a005f6886b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717690 Aug 24 04:11:06.167584 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2789/5833] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:11:06.170294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=35 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:06.171986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:06.178000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1bff8c3d-fa42-4cfe-8f25-541ea74bf57a tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:06.178716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1bff8c3d-fa42-4cfe-8f25-541ea74bf57a tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:06.255479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1bff8c3d-fa42-4cfe-8f25-541ea74bf57a tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:06.264802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1bff8c3d-fa42-4cfe-8f25-541ea74bf57a tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1212 microversion: 2.1 time: 0.096451 Aug 24 04:11:06.266048 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3045/5834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:06 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:11:07.289363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:07.290821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:07.301467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:07.302445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:07.303337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:07.304469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:07.305403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:07.306604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:07.429272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:07.439204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-334ff813-759e-4ed0-98d3-f018ae23d9fa tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1208 microversion: 2.1 time: 0.155714 Aug 24 04:11:07.441397 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2790/5835] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:07 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1208 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:11:08.464591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:08.465566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:08.475087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:08.475750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:08.476119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:08.477153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:08.477638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:08.478374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:08.554680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:08.563625 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-899c6b92-fe1e-4b3a-9b7c-7559cabb04d2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1270 microversion: 2.1 time: 0.105014 Aug 24 04:11:08.578230 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3046/5836] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:08 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:09.611710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:09.621727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:09.643973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:09.645556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:09.647050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:09.648933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:09.650248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:09.651793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:10.053268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:10.061795 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff9c23c7-f275-47a3-9a1f-062d435b00a1 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1312 microversion: 2.1 time: 0.476027 Aug 24 04:11:10.062988 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2791/5837] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:09 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1312 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:10.139312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-809af6d2-ca64-40fe-a6e9-2703bfc38f2b req-edbc203a-c919-4cae-a958-edb71b03ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fba19b-ccaa-44a5-8dc3-4d3925caf799", "tag": "148e8610-cd31-4c9d-99c9-ab255513e31d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:10.155869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-809af6d2-ca64-40fe-a6e9-2703bfc38f2b req-edbc203a-c919-4cae-a958-edb71b03ade6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:10.156434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-809af6d2-ca64-40fe-a6e9-2703bfc38f2b req-edbc203a-c919-4cae-a958-edb71b03ade6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:10.157205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-809af6d2-ca64-40fe-a6e9-2703bfc38f2b req-edbc203a-c919-4cae-a958-edb71b03ade6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:10.171765 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-809af6d2-ca64-40fe-a6e9-2703bfc38f2b req-edbc203a-c919-4cae-a958-edb71b03ade6 service nova] Creating event network-changed:148e8610-cd31-4c9d-99c9-ab255513e31d for instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 on n-h1-846470-15 Aug 24 04:11:10.193728 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-809af6d2-ca64-40fe-a6e9-2703bfc38f2b req-edbc203a-c919-4cae-a958-edb71b03ade6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053942 Aug 24 04:11:10.195193 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3047/5838] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:11:11.093543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:11.094484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:11.105901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:11.106483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:11.107540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:11.108121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:11.108471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:11.108938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:11.304573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:11.326042 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e795f629-c822-4832-bac3-14c504905b2f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1312 microversion: 2.1 time: 0.239728 Aug 24 04:11:11.344052 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2792/5839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:11 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:12.374293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:12.378898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:12.403619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:12.404253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:12.404879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:12.405711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:12.407091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:12.409126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:12.586883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:12.596482 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-89d45b66-8f0f-4139-a93e-09b7fd695276 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1312 microversion: 2.1 time: 0.235559 Aug 24 04:11:12.598034 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3048/5840] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:12 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:13.623957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:13.626459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:13.636725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:13.637749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:13.638399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:13.639490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:13.640104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:13.640650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:13.940095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:13.949720 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4f91fec-2c0a-445c-832d-2a146dd9fcb9 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1312 microversion: 2.1 time: 0.334121 Aug 24 04:11:13.950628 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2793/5841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:13 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1312 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:14.975246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:14.977110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:14.988511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:14.989339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:14.990033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:14.991284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:14.992207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:14.993028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:15.160195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:15.169669 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8cc5c4c1-729d-44ac-94bd-2b0da2689efc tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1312 microversion: 2.1 time: 0.199950 Aug 24 04:11:15.170263 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3049/5842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:14 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:16.204117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:16.204923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:16.212049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:16.213691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:16.215734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:16.216835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:16.217557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:16.218976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:16.219494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:16.219970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:16.382527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:16.579727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-85b87003-f2ea-4ea3-b96f-ea0cc26c7dd9 req-e6f8e5f3-5e8d-492b-b7cb-069782348b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fba19b-ccaa-44a5-8dc3-4d3925caf799", "name": "network-vif-plugged", "status": "completed", "tag": "148e8610-cd31-4c9d-99c9-ab255513e31d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:16.592855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85b87003-f2ea-4ea3-b96f-ea0cc26c7dd9 req-e6f8e5f3-5e8d-492b-b7cb-069782348b2b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:16.593978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85b87003-f2ea-4ea3-b96f-ea0cc26c7dd9 req-e6f8e5f3-5e8d-492b-b7cb-069782348b2b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:16.594552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-85b87003-f2ea-4ea3-b96f-ea0cc26c7dd9 req-e6f8e5f3-5e8d-492b-b7cb-069782348b2b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:16.621982 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-85b87003-f2ea-4ea3-b96f-ea0cc26c7dd9 req-e6f8e5f3-5e8d-492b-b7cb-069782348b2b service nova] Creating event network-vif-plugged:148e8610-cd31-4c9d-99c9-ab255513e31d for instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 on n-h1-846470-15 Aug 24 04:11:16.628026 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-85b87003-f2ea-4ea3-b96f-ea0cc26c7dd9 req-e6f8e5f3-5e8d-492b-b7cb-069782348b2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259130 Aug 24 04:11:16.628720 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3050/5843] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:11:16.736754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:16.746602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6fb8ed87-7b91-4be0-a646-76d42c63fd78 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1312 microversion: 2.1 time: 0.547677 Aug 24 04:11:16.747224 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2794/5844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:16 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1312 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:17.772502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:17.773630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:17.781233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:17.781877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:17.783427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:17.784540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:17.785245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:17.786489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:17.965928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:17.978485 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e38ac0d7-2f79-4813-b3e8-c53685f1794f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1312 microversion: 2.1 time: 0.211069 Aug 24 04:11:17.979089 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3051/5845] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:17 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:18.999938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:19.001197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:19.008293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:19.008816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:19.009276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:19.009961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:19.010416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:19.010838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:19.188031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:19.197515 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-54bcfbdc-944e-4614-a190-308cc6fe26a3 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1497 microversion: 2.1 time: 0.202803 Aug 24 04:11:19.198316 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2795/5846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:18 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:19.682321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:19.683361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:19.691415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:19.691955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:19.692402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:19.693130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:19.693599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:19.694031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:19.728196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:11:19.838121 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7122afaf-483c-47e8-a146-bd5ce0d849fd tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 204 len: 0 microversion: 2.1 time: 0.161728 Aug 24 04:11:19.839397 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3052/5847] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:11:19 2022] DELETE /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:11:19.848414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:19.849260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:19.855908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:19.856510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:19.856964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:19.857682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:19.858176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:19.858636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:20.002947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:20.011401 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d4e7a6e5-633f-4814-8239-640f85d86fe2 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1503 microversion: 2.1 time: 0.167754 Aug 24 04:11:20.011909 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2796/5848] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:19 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:21.037595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:21.038392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:21.047132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:21.047954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:21.049067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:21.049387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:21.049872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:21.050321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:21.212608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:21.233888 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0d13e2c-8469-4f80-81a3-632fa856805b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1503 microversion: 2.1 time: 0.203095 Aug 24 04:11:21.235033 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3053/5849] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:21 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:21.973753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6ed52c65-7f84-4a47-9c41-d59ca46dc1ec req-2d6d4658-6844-40c8-903a-cbaced70d0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fba19b-ccaa-44a5-8dc3-4d3925caf799", "name": "network-vif-deleted", "tag": "148e8610-cd31-4c9d-99c9-ab255513e31d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:21.990020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ed52c65-7f84-4a47-9c41-d59ca46dc1ec req-2d6d4658-6844-40c8-903a-cbaced70d0b3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:21.990668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ed52c65-7f84-4a47-9c41-d59ca46dc1ec req-2d6d4658-6844-40c8-903a-cbaced70d0b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:21.991171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ed52c65-7f84-4a47-9c41-d59ca46dc1ec req-2d6d4658-6844-40c8-903a-cbaced70d0b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:22.004522 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6ed52c65-7f84-4a47-9c41-d59ca46dc1ec req-2d6d4658-6844-40c8-903a-cbaced70d0b3 service nova] Creating event network-vif-deleted:148e8610-cd31-4c9d-99c9-ab255513e31d for instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 on n-h1-846470-15 Aug 24 04:11:22.010801 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6ed52c65-7f84-4a47-9c41-d59ca46dc1ec req-2d6d4658-6844-40c8-903a-cbaced70d0b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043720 Aug 24 04:11:22.012252 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2797/5850] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:11:22.255305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:22.256138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:22.264885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:22.264885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:22.265397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:22.266319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:22.266793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:22.267356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:22.310917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:22.311412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:22.311965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:22.312467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lazy-loading 'fault' on Instance uuid d2fba19b-ccaa-44a5-8dc3-4d3925caf799 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:11:22.360088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:22.372541 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76bbde86-09a4-496b-b036-26915957a5f5 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 200 len: 1302 microversion: 2.1 time: 0.121256 Aug 24 04:11:22.372737 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3054/5851] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:22 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 1302 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:23.394740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:23.396365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: d2fba19b-ccaa-44a5-8dc3-4d3925caf799] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:23.404043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:23.404798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:23.405427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:23.406322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:23.406968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:23.407700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:23.425825 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] HTTP exception thrown: Instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 could not be found. Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Request method failure captured: Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 HTTP/1.1 Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaTXiiSBg6E4VTDPxlIrdCp_7L4-x6Dyh4NWB-pnsY3bfZ3bkYPAeL70umh0Xew8maQE3Cf2qkxsgiANOnzZ8kXCW_vNWKrK7DfK44GyRWubmzk1mHj6ejNggymFZWFRCMS5tltqLO_01QLetX1bKzdKFGAqvztjOb1XmQXRHomWlKw Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: a54a2c40e6bc46aabdd356a0eda10a5a Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesActionsTest-129632375 Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a54a2c40e6bc46aabdd356a0eda10a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a54a2c40e6bc46aabdd356a0eda10a5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a54a2c40e6bc46aabdd356a0eda10a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a54a2c40e6bc46aabdd356a0eda10a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesActionsTest-129632375 Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: a54a2c40e6bc46aabdd356a0eda10a5a Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesActionsTest-129632375 Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesActionsTest-129632375-project Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 713a0ef4abc54f319de5b6aae792570f Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesActionsTest-129632375-project Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 could not be found. Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd2fba19b-ccaa-44a5-8dc3-4d3925caf799'} Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 could not be found. Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 could not be found. Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:11:23.440035 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:11:23.443445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:11:23.443445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:11:23.443445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:11:23.443445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:11:23.443445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:11:23.443445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 could not be found. Aug 24 04:11:23.443445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:11:23.447486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Returning 404 to user: Instance d2fba19b-ccaa-44a5-8dc3-4d3925caf799 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:11:23.449522 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c09e28c-e5e2-4c33-b4a3-8ea19c4baa7e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799" status: 404 len: 111 microversion: 2.1 time: 0.059108 Aug 24 04:11:23.450651 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2798/5852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:23 2022] GET /compute/v2.1/servers/d2fba19b-ccaa-44a5-8dc3-4d3925caf799 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:11:23.508025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1887635211", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "e8298a41-dba0-4da2-a66e-cc4a89574ff4"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:23.577569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] validate_networks() for [('e8298a41-dba0-4da2-a66e-cc4a89574ff4', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:11:24.053602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:11:24.054023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:11:24.054493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:11:24.054969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:11:24.055360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:11:24.065820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:24.066429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:24.066900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:24.067631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:24.068543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:24.069099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:24.088534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Getting quotas for project a54a2c40e6bc46aabdd356a0eda10a5a. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:11:24.094139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Getting quotas for user 713a0ef4abc54f319de5b6aae792570f and project a54a2c40e6bc46aabdd356a0eda10a5a. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:11:24.108394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:11:24.110693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:11:24.166548 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be5e7d1b-15ad-4159-98d7-c4adad08d680 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662974 Aug 24 04:11:24.167390 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3055/5853] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:11:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:11:24.178742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65ed861b-1401-4278-8e26-51a2f2837f62 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:24.179309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-65ed861b-1401-4278-8e26-51a2f2837f62 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:24.253370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-65ed861b-1401-4278-8e26-51a2f2837f62 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:24.261133 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-65ed861b-1401-4278-8e26-51a2f2837f62 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1214 microversion: 2.1 time: 0.086645 Aug 24 04:11:24.262084 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2799/5854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:24 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:25.284614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:25.285213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:25.293279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:25.293840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:25.294437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:25.295853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:25.295853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:25.296024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:25.379279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:25.399894 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d62c706b-4d73-4aa6-8a61-8771c78a4a93 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1266 microversion: 2.1 time: 0.120181 Aug 24 04:11:25.400481 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3056/5855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:25 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:26.422751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:26.423711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:26.434601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:26.434912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:26.435517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:26.436735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:26.437648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:26.438226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:27.053848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:27.066006 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-737368db-9c09-4209-9ccb-52e0428fa645 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1314 microversion: 2.1 time: 0.647788 Aug 24 04:11:27.080822 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2800/5856] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:26 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:27.751583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-32fa3f53-517b-409d-ab03-59b998356115 req-d94bdc5b-d908-4c86-9926-49e087d6074a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2509400a-a791-4886-a8de-28291ed16151", "tag": "bde97f0e-07a3-44ca-a010-df3ed177f9c6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:27.764982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-32fa3f53-517b-409d-ab03-59b998356115 req-d94bdc5b-d908-4c86-9926-49e087d6074a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:27.765968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-32fa3f53-517b-409d-ab03-59b998356115 req-d94bdc5b-d908-4c86-9926-49e087d6074a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:27.766600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-32fa3f53-517b-409d-ab03-59b998356115 req-d94bdc5b-d908-4c86-9926-49e087d6074a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:27.801896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-32fa3f53-517b-409d-ab03-59b998356115 req-d94bdc5b-d908-4c86-9926-49e087d6074a service nova] Creating event network-changed:bde97f0e-07a3-44ca-a010-df3ed177f9c6 for instance 2509400a-a791-4886-a8de-28291ed16151 on n-h2-846470-15 Aug 24 04:11:27.810500 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-32fa3f53-517b-409d-ab03-59b998356115 req-d94bdc5b-d908-4c86-9926-49e087d6074a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154322 Aug 24 04:11:27.811233 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3057/5857] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:11:28.088040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:28.089621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:28.097990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:28.098842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:28.099761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:28.100708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:28.101446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:28.102066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:28.281979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:28.292130 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a5a46dd6-e9c7-4610-859d-d9b1faff024e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1314 microversion: 2.1 time: 0.207903 Aug 24 04:11:28.293142 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2801/5858] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:28 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:29.317949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:29.318813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:29.326492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:29.327151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:29.327707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:29.328491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:29.329026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:29.329720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:29.490891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:29.499229 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b7612c26-9250-4fa4-b831-ee970977f03b tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1314 microversion: 2.1 time: 0.188287 Aug 24 04:11:29.499858 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3058/5859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:29 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:30.520590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:30.521374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:30.528306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:30.528904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:30.529549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:30.530256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:30.530717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:30.531146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:30.681592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:30.692063 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-afb23cfe-e35a-4e22-bde6-cd30066b0fb7 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1314 microversion: 2.1 time: 0.175380 Aug 24 04:11:30.692904 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2802/5860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:30 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:31.725984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:31.726684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:31.735082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:31.736249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:31.736702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:31.737435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:31.737921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:31.738350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:31.890260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:31.902813 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32cb47f9-7a61-42f3-8535-f3c6d5bde476 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1314 microversion: 2.1 time: 0.191882 Aug 24 04:11:31.903492 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3059/5861] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:31 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:32.927548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:32.928660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:32.940822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:32.941678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:32.942464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:32.943768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:32.944578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:32.945315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:33.153738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e07078c0-9a11-4b16-920a-d5f8865472d8 req-81c1901c-4670-4f7e-b26e-413ebd7c093c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2509400a-a791-4886-a8de-28291ed16151", "name": "network-vif-plugged", "status": "completed", "tag": "bde97f0e-07a3-44ca-a010-df3ed177f9c6"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:33.175772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e07078c0-9a11-4b16-920a-d5f8865472d8 req-81c1901c-4670-4f7e-b26e-413ebd7c093c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:33.177524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e07078c0-9a11-4b16-920a-d5f8865472d8 req-81c1901c-4670-4f7e-b26e-413ebd7c093c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:33.179590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e07078c0-9a11-4b16-920a-d5f8865472d8 req-81c1901c-4670-4f7e-b26e-413ebd7c093c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:33.189043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:33.200836 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e07078c0-9a11-4b16-920a-d5f8865472d8 req-81c1901c-4670-4f7e-b26e-413ebd7c093c service nova] Creating event network-vif-plugged:bde97f0e-07a3-44ca-a010-df3ed177f9c6 for instance 2509400a-a791-4886-a8de-28291ed16151 on n-h2-846470-15 Aug 24 04:11:33.201150 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01e127be-6a5c-4201-ad63-725fa486cd89 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1314 microversion: 2.1 time: 0.279240 Aug 24 04:11:33.215001 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2803/5862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:32 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:33.215555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e07078c0-9a11-4b16-920a-d5f8865472d8 req-81c1901c-4670-4f7e-b26e-413ebd7c093c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057454 Aug 24 04:11:33.215555 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3060/5863] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:11:34.228181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:34.229605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:34.244724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:34.246355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:34.246638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:34.248570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:34.249461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:34.250288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:34.297713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:34.480215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:34.494141 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7f0e952f-8729-4c36-9e10-65348041de84 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1314 microversion: 2.1 time: 0.272644 Aug 24 04:11:34.495324 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2804/5864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:34 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:35.526680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:35.527552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:35.530805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:35.531732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:35.541341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:35.542149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:35.542994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:35.544815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:35.545584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:35.546789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:35.714743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:35.724665 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d3a98502-ecc7-4f42-9839-f91c452c5c8e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1499 microversion: 2.1 time: 0.208129 Aug 24 04:11:35.726083 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3061/5865] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:35 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1499 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:36.522602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:36.523107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:36.535640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:36.538196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:36.538935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:36.540031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:36.541597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:36.542449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:36.543636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:36.560570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=79 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:36.594598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:11:36.729926 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c93054e2-40db-4bef-8241-b5f995106d86 tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 204 len: 0 microversion: 2.1 time: 0.211279 Aug 24 04:11:36.735703 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2805/5866] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:11:36 2022] DELETE /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:11:36.740770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:36.741498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:36.752609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:36.756023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:36.756767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:36.758173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:36.759580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:36.760458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:36.761241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:36.774380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:36.980328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:37.014096 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6ff1b49e-0af7-49bc-b51e-aca0c059387e tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1505 microversion: 2.1 time: 0.276583 Aug 24 04:11:37.015177 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3062/5867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:36 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:11:38.039113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:38.039924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:38.047355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:38.048369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:38.049039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:38.050067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:38.050703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:38.051292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:38.247016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:38.259099 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4c070d71-64ef-45c4-89dc-732aad8f1f3f tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1505 microversion: 2.1 time: 0.224176 Aug 24 04:11:38.259722 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2806/5868] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:38 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:11:39.287710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:39.288569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:39.304277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:39.304929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:39.305473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:39.306275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:39.306961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:39.307594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:39.834999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0420d87f-1e6e-442c-a8d5-d878b1990f90 req-0c5904f3-a79f-4721-a382-7a632834b8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2509400a-a791-4886-a8de-28291ed16151", "name": "network-vif-deleted", "tag": "bde97f0e-07a3-44ca-a010-df3ed177f9c6"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:39.874681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713a0ef4abc54f319de5b6aae792570f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54a2c40e6bc46aabdd356a0eda10a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:39.885831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0420d87f-1e6e-442c-a8d5-d878b1990f90 req-0c5904f3-a79f-4721-a382-7a632834b8db service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:39.889644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0420d87f-1e6e-442c-a8d5-d878b1990f90 req-0c5904f3-a79f-4721-a382-7a632834b8db service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:39.897364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0420d87f-1e6e-442c-a8d5-d878b1990f90 req-0c5904f3-a79f-4721-a382-7a632834b8db service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:39.902719 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b517e655-01c7-4854-ba50-1b635f9255ce tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 200 len: 1505 microversion: 2.1 time: 0.618493 Aug 24 04:11:39.905430 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3063/5869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:39 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:11:39.951738 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0420d87f-1e6e-442c-a8d5-d878b1990f90 req-0c5904f3-a79f-4721-a382-7a632834b8db service nova] Creating event network-vif-deleted:bde97f0e-07a3-44ca-a010-df3ed177f9c6 for instance 2509400a-a791-4886-a8de-28291ed16151 on n-h2-846470-15 Aug 24 04:11:39.964049 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0420d87f-1e6e-442c-a8d5-d878b1990f90 req-0c5904f3-a79f-4721-a382-7a632834b8db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148125 Aug 24 04:11:39.967752 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2807/5870] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:11:40.945659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:40.947005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] [instance: 2509400a-a791-4886-a8de-28291ed16151] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:40.964967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:40.965503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:40.968365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:40.969233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:40.971146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:40.975117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:41.016224 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] HTTP exception thrown: Instance 2509400a-a791-4886-a8de-28291ed16151 could not be found. Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Request method failure captured: Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 HTTP/1.1 Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaTXiiSBg6E4VTDPxlIrdCp_7L4-x6Dyh4NWB-pnsY3bfZ3bkYPAeL70umh0Xew8maQE3Cf2qkxsgiANOnzZ8kXCW_vNWKrK7DfK44GyRWubmzk1mHj6ejNggymFZWFRCMS5tltqLO_01QLetX1bKzdKFGAqvztjOb1XmQXRHomWlKw Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a54a2c40e6bc46aabdd356a0eda10a5a Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesActionsTest-129632375 Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a54a2c40e6bc46aabdd356a0eda10a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a54a2c40e6bc46aabdd356a0eda10a5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a54a2c40e6bc46aabdd356a0eda10a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a54a2c40e6bc46aabdd356a0eda10a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesActionsTest-129632375 Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a54a2c40e6bc46aabdd356a0eda10a5a Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesActionsTest-129632375 Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesActionsTest-129632375-project Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 713a0ef4abc54f319de5b6aae792570f Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesActionsTest-129632375-project Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 2509400a-a791-4886-a8de-28291ed16151 could not be found. Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '2509400a-a791-4886-a8de-28291ed16151'} Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2509400a-a791-4886-a8de-28291ed16151 could not be found. Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2509400a-a791-4886-a8de-28291ed16151 could not be found. Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:11:41.021829 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:11:41.031740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:11:41.031740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:11:41.031740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:11:41.031740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:11:41.031740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:11:41.031740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2509400a-a791-4886-a8de-28291ed16151 could not be found. Aug 24 04:11:41.031740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:11:41.035273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] Returning 404 to user: Instance 2509400a-a791-4886-a8de-28291ed16151 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:11:41.037821 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75b0ebda-f8ab-47c6-9079-a5ead2ce06eb tempest-VolumesActionsTest-129632375 tempest-VolumesActionsTest-129632375-project] 10.222.0.58 "GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151" status: 404 len: 111 microversion: 2.1 time: 0.096229 Aug 24 04:11:41.039503 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3064/5871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:40 2022] GET /compute/v2.1/servers/2509400a-a791-4886-a8de-28291ed16151 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:11:45.090837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1934384431", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "c779c117-c5c3-473e-8b39-511ef34585ac"}], "key_name": "tempest-TestSecurityGroupsBasicOps-505763909", "security_groups": []}, "os:scheduler_hints": {"different_host": ["e4144b74-de37-49c8-892e-9b391c2f6cec"]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:45.292521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] validate_networks() for [('c779c117-c5c3-473e-8b39-511ef34585ac', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:11:46.388837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:11:46.389463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:11:46.389961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:11:46.390445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:11:46.390952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:11:46.406107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:46.413974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:46.414714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:46.415897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:46.416618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:46.417338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:46.464273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Getting quotas for project a16cf00b984a4713a273e24b8731314d. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:11:46.479193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Getting quotas for user 5ff47a8c9f334ea19cb42e30e3678d6c and project a16cf00b984a4713a273e24b8731314d. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:11:46.504180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:11:46.507829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:11:46.597763 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91a23c91-2fec-4beb-b6e0-ade2cf052195 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.520179 Aug 24 04:11:46.608030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2808/5872] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:11:45 2022] POST /compute/v2.1/servers => generated 361 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:11:46.611549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eedd5e40-6b37-47b8-9499-dc16d22f4f7f tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:46.612204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eedd5e40-6b37-47b8-9499-dc16d22f4f7f tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:46.772644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eedd5e40-6b37-47b8-9499-dc16d22f4f7f tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:46.782773 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eedd5e40-6b37-47b8-9499-dc16d22f4f7f tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1241 microversion: 2.1 time: 0.175706 Aug 24 04:11:46.783914 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3065/5873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:46 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:47.807752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:47.809552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:47.853263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:47.856982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:47.857707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:47.858682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:47.860918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:47.869411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:48.187971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:48.199914 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5977d040-eb45-4d45-b099-4f94116e81e8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1245 microversion: 2.1 time: 0.396538 Aug 24 04:11:48.200993 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2809/5874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:47 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1245 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:49.225744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:49.226133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:49.238088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:49.238814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:49.239270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:49.240034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:49.240499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:49.240929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:49.468347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:49.483287 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-33f074e4-ccc4-49c8-99e9-5b7b1259b5b8 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1301 microversion: 2.1 time: 0.263989 Aug 24 04:11:49.483947 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3066/5875] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:49 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1301 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:11:50.514844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:50.515619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:50.537776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:50.551623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:50.554457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:50.555827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:50.558528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:50.562372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:50.823546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:50.833100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c0a1fe8-4e08-4586-b835-f09f6c7bc086 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.322939 Aug 24 04:11:50.833698 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2810/5876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:50 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:51.857188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:51.861500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:51.902279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:51.905059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:51.905763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:51.915113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:51.916476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:51.917428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:52.135776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ecbc93b1-80c0-4d52-a61c-62bd2cca0543 req-eaeab4e9-db41-459f-b8bd-f8f1be84f757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931f4767-8ca5-4dc4-9403-675ecb3068a7", "tag": "38e4c9fc-1555-4c36-801c-72e57cc109ec"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:11:52.166857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ecbc93b1-80c0-4d52-a61c-62bd2cca0543 req-eaeab4e9-db41-459f-b8bd-f8f1be84f757 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:52.167041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ecbc93b1-80c0-4d52-a61c-62bd2cca0543 req-eaeab4e9-db41-459f-b8bd-f8f1be84f757 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:52.167638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ecbc93b1-80c0-4d52-a61c-62bd2cca0543 req-eaeab4e9-db41-459f-b8bd-f8f1be84f757 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:52.183824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:52.210289 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa2cba1e-ec5a-4582-b71e-df9ce3926c17 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.357573 Aug 24 04:11:52.231649 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3067/5877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:51 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:52.242048 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ecbc93b1-80c0-4d52-a61c-62bd2cca0543 req-eaeab4e9-db41-459f-b8bd-f8f1be84f757 service nova] Creating event network-changed:38e4c9fc-1555-4c36-801c-72e57cc109ec for instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 on n-h1-846470-15 Aug 24 04:11:52.257630 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ecbc93b1-80c0-4d52-a61c-62bd2cca0543 req-eaeab4e9-db41-459f-b8bd-f8f1be84f757 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126532 Aug 24 04:11:52.259257 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2811/5878] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:11:53.240573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:53.243924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:53.263888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:53.270669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:53.272087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:53.274410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:53.275340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:53.277118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:53.406478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:53.428576 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0681fb1f-218d-41ca-ac51-5c07db395849 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.196150 Aug 24 04:11:53.445621 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3068/5879] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:53 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:54.453431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:54.454555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:54.464138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:54.464616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:54.468382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:54.472170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:54.472658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:54.473096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:54.624470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:54.635481 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a465ea0-8c78-41b8-a960-121a8d194f42 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.186370 Aug 24 04:11:54.649866 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2812/5880] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:54 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:55.663810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:55.665426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:55.678175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:55.678675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:55.681120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:55.681843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:55.682388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:55.682906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:55.941188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:55.949784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16b6980b-c6fa-4696-9030-032cfb702338 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.293736 Aug 24 04:11:55.950629 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3069/5881] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:55 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:56.973208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:56.976510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:56.982774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:56.991695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:57.021213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:57.022257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:57.022868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:57.023860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:57.024845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:57.025944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:57.179593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:57.210156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-44efd941-c16c-48b5-b424-9af95262d75e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.241535 Aug 24 04:11:57.224791 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2813/5882] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:56 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:58.246649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:58.247309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:58.253110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:58.280301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:58.285152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:58.286219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:58.287628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:58.290220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:58.297616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:58.479373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:58.512933 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db22571f-4a6b-45ed-bec3-84bf98c0e1cd tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.270215 Aug 24 04:11:58.515264 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3070/5883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:58 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:11:59.536456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:11:59.537718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:11:59.552037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:59.553117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:59.556466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:59.560722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:11:59.561783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:11:59.562951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:11:59.778384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:11:59.791009 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c34d8a0-6eb9-41df-9a02-b01e2d034caa tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.258344 Aug 24 04:11:59.791873 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2814/5884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:11:59 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:00.694486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-0e38e2df-6a8a-4921-9181-fcd61e1aca69 req-4dc25699-310c-44bd-b19e-44a8e6968e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931f4767-8ca5-4dc4-9403-675ecb3068a7", "name": "network-vif-plugged", "status": "completed", "tag": "38e4c9fc-1555-4c36-801c-72e57cc109ec"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:00.712104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0e38e2df-6a8a-4921-9181-fcd61e1aca69 req-4dc25699-310c-44bd-b19e-44a8e6968e6f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:00.715973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0e38e2df-6a8a-4921-9181-fcd61e1aca69 req-4dc25699-310c-44bd-b19e-44a8e6968e6f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:00.718125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-0e38e2df-6a8a-4921-9181-fcd61e1aca69 req-4dc25699-310c-44bd-b19e-44a8e6968e6f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:00.741121 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-0e38e2df-6a8a-4921-9181-fcd61e1aca69 req-4dc25699-310c-44bd-b19e-44a8e6968e6f service nova] Creating event network-vif-plugged:38e4c9fc-1555-4c36-801c-72e57cc109ec for instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 on n-h1-846470-15 Aug 24 04:12:00.770632 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-0e38e2df-6a8a-4921-9181-fcd61e1aca69 req-4dc25699-310c-44bd-b19e-44a8e6968e6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080189 Aug 24 04:12:00.774744 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3071/5885] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:12:00.835610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:00.837076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:00.848085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:00.849071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:00.849680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:00.850565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:00.851181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:00.851948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:01.028468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:01.050917 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bfcfffb5-2e20-4922-94bf-aea0bdfe8642 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.219596 Aug 24 04:12:01.052013 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2815/5886] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:00 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:02.077812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:02.078661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:02.099034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:02.099585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:02.100767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:02.101265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:02.101982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:02.102501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:02.229789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:02.241190 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8cbcd0b2-2459-4812-9901-bdd3252ea87e tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1299 microversion: 2.1 time: 0.169300 Aug 24 04:12:02.242757 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3072/5887] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:02 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:03.264495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:03.265744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:03.276730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:03.277912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:03.278862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:03.280226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:03.280971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:03.281593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:03.458646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:03.477574 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f74000d8-0ea8-45bc-b539-3e70f3701218 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1472 microversion: 2.1 time: 0.217224 Aug 24 04:12:03.479018 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2816/5888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:03 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:03.507776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:03.509397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:03.537644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:03.555950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:03.556582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:03.557342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:03.557811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:03.558233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:03.697315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:03.709648 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2cdf3013-b72a-493d-a0c8-a98b23af6053 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1472 microversion: 2.1 time: 0.206770 Aug 24 04:12:03.710797 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3073/5889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:03 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:03.738943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:03.741026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:03.764541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:03.767630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:03.770427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:03.773787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:03.778350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:03.779575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:03.959434 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7ac68b01-f928-44b1-a03b-96b24e2cf682 tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1625 microversion: 2.1 time: 0.227680 Aug 24 04:12:03.960684 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2817/5890] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:03 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1625 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:03.997393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:04.003575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:04.017953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:04.021586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:04.023225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:04.025166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:04.032585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:04.033112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:04.511946 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b317fd5a-ddb4-4ef2-a8e3-cd84379838cd tempest-TestSecurityGroupsBasicOps-1080782206 tempest-TestSecurityGroupsBasicOps-1080782206-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1915 microversion: 2.1 time: 0.521597 Aug 24 04:12:04.515108 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3074/5891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:03 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1915 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:04.635953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:04.636887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:04.667832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:04.676461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:04.677150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:04.677903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:04.678372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:04.678790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:04.719808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:12:04.839109 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52d36903-3dc4-4ed4-84b7-d6f24a7a2f98 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "DELETE /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 204 len: 0 microversion: 2.1 time: 0.208902 Aug 24 04:12:04.840569 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2818/5892] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:12:04 2022] DELETE /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:12:04.849816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:04.850693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:04.859987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:04.860737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:04.862013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:04.863376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:04.864029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:04.865251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:05.030178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:05.039311 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92539fd4-e693-42b3-b5ba-62cf2f2e5dea tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1478 microversion: 2.1 time: 0.193659 Aug 24 04:12:05.041123 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3075/5893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:04 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1478 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:06.066671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:06.068061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:06.080538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:06.081401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:06.082064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:06.083923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:06.088772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:06.089784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:06.290121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:06.328169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-22bd5843-f8a7-4421-93f7-f8443babb881 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1478 microversion: 2.1 time: 0.268943 Aug 24 04:12:06.341646 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2819/5894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:06 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1478 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:07.351541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:07.353450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:07.362136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=30 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:07.378005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:07.378806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:07.379412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:07.380364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:07.380983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:07.381554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:07.384856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=70 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:07.499505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e6a113ef-98f4-4ad4-befe-68417caee1b0 req-5456a281-3261-424e-b7ec-b56cacb438d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931f4767-8ca5-4dc4-9403-675ecb3068a7", "name": "network-vif-deleted", "tag": "38e4c9fc-1555-4c36-801c-72e57cc109ec"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:07.547898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:07.550995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e6a113ef-98f4-4ad4-befe-68417caee1b0 req-5456a281-3261-424e-b7ec-b56cacb438d5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:07.552052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e6a113ef-98f4-4ad4-befe-68417caee1b0 req-5456a281-3261-424e-b7ec-b56cacb438d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:07.552700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e6a113ef-98f4-4ad4-befe-68417caee1b0 req-5456a281-3261-424e-b7ec-b56cacb438d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:07.559125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:07.592581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:07.628460 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e6a113ef-98f4-4ad4-befe-68417caee1b0 req-5456a281-3261-424e-b7ec-b56cacb438d5 service nova] Creating event network-vif-deleted:38e4c9fc-1555-4c36-801c-72e57cc109ec for instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 on n-h1-846470-15 Aug 24 04:12:07.633791 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3785bf2f-f77c-4b94-80e3-9f92b26f6f03 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 200 len: 1478 microversion: 2.1 time: 0.286971 Aug 24 04:12:07.634435 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3076/5895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:07 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 1478 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:07.656439 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e6a113ef-98f4-4ad4-befe-68417caee1b0 req-5456a281-3261-424e-b7ec-b56cacb438d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162871 Aug 24 04:12:07.657628 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2820/5896] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:12:08.659825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:08.660395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: 931f4767-8ca5-4dc4-9403-675ecb3068a7] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:08.669623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:08.670366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:08.671248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:08.672390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:08.672998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:08.673609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:08.693314 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] HTTP exception thrown: Instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 could not be found. Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Request method failure captured: Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 HTTP/1.1 Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaSAwZW7Vyf3kBbSUFJbNDaYEXI_U9pBpW_FKK3bPUTxEHgNW6w-0Gdnt-J1NJkMHKAY7pN8Pf3RVksMDTLcSHukRWTM7y7NK8qJe-MtCr0RY3cX3zrjk-9LUZgme3RA1efht4vdeFYktS1KfuEZ5DuUn_fMVzvNrl2BZnKakmzfT5g Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a16cf00b984a4713a273e24b8731314d Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1722461348 Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a16cf00b984a4713a273e24b8731314d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a16cf00b984a4713a273e24b8731314d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a16cf00b984a4713a273e24b8731314d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a16cf00b984a4713a273e24b8731314d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1722461348 Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a16cf00b984a4713a273e24b8731314d Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1722461348 Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestSecurityGroupsBasicOps-1722461348-project Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5ff47a8c9f334ea19cb42e30e3678d6c Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1722461348-project Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 could not be found. Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '931f4767-8ca5-4dc4-9403-675ecb3068a7'} Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 could not be found. Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 could not be found. Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:08.695356 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:12:08.699815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:08.699815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:08.699815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:12:08.699815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:12:08.699815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:12:08.699815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:12:08.699815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 could not be found. Aug 24 04:12:08.699815 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:08.702622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Returning 404 to user: Instance 931f4767-8ca5-4dc4-9403-675ecb3068a7 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:12:08.703885 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d81a5bcb-7900-4993-95eb-a444acf367a9 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7" status: 404 len: 111 microversion: 2.1 time: 0.050382 Aug 24 04:12:08.704965 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3077/5897] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:08 2022] GET /compute/v2.1/servers/931f4767-8ca5-4dc4-9403-675ecb3068a7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:12:11.419419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:11.420007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:11.434338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:11.437050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:11.437613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:11.441807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:11.442363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:11.442908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:11.991699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:12.010471 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-982531d3-cd44-4c5b-aecc-817c35e75991 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.597415 Aug 24 04:12:12.014868 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2821/5898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:11 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:12.034043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:12.035437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:12.054574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:12.056430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:12.057187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:12.058408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:12.059205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:12.060842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:13.218251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:13.232873 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce91a132-2092-4949-975d-44aac655fdb3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 1.202789 Aug 24 04:12:13.248691 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3078/5899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:12 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:13.257131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:13.257953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:13.268757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:13.269264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:13.269713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:13.270434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:13.270902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:13.271335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:13.557552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:13.571377 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d34c798-36cf-4ae5-9fee-8ec324ab2818 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.319165 Aug 24 04:12:13.578702 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2822/5900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:13 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:13.602606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1229826195"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:13.605794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:13.619922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:13.620554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:13.621074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:13.623110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:13.624422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:13.624953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:14.082395 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-508d1351-45cc-48e4-a9c4-81ab1da7a7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.484019 Aug 24 04:12:14.087226 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3079/5901] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:12:13 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 04:12:16.366328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:16.366835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:16.374594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f167871f-3f04-4548-8fd4-e91d18276600 req-e39e2b52-210a-4b45-bbba-722a72eeb5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4144b74-de37-49c8-892e-9b391c2f6cec", "tag": "1e994136-5d7d-45c2-803b-8f2e5182fc67"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:16.404027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:16.406323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:16.407442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:16.409606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:16.410225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:16.412332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:16.415404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f167871f-3f04-4548-8fd4-e91d18276600 req-e39e2b52-210a-4b45-bbba-722a72eeb5fd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:16.419875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f167871f-3f04-4548-8fd4-e91d18276600 req-e39e2b52-210a-4b45-bbba-722a72eeb5fd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:16.420516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f167871f-3f04-4548-8fd4-e91d18276600 req-e39e2b52-210a-4b45-bbba-722a72eeb5fd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:16.448711 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f167871f-3f04-4548-8fd4-e91d18276600 req-e39e2b52-210a-4b45-bbba-722a72eeb5fd service nova] Creating event network-changed:1e994136-5d7d-45c2-803b-8f2e5182fc67 for instance e4144b74-de37-49c8-892e-9b391c2f6cec on n-h2-846470-15 Aug 24 04:12:16.464312 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f167871f-3f04-4548-8fd4-e91d18276600 req-e39e2b52-210a-4b45-bbba-722a72eeb5fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094654 Aug 24 04:12:16.465253 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3080/5902] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:12:16.505912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:12:16.743584 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0e3061e1-4748-4b7e-bcba-62c9cba1859b tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 204 len: 0 microversion: 2.1 time: 0.382278 Aug 24 04:12:16.748530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2823/5903] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:12:16 2022] DELETE /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:12:16.764710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:16.765453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:16.790937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:16.791535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:16.792160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:16.807587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:16.808183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:16.808608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:17.120885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:17.136723 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3287063-f14a-4c72-9d23-b307cf83140d tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1768 microversion: 2.1 time: 0.386261 Aug 24 04:12:17.143736 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3081/5904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:16 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1768 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:12:18.160825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:18.161565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:18.183737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:18.188409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:18.189099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:18.189885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:18.198802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:18.199348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:18.750157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:18.771246 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4aae276-fafc-4dda-a1f4-2e5ed0aadb51 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1768 microversion: 2.1 time: 0.615915 Aug 24 04:12:18.777412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2824/5905] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:18 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1768 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:19.801784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:19.802947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:19.820179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:19.820805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:19.821402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:19.822201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:19.823340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:19.826944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:20.005192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff47a8c9f334ea19cb42e30e3678d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16cf00b984a4713a273e24b8731314d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:20.015789 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31f33175-6679-457c-bf9c-d9fe475ade1a tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 200 len: 1530 microversion: 2.1 time: 0.218938 Aug 24 04:12:20.016391 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3082/5906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:19 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 1530 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:20.113020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6c788965-fad6-4395-8e48-e2351b5894fa req-85a8dc7d-76dd-45f4-a96b-dd5b572ca6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4144b74-de37-49c8-892e-9b391c2f6cec", "name": "network-vif-deleted", "tag": "1e994136-5d7d-45c2-803b-8f2e5182fc67"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:20.136430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c788965-fad6-4395-8e48-e2351b5894fa req-85a8dc7d-76dd-45f4-a96b-dd5b572ca6b3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:20.137075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c788965-fad6-4395-8e48-e2351b5894fa req-85a8dc7d-76dd-45f4-a96b-dd5b572ca6b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:20.137750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6c788965-fad6-4395-8e48-e2351b5894fa req-85a8dc7d-76dd-45f4-a96b-dd5b572ca6b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:20.172896 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6c788965-fad6-4395-8e48-e2351b5894fa req-85a8dc7d-76dd-45f4-a96b-dd5b572ca6b3 service nova] Creating event network-vif-deleted:1e994136-5d7d-45c2-803b-8f2e5182fc67 for instance e4144b74-de37-49c8-892e-9b391c2f6cec on n-h2-846470-15 Aug 24 04:12:20.178973 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6c788965-fad6-4395-8e48-e2351b5894fa req-85a8dc7d-76dd-45f4-a96b-dd5b572ca6b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071041 Aug 24 04:12:20.179639 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2825/5907] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:21.047893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:21.048648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] [instance: e4144b74-de37-49c8-892e-9b391c2f6cec] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:21.081142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:21.082698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:21.083961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:21.085108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:21.086113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:21.086746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:21.122670 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] HTTP exception thrown: Instance e4144b74-de37-49c8-892e-9b391c2f6cec could not be found. Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Request method failure captured: Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec HTTP/1.1 Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaSAwZW7Vyf3kBbSUFJbNDaYEXI_U9pBpW_FKK3bPUTxEHgNW6w-0Gdnt-J1NJkMHKAY7pN8Pf3RVksMDTLcSHukRWTM7y7NK8qJe-MtCr0RY3cX3zrjk-9LUZgme3RA1efht4vdeFYktS1KfuEZ5DuUn_fMVzvNrl2BZnKakmzfT5g Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a16cf00b984a4713a273e24b8731314d Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1722461348 Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a16cf00b984a4713a273e24b8731314d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a16cf00b984a4713a273e24b8731314d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a16cf00b984a4713a273e24b8731314d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a16cf00b984a4713a273e24b8731314d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1722461348 Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a16cf00b984a4713a273e24b8731314d Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1722461348 Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestSecurityGroupsBasicOps-1722461348-project Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 5ff47a8c9f334ea19cb42e30e3678d6c Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1722461348-project Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance e4144b74-de37-49c8-892e-9b391c2f6cec could not be found. Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'e4144b74-de37-49c8-892e-9b391c2f6cec'} Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4144b74-de37-49c8-892e-9b391c2f6cec could not be found. Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4144b74-de37-49c8-892e-9b391c2f6cec could not be found. Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:21.127393 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:12:21.131929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:21.131929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:21.131929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:12:21.131929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:12:21.131929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:12:21.131929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:12:21.131929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4144b74-de37-49c8-892e-9b391c2f6cec could not be found. Aug 24 04:12:21.131929 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:12:21.137518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Returning 404 to user: Instance e4144b74-de37-49c8-892e-9b391c2f6cec could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:12:21.140247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9cd9e3ee-1718-4b41-bde8-b67e4959d724 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec" status: 404 len: 111 microversion: 2.1 time: 0.099536 Aug 24 04:12:21.146951 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3083/5908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:21 2022] GET /compute/v2.1/servers/e4144b74-de37-49c8-892e-9b391c2f6cec => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:12:21.450936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a1bc4d61-869e-43d9-b271-7132f3b349d1 req-47b95dfd-0135-4b12-ba59-f9b9403a37b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "name": "network-vif-plugged", "status": "completed", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:21.508847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a1bc4d61-869e-43d9-b271-7132f3b349d1 req-47b95dfd-0135-4b12-ba59-f9b9403a37b0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:21.512022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a1bc4d61-869e-43d9-b271-7132f3b349d1 req-47b95dfd-0135-4b12-ba59-f9b9403a37b0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:21.512386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a1bc4d61-869e-43d9-b271-7132f3b349d1 req-47b95dfd-0135-4b12-ba59-f9b9403a37b0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:21.551457 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a1bc4d61-869e-43d9-b271-7132f3b349d1 req-47b95dfd-0135-4b12-ba59-f9b9403a37b0 service nova] Creating event network-vif-plugged:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:12:21.563992 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a1bc4d61-869e-43d9-b271-7132f3b349d1 req-47b95dfd-0135-4b12-ba59-f9b9403a37b0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144907 Aug 24 04:12:21.565170 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2826/5909] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:22.991371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:22.992714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:23.000261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:23.000999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:23.001586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:23.002648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:23.003251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:23.003901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:23.099301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lazy-loading 'services' on Instance uuid 68df9462-21ba-4fc4-b7a7-024266cd6f03 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:12:23.221102 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3e0d46c-de3a-4ca8-861b-b512389eb4bc tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "DELETE /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03/os-volume_attachments/9e9c91f7-4ab4-4637-b72d-6b90e502fcf8" status: 202 len: 0 microversion: 2.1 time: 0.233513 Aug 24 04:12:23.234299 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3084/5910] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:12:22 2022] DELETE /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03/os-volume_attachments/9e9c91f7-4ab4-4637-b72d-6b90e502fcf8 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:12:30.290972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-36a316ff-76ba-40a1-a3ed-2689d8d6bf26 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] Calling method '.version_select at 0x7f1029ebf670>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:30.381672 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-36a316ff-76ba-40a1-a3ed-2689d8d6bf26 tempest-TestSecurityGroupsBasicOps-1722461348 tempest-TestSecurityGroupsBasicOps-1722461348-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-505763909" status: 202 len: 0 microversion: 2.1 time: 0.117158 Aug 24 04:12:30.385253 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2827/5911] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:12:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-505763909 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:12:34.852102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=17 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:34.853654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:34.868274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:34.872507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:34.887020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:34.887842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:34.889790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:34.891153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:34.893489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:34.894479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:34.943304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:12:35.073066 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d2386fbf-336e-4958-b5ed-8cb1c158c65d tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "DELETE /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 204 len: 0 microversion: 2.1 time: 0.222578 Aug 24 04:12:35.075078 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3085/5912] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:12:34 2022] DELETE /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:12:35.091642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:35.092897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:35.146181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:35.162769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:35.163287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:35.171974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:35.176900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:35.177920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:35.180720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:35.595021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:35.613134 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6dc001bb-f09f-4d46-ae46-1263eeb003b5 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1470 microversion: 2.1 time: 0.530858 Aug 24 04:12:35.613949 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2828/5913] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:35 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1470 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:36.646456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:36.647181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:36.665356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:36.665853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:36.669393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:36.671874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:36.672378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:36.672818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:37.005400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:37.019504 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae4360fa-5dad-4921-a82e-c581e42c1bf1 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1470 microversion: 2.1 time: 0.388075 Aug 24 04:12:37.022296 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3086/5914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:36 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1470 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:38.047691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:38.047691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:38.062036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:38.062570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:38.072592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:38.082570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:38.083071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:38.083519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:39.231818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-36307f92-cc8f-4866-80f5-ddf60541270f req-b69742aa-9c5d-4ca6-a578-107a5e0ea6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68df9462-21ba-4fc4-b7a7-024266cd6f03", "name": "network-vif-deleted", "tag": "708f32e1-8a0b-4e0c-b26f-6be59487e78f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:39.255811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb3469ab376483eab6f1d40586df4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7197c804d3ee419eb16ccd7c4d7d3ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:39.285933 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79d2beae-04ed-4a32-87b1-e8c73041e889 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 200 len: 1470 microversion: 2.1 time: 1.226702 Aug 24 04:12:39.289748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-36307f92-cc8f-4866-80f5-ddf60541270f req-b69742aa-9c5d-4ca6-a578-107a5e0ea6d7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:39.292292 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2829/5915] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:38 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 1470 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:39.308295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-36307f92-cc8f-4866-80f5-ddf60541270f req-b69742aa-9c5d-4ca6-a578-107a5e0ea6d7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:39.310886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-36307f92-cc8f-4866-80f5-ddf60541270f req-b69742aa-9c5d-4ca6-a578-107a5e0ea6d7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:39.373359 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-36307f92-cc8f-4866-80f5-ddf60541270f req-b69742aa-9c5d-4ca6-a578-107a5e0ea6d7 service nova] Creating event network-vif-deleted:708f32e1-8a0b-4e0c-b26f-6be59487e78f for instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 on n-h1-846470-15 Aug 24 04:12:39.394022 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-36307f92-cc8f-4866-80f5-ddf60541270f req-b69742aa-9c5d-4ca6-a578-107a5e0ea6d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167787 Aug 24 04:12:39.398666 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3087/5916] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:12:40.314205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:40.315299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] [instance: 68df9462-21ba-4fc4-b7a7-024266cd6f03] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:40.339934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:40.340454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:40.341608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:40.342689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:40.343292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:40.348480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:40.412905 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] HTTP exception thrown: Instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 could not be found. Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Request method failure captured: Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 HTTP/1.1 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaSr6JB6pOeILzSxrZ2WIVST7e2r_qK0xoXnZuxvttgddi6gSFNVNb8q4sSat9QxJL-EFfURnb2WP7m6kHv4SSGJ8Af0kyi0nYhFrQ8Uh0T9PqzjUqS7G-oUbU9WOoU6jxkQ7gp84hho5B9SZj-UUdwgCWJYxITpxGdC1Axw86hk7Vc Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 7197c804d3ee419eb16ccd7c4d7d3ac6 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesBackupsTest-1588866627 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7197c804d3ee419eb16ccd7c4d7d3ac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7197c804d3ee419eb16ccd7c4d7d3ac6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7197c804d3ee419eb16ccd7c4d7d3ac6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7197c804d3ee419eb16ccd7c4d7d3ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesBackupsTest-1588866627 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 7197c804d3ee419eb16ccd7c4d7d3ac6 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesBackupsTest-1588866627 Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesBackupsTest-1588866627-project Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cbb3469ab376483eab6f1d40586df4db Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesBackupsTest-1588866627-project Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 could not be found. Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '68df9462-21ba-4fc4-b7a7-024266cd6f03'} Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 could not be found. Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 could not be found. Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:12:40.420738 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:12:40.428096 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:12:40.428096 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:12:40.428096 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:12:40.428096 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:12:40.428096 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:12:40.428096 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 could not be found. Aug 24 04:12:40.428096 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:12:40.430249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] Returning 404 to user: Instance 68df9462-21ba-4fc4-b7a7-024266cd6f03 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:12:40.432088 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1631df91-dbed-4cf2-96c3-121214caea89 tempest-VolumesBackupsTest-1588866627 tempest-VolumesBackupsTest-1588866627-project] 10.222.0.58 "GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03" status: 404 len: 111 microversion: 2.1 time: 0.123615 Aug 24 04:12:40.436042 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2830/5917] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:40 2022] GET /compute/v2.1/servers/68df9462-21ba-4fc4-b7a7-024266cd6f03 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:12:43.703779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d0c511c-4818-41de-a51e-71cef4d8ee23 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1409646205", "availability_zone": "foo_zone"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:43.748404 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:43.748404 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:12:43.751087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.aggregate [None req-1d0c511c-4818-41de-a51e-71cef4d8ee23 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Generated uuid f07b428e-3eb2-4571-8ae3-e25e1db2a433 for aggregate {{(pid=122536) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 04:12:43.759233 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1d0c511c-4818-41de-a51e-71cef4d8ee23 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:12:44.777607 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-1d0c511c-4818-41de-a51e-71cef4d8ee23 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 45978. Aug 24 04:12:44.883658 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d0c511c-4818-41de-a51e-71cef4d8ee23 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.422986 Aug 24 04:12:44.892833 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3088/5918] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 24 04:12:43 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:44.897288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-886e18c3-4a81-4d81-a364-b8e65cf1b7f6 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:44.900818 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:44.900818 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 04:12:44.911765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:45.000078 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-886e18c3-4a81-4d81-a364-b8e65cf1b7f6 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.107050 Aug 24 04:12:45.001363 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2831/5919] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 04:12:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:45.015876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0bcf35b-d6e0-4d5b-b02e-4a785ac4d22f tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:45.019237 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:45.019237 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:12:45.020900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0bcf35b-d6e0-4d5b-b02e-4a785ac4d22f tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:45.021657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0bcf35b-d6e0-4d5b-b02e-4a785ac4d22f tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:45.023337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0bcf35b-d6e0-4d5b-b02e-4a785ac4d22f tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:45.024396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0bcf35b-d6e0-4d5b-b02e-4a785ac4d22f tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:45.025115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0bcf35b-d6e0-4d5b-b02e-4a785ac4d22f tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:45.025708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0bcf35b-d6e0-4d5b-b02e-4a785ac4d22f tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:45.061412 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0bcf35b-d6e0-4d5b-b02e-4a785ac4d22f tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.052208 Aug 24 04:12:45.086843 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3089/5920] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 24 04:12:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:45.096241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-37d2304c-4347-47dd-93e2-e31585950c46 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:45.097385 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:45.097385 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 04:12:45.127141 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-37d2304c-4347-47dd-93e2-e31585950c46 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.036380 Aug 24 04:12:45.140178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9cf760f-6f0c-4842-8d31-f37041cb48e6 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846470-15"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:45.140540 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2832/5921] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 24 04:12:45 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:45.143510 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:45.143510 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:12:45.162264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9cf760f-6f0c-4842-8d31-f37041cb48e6 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:45.166125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9cf760f-6f0c-4842-8d31-f37041cb48e6 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:45.169470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9cf760f-6f0c-4842-8d31-f37041cb48e6 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:45.706616 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9cf760f-6f0c-4842-8d31-f37041cb48e6 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.570790 Aug 24 04:12:45.716749 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3090/5922] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 04:12:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:45.721964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-03e74959-dfd5-40e4-94ca-8dc8898ed2b7 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:45.722738 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:45.722738 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 04:12:45.736886 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-03e74959-dfd5-40e4-94ca-8dc8898ed2b7 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.018538 Aug 24 04:12:45.740854 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2833/5923] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 04:12:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:45.750091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1f801043-f1f3-4758-9497-9d3b1fb03446 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1567204754", "availability_zone": "foo_zone"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:45.881826 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:45.881826 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:12:46.011713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1f801043-f1f3-4758-9497-9d3b1fb03446 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.265631 Aug 24 04:12:46.012912 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3091/5924] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 24 04:12:45 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:46.032696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a1b40e59-713d-485f-8a70-d629e3e5ca89 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:46.038639 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:46.038639 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 04:12:46.104067 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a1b40e59-713d-485f-8a70-d629e3e5ca89 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.069678 Aug 24 04:12:46.110975 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2834/5925] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 04:12:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:46.117460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74203470-b2ea-4964-8c0f-d0ca4342145d tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:46.118219 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:46.118219 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:12:46.126781 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74203470-b2ea-4964-8c0f-d0ca4342145d tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.014395 Aug 24 04:12:46.127953 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3092/5926] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 24 04:12:46 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:46.140516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7bc8e8c1-2d49-47c7-9ecd-feb0da97cd6a tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846470-15"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:46.143110 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:46.143110 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 04:12:46.178013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bc8e8c1-2d49-47c7-9ecd-feb0da97cd6a tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:46.178534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bc8e8c1-2d49-47c7-9ecd-feb0da97cd6a tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:46.180214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bc8e8c1-2d49-47c7-9ecd-feb0da97cd6a tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:46.659238 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7bc8e8c1-2d49-47c7-9ecd-feb0da97cd6a tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.519452 Aug 24 04:12:46.660985 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2835/5927] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 24 04:12:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:46.673040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7aa913bb-ba85-40d8-a95a-ea23c5dfa5a3 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:46.673693 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:46.673693 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:12:46.749408 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7aa913bb-ba85-40d8-a95a-ea23c5dfa5a3 tempest-TestAggregatesBasicOps-1398453363 tempest-TestAggregatesBasicOps-1398453363-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.081489 Aug 24 04:12:46.750078 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3093/5928] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 24 04:12:46 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 04:12:50.379353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:50.380004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:50.394406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:50.394995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:50.395451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:50.396509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:50.398014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:50.398623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:50.637024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:50.647764 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2a1d87a-78bd-4d54-87a7-2aa0a09239fe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.273831 Aug 24 04:12:50.653146 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2836/5929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:50 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:51.672513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:12:51.673399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:51.682742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:51.683557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:51.684589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:51.686065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:51.687072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:51.687586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:52.013024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:12:52.032622 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6190a9d9-fb75-4250-93c0-7eab745f1e94 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.365269 Aug 24 04:12:52.034806 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3094/5930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:12:51 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:12:52.058211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1753498415"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:52.066238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:12:52.077905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:52.079037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:52.080078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:52.081597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:52.082443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:52.083558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:52.365413 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9a4045ca-a60e-4e9d-bbb7-027db3b83787 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.312273 Aug 24 04:12:52.366613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2837/5931] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:12:52 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 04:12:55.548596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-46e7c14f-f212-404b-9c93-61861218f71a req-a642da32-5e14-49e4-9fec-63d82b86bbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "name": "network-vif-unplugged", "status": "completed", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:55.554847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:55.571730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-46e7c14f-f212-404b-9c93-61861218f71a req-a642da32-5e14-49e4-9fec-63d82b86bbca service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:55.576803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-46e7c14f-f212-404b-9c93-61861218f71a req-a642da32-5e14-49e4-9fec-63d82b86bbca service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:55.577388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-46e7c14f-f212-404b-9c93-61861218f71a req-a642da32-5e14-49e4-9fec-63d82b86bbca service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:55.603638 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-46e7c14f-f212-404b-9c93-61861218f71a req-a642da32-5e14-49e4-9fec-63d82b86bbca service nova] Creating event network-vif-unplugged:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:12:55.615522 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-46e7c14f-f212-404b-9c93-61861218f71a req-a642da32-5e14-49e4-9fec-63d82b86bbca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070354 Aug 24 04:12:55.618154 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3095/5932] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:12:59.421950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8ffb1e0d-a5fd-4340-a112-df8ddf3c5d0a req-44a7a5ec-693e-4614-8634-71599c820533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "name": "network-vif-plugged", "status": "completed", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:12:59.440929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8ffb1e0d-a5fd-4340-a112-df8ddf3c5d0a req-44a7a5ec-693e-4614-8634-71599c820533 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:12:59.442137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8ffb1e0d-a5fd-4340-a112-df8ddf3c5d0a req-44a7a5ec-693e-4614-8634-71599c820533 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:12:59.443095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8ffb1e0d-a5fd-4340-a112-df8ddf3c5d0a req-44a7a5ec-693e-4614-8634-71599c820533 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:12:59.462623 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8ffb1e0d-a5fd-4340-a112-df8ddf3c5d0a req-44a7a5ec-693e-4614-8634-71599c820533 service nova] Creating event network-vif-plugged:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:12:59.473782 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8ffb1e0d-a5fd-4340-a112-df8ddf3c5d0a req-44a7a5ec-693e-4614-8634-71599c820533 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059115 Aug 24 04:12:59.476270 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2838/5933] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:13:17.540005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:17.541502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:17.883328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd9a652a-54e1-437e-8d77-a54be7b1e2f6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Action: 'create', calling method: .version_select at 0x7f1021ed3670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-879432176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMFnAG3CWs9fHMvaI0SCSYwM4P/4gUH8+WsvVybfNoPl5wc/8C8qXcOjSSS8yf4G4kGWQBNpuno+yuNIjlr2MPniRyv9lvmge470oPqlDDW0EhZWiKLMc+gW3rYhC74pQ=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:17.944580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cd9a652a-54e1-437e-8d77-a54be7b1e2f6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Getting quotas for project 754b63504b3f4a20b00c958e82d95d12. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:13:17.953188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-cd9a652a-54e1-437e-8d77-a54be7b1e2f6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Getting quotas for user 912e2ffef1da4908ba0d1bd92920e939 and project 754b63504b3f4a20b00c958e82d95d12. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:13:17.992303 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd9a652a-54e1-437e-8d77-a54be7b1e2f6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.458647 Aug 24 04:13:18.011993 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3096/5934] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:13:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:13:20.079110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-917680919", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-879432176", "security_groups": [{"name": "tempest-secgroup-smoke-1078150337"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "643362ff-d16a-4f3f-84b2-ca9657689e80"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:20.112329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:20.112875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:20.399276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] validate_networks() for [('643362ff-d16a-4f3f-84b2-ca9657689e80', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:13:21.359278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Getting quotas for project 754b63504b3f4a20b00c958e82d95d12. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:13:21.369871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Getting quotas for user 912e2ffef1da4908ba0d1bd92920e939 and project 754b63504b3f4a20b00c958e82d95d12. Resources: dict_keys(['metadata_items']) {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:13:21.437892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:13:21.441652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:13:21.447888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:13:21.449785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:13:21.450577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:13:21.491566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:21.496886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:21.498887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:21.500316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:21.501142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:21.502944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:21.544284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Getting quotas for project 754b63504b3f4a20b00c958e82d95d12. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:13:21.562232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Getting quotas for user 912e2ffef1da4908ba0d1bd92920e939 and project 754b63504b3f4a20b00c958e82d95d12. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:13:21.598175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:13:21.604213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:13:21.812541 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c0f7be82-30b4-4d8b-b41f-20b61b788343 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.738768 Aug 24 04:13:21.814826 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2839/5935] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:13:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:13:21.829188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6cb06c6f-dfef-4a49-bb7a-662879eeb059 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:21.829935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6cb06c6f-dfef-4a49-bb7a-662879eeb059 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:21.947113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6cb06c6f-dfef-4a49-bb7a-662879eeb059 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:21.960111 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6cb06c6f-dfef-4a49-bb7a-662879eeb059 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1301 microversion: 2.1 time: 0.137521 Aug 24 04:13:21.976814 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3097/5936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:21 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1301 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:22.984759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:22.985565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:23.006726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:23.007224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:23.013168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:23.016665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:23.017701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:23.022895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:24.047942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:24.084831 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-140ad296-fb96-4670-8588-d5e2d7d094a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1305 microversion: 2.1 time: 1.103278 Aug 24 04:13:24.089874 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2840/5937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:22 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1305 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:25.112248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:25.114381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:25.135984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:25.142381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:25.143158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:25.144656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:25.149167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:25.150825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:25.332410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:25.343241 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76cda569-87b8-4b35-9f69-412f1e64181c tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1359 microversion: 2.1 time: 0.236400 Aug 24 04:13:25.343867 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3098/5938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:25 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:26.365956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:26.366639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:26.397088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:26.403848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:26.404776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:26.406310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:26.406999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:26.409057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:26.801806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:26.826644 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50a58a29-87ca-443b-9b7c-0438be1aaaeb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.463610 Aug 24 04:13:26.828004 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2841/5939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:26 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:27.337870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:27.338693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:27.347296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.352191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.352768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:27.353554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.355633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.355633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:27.358040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-134b6bae-b056-4e3b-9c43-b18dd90d2980 req-05e481dd-84b4-4d9c-a1dd-7a3464f96f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19872732-a66c-4260-9b3b-5b9b9d63244c", "tag": "0deab4a6-e41c-4bef-9467-b4f65ceaee0a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:27.389174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-134b6bae-b056-4e3b-9c43-b18dd90d2980 req-05e481dd-84b4-4d9c-a1dd-7a3464f96f96 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.389825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-134b6bae-b056-4e3b-9c43-b18dd90d2980 req-05e481dd-84b4-4d9c-a1dd-7a3464f96f96 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.390112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-134b6bae-b056-4e3b-9c43-b18dd90d2980 req-05e481dd-84b4-4d9c-a1dd-7a3464f96f96 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:27.409397 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-134b6bae-b056-4e3b-9c43-b18dd90d2980 req-05e481dd-84b4-4d9c-a1dd-7a3464f96f96 service nova] Creating event network-changed:0deab4a6-e41c-4bef-9467-b4f65ceaee0a for instance 19872732-a66c-4260-9b3b-5b9b9d63244c on n-h1-846470-15 Aug 24 04:13:27.419056 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-134b6bae-b056-4e3b-9c43-b18dd90d2980 req-05e481dd-84b4-4d9c-a1dd-7a3464f96f96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065802 Aug 24 04:13:27.420068 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2842/5940] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:13:27.510906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:27.522372 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae112a3b-603f-47c0-a1f9-5b62c1033af1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.187664 Aug 24 04:13:27.522717 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3099/5941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:27 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:27.543202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1139077699"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:27.547701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:27.556494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.556970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.557427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:27.558320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.558873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.565533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:27.819648 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a8e4a6f4-71f1-4db0-b507-aca0dff1a4c3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.280854 Aug 24 04:13:27.820428 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2843/5942] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:13:27 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 04:13:27.829471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:27.830179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:27.839737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.840616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.841339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:27.842316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.861590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:27.862842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:27.863411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.864648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:27.876969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.880549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.881970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:27.883067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:27.883803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:27.884654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:28.113481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:28.123035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:28.123522 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97c98554-6f96-459f-bf97-3db052a8875a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.298544 Aug 24 04:13:28.137196 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3100/5943] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:27 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:28.158666 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4bed670-60b6-4593-8284-53ee93c18694 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.310138 Aug 24 04:13:28.159700 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2844/5944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:27 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:29.149623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:29.150244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:29.157458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:29.157941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:29.158372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:29.159064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:29.159598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:29.160210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:29.180927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:29.181540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:29.192570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:29.192981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:29.193417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:29.200950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:29.201683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:29.202277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:29.374516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:29.382657 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37204007-dbff-47d5-a321-81cf0db5e820 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.237474 Aug 24 04:13:29.384008 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3101/5945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:29 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:29.403068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:29.411235 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72ca5964-d66d-4349-9b5c-094d9ecd9a10 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.234134 Aug 24 04:13:29.412114 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2845/5946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:29 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:30.406946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:30.408231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:30.417058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:30.417756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:30.418198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:30.419062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:30.419813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:30.420266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:30.433801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:30.435605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:30.446614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:30.447414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:30.448230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:30.449251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:30.450236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:30.450883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:30.611165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:30.620490 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b03b47e2-ac1b-4adb-bd97-dd62a1459614 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.217551 Aug 24 04:13:30.633074 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3102/5947] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:30 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:30.707246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:30.716893 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-44d7f7ac-d13e-4398-b523-700b559c8e3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.287238 Aug 24 04:13:30.717742 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2846/5948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:30 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:31.449114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ef32c89b-305c-4205-afd9-853303bb1d04 req-5288ddfa-77e4-4d04-8e5a-21ca7a3658d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "name": "network-vif-unplugged", "status": "completed", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:31.462641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ef32c89b-305c-4205-afd9-853303bb1d04 req-5288ddfa-77e4-4d04-8e5a-21ca7a3658d0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:31.464279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ef32c89b-305c-4205-afd9-853303bb1d04 req-5288ddfa-77e4-4d04-8e5a-21ca7a3658d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:31.464935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ef32c89b-305c-4205-afd9-853303bb1d04 req-5288ddfa-77e4-4d04-8e5a-21ca7a3658d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:31.477287 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ef32c89b-305c-4205-afd9-853303bb1d04 req-5288ddfa-77e4-4d04-8e5a-21ca7a3658d0 service nova] Creating event network-vif-unplugged:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:13:31.483398 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ef32c89b-305c-4205-afd9-853303bb1d04 req-5288ddfa-77e4-4d04-8e5a-21ca7a3658d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038152 Aug 24 04:13:31.484297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3103/5949] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:13:31.644355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:31.645048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:31.649663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:31.650875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=10 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:31.657785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:31.658463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:31.658890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:31.659631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:31.660114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:31.660631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:31.739706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:31.740407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:31.750135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:31.750622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:31.751057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:31.751819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:31.752269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:31.752697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:31.843089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:31.858790 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09ad0cc6-e1c1-4741-afdd-b63198a0049a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1686 microversion: 2.1 time: 0.218535 Aug 24 04:13:31.859396 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2847/5950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:31 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1686 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:31.915720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:31.929424 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e0fc0007-83ea-4ac3-9508-60e7d8b6c8f5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.192726 Aug 24 04:13:31.930342 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3104/5951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:31 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:32.884598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:32.885421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:32.896227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:32.896745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:32.897392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:32.898155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:32.898627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:32.899263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:32.949611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:32.950791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:32.953047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:32.965399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:32.966489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:32.966615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:32.967607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:32.968352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:32.969311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:33.090851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:33.107125 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74fcc050-dc66-4b56-a3f2-110142b1621f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1686 microversion: 2.1 time: 0.227771 Aug 24 04:13:33.121696 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2848/5952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:32 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1686 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:33.153758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:33.161694 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ea89539-5018-4e7f-bbcb-a1d22a2c2378 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.216009 Aug 24 04:13:33.162285 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3105/5953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:32 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:34.133786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:34.134994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:34.144463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:34.145078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:34.145584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:34.146396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:34.146864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:34.147300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:34.183119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:34.187511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:34.193519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:34.195046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:34.195657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:34.199300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:34.200070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:34.202087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:34.324807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:34.335590 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-919ff510-57de-4727-b417-2bc0cd3fb465 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1686 microversion: 2.1 time: 0.209452 Aug 24 04:13:34.337105 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2849/5954] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:34 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1686 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:34.399844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:34.408025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ea14c36-7cd9-40a3-b9c4-0beab0a51a08 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.229244 Aug 24 04:13:34.409109 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3106/5955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:34 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:34.954367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-30f749ce-514d-4f61-9d7e-54115b725d0c req-34de7cc2-6f23-4e8d-aae2-8d67b9c570a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19872732-a66c-4260-9b3b-5b9b9d63244c", "name": "network-vif-plugged", "status": "completed", "tag": "0deab4a6-e41c-4bef-9467-b4f65ceaee0a"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:34.966706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30f749ce-514d-4f61-9d7e-54115b725d0c req-34de7cc2-6f23-4e8d-aae2-8d67b9c570a9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:34.967812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30f749ce-514d-4f61-9d7e-54115b725d0c req-34de7cc2-6f23-4e8d-aae2-8d67b9c570a9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:34.968740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30f749ce-514d-4f61-9d7e-54115b725d0c req-34de7cc2-6f23-4e8d-aae2-8d67b9c570a9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:34.992308 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-30f749ce-514d-4f61-9d7e-54115b725d0c req-34de7cc2-6f23-4e8d-aae2-8d67b9c570a9 service nova] Creating event network-vif-plugged:0deab4a6-e41c-4bef-9467-b4f65ceaee0a for instance 19872732-a66c-4260-9b3b-5b9b9d63244c on n-h1-846470-15 Aug 24 04:13:35.005510 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-30f749ce-514d-4f61-9d7e-54115b725d0c req-34de7cc2-6f23-4e8d-aae2-8d67b9c570a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053025 Aug 24 04:13:35.006510 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2850/5956] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:13:35.358119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:35.358745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:35.369467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:35.375643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:35.378179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:35.378984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:35.379534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:35.380228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:35.432543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:35.433284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:35.449928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:35.450447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:35.450903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:35.451642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:35.452142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:35.452577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:35.597222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:35.627583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0094844f-ce47-4e9f-9425-1b6bcdb5aa01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1686 microversion: 2.1 time: 0.267409 Aug 24 04:13:35.639690 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3107/5957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:35 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1686 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:35.710026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:35.719337 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eff056f5-4fd9-4a7e-8852-b20994f1f5e8 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.292671 Aug 24 04:13:35.729488 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2851/5958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:35 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:36.654171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:36.655921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:36.664519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:36.665374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:36.666117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:36.667473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:36.668135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:36.668720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:36.748872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:36.749607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:36.768730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:36.769279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:36.769731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:36.773364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:36.774563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:36.775519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:36.845972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:36.860310 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-68855c7b-6b54-4696-9c9f-93a45373287f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1686 microversion: 2.1 time: 0.206097 Aug 24 04:13:36.860941 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3108/5959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:36 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1686 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:37.032864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1d9f648e-761d-48ee-ac5e-b6971603e0c6 req-7cccff48-a1e1-4224-a452-77d5e10b086d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "name": "network-vif-plugged", "status": "completed", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:37.041487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:37.053652 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ddb44956-a1d2-4dc2-9896-c3b21d36fa3d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1427 microversion: 2.1 time: 0.314033 Aug 24 04:13:37.056265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d9f648e-761d-48ee-ac5e-b6971603e0c6 req-7cccff48-a1e1-4224-a452-77d5e10b086d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:37.056750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d9f648e-761d-48ee-ac5e-b6971603e0c6 req-7cccff48-a1e1-4224-a452-77d5e10b086d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:37.057213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1d9f648e-761d-48ee-ac5e-b6971603e0c6 req-7cccff48-a1e1-4224-a452-77d5e10b086d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:37.074786 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2852/5960] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:36 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1427 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:37.083453 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1d9f648e-761d-48ee-ac5e-b6971603e0c6 req-7cccff48-a1e1-4224-a452-77d5e10b086d service nova] Creating event network-vif-plugged:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:13:37.099371 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1d9f648e-761d-48ee-ac5e-b6971603e0c6 req-7cccff48-a1e1-4224-a452-77d5e10b086d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068725 Aug 24 04:13:37.100228 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3109/5961] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:13:37.882823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:37.883901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:37.896712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:37.897218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:37.903864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:37.904857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:37.905505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:37.906094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:38.082735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:38.083431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:38.091159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:38.091654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:38.092154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:38.092860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:38.093315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:38.093741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:38.121588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:38.131321 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c156277-78a5-421e-a0ff-250fbaebacc9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.252050 Aug 24 04:13:38.132317 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2853/5962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:37 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:38.257210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:38.268130 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3b9fd23-ba8f-4e96-9c0a-08f012ee44a5 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1606 microversion: 2.1 time: 0.189639 Aug 24 04:13:38.269682 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3110/5963] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:38 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1606 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:38.289412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:38.290350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:38.303146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:38.303912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:38.304606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:38.305391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:38.305984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:38.306637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:38.596050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:38.611856 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b99061a-8439-499f-83ba-007a3b8485b0 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1606 microversion: 2.1 time: 0.326613 Aug 24 04:13:38.623720 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2854/5964] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:38 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1606 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:38.637346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:38.638513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:38.645154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:38.645983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:38.646640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:38.647720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:38.648675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:38.665676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:38.890106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:38.900072 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-486ea56d-d5f9-4db9-ab34-10590174bd2b tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1606 microversion: 2.1 time: 0.266498 Aug 24 04:13:38.916126 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3111/5965] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:38 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1606 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:39.157960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:39.159289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:39.170195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:39.172270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:39.172984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:39.175265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:39.195984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:39.196799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:39.572250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:39.586709 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7052f9a4-41fe-4761-b7b1-9c8ca7e78f69 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.432784 Aug 24 04:13:39.587454 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2855/5966] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:39 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:40.615539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:40.616232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:40.635311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:40.635891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:40.636338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:40.637065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:40.640709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:40.641343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:40.893294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:40.910590 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9f99e95c-c78d-42f6-af58-257681eed83f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.299924 Aug 24 04:13:40.925509 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3112/5967] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:40 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:41.938153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:41.940603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:42.015214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:42.015707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c5013ec8-9337-4157-9633-462be77ea827 req-51ed9aee-177b-4f0a-9675-d4e26ee397b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19872732-a66c-4260-9b3b-5b9b9d63244c", "tag": "0deab4a6-e41c-4bef-9467-b4f65ceaee0a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:42.016218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:42.016218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:42.030814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:42.032352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:42.037852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:42.046108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c5013ec8-9337-4157-9633-462be77ea827 req-51ed9aee-177b-4f0a-9675-d4e26ee397b2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:42.046906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c5013ec8-9337-4157-9633-462be77ea827 req-51ed9aee-177b-4f0a-9675-d4e26ee397b2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:42.047512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c5013ec8-9337-4157-9633-462be77ea827 req-51ed9aee-177b-4f0a-9675-d4e26ee397b2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:42.078053 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c5013ec8-9337-4157-9633-462be77ea827 req-51ed9aee-177b-4f0a-9675-d4e26ee397b2 service nova] Creating event network-changed:0deab4a6-e41c-4bef-9467-b4f65ceaee0a for instance 19872732-a66c-4260-9b3b-5b9b9d63244c on n-h1-846470-15 Aug 24 04:13:42.091440 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c5013ec8-9337-4157-9633-462be77ea827 req-51ed9aee-177b-4f0a-9675-d4e26ee397b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081795 Aug 24 04:13:42.100219 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3113/5968] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:13:42.135253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:42.591913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:42.606069 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a20e5629-46c7-414d-8472-5887d60dd377 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.671663 Aug 24 04:13:42.621985 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2856/5969] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:41 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:43.631320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:43.632721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:43.648223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:43.648978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:43.655867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:43.657015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:43.657700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:43.658292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:43.916001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:43.935642 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2be3b71c-5356-4ead-aba0-31bed2a8e679 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.308688 Aug 24 04:13:43.960019 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3114/5970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:43 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:44.953822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b2cc10d-f595-49b8-84ee-73f45b7349ac tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Action: 'create', calling method: .version_select at 0x7f103433a430>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2004232172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAkdx9peiqF1zDi1EQ/BnrK+jGTTl6HrvgNTBkVAb1zx3/HAz8qnYKmXdVvsSU3IiZTqPLtqNuog4k0rbVuf23mpg5NZJ74RaJtX6m4GLr/Vb19WtSk7SmsZGwu75zq/Q=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:44.964331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:44.966886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:44.977747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:44.979195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:44.979851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:44.981216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:44.982026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:44.982602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:45.009873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-8b2cc10d-f595-49b8-84ee-73f45b7349ac tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Getting quotas for project e73ed94490364e6e9ff439f653eb6439. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:13:45.020189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-8b2cc10d-f595-49b8-84ee-73f45b7349ac tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Getting quotas for user 588d6afd7dea4792ac660027dd80640f and project e73ed94490364e6e9ff439f653eb6439. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:13:45.057704 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b2cc10d-f595-49b8-84ee-73f45b7349ac tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.108592 Aug 24 04:13:45.058640 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2857/5971] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:13:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:13:45.272255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:45.284072 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5d9700f-d6f2-40e2-b5af-70401f829a46 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.324730 Aug 24 04:13:45.285624 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3115/5972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:44 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:46.315470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:46.317500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:46.332484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:46.335366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:46.335852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:46.336789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:46.339434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:46.340104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:46.546218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:46.557448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6d01c421-1449-418c-ae62-47b8261d3bae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.246694 Aug 24 04:13:46.574165 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2858/5973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:46 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:46.784199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-523361908", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9ef8f4a0-9419-453c-86c1-4775cfdb5953", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2004232172", "security_groups": [{"name": "tempest-secgroup-smoke-1302912129"}], "networks": [{"uuid": "1ff43132-8fb6-4b55-aea3-fe6b414a5b62"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:46.945970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] validate_networks() for [('1ff43132-8fb6-4b55-aea3-fe6b414a5b62', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:13:47.500172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:13:47.501146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:13:47.501724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:13:47.502136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:13:47.502584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:13:47.514522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:47.515533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:47.516187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:47.517069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:47.517835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:47.518261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:47.542688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Getting quotas for project e73ed94490364e6e9ff439f653eb6439. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:13:47.550589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Getting quotas for user 588d6afd7dea4792ac660027dd80640f and project e73ed94490364e6e9ff439f653eb6439. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:13:47.584058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:47.586003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:47.606772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:47.607621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:47.608188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:47.616107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:47.616623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:47.617078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:47.646747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:13:47.649528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ef8f4a0-9419-453c-86c1-4775cfdb5953',volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:13:47.816506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:47.870546 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8f1baf03-c02e-43ae-831e-ced1c04d812f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.090278 Aug 24 04:13:47.871856 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3116/5974] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:13:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:13:47.875389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:47.886417 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffe7f217-f49d-4303-b1e8-ef0829e0e5b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.310873 Aug 24 04:13:47.887778 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2859/5975] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:47 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:47.894341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7fb919c-d308-4cd6-9089-a93f008063e2 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:47.895345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d7fb919c-d308-4cd6-9089-a93f008063e2 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:47.999858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d7fb919c-d308-4cd6-9089-a93f008063e2 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:48.027301 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d7fb919c-d308-4cd6-9089-a93f008063e2 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1098 microversion: 2.1 time: 0.142761 Aug 24 04:13:48.030503 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3117/5976] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:47 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1098 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:48.918162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:48.918862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:48.929280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:48.930084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:48.930738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:48.931931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:48.932576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:48.933487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:49.052589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:49.053573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:49.095814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:49.101977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:49.103159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:49.104113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:49.104757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:49.106874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:49.231570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:49.242585 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5bfc6df4-edfa-4ae5-b7a1-695a2e040b0e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.329565 Aug 24 04:13:49.243570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=99 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:49.260802 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2860/5977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:48 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:49.311404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:49.321735 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d8c0b24f-bfb1-4c2e-9b66-3f280f4867aa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1196 microversion: 2.1 time: 0.274495 Aug 24 04:13:49.322415 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3118/5978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:49 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1196 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:50.275955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:50.279223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:50.283321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:50.310699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:50.312089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:50.318604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:50.320220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:50.321826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:50.322859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:50.350340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:50.351082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:50.380279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:50.383170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:50.383975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:50.391389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:50.396257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:50.400327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:50.582176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:50.598071 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e84a40bf-3992-407b-8e1a-3320968dff52 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1214 microversion: 2.1 time: 0.255629 Aug 24 04:13:50.599288 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3119/5979] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:50 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:50.629506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:50.640402 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24f53bca-0a62-4786-8ede-eb2a3c456b3c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.372617 Aug 24 04:13:50.653109 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2861/5980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:50 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:51.624998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:51.625568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:51.638022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:51.639987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:51.641463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:51.642223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:51.644307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:51.645708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:51.675377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:51.684240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:51.698839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:51.699608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:51.700263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:51.701365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:51.702256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:51.703077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:51.876149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:51.897634 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-489b4872-7807-4aa1-8e32-227f7a5e4726 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1282 microversion: 2.1 time: 0.276643 Aug 24 04:13:51.899141 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3120/5981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:51 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1282 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:51.923835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:51.945041 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a79f9e1-dba1-4878-b73b-edbfd77240f1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.273311 Aug 24 04:13:51.955119 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2862/5982] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:51 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:52.244522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-438ffa00-4cd0-4864-94c2-72e1310bdace req-d2592d0e-3f1d-4f8a-b036-e185f62bf761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38", "tag": "61e84eca-fe1c-4cfd-806a-69d4042cf9ae"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:52.268976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-438ffa00-4cd0-4864-94c2-72e1310bdace req-d2592d0e-3f1d-4f8a-b036-e185f62bf761 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:52.269898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-438ffa00-4cd0-4864-94c2-72e1310bdace req-d2592d0e-3f1d-4f8a-b036-e185f62bf761 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:52.271213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-438ffa00-4cd0-4864-94c2-72e1310bdace req-d2592d0e-3f1d-4f8a-b036-e185f62bf761 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:52.299886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-438ffa00-4cd0-4864-94c2-72e1310bdace req-d2592d0e-3f1d-4f8a-b036-e185f62bf761 service nova] Creating event network-changed:61e84eca-fe1c-4cfd-806a-69d4042cf9ae for instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 on n-h2-846470-15 Aug 24 04:13:52.339161 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-438ffa00-4cd0-4864-94c2-72e1310bdace req-d2592d0e-3f1d-4f8a-b036-e185f62bf761 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097964 Aug 24 04:13:52.343178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3121/5983] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:13:52.921050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:52.921723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:52.929297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:52.930086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:52.930767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:52.931687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:52.932314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:52.932923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:52.973859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:52.974583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:52.999684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:53.000473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:53.003098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:53.004208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:53.004702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:53.013522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:53.269023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:53.280378 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-edb5a8eb-4c86-4984-992c-03639f1ef8a6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1681 microversion: 2.1 time: 0.314964 Aug 24 04:13:53.281486 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3122/5984] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:52 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1681 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:53.307501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:53.320671 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-abcd5fce-2221-4c48-bd5b-11ceb0b81dea tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1282 microversion: 2.1 time: 0.404699 Aug 24 04:13:53.321767 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2863/5985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:52 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1282 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:54.303508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:54.304274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:54.312215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:54.312830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:54.313584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:54.315076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:54.315833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:54.316631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:54.345054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:54.346609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:54.365593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:54.367842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:54.368911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:54.369062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:54.369506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:54.369930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:54.561436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:54.572403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d7d212b0-fc5d-4574-9a8e-4e4da8734f0a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.272443 Aug 24 04:13:54.573267 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3123/5986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:54 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:54.684884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:54.694105 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ba0ce43-a1b5-4393-9dee-fe698d8d4134 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1282 microversion: 2.1 time: 0.354025 Aug 24 04:13:54.694690 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2864/5987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:54 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1282 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:55.714789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:55.719301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:55.719946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:55.722590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:55.724576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:55.733248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:55.733763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:55.734206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:55.734927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:55.735389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:55.735853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:55.743105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:55.743604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:55.744146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:55.744900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:55.745364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:55.745792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:55.927600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:55.929957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:55.937049 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-04ed375a-7dd8-4e0d-a464-c9272e32171e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.227434 Aug 24 04:13:55.947919 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-95f43d99-1814-458f-93fd-730fe08e33d1 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1282 microversion: 2.1 time: 0.229401 Aug 24 04:13:55.948646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3124/5988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:55 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:55.955765 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2865/5989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:55 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1282 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:56.969293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:56.971524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:56.985937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:56.987093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:56.988393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:56.989785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:56.990904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:56.991620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.101005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:57.102410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:57.111089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.111935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.112628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.113554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.114225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.114867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.185223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:57.194155 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c0a445f7-d33a-4cee-940b-4899cfb74271 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.235516 Aug 24 04:13:57.195346 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3125/5990] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:56 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:13:57.257764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:57.265821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f99051c3-a5f1-42be-ba95-6b772e1f6211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.168947 Aug 24 04:13:57.266401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2866/5991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:57 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:57.286498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:57.287149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:57.296857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.297351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.297924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.298840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.299521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.300094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.437692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:57.446028 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0fcdd20-6329-44e1-a493-7b781d128357 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.163637 Aug 24 04:13:57.446608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3126/5992] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:57 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:57.468229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:57.469011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:57.475769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.476489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.476941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.478298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.478765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.479201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.594377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-082b31ae-4d54-497a-a8b1-c3d3fcc9ede5 req-e7983dd6-6077-4444-8e81-2240a25c9872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "name": "network-vif-unplugged", "status": "completed", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:57.602262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:57.609485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-082b31ae-4d54-497a-a8b1-c3d3fcc9ede5 req-e7983dd6-6077-4444-8e81-2240a25c9872 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.610052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-082b31ae-4d54-497a-a8b1-c3d3fcc9ede5 req-e7983dd6-6077-4444-8e81-2240a25c9872 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.610562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-082b31ae-4d54-497a-a8b1-c3d3fcc9ede5 req-e7983dd6-6077-4444-8e81-2240a25c9872 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.622316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:57.628154 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-082b31ae-4d54-497a-a8b1-c3d3fcc9ede5 req-e7983dd6-6077-4444-8e81-2240a25c9872 service nova] Creating event network-vif-unplugged:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:13:57.630827 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b453d29-f148-4491-8a93-c7fe03069cee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.167457 Aug 24 04:13:57.631835 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2867/5993] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:57 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:57.635100 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-082b31ae-4d54-497a-a8b1-c3d3fcc9ede5 req-e7983dd6-6077-4444-8e81-2240a25c9872 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044773 Aug 24 04:13:57.636125 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3127/5994] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:13:57.654295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:13:57.656980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:57.663367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.664316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.665334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.666258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.666863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.667303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.767110 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c720b70-0384-4567-8669-41fb5e7ce13e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.118225 Aug 24 04:13:57.771319 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2868/5995] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:13:57 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:13:57.777666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:57.778598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:57.785451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.786313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.787064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.788222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:57.788679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:57.789077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:57.934254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:57.944975 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14c906eb-8340-4a56-a6c0-02d607d96296 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1670 microversion: 2.1 time: 0.172015 Aug 24 04:13:57.948782 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3128/5996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:57 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:58.218458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:58.219175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:58.226043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:58.226953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:58.227428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:58.228317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:58.228788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:58.229224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:58.453999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:58.469202 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d86fa2ce-06a1-44f0-ab8d-d294f08655cc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.256560 Aug 24 04:13:58.469970 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2869/5997] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:58 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:58.969997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:58.971209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:58.974090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:58.980320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:58.980825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:58.981272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:58.981977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:58.982436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:58.983006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:59.127975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:59.136758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-46435595-ba85-4278-9db9-f2bc1df68f83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1675 microversion: 2.1 time: 0.171207 Aug 24 04:13:59.137338 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3129/5998] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:58 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:13:59.490434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:13:59.491191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:13:59.498684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:59.499201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:59.499634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:59.500373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:13:59.500840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:13:59.501272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:13:59.646965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:13:59.656175 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0b497de4-12b1-4e21-ab4c-e78659942105 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.169638 Aug 24 04:13:59.656783 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2870/5999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:13:59 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:00.158724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:00.159282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:00.166737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.167194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.167624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.168355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.168802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.169223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.306628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:00.314793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-41351d79-5e03-4f4c-a75f-a55087b4003a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.160212 Aug 24 04:14:00.315412 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3130/6000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:00 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:00.336441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:00.338909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:00.345265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.345843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.346374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.347152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.347699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.348236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.400463 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7987c933-b860-4db6-824e-ee00e0151146 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 200 len: 323 microversion: 2.1 time: 0.068174 Aug 24 04:14:00.405523 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2871/6001] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:14:00 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 323 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:00.410851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:00.411577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:00.417778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.418328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.418829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.419594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.420141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.420620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.575544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:00.584708 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-36f93db6-a555-4d1c-9aab-d71db791846d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.177610 Aug 24 04:14:00.585180 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3131/6002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:00 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:00.606995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:00.607718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:00.615400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.615927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.616365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.617071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.617624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.618118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.678217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:00.679024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:00.685992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.686477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.686908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.687606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.688079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.688497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.762540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:00.770550 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-28cf530a-91db-42df-9bf1-58c3489c2713 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.167857 Aug 24 04:14:00.771446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2872/6003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:00 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:00.790721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:00.792176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:00.798599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.799167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.799700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.800487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.801024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.801520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.807383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:00.831326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:00.840907 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-207e67b3-5465-4876-a14d-03859d239e8d tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.166723 Aug 24 04:14:00.841683 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3132/6004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:00 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:14:00.946422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:00.954809 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9b53ae9f-0bd7-49f4-ac8c-d6715e8f6894 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.168231 Aug 24 04:14:00.955401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2873/6005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:00 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:14:00.975878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:00.976486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:00.982764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.983273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.983720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:00.984414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:00.984863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:00.985285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:01.127695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:01.136921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59a028d8-de43-4a88-b7f5-2fa32e0f5daf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.165047 Aug 24 04:14:01.137616 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3133/6006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:00 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:01.250207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-862850951", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "84625d62-df37-416c-9910-28257ed66bfc"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:01.305423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] validate_networks() for [('84625d62-df37-416c-9910-28257ed66bfc', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:14:01.700911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:14:01.701492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:14:01.701806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:14:01.702237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:14:01.702672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:14:01.712249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:01.712745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:01.713509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:01.714236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:01.714700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:01.715126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:01.732678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:14:01.738116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for user bbc89071f3d44e14ac21298ac15d7c33 and project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:14:01.750803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:14:01.753175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:14:01.799066 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d133c2e-9903-4540-9f05-cb090672dee0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552700 Aug 24 04:14:01.799944 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2874/6007] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:14:01.810583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6d5d2daf-ff18-4e67-ada5-667fd37c3f04 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:01.811190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6d5d2daf-ff18-4e67-ada5-667fd37c3f04 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:01.862784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:01.864515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:01.869135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6d5d2daf-ff18-4e67-ada5-667fd37c3f04 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:01.873244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:01.873822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:01.874397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:01.875203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:01.875777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:01.876456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:01.879814 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6d5d2daf-ff18-4e67-ada5-667fd37c3f04 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1214 microversion: 2.1 time: 0.073020 Aug 24 04:14:01.880429 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3134/6008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:01 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:02.030077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:02.038863 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7ad4c1e3-63eb-41d9-a640-edef7133dcdc tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.180091 Aug 24 04:14:02.039509 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2875/6009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:01 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:14:02.902301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:02.903002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:02.912961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:02.913456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:02.913900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:02.914674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:02.915137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:02.915566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:02.999093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:03.007415 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b9a215f2-f242-4c50-b893-e4032a448492 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1266 microversion: 2.1 time: 0.110256 Aug 24 04:14:03.008413 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3135/6010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:02 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:03.060926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:03.062346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:03.071505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:03.072547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:03.073490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:03.074417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:03.074956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:03.075485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:03.258059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:03.268951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-057e383d-23d3-4e2d-a64f-dcdf2b8a0099 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.213123 Aug 24 04:14:03.270354 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2876/6011] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:03 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:04.033266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:04.034201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:04.041692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:04.042269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:04.042775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:04.043543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:04.044280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:04.045143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:04.187870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:04.196613 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f216e33d-5c0e-42ff-98e1-2331bee6cafe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1314 microversion: 2.1 time: 0.167170 Aug 24 04:14:04.210776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3136/6012] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:04 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:04.291463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:04.292475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:04.300714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:04.301401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:04.301816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:04.302769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:04.303230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:04.303692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:04.664517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:04.673213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9cc08555-579b-4e98-86af-3f012da85e0f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.386267 Aug 24 04:14:04.674061 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2877/6013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:04 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:04.971971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b3b44605-da02-4026-b4a7-7a7375538769 req-d49220e2-0cc3-4b1a-b6e4-bcda284a6626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4682e34-7b8a-4251-8259-ddceebb605cd", "tag": "20795ab5-c5c9-4e7e-89b7-403b9f4398d7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:04.983058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b3b44605-da02-4026-b4a7-7a7375538769 req-d49220e2-0cc3-4b1a-b6e4-bcda284a6626 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:04.983835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b3b44605-da02-4026-b4a7-7a7375538769 req-d49220e2-0cc3-4b1a-b6e4-bcda284a6626 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:04.984425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b3b44605-da02-4026-b4a7-7a7375538769 req-d49220e2-0cc3-4b1a-b6e4-bcda284a6626 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:04.988782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:05.002358 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b3b44605-da02-4026-b4a7-7a7375538769 req-d49220e2-0cc3-4b1a-b6e4-bcda284a6626 service nova] Creating event network-changed:20795ab5-c5c9-4e7e-89b7-403b9f4398d7 for instance b4682e34-7b8a-4251-8259-ddceebb605cd on n-h1-846470-15 Aug 24 04:14:05.012145 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b3b44605-da02-4026-b4a7-7a7375538769 req-d49220e2-0cc3-4b1a-b6e4-bcda284a6626 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042785 Aug 24 04:14:05.013708 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3137/6014] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:05.219656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:05.220372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:05.227995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:05.228494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:05.228931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:05.229668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:05.230268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:05.230876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:05.488664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:05.500458 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f596321a-f361-4f62-8c9f-90ab5812870b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1314 microversion: 2.1 time: 0.284396 Aug 24 04:14:05.511978 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2878/6015] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:05 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:05.696144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:05.696860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:05.703150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:05.703618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:05.704304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:05.704983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:05.705625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:05.706057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:05.856537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:05.864803 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e8a02944-9d19-4138-b7f8-55a34b1e3e8b tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.173847 Aug 24 04:14:05.865429 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3138/6016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:05 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:06.522225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:06.522949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:06.530896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:06.531441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:06.531967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:06.532715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:06.533229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:06.533727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:06.672553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:06.682010 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-278cae0b-49b5-462f-8a2b-2ac713b60484 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1314 microversion: 2.1 time: 0.163705 Aug 24 04:14:06.682611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2879/6017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:06 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:06.889252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:06.889952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:06.897070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:06.897544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:06.897962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:06.898666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:06.899114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:06.899533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:07.039130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:07.047476 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6756c97b-e746-48b3-a9a2-46a26b884e39 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.162151 Aug 24 04:14:07.048144 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3139/6018] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:06 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:07.708413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:07.709078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:07.717727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:07.718226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:07.718665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:07.719384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:07.720334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:07.720334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:07.898215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e2d62f1e-5da2-435a-878d-54baa083ea0c req-1652f196-d0ab-4cb5-b37b-af9ba4ba1882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38", "name": "network-vif-plugged", "status": "completed", "tag": "61e84eca-fe1c-4cfd-806a-69d4042cf9ae"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:07.917399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2d62f1e-5da2-435a-878d-54baa083ea0c req-1652f196-d0ab-4cb5-b37b-af9ba4ba1882 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:07.918118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2d62f1e-5da2-435a-878d-54baa083ea0c req-1652f196-d0ab-4cb5-b37b-af9ba4ba1882 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:07.918797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e2d62f1e-5da2-435a-878d-54baa083ea0c req-1652f196-d0ab-4cb5-b37b-af9ba4ba1882 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:07.922075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:07.932880 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-22a66410-b521-40c4-9b2e-bb8e00865c65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1314 microversion: 2.1 time: 0.232240 Aug 24 04:14:07.933559 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e2d62f1e-5da2-435a-878d-54baa083ea0c req-1652f196-d0ab-4cb5-b37b-af9ba4ba1882 service nova] Creating event network-vif-plugged:61e84eca-fe1c-4cfd-806a-69d4042cf9ae for instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 on n-h2-846470-15 Aug 24 04:14:07.940132 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e2d62f1e-5da2-435a-878d-54baa083ea0c req-1652f196-d0ab-4cb5-b37b-af9ba4ba1882 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048677 Aug 24 04:14:07.941131 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2880/6019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:07 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:07.941502 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3140/6020] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:14:08.072713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:08.073679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:08.081743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:08.082324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:08.082846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:08.083638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:08.084209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:08.084764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:08.337094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:08.345913 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0403163d-61a3-4985-aeea-477b6608fb35 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.279955 Aug 24 04:14:08.346666 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2881/6021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:08 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:08.963703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:08.964852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:08.971081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:08.971700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:08.972232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:08.973090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:08.973559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:08.974234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:09.126324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:09.136179 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ff0809d3-7fad-441d-b956-8810016e7462 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1314 microversion: 2.1 time: 0.178037 Aug 24 04:14:09.137621 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3141/6022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:08 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:09.366898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:09.367774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:09.379046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:09.379839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:09.380564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:09.381812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:09.382573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:09.383073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:09.533480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:09.541671 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b495f66-45c9-45a9-b773-10e84f622763 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1270 microversion: 2.1 time: 0.178869 Aug 24 04:14:09.542265 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2882/6023] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:09 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:10.158660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:10.159347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:10.167187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:10.167698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:10.168159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:10.168860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:10.169280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:10.169699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:10.313676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:10.321820 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fa1a27c2-17c3-4a72-a418-aff93e5f798b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1314 microversion: 2.1 time: 0.167177 Aug 24 04:14:10.322524 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3142/6024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:10 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:10.563426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:10.564152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:10.572056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:10.572542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:10.572969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:10.573675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:10.574133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:10.574558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:10.712267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:10.721047 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e242205-5545-4e07-ae49-9655147f7242 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1460 microversion: 2.1 time: 0.161621 Aug 24 04:14:10.721629 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2883/6025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:10 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1460 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:10.741494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:10.742488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:10.748451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:10.748948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:10.749357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:10.750070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:10.750550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:10.750936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:10.891931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:10.902413 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-661e352d-fda9-45b1-8de3-b45d39a28faa tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1460 microversion: 2.1 time: 0.164734 Aug 24 04:14:10.903022 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3143/6026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:10 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1460 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:11.175016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d769054d-2a28-4d56-998a-8b454aaf365e req-b9397361-c07e-4554-afa6-71b81500f4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4682e34-7b8a-4251-8259-ddceebb605cd", "name": "network-vif-plugged", "status": "completed", "tag": "20795ab5-c5c9-4e7e-89b7-403b9f4398d7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:11.194340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d769054d-2a28-4d56-998a-8b454aaf365e req-b9397361-c07e-4554-afa6-71b81500f4bf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:11.195742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d769054d-2a28-4d56-998a-8b454aaf365e req-b9397361-c07e-4554-afa6-71b81500f4bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:11.196785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d769054d-2a28-4d56-998a-8b454aaf365e req-b9397361-c07e-4554-afa6-71b81500f4bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:11.211745 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d769054d-2a28-4d56-998a-8b454aaf365e req-b9397361-c07e-4554-afa6-71b81500f4bf service nova] Creating event network-vif-plugged:20795ab5-c5c9-4e7e-89b7-403b9f4398d7 for instance b4682e34-7b8a-4251-8259-ddceebb605cd on n-h1-846470-15 Aug 24 04:14:11.219729 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d769054d-2a28-4d56-998a-8b454aaf365e req-b9397361-c07e-4554-afa6-71b81500f4bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048116 Aug 24 04:14:11.220655 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2884/6027] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:11.345140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:11.345726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:11.353936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:11.354445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:11.354889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:11.360894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:11.361514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:11.361964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:11.608996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:11.617292 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-21877c30-8818-4fff-85bb-0382aade95b0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1314 microversion: 2.1 time: 0.277533 Aug 24 04:14:11.617860 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3144/6028] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:11 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:12.639947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:12.640896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:12.644081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:12.644824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:12.652368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:12.653213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:12.653894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:12.654701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:12.655239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:12.655880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:12.809705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:12.818968 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d8c9c819-b361-4fed-8f23-2b5ca7033a1c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1314 microversion: 2.1 time: 0.183502 Aug 24 04:14:12.820211 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2885/6029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:12 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:13.226912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-69937507-4c45-4a8e-baf6-5ad7b9ed85d9 req-aff3eadd-d8a0-487e-816c-89a5fbc4e371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38", "tag": "61e84eca-fe1c-4cfd-806a-69d4042cf9ae"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:13.240946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:13.246394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-69937507-4c45-4a8e-baf6-5ad7b9ed85d9 req-aff3eadd-d8a0-487e-816c-89a5fbc4e371 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:13.247150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-69937507-4c45-4a8e-baf6-5ad7b9ed85d9 req-aff3eadd-d8a0-487e-816c-89a5fbc4e371 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:13.247820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-69937507-4c45-4a8e-baf6-5ad7b9ed85d9 req-aff3eadd-d8a0-487e-816c-89a5fbc4e371 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:13.275719 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-69937507-4c45-4a8e-baf6-5ad7b9ed85d9 req-aff3eadd-d8a0-487e-816c-89a5fbc4e371 service nova] Creating event network-changed:61e84eca-fe1c-4cfd-806a-69d4042cf9ae for instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 on n-h2-846470-15 Aug 24 04:14:13.281891 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-69937507-4c45-4a8e-baf6-5ad7b9ed85d9 req-aff3eadd-d8a0-487e-816c-89a5fbc4e371 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062012 Aug 24 04:14:13.283097 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3145/6030] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:13.841611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:13.842526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:13.858651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:13.859622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:13.860852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:13.863598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:13.864345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:13.867613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:14.157734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:14.176390 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d729f031-6c53-4759-a626-8aab1ca0d734 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1501 microversion: 2.1 time: 0.339797 Aug 24 04:14:14.177567 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2886/6031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:13 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1501 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:14.204276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac07d596-96e2-4daf-a0c2-64091d302888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:14.212762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac07d596-96e2-4daf-a0c2-64091d302888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:14.213616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac07d596-96e2-4daf-a0c2-64091d302888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:14.214282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac07d596-96e2-4daf-a0c2-64091d302888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:14.250077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac07d596-96e2-4daf-a0c2-64091d302888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Going to try to stop instance {{(pid=122536) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 04:14:14.311832 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac07d596-96e2-4daf-a0c2-64091d302888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd/action" status: 202 len: 0 microversion: 2.1 time: 0.112571 Aug 24 04:14:14.312929 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3146/6032] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:14:14 2022] POST /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:14:14.323556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:14.325173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:14.335551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:14.336403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:14.337074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:14.338269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:14.340435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:14.341466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:14.515925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:14.525178 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-933c39e1-939e-4dbe-b908-188ac33db7cb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.207051 Aug 24 04:14:14.526098 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2887/6033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:14 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:15.323639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2196f3fa-cec1-472e-af39-e94721fa6d23 req-9bf96457-770d-4e17-a64a-28aae57218ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38", "tag": "61e84eca-fe1c-4cfd-806a-69d4042cf9ae"}, {"name": "network-changed", "server_uuid": "cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38", "tag": "61e84eca-fe1c-4cfd-806a-69d4042cf9ae"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:15.333568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2196f3fa-cec1-472e-af39-e94721fa6d23 req-9bf96457-770d-4e17-a64a-28aae57218ba service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:15.334058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2196f3fa-cec1-472e-af39-e94721fa6d23 req-9bf96457-770d-4e17-a64a-28aae57218ba service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:15.334494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2196f3fa-cec1-472e-af39-e94721fa6d23 req-9bf96457-770d-4e17-a64a-28aae57218ba service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:15.346834 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2196f3fa-cec1-472e-af39-e94721fa6d23 req-9bf96457-770d-4e17-a64a-28aae57218ba service nova] Creating event network-changed:61e84eca-fe1c-4cfd-806a-69d4042cf9ae for instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 on n-h2-846470-15 Aug 24 04:14:15.347765 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2196f3fa-cec1-472e-af39-e94721fa6d23 req-9bf96457-770d-4e17-a64a-28aae57218ba service nova] Creating event network-changed:61e84eca-fe1c-4cfd-806a-69d4042cf9ae for instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 on n-h2-846470-15 Aug 24 04:14:15.354885 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2196f3fa-cec1-472e-af39-e94721fa6d23 req-9bf96457-770d-4e17-a64a-28aae57218ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036492 Aug 24 04:14:15.356172 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3147/6034] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:15.548856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:15.550382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:15.559787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:15.560741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:15.561395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:15.562531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:15.563220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:15.563979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:15.767721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:15.776495 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ecd484a-2a60-4436-906f-15c36f1d8766 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.233041 Aug 24 04:14:15.791039 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2888/6035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:15 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:16.803768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:16.805050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:16.815393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:16.816041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:16.816534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:16.817635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:16.818305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:16.818986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:16.972667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:16.982681 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14e8a446-8ecd-47c8-a086-099d9ed2a004 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.186375 Aug 24 04:14:16.983713 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3148/6036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:16 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:18.004333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:18.005016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:18.013382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:18.013906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:18.014357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:18.015088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:18.015554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:18.016010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:18.163820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:18.172169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-32f577f8-05b9-401a-9884-2fd4eb937552 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.172217 Aug 24 04:14:18.172814 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2889/6037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:17 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:19.193939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:19.194608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:19.197667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=69 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:19.203449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:19.203991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:19.204432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:19.205139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:19.205599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:19.206026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:19.353497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:19.362230 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c55e6c0-2d58-4386-b34a-47f5b07e4638 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.172167 Aug 24 04:14:19.363002 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3149/6038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:19 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:20.385013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:20.385596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:20.388500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:20.394078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:20.394579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:20.395011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:20.395971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:20.396449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:20.396925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:20.553069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:20.561710 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94fd64d1-a59b-4fb3-a347-20d707187845 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.181408 Aug 24 04:14:20.562359 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2890/6039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:20 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:21.586082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:21.586758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:21.594419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:21.594910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:21.595376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:21.596102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:21.596589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:21.597012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:21.752876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:21.761637 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ff3532f1-9741-4bdf-9528-582d6e0c1f24 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.181410 Aug 24 04:14:21.762380 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3150/6040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:21 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:14:22.785396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:22.786596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:22.794439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:22.795019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:22.795545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:22.796318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:22.796841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:22.797366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:22.802456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:22.959293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:22.969183 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-10c5e835-da7b-4306-ab80-1998b870a0f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.188607 Aug 24 04:14:22.969774 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2891/6041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:22 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:23.990797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:23.992909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:24.000724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:24.001402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:24.001953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:24.003014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:24.003596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:24.004261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:24.175078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:24.189685 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3b98016-990e-486b-a4f1-869dccd64b36 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.202843 Aug 24 04:14:24.190287 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3151/6042] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:23 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:25.211730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:25.212661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:25.220527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:25.221029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:25.221476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:25.222197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:25.222661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:25.223097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:25.380440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:25.388511 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0bb0830d-fa8f-4074-8be2-aa0b115abbd7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.181509 Aug 24 04:14:25.389107 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2892/6043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:25 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:26.414180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:26.416272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:26.426064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:26.426880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:26.427298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:26.428067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:26.428566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:26.429160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:26.575769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:26.583741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-304ced3b-a3cd-4620-9702-bc6d6632e2ce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.176717 Aug 24 04:14:26.584287 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3152/6044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:26 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:27.604923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:27.605908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:27.613431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:27.613931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:27.614405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:27.615380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:27.615898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:27.616336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:27.756198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:27.766196 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-681c2002-c586-4b79-ace5-9102e8ed7d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.165276 Aug 24 04:14:27.766836 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2893/6045] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:27 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:28.788689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:28.789337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:28.797736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:28.798349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:28.798786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:28.799500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:28.799974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:28.800405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:28.951804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:28.960713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6eb413c8-ba34-47d7-9951-02e42b1c41b8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.176462 Aug 24 04:14:28.961312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3153/6046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:28 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:29.982817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:29.983463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:29.991148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:29.991691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:29.992151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:29.992875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:29.993345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:29.993778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:30.151438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:30.160170 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ff176cb-3375-4a57-8f92-ffe94e9e1b98 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.181524 Aug 24 04:14:30.160869 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2894/6047] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:29 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:31.183484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:31.184319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:31.192146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:31.192641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:31.193075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:31.193783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:31.194233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:31.194654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:31.335032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:31.344775 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e419bae4-4d68-4ecd-b321-56e64a3d02c6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.166391 Aug 24 04:14:31.345411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3154/6048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:31 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:32.370478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:32.371150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:32.379568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:32.380098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:32.380608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:32.381282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:32.381724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:32.382163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:32.550629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:32.562404 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16688d7f-8300-4573-8b34-3951d9a69e64 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.196445 Aug 24 04:14:32.563356 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2895/6049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:32 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:33.587326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:33.588040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:33.595339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:33.595913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:33.596361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:33.597166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:33.597698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:33.598220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:33.614642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:33.758061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:33.768779 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2cd4e203-9a2d-416a-8c57-9845b355d1c2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.185690 Aug 24 04:14:33.769596 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3155/6050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:33 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:34.792605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:34.793306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:34.802103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:34.802654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:34.803104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:34.803878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:34.804351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:34.804780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:34.968981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:34.977534 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2c911f92-0570-49df-9c18-84c43d85f75e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.190139 Aug 24 04:14:34.978184 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2896/6051] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:34 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:35.999328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:36.000097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:36.007708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:36.008290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:36.008716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:36.009465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:36.010173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:36.010404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:36.193623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:36.203529 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e6a8f6c5-32e6-4f70-9c08-4f7f33212ffe tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.208524 Aug 24 04:14:36.204211 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3156/6052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:35 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:37.227460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:37.228328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:37.237805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:37.238757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:37.239272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:37.240959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:37.241866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:37.242541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:37.431651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:37.440815 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d003ec9b-dfce-4220-a562-909741c1d34d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.217482 Aug 24 04:14:37.441446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2897/6053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:37 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:38.477150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:38.477787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:38.485504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:38.486015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:38.486510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:38.487257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:38.487752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:38.488213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:38.650153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:38.659521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4cb5c459-6696-4a1f-b482-c2c88a74535b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.186697 Aug 24 04:14:38.660413 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3157/6054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:38 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:39.681957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:39.682614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:39.691319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:39.691899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:39.692351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:39.693113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:39.693580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:39.694022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:39.874645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:39.891790 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b62c9eee-3192-4a7d-a4c9-9c49f3d47956 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.214441 Aug 24 04:14:39.893054 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2898/6055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:39 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:40.931781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:40.932845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:40.944196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:40.945004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:40.945452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:40.946416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:40.947302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:40.947808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:41.138324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:41.149327 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-77aac52f-82fe-4b4b-bef0-49bba24b514a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.221914 Aug 24 04:14:41.150260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3158/6056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:40 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:14:42.174908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:42.175605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:42.184439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:42.185056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:42.185573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:42.186296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:42.186784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:42.187229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:42.351118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:42.367913 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02e4f30d-cdad-4941-a144-025233811ca5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.196911 Aug 24 04:14:42.369061 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2899/6057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:42 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:43.391235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:43.391904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:43.399611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:43.400382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:43.400818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:43.401510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:43.401976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:43.402396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:43.549339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:43.557938 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a22ff3ef-55f4-4969-9a7d-036d0a15dff9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.170970 Aug 24 04:14:43.558758 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3159/6058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:43 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:44.581681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:44.582298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:44.591030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:44.591551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:44.592032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:44.592782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:44.593240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:44.593670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:44.739953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:44.748964 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bb62de7c-da24-4ae7-adf8-7ee754696bfa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1511 microversion: 2.1 time: 0.171740 Aug 24 04:14:44.749556 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2900/6059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:44 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:45.770516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:45.771117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:45.778749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:45.779237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:45.779695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:45.780445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:45.780893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:45.781340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:45.992850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:46.001539 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4895e4a3-bb67-4f6d-82a8-33a386a280eb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1488 microversion: 2.1 time: 0.234882 Aug 24 04:14:46.002116 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3160/6060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:45 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1488 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:46.022777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:46.025938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:46.033633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.034190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.034604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.035343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.035879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.036314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.092944 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2242e938-130e-44bf-9902-b1790d933cd6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 200 len: 183 microversion: 2.1 time: 0.074041 Aug 24 04:14:46.093649 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2901/6061] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:14:46 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:46.104405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:46.105033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:46.112087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.112577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.113015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.113740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.114191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.114611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.266354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:46.276331 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aade05c9-fb4e-4ca8-bbdd-ba59a6013e19 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.176177 Aug 24 04:14:46.276843 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3161/6062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:46 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:46.307399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:46.308469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:46.317175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.317682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.319245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.320155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.320480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.321205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.491809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:46.503275 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d1e75682-db14-4991-bd76-8c45550b8130 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.200767 Aug 24 04:14:46.504321 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2902/6063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:46 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:46.525925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:46.526606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:46.533538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.534063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.534553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.535264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.536040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.536196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.695226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:46.708179 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d642f5dd-2756-491d-892c-61633b4994f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.187001 Aug 24 04:14:46.709003 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3162/6064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:46 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:46.730678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:46.731750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:46.738642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.739147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.739693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.740396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:46.740858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:46.741486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:46.885676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:46.894261 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31e3b807-9ef9-44d7-91e1-1e449cd12af6 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.167809 Aug 24 04:14:46.894875 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2903/6065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:46 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:46.956875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-976145537", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "84625d62-df37-416c-9910-28257ed66bfc"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:47.019277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] validate_networks() for [('84625d62-df37-416c-9910-28257ed66bfc', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:14:47.471517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:14:47.471980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:14:47.472446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:14:47.472848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:14:47.473257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:14:47.482550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:47.483039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:47.483499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:47.484258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:47.484902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:47.485327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:47.504691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:14:47.511380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for user bbc89071f3d44e14ac21298ac15d7c33 and project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:14:47.529181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:14:47.532109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:14:47.582340 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31a7cd2b-f5e4-49e9-a5a5-619ba8ce590e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629843 Aug 24 04:14:47.583440 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3163/6066] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:14:47.595376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf6aa2d0-d798-43ee-bf60-14231c5b8e72 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:47.596518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf6aa2d0-d798-43ee-bf60-14231c5b8e72 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:47.664028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf6aa2d0-d798-43ee-bf60-14231c5b8e72 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:47.672288 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf6aa2d0-d798-43ee-bf60-14231c5b8e72 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1214 microversion: 2.1 time: 0.080960 Aug 24 04:14:47.673140 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2904/6067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:47 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:48.696310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:48.697007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:48.705887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:48.706691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:48.707137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:48.708013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:48.708669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:48.709310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:48.784684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:48.799547 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e12b176-1650-4b82-beb0-c0b90c2386d7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1266 microversion: 2.1 time: 0.109372 Aug 24 04:14:48.811557 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3164/6068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:48 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:49.833041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:49.833832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:49.842938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:49.843435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:49.844129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:49.844843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:49.845688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:49.846282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:50.103341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:50.112514 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b040e874-0306-4512-9b22-b6e6007813db tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1314 microversion: 2.1 time: 0.283647 Aug 24 04:14:50.113107 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2905/6069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:49 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:50.448429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7fe736c8-e0ea-4e6f-93e3-ccaa2f67c346 req-06b77439-b7d0-4ba0-bbe8-3a649137a613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5901d7e-3d59-48a4-baee-02b93e921f35", "tag": "205cf9a4-a1f3-4b4e-b415-3d6ae0a96cf3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:50.455763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:50.463062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7fe736c8-e0ea-4e6f-93e3-ccaa2f67c346 req-06b77439-b7d0-4ba0-bbe8-3a649137a613 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:50.463546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7fe736c8-e0ea-4e6f-93e3-ccaa2f67c346 req-06b77439-b7d0-4ba0-bbe8-3a649137a613 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:50.464312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7fe736c8-e0ea-4e6f-93e3-ccaa2f67c346 req-06b77439-b7d0-4ba0-bbe8-3a649137a613 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:50.482199 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7fe736c8-e0ea-4e6f-93e3-ccaa2f67c346 req-06b77439-b7d0-4ba0-bbe8-3a649137a613 service nova] Creating event network-changed:205cf9a4-a1f3-4b4e-b415-3d6ae0a96cf3 for instance d5901d7e-3d59-48a4-baee-02b93e921f35 on n-h2-846470-15 Aug 24 04:14:50.487804 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7fe736c8-e0ea-4e6f-93e3-ccaa2f67c346 req-06b77439-b7d0-4ba0-bbe8-3a649137a613 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045003 Aug 24 04:14:50.489058 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3165/6070] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:51.135299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:51.136612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:51.144646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=34 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:51.146570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:51.147160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:51.147626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:51.148422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:51.148910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:51.149350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:51.326673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:51.335378 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-95a07ce1-2cf6-47ad-94d7-c3d918b6acef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1314 microversion: 2.1 time: 0.204523 Aug 24 04:14:51.336132 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2906/6071] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:51 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:52.362276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:52.362985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:52.370215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:52.370708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:52.371889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:52.373123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:52.373123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:52.373491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:52.960448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:52.971219 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8b7fe10-d646-435e-b65a-5628a29baaf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1314 microversion: 2.1 time: 0.615866 Aug 24 04:14:52.972597 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3166/6072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:52 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:53.156894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-73df7f9b-fbea-4f04-b05d-02d279f3c587 req-b63519e3-7dfc-44b2-a92f-3b2cfdd2be8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38", "tag": "61e84eca-fe1c-4cfd-806a-69d4042cf9ae"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:53.159268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:53.162750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:53.193097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:53.194533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:53.195647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:53.197158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:53.197948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:53.198832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:53.216540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-73df7f9b-fbea-4f04-b05d-02d279f3c587 req-b63519e3-7dfc-44b2-a92f-3b2cfdd2be8d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:53.220499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-73df7f9b-fbea-4f04-b05d-02d279f3c587 req-b63519e3-7dfc-44b2-a92f-3b2cfdd2be8d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:53.220964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-73df7f9b-fbea-4f04-b05d-02d279f3c587 req-b63519e3-7dfc-44b2-a92f-3b2cfdd2be8d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:53.234896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=87 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:53.241972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:14:53.250978 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-73df7f9b-fbea-4f04-b05d-02d279f3c587 req-b63519e3-7dfc-44b2-a92f-3b2cfdd2be8d service nova] Creating event network-changed:61e84eca-fe1c-4cfd-806a-69d4042cf9ae for instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 on n-h2-846470-15 Aug 24 04:14:53.284651 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-73df7f9b-fbea-4f04-b05d-02d279f3c587 req-b63519e3-7dfc-44b2-a92f-3b2cfdd2be8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131795 Aug 24 04:14:53.285731 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3167/6073] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:53.352411 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9dfa6e3f-2f7e-4475-a505-b5a48d667f80 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 204 len: 0 microversion: 2.1 time: 0.203651 Aug 24 04:14:53.353705 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2907/6074] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:14:53 2022] DELETE /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:14:53.364316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:53.365695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:53.384004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:53.384972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:53.385691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:53.387407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:53.388109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:53.389001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:53.584490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:53.594877 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8bd1b05-de4b-4645-8fae-7ea904450be4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1584 microversion: 2.1 time: 0.236602 Aug 24 04:14:53.596797 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3168/6075] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:53 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1584 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:53.996320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:53.997386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:54.010425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:54.014311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:54.015235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:54.017656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:54.018354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:54.018841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:54.181848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:54.191339 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-018ef27e-2805-4fcb-8b4d-250002ef0c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1314 microversion: 2.1 time: 0.202056 Aug 24 04:14:54.192151 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2908/6076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:53 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:14:54.621179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:54.622400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:54.629362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:54.629849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:54.630527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:54.631390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:54.631848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:54.632337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:54.802440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:54.811409 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f67ea636-be17-4131-842b-51da35485718 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1584 microversion: 2.1 time: 0.195149 Aug 24 04:14:54.823754 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3169/6077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:54 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1584 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:55.217577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:55.217577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:55.226036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:55.226618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:55.227233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:55.228020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:55.228672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:55.229148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:55.546617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:55.587195 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f3932b1a-a32e-493a-9450-43ea0985d7a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1314 microversion: 2.1 time: 0.377131 Aug 24 04:14:55.589267 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2909/6078] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:55 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:55.793335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9002d6cc-e7c7-4705-9793-048e8aef47f7 req-1b042baa-dbc0-4c27-8a4f-8f6eb9d6e749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38", "name": "network-vif-deleted", "tag": "61e84eca-fe1c-4cfd-806a-69d4042cf9ae"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:55.803518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9002d6cc-e7c7-4705-9793-048e8aef47f7 req-1b042baa-dbc0-4c27-8a4f-8f6eb9d6e749 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:55.804043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9002d6cc-e7c7-4705-9793-048e8aef47f7 req-1b042baa-dbc0-4c27-8a4f-8f6eb9d6e749 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:55.804470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9002d6cc-e7c7-4705-9793-048e8aef47f7 req-1b042baa-dbc0-4c27-8a4f-8f6eb9d6e749 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:55.817589 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9002d6cc-e7c7-4705-9793-048e8aef47f7 req-1b042baa-dbc0-4c27-8a4f-8f6eb9d6e749 service nova] Creating event network-vif-deleted:61e84eca-fe1c-4cfd-806a-69d4042cf9ae for instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 on n-h2-846470-15 Aug 24 04:14:55.823692 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9002d6cc-e7c7-4705-9793-048e8aef47f7 req-1b042baa-dbc0-4c27-8a4f-8f6eb9d6e749 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036319 Aug 24 04:14:55.824642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3170/6079] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:14:55.833839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:55.834755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:55.843904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:55.845522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:55.846138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:55.847105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:55.847863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:55.848580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:55.939170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:55.947990 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0fcdbd80-4cb1-40b5-b869-1dc8f4f188b9 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1229 microversion: 2.1 time: 0.118217 Aug 24 04:14:55.948621 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2910/6080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:55 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:14:56.609488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:56.610199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:56.640376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:56.641464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:56.642296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:56.643325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:56.643824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:56.644256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:56.845260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:56.868856 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7482d46-a5cd-4a18-a664-599cf3a28114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1314 microversion: 2.1 time: 0.263703 Aug 24 04:14:56.882207 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3171/6081] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:56 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:56.971028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:56.972366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:56.987541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:56.988126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:56.988625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:56.989410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:56.989924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:56.990412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:57.082569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:57.095257 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-82403e09-2f5f-467c-8d23-40cd9a1ce4a7 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1229 microversion: 2.1 time: 0.128801 Aug 24 04:14:57.096264 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2911/6082] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:56 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1229 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:57.889888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:57.891707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:57.898384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:57.900018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:57.904282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:57.905511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:57.906276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:57.907182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:57.907801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:57.908250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:58.107960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c7ba322f-3217-47f6-bcd8-88d0b23a56db req-12152100-1e4c-4085-bcf2-85de0b8be0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5901d7e-3d59-48a4-baee-02b93e921f35", "name": "network-vif-plugged", "status": "completed", "tag": "205cf9a4-a1f3-4b4e-b415-3d6ae0a96cf3"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:14:58.121463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:58.127183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c7ba322f-3217-47f6-bcd8-88d0b23a56db req-12152100-1e4c-4085-bcf2-85de0b8be0c7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:58.127982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c7ba322f-3217-47f6-bcd8-88d0b23a56db req-12152100-1e4c-4085-bcf2-85de0b8be0c7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:58.128629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c7ba322f-3217-47f6-bcd8-88d0b23a56db req-12152100-1e4c-4085-bcf2-85de0b8be0c7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:58.144720 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c7ba322f-3217-47f6-bcd8-88d0b23a56db req-12152100-1e4c-4085-bcf2-85de0b8be0c7 service nova] Creating event network-vif-plugged:205cf9a4-a1f3-4b4e-b415-3d6ae0a96cf3 for instance d5901d7e-3d59-48a4-baee-02b93e921f35 on n-h2-846470-15 Aug 24 04:14:58.150914 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c7ba322f-3217-47f6-bcd8-88d0b23a56db req-12152100-1e4c-4085-bcf2-85de0b8be0c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048065 Aug 24 04:14:58.151296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:58.152333 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2912/6083] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:14:58.158225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:58.159343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:58.168846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:58.169452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:58.170150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:58.171099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:58.171771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:58.172479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:58.175867 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-43749d60-f008-4cab-afa6-627608ee960a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1314 microversion: 2.1 time: 0.290036 Aug 24 04:14:58.199559 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3172/6084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:57 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:58.272371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:58.288254 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae4febf9-4f5f-4875-9434-aec5a944ac3f tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1229 microversion: 2.1 time: 0.134298 Aug 24 04:14:58.288972 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2913/6085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:58 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1229 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:59.204997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:59.205602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:59.214044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:59.214889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:59.215515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:59.216452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:59.217090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:59.217712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:59.313545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:14:59.314969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:14:59.328880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:59.329722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:59.330368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:59.331344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:14:59.332137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:14:59.332908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:14:59.412416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:59.426513 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66ea862f-bde8-4f56-8294-1760cdf3cc0c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1314 microversion: 2.1 time: 0.227318 Aug 24 04:14:59.427117 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3173/6086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:59 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:14:59.439995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:14:59.448916 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8a82d57-7532-4ba0-8ec3-bfef743c6a14 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1229 microversion: 2.1 time: 0.139752 Aug 24 04:14:59.449690 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2914/6087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:14:59 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1229 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:15:00.441774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:00.442395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:00.450919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:00.451522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:00.451522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:00.452272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:00.452728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:00.453437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:00.454551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:00.455204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:00.462345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:00.462817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:00.462817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:00.463610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:00.464421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:00.465273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:00.491790 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7dc25b18-1200-4da8-8934-964b92260855 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.054629 Aug 24 04:15:00.493061 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3174/6088] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 24 04:15:00 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c/os-server-password => generated 116 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:15:00.498242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:00.498996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:00.505571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:00.506214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:00.506766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:00.507573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:00.508287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:00.508963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:00.533161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:15:00.593804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d6afd7dea4792ac660027dd80640f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73ed94490364e6e9ff439f653eb6439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:00.602621 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-00d477a8-5347-4860-8326-fd9836e2dfd4 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 200 len: 1229 microversion: 2.1 time: 0.108221 Aug 24 04:15:00.603692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3175/6089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:00 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:00.659272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:00.668889 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9eb060e8-f27e-47b3-833a-b29c5e9f9722 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1501 microversion: 2.1 time: 0.223368 Aug 24 04:15:00.675728 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2915/6090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:00 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1501 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:15:00.691415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:00.693897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:00.700873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:00.701469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:00.701979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:00.702919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:00.703426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:00.703988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:00.747018 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2913f664-4ca7-4629-8ec0-6cf554fd69bf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.060174 Aug 24 04:15:00.747707 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3176/6091] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:00 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:01.628674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:01.629341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] [instance: cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:01.638912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:01.639822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:01.640529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:01.641317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:01.641834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:01.642276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:01.660500 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] HTTP exception thrown: Instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 could not be found. Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Request method failure captured: Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 HTTP/1.1 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaS4hn_cAI8IHDAahViHIyhJSi9HPoZyt8GkX0CjIF-yJP2o4S3gKkUA2qQmDnXBCyhlgxAHFqRFJF9W0rA14eM7V1zvLaPVelzNT14V34_eYMO9094Rz4wvNch4bf5KBChLN0mRos_66cfb3zsWy3w1xkTACUY1hdR9FvGmvpz0GdU Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: e73ed94490364e6e9ff439f653eb6439 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestVolumeBackupRestore-1890450816 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e73ed94490364e6e9ff439f653eb6439"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e73ed94490364e6e9ff439f653eb6439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e73ed94490364e6e9ff439f653eb6439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e73ed94490364e6e9ff439f653eb6439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestVolumeBackupRestore-1890450816 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: e73ed94490364e6e9ff439f653eb6439 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1890450816 Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestVolumeBackupRestore-1890450816-project Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 588d6afd7dea4792ac660027dd80640f Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestVolumeBackupRestore-1890450816-project Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 could not be found. Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38'} Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 could not be found. Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 could not be found. Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:15:01.662257 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 could not be found. Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Returning 404 to user: Instance cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:15:01.667555 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-44b19035-7522-4515-8c5f-b8bf28babf95 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38" status: 404 len: 111 microversion: 2.1 time: 0.039135 Aug 24 04:15:01.669755 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2916/6092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:01 2022] GET /compute/v2.1/servers/cbcbb2a2-4ae8-4387-a5d6-c3cd21d81e38 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:15:01.760111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:01.762445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:01.769992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:01.770476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:01.771321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:01.771590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:01.772067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:01.772485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:01.815071 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b6ae4233-0955-4914-ab6f-e0f59ed5ac8b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.059564 Aug 24 04:15:01.816247 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3177/6093] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:01 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:01.850913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31ae90ad-8742-4461-afc0-c880ad73b986 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] Calling method '.version_select at 0x7f103433a790>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:01.881796 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31ae90ad-8742-4461-afc0-c880ad73b986 tempest-TestVolumeBackupRestore-1890450816 tempest-TestVolumeBackupRestore-1890450816-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2004232172" status: 202 len: 0 microversion: 2.1 time: 0.034971 Aug 24 04:15:01.896988 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2917/6094] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 04:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2004232172 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:15:02.827602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:02.830023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:02.843863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:02.844367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:02.844808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:02.845695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:02.846329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:02.847256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:02.908863 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-803738aa-1b4f-4a32-b162-79028c44285a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.083304 Aug 24 04:15:02.911721 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3178/6095] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:02 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:03.921351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:03.925194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:03.950978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:03.951611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:03.951945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:03.953299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:03.954132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:03.954597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:04.010778 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-af9f0b9f-c8f1-460a-8d87-01cbb0965edb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.094066 Aug 24 04:15:04.015956 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2918/6096] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:03 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:05.024138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:05.026830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:05.047787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:05.050071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:05.050882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:05.051927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:05.052596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:05.053368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:05.127515 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cf2d42a2-fb7a-47e5-bbed-a2b5b61a7619 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.107525 Aug 24 04:15:05.129186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3179/6097] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:05 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:06.141368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:06.144061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:06.159712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:06.162656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:06.162907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:06.163895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:06.165303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:06.165869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:06.216295 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f000dc7-e69a-44f5-b1ba-3b7210618416 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.079686 Aug 24 04:15:06.217411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2919/6098] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:06 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:07.236274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:07.240662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:07.257045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:07.262476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:07.263121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:07.264090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:07.265738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:07.266864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:07.311741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-79ef7665-f7bc-4e9d-88ea-000e945876f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.086987 Aug 24 04:15:07.316821 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3180/6099] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:07 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:08.324719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:08.327788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:08.336670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:08.337437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:08.337958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:08.338762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:08.339300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:08.339982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:08.382286 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-60c4b0d8-c924-4164-8173-9f6e3aa924c7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.062426 Aug 24 04:15:08.384045 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2920/6100] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:08 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:09.395625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:09.398196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:09.407495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:09.408120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:09.408843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:09.409723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:09.410432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:09.410875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:09.462767 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bef552a4-713d-49af-8523-d9d0a6867235 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.071435 Aug 24 04:15:09.464076 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3181/6101] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:09 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:10.477179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:10.479719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:10.488443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:10.489189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:10.489833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:10.490554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:10.491196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:10.491631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:10.533156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bb425045-707e-4208-b33b-339ba20e54d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.061553 Aug 24 04:15:10.534191 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2921/6102] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:10 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:11.546773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:11.548939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:11.557507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:11.558284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:11.558710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:11.559604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:11.560258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:11.560873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:11.607903 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-21362e92-235f-4d62-a940-f34f720d2d60 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.065422 Aug 24 04:15:11.608582 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3182/6103] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:11 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:15:12.620238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:12.622997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:12.632312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:12.633156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:12.633660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:12.634442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:12.634980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:12.635475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:12.681796 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7748f67a-58fa-464c-ab34-2c1c8ea86cbd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 14 microversion: 2.1 time: 0.066150 Aug 24 04:15:12.682497 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2922/6104] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:12 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 04:15:13.699773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:13.704848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:13.767211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:13.770453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:13.776931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:13.780017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:13.796185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:13.797458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:13.934153 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a980ce6-292b-450d-819e-ccb8a0d7f2a2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action" status: 200 len: 8206 microversion: 2.1 time: 0.241026 Aug 24 04:15:13.936383 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3183/6105] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:13 2022] POST /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35/action => generated 8206 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:13.987031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:13.989723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:14.018844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:14.019835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:14.021018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:14.022437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:14.023325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:14.024066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:14.708384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:14.719019 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c78d0dde-0f17-4f21-a095-1555fc3887c4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.774386 Aug 24 04:15:14.735867 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2923/6106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:13 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:14.752399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:14.753121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:14.761756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:14.762335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:14.762689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:14.763407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:14.763900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:14.764336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:15.058852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:15.080316 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c4be25a-a06e-4b95-a131-a35e1dcd3933 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.332396 Aug 24 04:15:15.081460 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3184/6107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:14 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:15.120339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:15.120977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:15.141791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:15.144953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:15.152777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:15.163976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:15.164886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:15.165708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:15.373079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:15.386565 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6dd7b1f3-4fdd-482b-b546-4255b2969888 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.277115 Aug 24 04:15:15.387341 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2924/6108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:15 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:15.411108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:15.411570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:15.426143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:15.426663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:15.427113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:15.427890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:15.428350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:15.428965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:15.630702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:15.639397 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-17875579-aebd-4be5-a537-1b42b75087d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.232889 Aug 24 04:15:15.640031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3185/6109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:15 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:15:15.667889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:15.668574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:15.680623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:15.682217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:15.683035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:15.684031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:15.684545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:15.684991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:15.736130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:15:15.759272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Locking {{(pid=122535) lock /opt/stack/nova/nova/compute/api.py:4828}} Aug 24 04:15:15.845328 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-232ebcdd-2e1c-4499-8883-4634198305ee tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.185361 Aug 24 04:15:15.845810 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2925/6110] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:15 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:15:15.855741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:15.856594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:15.870015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:15.870582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:15.871180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:15.872509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:15.873108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:15.873643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:16.079824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:16.091845 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ddd4a25a-12e9-4a89-b763-5db507e8e434 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.240793 Aug 24 04:15:16.092873 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3186/6111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:15 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:16.120369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83dab1c8-1b00-4f91-b034-858e7d0be7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:16.134305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83dab1c8-1b00-4f91-b034-858e7d0be7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:16.135314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83dab1c8-1b00-4f91-b034-858e7d0be7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:16.136267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83dab1c8-1b00-4f91-b034-858e7d0be7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:16.183658 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-83dab1c8-1b00-4f91-b034-858e7d0be7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] HTTP exception thrown: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 is locked Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83dab1c8-1b00-4f91-b034-858e7d0be7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Request method failure captured: Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action HTTP/1.1 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 15 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaS1r6hk_54d5Fowo6qEH4lsorCdRVMQPDbywiekyuxytw6-jp0qNJFu-DWZy1VZS9KXSPHunAHvjYYFCYg_K68zFYmHmSYHsiMrPuFgfoXKlyVRdR37Q22etS8CC611DA9BcEGlPu1LDFMYsP1H7z6ec65Rlf7Ooj6Zk7hfrBOShKg Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-663356641 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: bbc89071f3d44e14ac21298ac15d7c33 Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: {"os-stop": {}} Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 is locked Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '05ef27b8-4d47-4c22-8f03-87d9d7b2e883', 'body': {'os-stop': {}}} Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 is locked Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 is locked Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 is locked Aug 24 04:15:16.186592 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:15:16.199881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83dab1c8-1b00-4f91-b034-858e7d0be7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Returning 409 to user: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 is locked {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:15:16.199881 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-83dab1c8-1b00-4f91-b034-858e7d0be7d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 409 len: 107 microversion: 2.1 time: 0.078401 Aug 24 04:15:16.199881 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2926/6112] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:16 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 107 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:15:16.207338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:16.208444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:16.222716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:16.223799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:16.224629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:16.226379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:16.228136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:16.228981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:16.306947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Unlocking {{(pid=122536) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 24 04:15:16.386829 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-297f63ef-1059-4c2b-b8d5-eb1be5a921c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.187725 Aug 24 04:15:16.387978 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3187/6113] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:16 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:15:16.399568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-00eaed1c-ed70-4013-b5eb-1bc126dc0e3a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:16.407476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eaed1c-ed70-4013-b5eb-1bc126dc0e3a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:16.408029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eaed1c-ed70-4013-b5eb-1bc126dc0e3a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:16.408482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-00eaed1c-ed70-4013-b5eb-1bc126dc0e3a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:16.438309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-00eaed1c-ed70-4013-b5eb-1bc126dc0e3a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Going to try to stop instance {{(pid=122535) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 04:15:16.514991 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-00eaed1c-ed70-4013-b5eb-1bc126dc0e3a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.121102 Aug 24 04:15:16.515894 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2927/6114] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:16 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:15:16.531428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:16.533259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:16.545548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:16.546384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:16.547079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:16.548085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:16.549249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:16.550014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:16.791036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:16.811464 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aee6360b-232a-44b5-bfbf-99d50b00d879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.288640 Aug 24 04:15:16.823709 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3188/6115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:16 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:15:17.839752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:17.840496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:17.850344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:17.851993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:17.852860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:17.854185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:17.855061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:17.855914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:18.031685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:18.040873 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1dc121df-136e-479d-babd-8bca37ac7c6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.207118 Aug 24 04:15:18.041738 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2928/6116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:17 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:19.091282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:19.091951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:19.103340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:19.103923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:19.104368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:19.105280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:19.105872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:19.106419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:19.318390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:19.328738 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c16da46a-8569-4259-a8eb-6df0a31b8b74 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.247341 Aug 24 04:15:19.329374 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3189/6117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:19 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:20.371638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:20.372843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:20.387058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:20.388095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:20.388907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:20.390331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:20.391203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:20.392003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:20.562705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:20.574107 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-068d46c4-a028-46a7-9e4a-1f696777ccc4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.211962 Aug 24 04:15:20.575240 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2929/6118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:20 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:21.604996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:21.605938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:21.609957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=50 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:15:21.620398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:21.621766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:21.622560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:21.623857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:21.624662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:21.625413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:21.815472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:21.825112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-761f630c-6cc4-4ef0-a10c-060d47c9552e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.224597 Aug 24 04:15:21.825828 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3190/6119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:21 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:15:22.855023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:22.857073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:22.875931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:15:22.887380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:22.892953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:22.893740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:22.898081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:22.899290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:22.900155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:23.181199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:23.197015 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c8233ba4-2c62-4b8e-8567-951b2c522a76 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.350363 Aug 24 04:15:23.198381 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2930/6120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:22 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:15:24.235398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:24.236724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:24.248586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:24.249234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:24.249794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:24.250631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:24.251207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:24.251918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:24.531327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:24.538719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:15:24.547421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c12ae8e0-3b6c-4fc3-bda4-77cf6443141d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.316464 Aug 24 04:15:24.548296 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3191/6121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:24 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:25.584030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:25.594516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:25.605542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:25.606285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:25.606865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:25.607761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:25.608368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:25.608935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:25.851815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:25.867293 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fe028a22-6eed-4592-a5db-049ce3e94b9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.293652 Aug 24 04:15:25.869401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2931/6122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:25 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:26.901578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:26.902546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:26.914268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:26.914928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:26.915440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:26.916499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:26.917459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:26.917956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:27.151782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:27.169941 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-21ebb8e1-6eb7-47b0-99e5-268c375acd7c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.275520 Aug 24 04:15:27.171185 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3192/6123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:26 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:28.195161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:28.196046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:28.204643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:28.205306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:28.205908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:28.206720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:28.207256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:28.207867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:28.405692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:28.415038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91155686-2532-430f-895f-544d6b9d602d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1655 microversion: 2.1 time: 0.224289 Aug 24 04:15:28.415713 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2932/6124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:28 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1655 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:28.447589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-422b36e5-5ffd-400d-ba59-ac609ac0401d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:28.458739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422b36e5-5ffd-400d-ba59-ac609ac0401d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:28.459455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422b36e5-5ffd-400d-ba59-ac609ac0401d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:28.460153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-422b36e5-5ffd-400d-ba59-ac609ac0401d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:28.502097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-422b36e5-5ffd-400d-ba59-ac609ac0401d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Going to try to start instance {{(pid=122536) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 04:15:28.572870 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-422b36e5-5ffd-400d-ba59-ac609ac0401d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.131244 Aug 24 04:15:28.574010 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3193/6125] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:28 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:15:28.968220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:28.969478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:28.981040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:28.982007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:28.982859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:28.984286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:28.985242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:28.986095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:29.204559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:29.216642 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bfb30322-7f25-4592-b05a-fae44457ddae tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1664 microversion: 2.1 time: 0.636651 Aug 24 04:15:29.217286 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2933/6126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:28 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1664 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:30.242524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:30.244299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:30.252200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:30.252763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:30.253256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:30.253992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:30.254676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:30.258882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:30.455384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:30.469243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-050c824c-80fb-4a08-bbd9-9c58a182382e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1664 microversion: 2.1 time: 0.232948 Aug 24 04:15:30.470247 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3194/6127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:30 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1664 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:15:31.497812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:31.498761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:31.505833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:31.506513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:31.507376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:31.508654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:31.509143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:31.509581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:31.712593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:31.742810 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d5ee2c4d-f6c0-49f4-98e7-99ea9e452738 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.249797 Aug 24 04:15:31.748382 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2934/6128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:31 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:31.767950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:31.768941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:31.778821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:31.779369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:31.780167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:31.780946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:31.781415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:31.781843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:31.989267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:31.998694 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2139be55-4829-4a92-b6f2-99f95cd4ce22 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.235323 Aug 24 04:15:31.999345 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3195/6129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:31 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:32.022682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:32.023634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:32.032049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.032654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.033195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.034013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.034548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.035116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.090398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Unlocking {{(pid=122535) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 24 04:15:32.156345 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-39d38820-fe53-45e9-b122-b8a8fc105ec1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.138226 Aug 24 04:15:32.157552 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2935/6130] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:32 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:15:32.173923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:32.174620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:32.182525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.183134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.183643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.184507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.185035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.185533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.361158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:32.371169 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b821a319-bcd0-4b62-8834-df9926799218 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.203271 Aug 24 04:15:32.371936 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3196/6131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:32 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:32.396209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:32.397227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:32.406067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.406826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.407373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.408350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.408952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.409611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.606354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:32.619573 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d75856b9-90ec-40be-b4c3-08ac101d0d52 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.229347 Aug 24 04:15:32.620274 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2936/6132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:32 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:32.655062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:32.658494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:32.670892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.671885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.672678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.673958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.674750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.675549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.868592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:32.882013 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9c332bde-0bef-4eca-be56-55745086898a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.235097 Aug 24 04:15:32.883208 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3197/6133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:32 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:32.907532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:32.908218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:32.918727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.919302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.919913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.920896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:32.921473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:32.922029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:32.925850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=9,nova_cell1:INSERT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:15:33.013057 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e1c5b40f-4065-4295-9925-bb071d88d2dc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.110030 Aug 24 04:15:33.019465 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2937/6134] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:32 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:15:33.030964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:33.032012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:33.043515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:33.045017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:33.045989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:33.047144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:33.047827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:33.048454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:33.282124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:33.291261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1240356e-e2aa-4708-87b2-976f4fdc3c89 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1673 microversion: 2.1 time: 0.270013 Aug 24 04:15:33.291899 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3198/6135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:33 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1673 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:15:34.321946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:34.323207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:34.336266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:34.337122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:34.337974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:34.339428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:34.340369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:34.341181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:34.549504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:34.559070 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05a666ce-2970-4031-afaf-ebbd2d1a00b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1653 microversion: 2.1 time: 0.247214 Aug 24 04:15:34.559693 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2938/6136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:34 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1653 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:34.588021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:15:34.588801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:34.598689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:34.599441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:34.600136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:34.601331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:34.602020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:34.602616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:34.698122 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8f583301-60c6-44a8-baea-dcde2e721ed1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.114905 Aug 24 04:15:34.698797 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3199/6137] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:15:34 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:15:34.714392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:34.715653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:34.730304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:34.731637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:34.732508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:34.733795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:34.734625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:34.735414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:34.975436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:34.985599 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e3fea07b-2734-47f6-bb83-8343682fae97 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1660 microversion: 2.1 time: 0.280224 Aug 24 04:15:34.986347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2939/6138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:34 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1660 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:36.014146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:36.014876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:36.022198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:36.022707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:36.023149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:36.023886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:36.024488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:36.024769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:36.236358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:36.246604 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ea2d6d5-2bb7-4659-b355-506c1c805aa5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.238859 Aug 24 04:15:36.247475 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3200/6139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:36 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:36.282556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:36.283482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:36.292951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:36.293796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:36.295430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:36.295894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:36.296511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:36.297133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:36.483833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:36.493539 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ba6f305-cf91-408d-92ed-56bf00d48ffd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.215359 Aug 24 04:15:36.494141 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2940/6140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:36 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:36.516389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:36.517018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:36.524937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:36.525429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:36.525872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:36.526581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:36.527028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:36.527447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:36.718192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:36.727126 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8b755f3d-0d29-4560-9bc8-6188a130edca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.214691 Aug 24 04:15:36.727749 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3201/6141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:36 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:36.751940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:36.752563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:36.759588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:36.760370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:36.761070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:36.762208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:36.762814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:36.763344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:36.977732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:36.988100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a3e4018a-e38d-4640-8fb2-7be05bc1f509 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.240741 Aug 24 04:15:36.988870 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2941/6142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:36 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:37.010850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:37.011475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:37.018771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:37.019513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:37.019732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:37.020625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:37.021092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:37.021519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:37.180038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:37.191147 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-77d2ee3c-648f-4d77-905e-2aec1589921b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.184990 Aug 24 04:15:37.191776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3202/6143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:37 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:15:37.212921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:15:37.213583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:15:37.227934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:37.228930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:37.229441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:37.230302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:15:37.230879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:15:37.231610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:15:37.428946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:15:37.438879 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47bb11b1-17a8-47b6-aadb-c69929f33aa4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.230306 Aug 24 04:15:37.439848 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2942/6144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:15:37 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:16:14.219946 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:16:14.220618 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:16:33.355977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:16:33.358946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:16:33.362003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=25 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:33.362709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:33.370450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:16:33.370972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:16:33.371421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:16:33.372192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:16:33.372662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:16:33.373097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:16:33.481164 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb0a1657-53c2-4950-a045-a276fe84d9f0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.129639 Aug 24 04:16:33.482449 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3203/6145] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:16:33 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:16:33.506440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:16:33.509031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:16:33.518166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=25 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:33.519513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:33.521972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:16:33.522490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:16:33.523989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:16:33.525132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:16:33.526361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:16:33.526807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:16:33.694114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:16:33.703231 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff5af90b-29d1-4b87-96c6-714866c641f4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1670 microversion: 2.1 time: 0.213645 Aug 24 04:16:33.703853 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2943/6146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:16:33 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1670 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:16:34.728981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:16:34.729548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:16:34.744420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:16:34.746176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:16:34.747090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:16:34.749460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:16:34.750430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:16:34.750954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:16:34.965034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:16:34.974804 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7573f32a-8446-4521-8fed-83b3874e1ecc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.251529 Aug 24 04:16:34.975492 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3204/6147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:16:34 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:21.360628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.361537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.518390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-70d0cded-561e-4124-aec5-937a91d824e1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:21.519514 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:17:21.519514 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 04:17:21.520977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70d0cded-561e-4124-aec5-937a91d824e1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:21.526996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70d0cded-561e-4124-aec5-937a91d824e1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:21.528568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70d0cded-561e-4124-aec5-937a91d824e1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:21.528874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70d0cded-561e-4124-aec5-937a91d824e1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:21.529357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70d0cded-561e-4124-aec5-937a91d824e1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:21.530115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-70d0cded-561e-4124-aec5-937a91d824e1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:21.554763 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-70d0cded-561e-4124-aec5-937a91d824e1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.199039 Aug 24 04:17:21.569272 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2944/6148] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 24 04:17:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:17:21.678617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-933392263", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "availability_zone": "nova:n-h1-846470-15", "networks": [{"uuid": "f66906dc-973f-4204-8965-03c7c110ae42"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:21.686556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.687227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.752390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] validate_networks() for [('f66906dc-973f-4204-8965-03c7c110ae42', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:17:22.246658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:17:22.247162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:17:22.247647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:17:22.248091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:17:22.248523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:17:22.272809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:22.273304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:22.273759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:22.277295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:22.277895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:22.278336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:22.302802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Getting quotas for project 96159622ab544ae680a3b040017f7728. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:17:22.316872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Getting quotas for user 88a36012ab284cc4abd1305cb3f65b47 and project 96159622ab544ae680a3b040017f7728. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:17:22.340982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:17:22.343750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:17:22.404311 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-335f808e-fcdf-47f5-b3a4-cb783f4a71ab tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729421 Aug 24 04:17:22.405121 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3205/6149] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:17:22.421765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7edab782-2a18-4bf0-86ee-b5f50c974114 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:22.422499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7edab782-2a18-4bf0-86ee-b5f50c974114 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:22.511500 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7edab782-2a18-4bf0-86ee-b5f50c974114 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1328 microversion: 2.1 time: 0.095287 Aug 24 04:17:22.512715 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2945/6150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:22 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:23.534233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:23.534840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:23.552746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:23.553272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:23.553996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:23.554451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:23.554918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:23.560110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:23.647972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a7ec628-db44-4efb-b5d3-e031dcfbc8f6 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1417 microversion: 2.1 time: 0.116879 Aug 24 04:17:23.649514 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3206/6151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:23 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1417 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:24.677239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:24.678702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:24.691198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:24.692418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:24.693347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:24.694817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:24.695796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:24.696540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:24.980251 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ec08c293-c69f-4745-b7b3-f2ef089fa071 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1465 microversion: 2.1 time: 0.299330 Aug 24 04:17:24.980958 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2946/6152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:24 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1465 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:25.490186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a2369ce4-3406-4d18-af7a-7f863e322eda req-b899f55a-014e-47ed-beb2-6d41543628fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a753b6-52cf-47df-aa0d-553408caeb63", "tag": "52fcc45f-bc17-45a7-958e-ec45334222e3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:25.510195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a2369ce4-3406-4d18-af7a-7f863e322eda req-b899f55a-014e-47ed-beb2-6d41543628fe service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:25.511468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a2369ce4-3406-4d18-af7a-7f863e322eda req-b899f55a-014e-47ed-beb2-6d41543628fe service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:25.511939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a2369ce4-3406-4d18-af7a-7f863e322eda req-b899f55a-014e-47ed-beb2-6d41543628fe service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:25.530221 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a2369ce4-3406-4d18-af7a-7f863e322eda req-b899f55a-014e-47ed-beb2-6d41543628fe service nova] Creating event network-changed:52fcc45f-bc17-45a7-958e-ec45334222e3 for instance b4a753b6-52cf-47df-aa0d-553408caeb63 on n-h1-846470-15 Aug 24 04:17:25.535574 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a2369ce4-3406-4d18-af7a-7f863e322eda req-b899f55a-014e-47ed-beb2-6d41543628fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148678 Aug 24 04:17:25.536529 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3207/6153] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:17:26.001680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:26.002318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:26.009616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:26.010112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:26.010585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:26.011288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:26.011999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:26.012432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:26.148107 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b6947616-959d-456f-ae40-53ab775e30db tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1465 microversion: 2.1 time: 0.150164 Aug 24 04:17:26.148968 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2947/6154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:25 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:27.170409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:27.171024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:27.178386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:27.178890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:27.179349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:27.180107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:27.181551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:27.181551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:27.322618 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f5577e44-c8f3-4d29-8391-3ae5a2099b84 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1465 microversion: 2.1 time: 0.156902 Aug 24 04:17:27.323349 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3208/6155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:27 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:28.350721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:28.351322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:28.359085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:28.359583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:28.360069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:28.360779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:28.361248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:28.361683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:28.502716 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7f1534cd-0e43-4763-9c49-cca932ab6477 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1465 microversion: 2.1 time: 0.155779 Aug 24 04:17:28.503316 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2948/6156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:28 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:29.523927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:29.524490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:29.531515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:29.532058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:29.532497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:29.533202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:29.533631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:29.534083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:29.671866 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e6b0b13c-a5f5-4638-a30b-a5796e2b4df1 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1465 microversion: 2.1 time: 0.151627 Aug 24 04:17:29.672487 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3209/6157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:29 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:30.692642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:30.693256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:30.700727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:30.701224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:30.701662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:30.702383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:30.702837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:30.703287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:30.842416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e96e9287-39db-444c-a0b1-b223019358ee tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1465 microversion: 2.1 time: 0.153749 Aug 24 04:17:30.843000 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2949/6158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:30 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:31.866900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:31.867524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:31.877382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:31.878371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:31.878371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:31.879093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:31.879543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:31.880017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:32.014879 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cc009afd-b3e7-4027-b63a-c8e2164a3493 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1465 microversion: 2.1 time: 0.154100 Aug 24 04:17:32.015477 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3210/6159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:31 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:32.224162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:32.298340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d8ff1e82-a501-4cf5-a281-2015f98e7004 req-d1a527ab-da38-436b-b13e-df47688e2326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a753b6-52cf-47df-aa0d-553408caeb63", "name": "network-vif-plugged", "status": "completed", "tag": "52fcc45f-bc17-45a7-958e-ec45334222e3"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:32.309042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d8ff1e82-a501-4cf5-a281-2015f98e7004 req-d1a527ab-da38-436b-b13e-df47688e2326 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:32.309604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d8ff1e82-a501-4cf5-a281-2015f98e7004 req-d1a527ab-da38-436b-b13e-df47688e2326 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:32.310038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d8ff1e82-a501-4cf5-a281-2015f98e7004 req-d1a527ab-da38-436b-b13e-df47688e2326 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:32.321785 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d8ff1e82-a501-4cf5-a281-2015f98e7004 req-d1a527ab-da38-436b-b13e-df47688e2326 service nova] Creating event network-vif-plugged:52fcc45f-bc17-45a7-958e-ec45334222e3 for instance b4a753b6-52cf-47df-aa0d-553408caeb63 on n-h1-846470-15 Aug 24 04:17:32.327420 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d8ff1e82-a501-4cf5-a281-2015f98e7004 req-d1a527ab-da38-436b-b13e-df47688e2326 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107566 Aug 24 04:17:32.328047 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2950/6160] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:17:33.038896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:33.039585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:33.042096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:33.042811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:33.050982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:33.051620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:33.052272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:33.053165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:33.053838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:33.054491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:33.206675 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af6f75dc-6023-4ae3-b4da-b96965a0cacf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1465 microversion: 2.1 time: 0.173510 Aug 24 04:17:33.207257 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3211/6161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:33 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1465 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:34.226822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:34.232326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:34.233043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:34.243039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:34.243798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:34.244444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:34.245362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:34.246037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:34.246462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:34.389540 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b83e6bd-a5f4-471c-8b17-0daabae416d9 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1650 microversion: 2.1 time: 0.164374 Aug 24 04:17:34.390203 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2951/6162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:34 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1650 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:34.412597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:34.413436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:34.421584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:34.422080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:34.422540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:34.423268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:34.423764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:34.424195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:34.576933 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f84e3a78-2dc3-45e6-98ed-d4941d3b23b0 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1650 microversion: 2.1 time: 0.168152 Aug 24 04:17:34.577506 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3212/6163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:34 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1650 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:34.598170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:34.598682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:34.605845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:34.606344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:34.606783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:34.607505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:34.608055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:34.608447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:34.747767 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6d5a8427-c5e0-4c59-8ed1-48e2bf4b21dc tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1650 microversion: 2.1 time: 0.153689 Aug 24 04:17:34.748366 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2952/6164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:34 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1650 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:34.820912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1848580492", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "availability_zone": "nova:n-h2-846470-15", "networks": [{"uuid": "f66906dc-973f-4204-8965-03c7c110ae42"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:34.884241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] validate_networks() for [('f66906dc-973f-4204-8965-03c7c110ae42', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:17:35.295988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:17:35.296410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:17:35.296887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:17:35.297292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:17:35.297707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:17:35.307211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:35.308111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:35.308568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:35.309317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:35.309776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:35.310196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:35.329186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Getting quotas for project 96159622ab544ae680a3b040017f7728. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:17:35.335310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Getting quotas for user 88a36012ab284cc4abd1305cb3f65b47 and project 96159622ab544ae680a3b040017f7728. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:17:35.353067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:17:35.355981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:17:35.405847 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81a7ecc3-12c6-44f3-bca1-f290b1a2e037 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588781 Aug 24 04:17:35.407162 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3213/6165] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:17:35.419072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0e5dae39-65c3-40b6-ae4d-6c9d81bbe664 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:35.419721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e5dae39-65c3-40b6-ae4d-6c9d81bbe664 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:35.498469 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0e5dae39-65c3-40b6-ae4d-6c9d81bbe664 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1329 microversion: 2.1 time: 0.083536 Aug 24 04:17:35.498967 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2953/6166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:35 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1329 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:36.522109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:36.522846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:36.534150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:36.534925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:36.535532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:36.536494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:36.537082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:36.537623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:36.939866 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0841a345-9d72-4f42-8027-e33567572866 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1418 microversion: 2.1 time: 0.423970 Aug 24 04:17:36.942718 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3214/6167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:36 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1418 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:37.964951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:37.965970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:37.976526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:37.977016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:37.977491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:37.978220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:37.980990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:37.980990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.157872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e40ffd60-a39b-41a2-9e71-0eb766c7780c req-974dba21-c89d-41a6-8a02-07a2c9f78958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccb3fd5a-5082-4001-bcba-10669c946c19", "tag": "bf754ada-74a7-4a1d-8391-57842ab73bf5"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:38.162892 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3578a246-c7d4-4397-8dfb-2a6c9d97f971 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.193387 Aug 24 04:17:38.163559 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2954/6168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:37 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:38.168764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:38.169284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:38.177117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e40ffd60-a39b-41a2-9e71-0eb766c7780c req-974dba21-c89d-41a6-8a02-07a2c9f78958 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.177597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e40ffd60-a39b-41a2-9e71-0eb766c7780c req-974dba21-c89d-41a6-8a02-07a2c9f78958 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.178026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e40ffd60-a39b-41a2-9e71-0eb766c7780c req-974dba21-c89d-41a6-8a02-07a2c9f78958 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.186658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.187204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.187652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.188574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.188929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.189475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.190449 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e40ffd60-a39b-41a2-9e71-0eb766c7780c req-974dba21-c89d-41a6-8a02-07a2c9f78958 service nova] Creating event network-changed:bf754ada-74a7-4a1d-8391-57842ab73bf5 for instance ccb3fd5a-5082-4001-bcba-10669c946c19 on n-h2-846470-15 Aug 24 04:17:38.196654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e40ffd60-a39b-41a2-9e71-0eb766c7780c req-974dba21-c89d-41a6-8a02-07a2c9f78958 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125295 Aug 24 04:17:38.197845 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3215/6169] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:17:38.348216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:38.358066 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ec84d44-3e87-40e1-9ff1-2d944c5ddeff tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.193320 Aug 24 04:17:38.360234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2955/6170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:38 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:38.396288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:38.396986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:38.407173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.408013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.408530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.409415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.409850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.410374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.633003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:38.641796 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8f9ef23-4eb9-4043-a547-7c4361647fdf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.250390 Aug 24 04:17:38.642142 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3216/6171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:38 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:38.670457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:38.671073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:38.677892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.678384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.678840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.679553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.680220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.680649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.826603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:38.835170 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27be401a-f542-43b2-8328-04df7c35612f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.169747 Aug 24 04:17:38.835753 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2956/6172] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:38 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:38.856960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:38.857589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:38.864007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.864488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.864918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:38.866002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:38.866130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:38.866486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:39.012594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:39.021867 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-861f2db6-937b-472d-9d95-d67ff29dc747 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.168925 Aug 24 04:17:39.022465 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3217/6173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:38 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:39.144718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1672301051", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "84625d62-df37-416c-9910-28257ed66bfc"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:39.185985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:39.186663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:39.194858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:39.195364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:39.195835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:39.196573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:39.197028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:39.198670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:39.205760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] validate_networks() for [('84625d62-df37-416c-9910-28257ed66bfc', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:17:39.341087 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd6a2a82-557a-47b6-a66c-4d1ae0744546 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.159602 Aug 24 04:17:39.341887 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3218/6174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:39 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:39.791584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:17:39.792096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:17:39.792598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:17:39.793003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:17:39.793415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:17:39.803415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:39.803942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:39.804379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:39.805097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:39.805556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:39.805982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:39.824428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:17:39.830701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for user bbc89071f3d44e14ac21298ac15d7c33 and project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:17:39.844892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:17:39.847324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:17:39.898193 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a2a2fb8-9796-4a16-9d1a-8e22ab2188e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758041 Aug 24 04:17:39.898993 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2957/6175] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:17:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:17:39.912138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f604a0ec-41c6-46d3-9158-2ca10736c76d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:39.912772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f604a0ec-41c6-46d3-9158-2ca10736c76d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:39.972910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f604a0ec-41c6-46d3-9158-2ca10736c76d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:39.981876 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f604a0ec-41c6-46d3-9158-2ca10736c76d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1215 microversion: 2.1 time: 0.073673 Aug 24 04:17:39.982887 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3219/6176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:39 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:40.364466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:40.365193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:40.372067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:40.372557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:40.373014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:40.373700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:40.374156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:40.374578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:40.518161 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-048c9d26-ee14-4e87-9ad0-77e809125d5b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.158764 Aug 24 04:17:40.518795 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2958/6177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:40 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:41.003453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:41.004382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:41.014223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:41.014847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:41.015455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:41.016519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:41.017256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:41.017679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:41.089274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:41.097730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de722812-ef68-490a-8cdd-9a2627dccf6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1219 microversion: 2.1 time: 0.098979 Aug 24 04:17:41.098567 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3220/6178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:40 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:41.541991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:41.542597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:41.550176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:41.550685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:41.551130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:41.551903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:41.552367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:41.552780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:41.699281 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5cb8ae18-a975-4c65-b8ff-12d0f4acca61 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.163104 Aug 24 04:17:41.699895 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2959/6179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:41 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:42.119110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:42.119873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:42.126957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:42.127447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:42.127912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:42.128627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:42.129071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:42.129504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:42.201553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:42.210803 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e0cba94-f526-43d2-81ff-460dc66cae31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1273 microversion: 2.1 time: 0.095666 Aug 24 04:17:42.211568 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3221/6180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:42 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:42.724241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:42.725358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:42.738412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:42.739277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:42.740481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:42.741798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:42.742705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:42.743759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:42.971435 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c21f617a-79ef-4499-a4a8-8747cee59591 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.254069 Aug 24 04:17:42.972437 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2960/6181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:42 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:43.231740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:43.233182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:43.241219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:43.241727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:43.242201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:43.242912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:43.243352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:43.243864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:43.287350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-97e451a8-8ff1-4ac9-9950-1c5f764a5dc1 req-8657cc37-e03b-4c8f-9353-cd8016baadf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4954ad56-4dc1-44c0-8410-07426be94cf9", "tag": "1930fb6c-a163-4eee-aa40-e74b0b48975f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:43.298202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-97e451a8-8ff1-4ac9-9950-1c5f764a5dc1 req-8657cc37-e03b-4c8f-9353-cd8016baadf4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:43.298655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-97e451a8-8ff1-4ac9-9950-1c5f764a5dc1 req-8657cc37-e03b-4c8f-9353-cd8016baadf4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:43.299287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-97e451a8-8ff1-4ac9-9950-1c5f764a5dc1 req-8657cc37-e03b-4c8f-9353-cd8016baadf4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:43.311109 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-97e451a8-8ff1-4ac9-9950-1c5f764a5dc1 req-8657cc37-e03b-4c8f-9353-cd8016baadf4 service nova] Creating event network-changed:1930fb6c-a163-4eee-aa40-e74b0b48975f for instance 4954ad56-4dc1-44c0-8410-07426be94cf9 on n-h2-846470-15 Aug 24 04:17:43.316563 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-97e451a8-8ff1-4ac9-9950-1c5f764a5dc1 req-8657cc37-e03b-4c8f-9353-cd8016baadf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032806 Aug 24 04:17:43.317224 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2961/6182] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:17:43.394975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:43.403978 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-83166bc0-1a37-41da-a078-ec29a01d984a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1315 microversion: 2.1 time: 0.175985 Aug 24 04:17:43.404576 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3222/6183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:43 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:43.994960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:43.995520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:44.002133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:44.002966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:44.003403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:44.004139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:44.004587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:44.005012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:44.163745 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e1948a17-2a9f-48ae-b17f-e261b9370a76 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.173847 Aug 24 04:17:44.164584 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2962/6184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:43 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:44.425284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:44.425833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:44.433399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:44.433887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:44.434322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:44.435016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:44.435466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:44.435916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:44.579323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:44.591179 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-acc49da0-7015-4bde-8ffa-46c7974cf6fb tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1315 microversion: 2.1 time: 0.169635 Aug 24 04:17:44.592094 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3223/6185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:44 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:45.038284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a55c260a-eac8-4bd6-bb4f-3269fcda0019 req-8c6d5259-b6eb-4a63-b991-82972c349995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb3fd5a-5082-4001-bcba-10669c946c19", "name": "network-vif-plugged", "status": "completed", "tag": "bf754ada-74a7-4a1d-8391-57842ab73bf5"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:45.051073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a55c260a-eac8-4bd6-bb4f-3269fcda0019 req-8c6d5259-b6eb-4a63-b991-82972c349995 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:45.051603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a55c260a-eac8-4bd6-bb4f-3269fcda0019 req-8c6d5259-b6eb-4a63-b991-82972c349995 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:45.052051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a55c260a-eac8-4bd6-bb4f-3269fcda0019 req-8c6d5259-b6eb-4a63-b991-82972c349995 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:45.067255 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a55c260a-eac8-4bd6-bb4f-3269fcda0019 req-8c6d5259-b6eb-4a63-b991-82972c349995 service nova] Creating event network-vif-plugged:bf754ada-74a7-4a1d-8391-57842ab73bf5 for instance ccb3fd5a-5082-4001-bcba-10669c946c19 on n-h2-846470-15 Aug 24 04:17:45.070714 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a55c260a-eac8-4bd6-bb4f-3269fcda0019 req-8c6d5259-b6eb-4a63-b991-82972c349995 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036679 Aug 24 04:17:45.071705 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2963/6186] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:17:45.190236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:45.190843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:45.197751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:45.198171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:45.198605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:45.199307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:45.199797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:45.200227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:45.318817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:45.348678 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81ddfc49-d229-4aa2-8214-77849060e53a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.161664 Aug 24 04:17:45.349097 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3224/6187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:45 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:45.612989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:45.613686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:45.620811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:45.621299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:45.621735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:45.622425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:45.622883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:45.623309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:45.774601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:45.783702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b91713d3-10be-4040-a3a4-e028bc16ff6e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1315 microversion: 2.1 time: 0.175025 Aug 24 04:17:45.784325 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2964/6188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:45 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:46.372308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:46.372903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:46.380302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:46.380826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:46.381251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:46.381960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:46.382458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:46.382863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:46.387077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.542278 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60b2d015-2af2-461d-a98e-9afd4857d5e4 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.175220 Aug 24 04:17:46.543342 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3225/6189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:46 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:46.806140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:46.806771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:46.814481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:46.815110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:46.815551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:46.816297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:46.816753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:46.817165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:46.965136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:46.969206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.975450 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0824a6c6-3b3a-4084-9a98-f20dfb43484c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1315 microversion: 2.1 time: 0.173614 Aug 24 04:17:46.976087 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2965/6190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:46 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:17:47.565342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:47.566261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:47.576733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:47.577220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:47.577657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:47.578354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:47.578812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:47.579223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:47.724631 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3e5e0b4d-dec2-40b4-bf4e-dfee4164c7ea tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1466 microversion: 2.1 time: 0.165133 Aug 24 04:17:47.725410 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3226/6191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:47 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1466 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:47.996471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:47.997139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:48.004373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:48.004881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:48.005360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:48.006103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:48.006593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:48.007164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:48.159083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:48.171273 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4ef7a4b-373e-49e0-9667-bbe6209b7e81 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1315 microversion: 2.1 time: 0.179308 Aug 24 04:17:48.171912 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2966/6192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:47 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:48.746353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:48.747029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:48.755281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:48.755809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:48.756254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:48.756990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:48.757493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:48.757930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:48.911091 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5289c706-1b04-4104-b621-d01c7b48ff88 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1652 microversion: 2.1 time: 0.168505 Aug 24 04:17:48.911707 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3227/6193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:48 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1652 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:48.933514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:48.934146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:48.941705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:48.942264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:48.942712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:48.943453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:48.943954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:48.944383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.103091 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ccd33eed-f121-4961-88b7-fe8993e0cf2d tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1652 microversion: 2.1 time: 0.173832 Aug 24 04:17:49.103851 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2967/6194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:48 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1652 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:49.125324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:49.126289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:49.132542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:49.133811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:49.133811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.134332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:49.134787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:49.135196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.193260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:49.193882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:49.201188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:49.201722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:49.202163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.202920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:49.203380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:49.203839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.276922 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d028b277-46f9-4752-b941-1014ed9d7bb5 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1652 microversion: 2.1 time: 0.155764 Aug 24 04:17:49.277611 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3228/6195] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:49 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1652 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:49.298779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:49.299286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:49.305682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:49.306183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:49.306641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.307487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:49.307840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:49.308257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.336222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:17:49.350832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:49.360588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-754a7433-2f57-4594-bdd2-fb094f6ac295 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1315 microversion: 2.1 time: 0.171462 Aug 24 04:17:49.361277 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2968/6196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:49 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:49.418706 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1868664c-8bb7-4044-9b4d-c48e535eed80 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 204 len: 0 microversion: 2.1 time: 0.123560 Aug 24 04:17:49.420632 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3229/6197] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:17:49 2022] DELETE /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:49.429628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:49.430302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:49.436984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:49.437476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:49.437916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.438608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:49.439071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:49.439500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:49.576213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9da3a058-c40d-4e3f-af7a-2071d0957a6a tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1658 microversion: 2.1 time: 0.150325 Aug 24 04:17:49.577089 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2969/6198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:49 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1658 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:50.384201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:50.384894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:50.387898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:50.394483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:50.394964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:50.395412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:50.396148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:50.396609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:50.397039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:50.542463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:50.551628 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ea8e07f7-c8f0-4e68-b871-051c3c2d58f5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1315 microversion: 2.1 time: 0.172195 Aug 24 04:17:50.552235 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3230/6199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:50 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:50.604159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:50.604955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:50.606894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:50.607639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:50.614738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:50.615226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:50.615685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:50.616368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:50.616830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:50.617252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:50.760525 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-73f9640c-03a5-430b-ab41-d53032ff8a09 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1658 microversion: 2.1 time: 0.160006 Aug 24 04:17:50.761277 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2970/6200] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:50 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1658 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:51.068071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-798fe0f6-9eae-44ac-aff7-e7fdc7c1e979 req-ad106c1e-1e7c-4ad7-bdcc-1d4428d3efc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4954ad56-4dc1-44c0-8410-07426be94cf9", "name": "network-vif-plugged", "status": "completed", "tag": "1930fb6c-a163-4eee-aa40-e74b0b48975f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:51.074787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-798fe0f6-9eae-44ac-aff7-e7fdc7c1e979 req-ad106c1e-1e7c-4ad7-bdcc-1d4428d3efc8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:51.075387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-798fe0f6-9eae-44ac-aff7-e7fdc7c1e979 req-ad106c1e-1e7c-4ad7-bdcc-1d4428d3efc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:51.076107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-798fe0f6-9eae-44ac-aff7-e7fdc7c1e979 req-ad106c1e-1e7c-4ad7-bdcc-1d4428d3efc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:51.092754 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-798fe0f6-9eae-44ac-aff7-e7fdc7c1e979 req-ad106c1e-1e7c-4ad7-bdcc-1d4428d3efc8 service nova] Creating event network-vif-plugged:1930fb6c-a163-4eee-aa40-e74b0b48975f for instance 4954ad56-4dc1-44c0-8410-07426be94cf9 on n-h2-846470-15 Aug 24 04:17:51.098624 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-798fe0f6-9eae-44ac-aff7-e7fdc7c1e979 req-ad106c1e-1e7c-4ad7-bdcc-1d4428d3efc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039416 Aug 24 04:17:51.099626 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3231/6201] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:17:51.416428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-b6d741ca-edd5-40b9-a911-eb970c6d4184 req-cb3e5868-3527-4778-89c0-231c76e1e417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb3fd5a-5082-4001-bcba-10669c946c19", "name": "network-vif-deleted", "tag": "bf754ada-74a7-4a1d-8391-57842ab73bf5"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:51.422243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:51.430716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b6d741ca-edd5-40b9-a911-eb970c6d4184 req-cb3e5868-3527-4778-89c0-231c76e1e417 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:51.432493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b6d741ca-edd5-40b9-a911-eb970c6d4184 req-cb3e5868-3527-4778-89c0-231c76e1e417 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:51.432959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-b6d741ca-edd5-40b9-a911-eb970c6d4184 req-cb3e5868-3527-4778-89c0-231c76e1e417 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:51.450668 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-b6d741ca-edd5-40b9-a911-eb970c6d4184 req-cb3e5868-3527-4778-89c0-231c76e1e417 service nova] Creating event network-vif-deleted:bf754ada-74a7-4a1d-8391-57842ab73bf5 for instance ccb3fd5a-5082-4001-bcba-10669c946c19 on n-h2-846470-15 Aug 24 04:17:51.458356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-b6d741ca-edd5-40b9-a911-eb970c6d4184 req-cb3e5868-3527-4778-89c0-231c76e1e417 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045036 Aug 24 04:17:51.458535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2971/6202] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:17:51.574760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:51.575508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:51.586415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:51.586931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:51.587368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:51.588195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:51.588719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:51.589153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:51.734419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:51.742534 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f443f0ac-4365-47d5-9c56-5094a6b8073e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1315 microversion: 2.1 time: 0.172885 Aug 24 04:17:51.743111 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3232/6203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:51 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:51.782696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:51.783353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:51.791187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:51.791695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:51.792158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:51.792870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:51.793329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:51.793746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:51.826617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:51.827120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:51.827563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:51.828078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lazy-loading 'fault' on Instance uuid ccb3fd5a-5082-4001-bcba-10669c946c19 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:17:51.882453 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e051945d-5984-4045-8b5c-ae11c590c63c tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 200 len: 1456 microversion: 2.1 time: 0.104156 Aug 24 04:17:51.883044 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2972/6204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:51 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 1456 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:52.770656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:52.771275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:52.774214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:52.780484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:52.780932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:52.781581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:52.782301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:52.782757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:52.783182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:52.903305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:52.903957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: ccb3fd5a-5082-4001-bcba-10669c946c19] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:52.911391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:52.911932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:52.912370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:52.913113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:52.913582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:52.914020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:52.928469 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] HTTP exception thrown: Instance ccb3fd5a-5082-4001-bcba-10669c946c19 could not be found. Aug 24 04:17:52.929134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Request method failure captured: Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 HTTP/1.1 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaZRC4QmE9h3ur_gnnE7nr2Wa9lqwLKFUUEU_fohOtleQV1nJqPwsgnz0NSJ18IyZdD6H2vyEXcx8N58UWxGLJ3nNzqd0lcs32GA96A2gvu8giNVGxzpQYtcRdh9lRxpT4dOg6ZqEu23MM-qwCwMoyAY_s-W-3wfY4haHxfOgIV5FWE Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 96159622ab544ae680a3b040017f7728 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestServerMultinode-1766133709 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_96159622ab544ae680a3b040017f7728"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/96159622ab544ae680a3b040017f7728"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96159622ab544ae680a3b040017f7728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96159622ab544ae680a3b040017f7728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestServerMultinode-1766133709 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 96159622ab544ae680a3b040017f7728 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestServerMultinode-1766133709 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestServerMultinode-1766133709-project-admin Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 88a36012ab284cc4abd1305cb3f65b47 Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestServerMultinode-1766133709-project-admin Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance ccb3fd5a-5082-4001-bcba-10669c946c19 could not be found. Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'ccb3fd5a-5082-4001-bcba-10669c946c19'} Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccb3fd5a-5082-4001-bcba-10669c946c19 could not be found. Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb3fd5a-5082-4001-bcba-10669c946c19 could not be found. Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:17:52.930178 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb3fd5a-5082-4001-bcba-10669c946c19 could not be found. Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Returning 404 to user: Instance ccb3fd5a-5082-4001-bcba-10669c946c19 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5181764d-df8b-4e80-b9eb-d5b466506981 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19" status: 404 len: 111 microversion: 2.1 time: 0.032256 Aug 24 04:17:52.935507 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2973/6205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:52 2022] GET /compute/v2.1/servers/ccb3fd5a-5082-4001-bcba-10669c946c19 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:17:52.939573 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dfdbc578-b2c4-48a1-98ab-836b11c95879 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1503 microversion: 2.1 time: 0.173807 Aug 24 04:17:52.940249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:52.940755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:52.941208 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3233/6206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:52 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:52.947691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:52.948219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:52.948661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:52.949369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:52.949829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:52.950266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:52.964755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:52.965307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:52.972565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:52.973118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:52.973644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:52.974404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:52.974923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:52.975418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:52.980292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:17:53.061520 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-917d632a-bd0e-4f73-a3be-f892fd4d0edf tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 204 len: 0 microversion: 2.1 time: 0.124306 Aug 24 04:17:53.066210 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2974/6207] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:17:52 2022] DELETE /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:53.072628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:53.073681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:53.082654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.083246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.083785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:53.084591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.085117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.085610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:53.112050 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.network.security_group_api [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Removing security group 6f70a88b-12eb-419a-8f74-e76c955ef864 from port 1930fb6c-a163-4eee-aa40-e74b0b48975f Aug 24 04:17:53.225343 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e27b7954-d9fb-4745-ba4e-2c656a1ae916 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1656 microversion: 2.1 time: 0.157511 Aug 24 04:17:53.225932 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2975/6208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:53 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:53.424680 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32d589a4-a939-4dde-9478-7689e8acf682 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9/action" status: 202 len: 0 microversion: 2.1 time: 0.465833 Aug 24 04:17:53.425580 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3234/6209] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:17:52 2022] POST /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:17:53.434846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:53.435702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:53.439361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-fa8f82c5-220b-45fd-a2cf-73dd3cdefa9f req-882ab3ad-6885-4c68-8876-2c1752d0ade2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4954ad56-4dc1-44c0-8410-07426be94cf9", "tag": "1930fb6c-a163-4eee-aa40-e74b0b48975f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:53.443098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.443946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.444627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:53.445564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.446993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.448584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:53.450525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fa8f82c5-220b-45fd-a2cf-73dd3cdefa9f req-882ab3ad-6885-4c68-8876-2c1752d0ade2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.451223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fa8f82c5-220b-45fd-a2cf-73dd3cdefa9f req-882ab3ad-6885-4c68-8876-2c1752d0ade2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.452742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fa8f82c5-220b-45fd-a2cf-73dd3cdefa9f req-882ab3ad-6885-4c68-8876-2c1752d0ade2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:53.474092 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fa8f82c5-220b-45fd-a2cf-73dd3cdefa9f req-882ab3ad-6885-4c68-8876-2c1752d0ade2 service nova] Creating event network-changed:1930fb6c-a163-4eee-aa40-e74b0b48975f for instance 4954ad56-4dc1-44c0-8410-07426be94cf9 on n-h2-846470-15 Aug 24 04:17:53.481571 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-fa8f82c5-220b-45fd-a2cf-73dd3cdefa9f req-882ab3ad-6885-4c68-8876-2c1752d0ade2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046571 Aug 24 04:17:53.483513 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3235/6210] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:17:53.582604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:53.591392 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de72aea1-814b-4f30-bb88-0c66989020e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1461 microversion: 2.1 time: 0.160569 Aug 24 04:17:53.592149 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2976/6211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:53 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1461 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:53.613452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:53.614462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:53.620732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.621474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.621911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:53.622616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.623998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.624622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:53.781142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:53.790827 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a570133-59b7-4519-bddc-0f09035edb1b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.181597 Aug 24 04:17:53.792090 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3236/6212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:53 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:53.815311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:53.816039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:53.822334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.822836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.823280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:53.824025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:53.824494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:53.824933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:54.047576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:54.055458 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90f48705-2439-4634-86c5-b98d96c5242c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.244613 Aug 24 04:17:54.056071 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2977/6213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:53 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:54.075864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:54.076723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:54.083928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:54.084411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:54.084846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:54.085550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:54.086004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:54.086433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:54.227463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:54.236423 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4286be4b-5e34-48e8-acda-5c7d5dfe2c7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.164913 Aug 24 04:17:54.237009 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3237/6214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:54 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:54.246638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:54.247248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:54.253697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:54.254759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:54.254759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:54.255327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:54.255808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:54.256230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:54.258318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:54.258931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:54.265449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:54.265944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:54.266382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:54.267115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:54.267579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:54.268033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:54.396782 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f514402e-c67d-41c9-8349-b1c4b7e06e4b tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1656 microversion: 2.1 time: 0.154061 Aug 24 04:17:54.397860 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2978/6215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:54 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:54.404970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:54.415696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b8f1599-0e03-429a-933f-10a75a935d16 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.161438 Aug 24 04:17:54.416361 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3238/6216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:54 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:54.524087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1313783250", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "84625d62-df37-416c-9910-28257ed66bfc"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:54.585413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] validate_networks() for [('84625d62-df37-416c-9910-28257ed66bfc', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:17:54.998104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:17:54.998728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:17:54.999203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:17:54.999638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:17:55.000093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:17:55.009475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:55.009963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:55.010399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:55.011117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:55.011961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:55.012392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:55.029619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:17:55.035771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Getting quotas for user bbc89071f3d44e14ac21298ac15d7c33 and project f3f788bb5b144dc4ba4c2583b50165f6. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:17:55.050529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:17:55.052887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:17:55.105329 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8c46fc5-ba85-41f2-b7ec-3d3324c607cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587520 Aug 24 04:17:55.105992 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2979/6217] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:17:55.117517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c76f6200-643e-471f-b3e5-bd4113ec0b48 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:55.118134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c76f6200-643e-471f-b3e5-bd4113ec0b48 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:55.194823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c76f6200-643e-471f-b3e5-bd4113ec0b48 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:55.202537 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c76f6200-643e-471f-b3e5-bd4113ec0b48 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1215 microversion: 2.1 time: 0.088834 Aug 24 04:17:55.203049 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3239/6218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:55 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:55.419182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:55.420520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:55.430558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:55.431143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:55.431869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:55.432619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:55.433536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:55.434234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:55.698196 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6bfd43ce-89a4-4c8d-bd19-e19ac1f9d3d7 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 200 len: 1656 microversion: 2.1 time: 0.283518 Aug 24 04:17:55.699262 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2980/6219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:55 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 1656 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:55.712521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-78f9ee3b-7dad-4962-b85f-fccbd273fc60 req-8a3d549e-3415-43ea-9d47-c998d2aa53de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a753b6-52cf-47df-aa0d-553408caeb63", "name": "network-vif-deleted", "tag": "52fcc45f-bc17-45a7-958e-ec45334222e3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:55.732550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-78f9ee3b-7dad-4962-b85f-fccbd273fc60 req-8a3d549e-3415-43ea-9d47-c998d2aa53de service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:55.733845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-78f9ee3b-7dad-4962-b85f-fccbd273fc60 req-8a3d549e-3415-43ea-9d47-c998d2aa53de service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:55.734668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-78f9ee3b-7dad-4962-b85f-fccbd273fc60 req-8a3d549e-3415-43ea-9d47-c998d2aa53de service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:55.749310 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-78f9ee3b-7dad-4962-b85f-fccbd273fc60 req-8a3d549e-3415-43ea-9d47-c998d2aa53de service nova] Creating event network-vif-deleted:52fcc45f-bc17-45a7-958e-ec45334222e3 for instance b4a753b6-52cf-47df-aa0d-553408caeb63 on n-h1-846470-15 Aug 24 04:17:55.754650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-78f9ee3b-7dad-4962-b85f-fccbd273fc60 req-8a3d549e-3415-43ea-9d47-c998d2aa53de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048810 Aug 24 04:17:55.756100 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3240/6220] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:17:56.224995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:56.225545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:56.234807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:56.235306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:56.235831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:56.236567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:56.237046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:56.237455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:56.347105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:56.356623 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0dc1a6fa-d0a6-4c29-b483-038cf95e55f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1275 microversion: 2.1 time: 0.136790 Aug 24 04:17:56.357537 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2981/6221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:56 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:56.721484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:56.722153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] [instance: b4a753b6-52cf-47df-aa0d-553408caeb63] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:56.729447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:56.729938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:56.730379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:56.731080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:56.731543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:56.732009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:56.746008 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] HTTP exception thrown: Instance b4a753b6-52cf-47df-aa0d-553408caeb63 could not be found. Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Request method failure captured: Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 HTTP/1.1 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaZRC4QmE9h3ur_gnnE7nr2Wa9lqwLKFUUEU_fohOtleQV1nJqPwsgnz0NSJ18IyZdD6H2vyEXcx8N58UWxGLJ3nNzqd0lcs32GA96A2gvu8giNVGxzpQYtcRdh9lRxpT4dOg6ZqEu23MM-qwCwMoyAY_s-W-3wfY4haHxfOgIV5FWE Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 96159622ab544ae680a3b040017f7728 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestServerMultinode-1766133709 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_96159622ab544ae680a3b040017f7728"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/96159622ab544ae680a3b040017f7728"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96159622ab544ae680a3b040017f7728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96159622ab544ae680a3b040017f7728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestServerMultinode-1766133709 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 96159622ab544ae680a3b040017f7728 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestServerMultinode-1766133709 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestServerMultinode-1766133709-project-admin Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 88a36012ab284cc4abd1305cb3f65b47 Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestServerMultinode-1766133709-project-admin Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance b4a753b6-52cf-47df-aa0d-553408caeb63 could not be found. Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'b4a753b6-52cf-47df-aa0d-553408caeb63'} Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a753b6-52cf-47df-aa0d-553408caeb63 could not be found. Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a753b6-52cf-47df-aa0d-553408caeb63 could not be found. Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:17:56.748186 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a753b6-52cf-47df-aa0d-553408caeb63 could not be found. Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] Returning 404 to user: Instance b4a753b6-52cf-47df-aa0d-553408caeb63 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d2d39c97-b262-486a-9e8a-c9788d24bb54 tempest-TestServerMultinode-1766133709 tempest-TestServerMultinode-1766133709-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63" status: 404 len: 111 microversion: 2.1 time: 0.032504 Aug 24 04:17:56.752963 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3241/6222] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:56 2022] GET /compute/v2.1/servers/b4a753b6-52cf-47df-aa0d-553408caeb63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:17:57.380037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:57.380703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:57.386940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:57.387430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:57.387908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:57.388643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:57.389328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:57.389979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:57.409963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:57.794853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:57.811211 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-853026b7-dd5d-4519-b2f7-b273f28d375b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1315 microversion: 2.1 time: 0.435472 Aug 24 04:17:57.824073 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2982/6223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:57 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:58.834672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:17:58.835471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:17:58.844260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:58.844875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:58.845427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:58.846252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:58.846839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:58.847429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:58.963936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-da0e3139-4f4f-4fcd-8fbf-8a600f07c220 req-2ad28d33-a3c6-41e5-8d3a-674b35eb4865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff34e3d1-0d66-4263-9b17-a9852423f5db", "tag": "ec778c34-01da-46ba-8d4c-e42c69666c5e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:17:58.987172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-da0e3139-4f4f-4fcd-8fbf-8a600f07c220 req-2ad28d33-a3c6-41e5-8d3a-674b35eb4865 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:17:58.990362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-da0e3139-4f4f-4fcd-8fbf-8a600f07c220 req-2ad28d33-a3c6-41e5-8d3a-674b35eb4865 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:17:58.990929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-da0e3139-4f4f-4fcd-8fbf-8a600f07c220 req-2ad28d33-a3c6-41e5-8d3a-674b35eb4865 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:17:59.008464 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-da0e3139-4f4f-4fcd-8fbf-8a600f07c220 req-2ad28d33-a3c6-41e5-8d3a-674b35eb4865 service nova] Creating event network-changed:ec778c34-01da-46ba-8d4c-e42c69666c5e for instance ff34e3d1-0d66-4263-9b17-a9852423f5db on n-h2-846470-15 Aug 24 04:17:59.016671 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-da0e3139-4f4f-4fcd-8fbf-8a600f07c220 req-2ad28d33-a3c6-41e5-8d3a-674b35eb4865 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056747 Aug 24 04:17:59.018742 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2983/6224] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:17:59.033642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:17:59.050146 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-827e13d7-58d1-4385-9b5e-c939b9ea04ca tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1315 microversion: 2.1 time: 0.220864 Aug 24 04:17:59.051073 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3242/6225] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:17:58 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:00.073645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:00.075075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:00.086490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:00.087027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:00.087475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:00.088277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:00.088751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:00.089247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:00.253796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:00.262174 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d5c8a5d-fb78-4878-a78e-45c77a8410af tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1315 microversion: 2.1 time: 0.193372 Aug 24 04:18:00.262806 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2984/6226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:00 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:01.288003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:01.288670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:01.297866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:01.298703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:01.299148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:01.299925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:01.300394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:01.300831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:01.515380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:01.525169 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e146deba-620c-4986-b1ee-518cbff1051f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1315 microversion: 2.1 time: 0.241597 Aug 24 04:18:01.525770 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3243/6227] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:01 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:02.548015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:02.548762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:02.556675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:02.557177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:02.557819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:02.558763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:02.559481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:02.560377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:02.779852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:02.788316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e7456e6-6646-4692-8532-4a64ce31ac65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1315 microversion: 2.1 time: 0.244892 Aug 24 04:18:02.788997 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2985/6228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:02 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:03.811011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:03.812211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:03.819015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:03.819519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:03.820014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:03.820748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:03.821209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:03.821639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:03.826593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:04.024972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:04.033812 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5c26edd-8aba-4ea1-bd9e-a9363227a51c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1315 microversion: 2.1 time: 0.227427 Aug 24 04:18:04.034419 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3244/6229] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:03 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:05.056223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:05.057618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:05.061316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:05.062057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:05.071147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:05.072007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:05.072604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:05.073527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:05.076572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:05.076572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:05.171865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-860ce1c6-bb11-489a-9c2a-440ad1d8121b req-1afc3c4d-b193-4343-ba4b-efccc7746db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff34e3d1-0d66-4263-9b17-a9852423f5db", "name": "network-vif-plugged", "status": "completed", "tag": "ec778c34-01da-46ba-8d4c-e42c69666c5e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:05.189872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-860ce1c6-bb11-489a-9c2a-440ad1d8121b req-1afc3c4d-b193-4343-ba4b-efccc7746db2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:05.190612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-860ce1c6-bb11-489a-9c2a-440ad1d8121b req-1afc3c4d-b193-4343-ba4b-efccc7746db2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:05.191196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-860ce1c6-bb11-489a-9c2a-440ad1d8121b req-1afc3c4d-b193-4343-ba4b-efccc7746db2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:05.199494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:05.215314 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-860ce1c6-bb11-489a-9c2a-440ad1d8121b req-1afc3c4d-b193-4343-ba4b-efccc7746db2 service nova] Creating event network-vif-plugged:ec778c34-01da-46ba-8d4c-e42c69666c5e for instance ff34e3d1-0d66-4263-9b17-a9852423f5db on n-h2-846470-15 Aug 24 04:18:05.222148 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-860ce1c6-bb11-489a-9c2a-440ad1d8121b req-1afc3c4d-b193-4343-ba4b-efccc7746db2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057435 Aug 24 04:18:05.223162 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3245/6230] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:18:05.432293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:05.444437 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c7c84529-aa11-429e-968d-1fb7c7f08d4d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1315 microversion: 2.1 time: 0.391075 Aug 24 04:18:05.445068 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2986/6231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:05 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:06.468885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:06.469516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:06.477905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:06.478604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:06.479047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:06.479811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:06.480270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:06.480945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:06.639051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:06.648298 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b0afa35-f99b-4b00-9ef8-fea9ad3b4949 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1315 microversion: 2.1 time: 0.185532 Aug 24 04:18:06.648894 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3246/6232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:06 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:07.672724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:07.673436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:07.683026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:07.683542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:07.684046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:07.684759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:07.685236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:07.686019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:07.835281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:07.845131 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-57647d66-9218-438d-ac40-dbe390860f08 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1502 microversion: 2.1 time: 0.176721 Aug 24 04:18:07.846017 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2987/6233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:07 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:07.867674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:07.868295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:07.874939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:07.875434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:07.875926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:07.876677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:07.877127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:07.877572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:07.959224 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-77661a61-2c23-40fb-ae7a-36ae8c51c5fa tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db/action" status: 202 len: 0 microversion: 2.1 time: 0.095346 Aug 24 04:18:07.960335 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3247/6234] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:18:07 2022] POST /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:18:07.971570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:07.972302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:07.980664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:07.981147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:07.981913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:07.982679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:07.983316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:07.983800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:08.155111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:08.165508 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-715a19ab-0a63-4633-af84-bf4b06211a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1507 microversion: 2.1 time: 0.200324 Aug 24 04:18:08.166606 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2988/6235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:07 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:09.191741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:09.192635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:09.200162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:09.200941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:09.201757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:09.202782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:09.203441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:09.204117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:09.527398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:09.537342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-443f3c35-2441-41e4-9b34-45212dabf7e5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1487 microversion: 2.1 time: 0.351313 Aug 24 04:18:09.538279 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3248/6236] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:09 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:09.558377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:09.559118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:09.566950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:09.567590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:09.568158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:09.568969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:09.569579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:09.570113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:09.599910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lazy-loading 'flavor' on Instance uuid ff34e3d1-0d66-4263-9b17-a9852423f5db {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:18:09.833194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-53a98e4e-ef16-4aa1-841a-fa3c17b0e00f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db/action" status: 202 len: 0 microversion: 2.1 time: 0.278680 Aug 24 04:18:09.833827 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2989/6237] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:18:09 2022] POST /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:18:09.844185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:09.845235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:09.853211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:09.854063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:09.854715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:09.859384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:09.860064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:09.860733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:10.049715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:10.059578 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-508a7950-ed2f-4e74-8ec9-ee5e400021e3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1493 microversion: 2.1 time: 0.220848 Aug 24 04:18:10.060374 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3249/6238] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:09 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1493 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:11.087708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:11.088951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:11.097458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:11.098363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:11.099001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:11.099856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:11.100403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:11.100918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:11.336982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:11.346332 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-369d75bd-57bc-475b-9649-96030b172125 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1493 microversion: 2.1 time: 0.268185 Aug 24 04:18:11.347479 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2990/6239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:11 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1493 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:12.368937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:12.370977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:12.383564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:12.384117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:12.384525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:12.385423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:12.386042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:12.386630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:12.565026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:12.578830 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6968a347-3c9c-4c2f-9db5-c61f8d3596cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1514 microversion: 2.1 time: 0.210779 Aug 24 04:18:12.592737 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3250/6240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:12 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:13.602018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:13.604118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:13.612150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:13.612567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:13.613012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:13.613787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:13.614435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:13.615026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:13.771285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:13.780580 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-79b7cc03-3c75-44ec-9b83-f21e406d58ef tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1514 microversion: 2.1 time: 0.182448 Aug 24 04:18:13.781187 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2991/6241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:13 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:14.804390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:14.805737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:14.814272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:14.815120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:14.815814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:14.816674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:14.817279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:14.817825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:14.963404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:14.973570 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4ace7ac3-128d-4c2e-8996-beb072993541 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1514 microversion: 2.1 time: 0.174279 Aug 24 04:18:14.974154 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3251/6242] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:14 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:15.312416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-977b4b70-cd4d-4e74-8372-1977b7ab61d1 req-6140f3fa-5310-4479-934e-4e327d397969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff34e3d1-0d66-4263-9b17-a9852423f5db", "name": "network-vif-plugged", "status": "completed", "tag": "ec778c34-01da-46ba-8d4c-e42c69666c5e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:15.330526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-977b4b70-cd4d-4e74-8372-1977b7ab61d1 req-6140f3fa-5310-4479-934e-4e327d397969 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:15.331016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-977b4b70-cd4d-4e74-8372-1977b7ab61d1 req-6140f3fa-5310-4479-934e-4e327d397969 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:15.341577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-977b4b70-cd4d-4e74-8372-1977b7ab61d1 req-6140f3fa-5310-4479-934e-4e327d397969 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:15.379864 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-977b4b70-cd4d-4e74-8372-1977b7ab61d1 req-6140f3fa-5310-4479-934e-4e327d397969 service nova] Creating event network-vif-plugged:ec778c34-01da-46ba-8d4c-e42c69666c5e for instance ff34e3d1-0d66-4263-9b17-a9852423f5db on n-h2-846470-15 Aug 24 04:18:15.394430 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-977b4b70-cd4d-4e74-8372-1977b7ab61d1 req-6140f3fa-5310-4479-934e-4e327d397969 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090787 Aug 24 04:18:15.395276 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2992/6243] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:18:15.997667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:15.998551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:16.006106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:16.006859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:16.007832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:16.008445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:16.008867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:16.009648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:16.312277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:16.325307 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-627bb65b-dfa7-4164-afd0-8c3f6b84dc8c tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.333149 Aug 24 04:18:16.326537 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3252/6244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:15 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:17.351140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:17.352555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:17.364787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:17.365536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:17.366073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:17.367981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:17.368823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:17.370978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:17.565740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:17.583887 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a724a30c-5003-4f49-ac33-96cc53225e83 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.232477 Aug 24 04:18:17.601261 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2993/6245] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:17 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:18.612387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:18.613756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:18.621378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:18.622325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:18.623165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:18.624149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:18.624719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:18.625358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:18.885221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:18.902755 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2ab344dc-8156-40a9-9801-02466cb703b3 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.299042 Aug 24 04:18:18.924327 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3253/6246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:18 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:19.931319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:19.932612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:19.941449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:19.942261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:19.942863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:19.946989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:19.948070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:19.949012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:20.121476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:20.149020 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3023ba22-3914-4a0e-b66a-afe30f64da9b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.223650 Aug 24 04:18:20.149622 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2994/6247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:19 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:21.186071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:21.187579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:21.199705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:21.200670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:21.201538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:21.203639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:21.204865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:21.205987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:21.491068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:21.504581 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f461098-a72d-4b68-ad63-dbe3d01f1525 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.325296 Aug 24 04:18:21.522148 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3254/6248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:21 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:22.529173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:22.529803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:22.533820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.557776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:22.562974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:22.565812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:22.567065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:22.569829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:22.571836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:23.879140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:23.894276 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f75d0ecb-f925-49c7-bf10-5e51526881b9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 1.367777 Aug 24 04:18:23.898260 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2995/6249] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:22 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:24.929240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:24.931794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:24.951333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=46 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:24.957571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:24.962851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:24.964866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:24.968344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:24.970224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:24.972109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:25.181239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:25.192841 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dee6b19e-fefa-4ace-937d-6ab635b16f01 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.268643 Aug 24 04:18:25.193806 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3255/6250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:24 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:26.214871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:26.215542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:26.235229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:26.236055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:26.236657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:26.237539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:26.238152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:26.238736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:26.531639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:26.548309 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9fa57c98-c60e-4603-a062-e8cce5406ab1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.337363 Aug 24 04:18:26.548938 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2996/6251] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:26 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:27.571087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:27.573457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:27.600338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:27.603376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:27.611253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:27.612177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:27.612652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:27.613126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:27.923004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:27.937831 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba79b84d-f4bc-47dc-b1ca-234826a97cba tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.370984 Aug 24 04:18:27.938480 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3256/6252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:27 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:28.962027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:28.963944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:28.974999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:28.975521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:28.976008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:28.976709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:28.977167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:28.977605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:28.981070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:29.237536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:29.246306 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-23007999-26d9-4bbd-a733-b9c30f9e0165 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1509 microversion: 2.1 time: 0.288208 Aug 24 04:18:29.247781 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2997/6253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:28 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:30.268472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:30.269089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:30.276784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:30.277383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:30.278245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:30.278976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:30.279739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:30.280378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:30.505986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:30.516539 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-02a663f1-5161-4001-b986-6b9de920f312 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1506 microversion: 2.1 time: 0.252381 Aug 24 04:18:30.517233 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3257/6254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:30 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:31.540069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:31.541368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:31.550488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:31.551265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:31.551917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:31.552933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:31.553571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:31.554380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:32.454654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:32.480418 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f0130504-5402-43cf-9aa4-158af1d6aaab tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1506 microversion: 2.1 time: 0.944029 Aug 24 04:18:32.481901 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2998/6255] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:31 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1506 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:33.507108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:33.515022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:33.515463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7ae3dc3a-d8a8-4693-842a-b0956c0c9bb0 req-7f4c43d3-d31a-4a81-9a64-2740341b9f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff34e3d1-0d66-4263-9b17-a9852423f5db", "name": "network-vif-unplugged", "status": "completed", "tag": "ec778c34-01da-46ba-8d4c-e42c69666c5e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:33.544378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:33.545520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:33.546283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:33.549697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:33.551792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:33.552259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:33.553708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7ae3dc3a-d8a8-4693-842a-b0956c0c9bb0 req-7f4c43d3-d31a-4a81-9a64-2740341b9f15 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:33.554196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7ae3dc3a-d8a8-4693-842a-b0956c0c9bb0 req-7f4c43d3-d31a-4a81-9a64-2740341b9f15 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:33.554776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7ae3dc3a-d8a8-4693-842a-b0956c0c9bb0 req-7f4c43d3-d31a-4a81-9a64-2740341b9f15 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:33.592902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.compute.server_external_events [req-7ae3dc3a-d8a8-4693-842a-b0956c0c9bb0 req-7f4c43d3-d31a-4a81-9a64-2740341b9f15 service nova] Unable to find a host for instance ff34e3d1-0d66-4263-9b17-a9852423f5db. Dropping event network-vif-unplugged {{(pid=122536) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 04:18:33.595393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7ae3dc3a-d8a8-4693-842a-b0956c0c9bb0 req-7f4c43d3-d31a-4a81-9a64-2740341b9f15 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.098892 Aug 24 04:18:33.599578 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3258/6256] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 104 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 04:18:33.846238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:33.857615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd247a8b-25cf-452b-9ef5-cd7f87ae99a4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 200 len: 1449 microversion: 2.1 time: 0.358665 Aug 24 04:18:33.863954 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 2999/6257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:33 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 1449 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:33.888188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:33.889719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:33.900740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:33.901522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:33.902160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:33.903306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:33.904242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:33.904858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:33.909918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:34.218508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:34.226784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e841ede3-b64f-4fba-8d69-7cf8ea3035a1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.343518 Aug 24 04:18:34.227396 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3259/6258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:33 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:34.255956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:34.256670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:34.269786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:34.271376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:34.272402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:34.273220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:34.273903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:34.274559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:34.455317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:34.468225 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b6a500b1-a977-4bc0-870e-30c80eb55ae4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.215545 Aug 24 04:18:34.471098 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3000/6259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:34 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:34.491201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:34.492212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:34.500401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:34.501311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:34.509102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:34.510529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:34.511207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:34.512007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:34.784385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:34.799319 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-885d37c0-69c4-4182-a27f-10a1d1c8c6f7 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.312263 Aug 24 04:18:34.800663 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3260/6260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:34 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:34.829224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:34.830774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:34.845996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:34.847380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:34.848245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:34.852482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:34.853243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:34.853825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:35.119809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:35.135794 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e858fec-f854-439e-a388-9745fd8aecd4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.311530 Aug 24 04:18:35.148487 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3001/6261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:34 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:35.171032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7362a9cc-9d68-4dad-9e03-9190bd934e90 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:35.180791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7362a9cc-9d68-4dad-9e03-9190bd934e90 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:35.181979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7362a9cc-9d68-4dad-9e03-9190bd934e90 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:35.184920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7362a9cc-9d68-4dad-9e03-9190bd934e90 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:35.225484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7362a9cc-9d68-4dad-9e03-9190bd934e90 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Going to try to stop instance {{(pid=122536) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 04:18:35.287641 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7362a9cc-9d68-4dad-9e03-9190bd934e90 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.123672 Aug 24 04:18:35.291489 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3261/6262] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:18:35 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:18:35.297118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:35.298016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:35.317712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:35.318220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:35.318657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:35.319380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:35.319890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:35.320326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:35.493977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:35.503985 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb07e632-666a-4180-bcb9-29e9f18a1c8f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.210970 Aug 24 04:18:35.505039 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3002/6263] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:35 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:36.528136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:36.529840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:36.537768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:36.538602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:36.539516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:36.540425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:36.541187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:36.541790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:36.703162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:36.712487 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-106440a4-0dd8-406e-862f-661494d6a62e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.189373 Aug 24 04:18:36.725535 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3262/6264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:36 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:37.460725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-975457049", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "aabff133-5b54-4f4a-82c0-1533cdaeb3a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9935c908-0959-4c8b-be4e-161d3600b222"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:37.532768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] validate_networks() for [('9935c908-0959-4c8b-be4e-161d3600b222', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:18:37.741128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:37.742388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:37.751322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:37.751871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:37.752314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:37.753024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:37.753504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:37.753950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:37.939311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:37.948669 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b2d42d5e-a61a-43fe-ab82-c2891fc70805 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.211439 Aug 24 04:18:37.964801 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3263/6265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:37 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:37.991077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:18:37.991501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:18:37.992039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:18:37.992453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:18:37.992879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:18:38.003384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:38.003969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:38.004417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:38.005173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:38.005635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:38.006071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:38.027861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:18:38.033486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:18:38.099632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:18:38.101789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aabff133-5b54-4f4a-82c0-1533cdaeb3a5',volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:18:38.254695 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c1182a29-846f-4385-b00a-d83c77dbc79e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798212 Aug 24 04:18:38.255450 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3003/6266] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:18:38.266802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de16d0c8-45c6-4546-bce4-23e3a94941a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:38.267418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de16d0c8-45c6-4546-bce4-23e3a94941a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:38.344000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-de16d0c8-45c6-4546-bce4-23e3a94941a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:38.351544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de16d0c8-45c6-4546-bce4-23e3a94941a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1056 microversion: 2.1 time: 0.088690 Aug 24 04:18:38.352250 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3264/6267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:38 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1056 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:38.972850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:38.974095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:38.982706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:38.989125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:38.989916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:38.991636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:38.992252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:38.992766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:39.176063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:39.197555 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-845279e3-275a-4dd8-abc8-bced08660bfd tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.230374 Aug 24 04:18:39.200373 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3004/6268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:38 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:39.373844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:39.374568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:39.383124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:39.383813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:39.384395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:39.385277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:39.388400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:39.390077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:39.464639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:39.473281 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-052e76bc-6697-4783-a90b-56a2d7d400a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1154 microversion: 2.1 time: 0.103832 Aug 24 04:18:39.473901 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3265/6269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:39 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1154 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:40.224806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:40.226009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:40.234864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:40.235359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:40.235839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:40.236536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:40.237149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:40.237577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:40.434777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:40.444206 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-61f0cd61-b661-4b98-9abc-b283bdb91d17 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.223329 Aug 24 04:18:40.445889 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3005/6270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:40 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:40.494627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:40.495226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:40.502836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:40.503433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:40.503831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:40.504601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:40.505259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:40.505700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:40.695822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:40.704984 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8aea3a0a-aedb-40d7-8255-ab79a5fd99ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1214 microversion: 2.1 time: 0.214284 Aug 24 04:18:40.705881 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3266/6271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:40 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:41.280134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1025a153-8480-4cda-a013-751171b7fe97 req-78a9ef6b-9236-4cb9-bd13-f8b3c298186c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f656b1-c72d-490c-bd9a-c5a7937dce39", "tag": "e5ca7507-2282-4e39-9971-06863bdc8341"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:41.294637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1025a153-8480-4cda-a013-751171b7fe97 req-78a9ef6b-9236-4cb9-bd13-f8b3c298186c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:41.295468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1025a153-8480-4cda-a013-751171b7fe97 req-78a9ef6b-9236-4cb9-bd13-f8b3c298186c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:41.296217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1025a153-8480-4cda-a013-751171b7fe97 req-78a9ef6b-9236-4cb9-bd13-f8b3c298186c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:41.310453 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1025a153-8480-4cda-a013-751171b7fe97 req-78a9ef6b-9236-4cb9-bd13-f8b3c298186c service nova] Creating event network-changed:e5ca7507-2282-4e39-9971-06863bdc8341 for instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 on n-h1-846470-15 Aug 24 04:18:41.316057 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1025a153-8480-4cda-a013-751171b7fe97 req-78a9ef6b-9236-4cb9-bd13-f8b3c298186c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040004 Aug 24 04:18:41.316899 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3006/6272] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:18:41.467230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:41.468028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:41.474732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:41.475504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:41.476109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:41.476843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:41.477304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:41.477735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:41.627402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:41.636068 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa0e3efc-2e6a-4979-b1ef-83a3f537754f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.173317 Aug 24 04:18:41.637249 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3267/6273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:41 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:41.728611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:41.729527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:41.737172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:41.738007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:41.738709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:41.739535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:41.740095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:41.740612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:41.925711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:41.937736 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8ca2fd8-75e9-47dc-bcaa-ab9919f38717 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1214 microversion: 2.1 time: 0.213331 Aug 24 04:18:41.938648 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3007/6274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:41 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:42.658221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:42.658784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:42.666060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:42.666565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:42.667061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:42.667761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:42.668338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:42.668777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:42.806601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:42.815570 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-558b7812-9f8a-472c-9fba-9b23884f5d47 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.161437 Aug 24 04:18:42.816188 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3268/6275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:42 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:42.959777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:42.960455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:42.969792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:42.970346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:42.970778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:42.971496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:42.971985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:42.972567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:43.120735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:43.130032 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81770850-cb48-47c4-9535-d1957cf8b45f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1214 microversion: 2.1 time: 0.174532 Aug 24 04:18:43.131006 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3008/6276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:42 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:43.838130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:43.838793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:43.846425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:43.846909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:43.847331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:43.848060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:43.848511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:43.848917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:44.002783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:44.011850 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eeb0a9bc-533f-443e-9485-6543b53ae041 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.177534 Aug 24 04:18:44.012502 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3269/6277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:43 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:44.152607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:44.153252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:44.160790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:44.161319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:44.161764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:44.162478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:44.162941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:44.163358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:44.323614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:44.332146 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b98a4f38-77a5-4586-a787-a3879f94e20d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1214 microversion: 2.1 time: 0.184002 Aug 24 04:18:44.332952 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3009/6278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:44 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:45.034059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:45.034819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:45.043047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:45.043545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:45.044010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:45.044832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:45.045180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:45.045604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:45.190509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:45.198905 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7cafe316-229c-4439-bf35-2b231e03a836 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1678 microversion: 2.1 time: 0.169202 Aug 24 04:18:45.199878 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3270/6279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:45 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:45.353781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:45.354324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:45.365395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:45.365896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:45.366327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:45.367053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:45.367515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:45.367979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:45.512352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:45.524461 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-65e70a9c-b578-42f4-969b-c3728f4bea52 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.174201 Aug 24 04:18:45.525052 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3010/6280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:45 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:46.221727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:46.222420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:46.229476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:46.229978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:46.230460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:46.231161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:46.231619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:46.232079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:46.382052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:46.390596 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-534335da-a8dd-43f4-88d8-eda7156e070b tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1655 microversion: 2.1 time: 0.172922 Aug 24 04:18:46.391176 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3271/6281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:46 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1655 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:46.417275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4d43662-3d01-485b-b369-86bbdea71f77 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:46.428123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d43662-3d01-485b-b369-86bbdea71f77 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:46.428895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d43662-3d01-485b-b369-86bbdea71f77 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:46.429526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4d43662-3d01-485b-b369-86bbdea71f77 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:46.453921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a4d43662-3d01-485b-b369-86bbdea71f77 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Going to try to start instance {{(pid=122535) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 04:18:46.499589 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4d43662-3d01-485b-b369-86bbdea71f77 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.087908 Aug 24 04:18:46.500440 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3011/6282] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:18:46 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:18:46.509620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:46.510424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:46.520198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:46.520927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:46.521553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:46.522547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:46.523406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:46.524042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:46.550522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:46.551519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:46.558646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:46.559523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:46.560006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:46.560779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:46.561265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:46.561699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:46.675485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:46.693036 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1eb1f63c-bfaf-490e-bd15-ce110837255e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1664 microversion: 2.1 time: 0.188040 Aug 24 04:18:46.707791 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3272/6283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:46 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1664 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:46.805889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:46.814267 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02302f74-d879-458a-a96c-731aa194c3ce tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.268054 Aug 24 04:18:46.814879 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3012/6284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:46 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:47.729334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:47.730497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:47.737819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:47.738337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:47.738795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:47.739602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:47.740092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:47.740521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:47.836214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:47.836842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:47.844235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:47.844730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:47.845162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:47.845930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:47.846391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:47.846883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:47.884777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:47.893685 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-64910b6d-82ac-48b6-b22e-b24b5c208602 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1664 microversion: 2.1 time: 0.170444 Aug 24 04:18:47.894519 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3273/6285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:47 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:47.980319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:47.992308 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09ce3b28-2c66-49d4-b627-fd6734febcc0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.161438 Aug 24 04:18:47.993126 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3013/6286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:47 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:48.914805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:48.915383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:48.917827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:48.924515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:48.925001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:48.925462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:48.926171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:48.926613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:48.927049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.014227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:49.014824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:49.016937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:49.017601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:49.024997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.025503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.025957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.026667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.027222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.027658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.030530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:49.079086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:49.087921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-33244101-691e-43ef-b91b-a6ce4ff90035 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.177150 Aug 24 04:18:49.088500 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3274/6287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:48 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:49.110761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:49.111599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:49.119549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.120365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.120828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.121938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.122415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.122842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.169653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:49.183996 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-87eea86c-27a6-4d13-b170-dcb00eda9384 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.173615 Aug 24 04:18:49.185097 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3014/6288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:49 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:49.265019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:49.267480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:49.274792 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72fbb8d2-9602-41ed-9cd7-66ab96561d6a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.168654 Aug 24 04:18:49.275404 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3275/6289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:49 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:49.307379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:49.308657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:49.315967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.316487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.317132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.318264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.318799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.319325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.471261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:49.480632 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dfbe6f81-e3cd-4859-b252-8b4b041cf2cf tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.180113 Aug 24 04:18:49.481220 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3015/6290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:49 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:49.501960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:49.502576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:49.509503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.509994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.510440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.511140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.512216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.512659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.659925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:49.668311 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f6507488-7244-4722-9cc4-457e3d6d8a9e tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.170942 Aug 24 04:18:49.668889 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3276/6291] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:49 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:49.688681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:49.689333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:49.696071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.696587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.697028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.697722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.698217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.698647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.844760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:49.853289 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-76d1bfa7-fc92-44bc-9bea-cf7d38473d65 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.168659 Aug 24 04:18:49.853874 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3016/6292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:49 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:49.874940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:49.875467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:49.881994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.882473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.882907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.883590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:49.884080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:49.884502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:49.910108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lazy-loading 'flavor' on Instance uuid 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:18:50.001135 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ce76d39-d460-4f9a-bf9b-f35859c6dbc5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.130019 Aug 24 04:18:50.002409 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3277/6293] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:18:49 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:18:50.012271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:50.012908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:50.020050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:50.021006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:50.021006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:50.021743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:50.022326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:50.022808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:50.170619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:50.178730 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2146457-44ce-4a7d-8110-a83eb2bee672 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1676 microversion: 2.1 time: 0.171114 Aug 24 04:18:50.179309 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3017/6294] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:50 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:50.207836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:50.208545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:50.215035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:50.215535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:50.216006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:50.216743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:50.217207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:50.217640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:50.360946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:50.369438 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-739a3c84-d453-4c32-bfc1-a6febbf367f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.166750 Aug 24 04:18:50.370005 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3278/6295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:50 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:51.201168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:51.201896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:51.210284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:51.210786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:51.211233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:51.211981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:51.212442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:51.212876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:51.372795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:51.380862 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09528965-cba6-4db5-8195-53318a3f3e34 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1659 microversion: 2.1 time: 0.184152 Aug 24 04:18:51.381438 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3018/6296] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:51 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1659 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:51.396799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:51.397412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:51.401340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:51.401951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:51.404669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:51.405164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:51.405610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:51.406315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:51.406789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:51.407224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:51.408387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:51.408890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:51.409337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:51.410050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:51.410512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:51.410963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:51.490697 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab8b98ef-efb2-4e54-b7c2-54382b37fd49 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action" status: 202 len: 0 microversion: 2.1 time: 0.093130 Aug 24 04:18:51.494598 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3019/6297] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:18:51 2022] POST /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:18:51.501923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:51.502694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:51.510474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:51.510981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:51.511707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:51.512538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:51.513016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:51.513440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:51.559682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:51.576645 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b06bf74b-10cc-4d5b-9bd5-557f6a50e7c0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.183477 Aug 24 04:18:51.577269 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3279/6298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:51 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:51.728042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:51.737674 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f0a89c5e-f526-4620-9255-3d03a7cef211 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1665 microversion: 2.1 time: 0.241663 Aug 24 04:18:51.738520 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3020/6299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:51 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1665 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:52.599197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:52.599863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:52.607092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:52.607573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:52.608029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:52.608755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:52.609207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:52.609632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:52.750440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:52.758463 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-404208c4-5ec4-4388-821f-81449f055237 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.163307 Aug 24 04:18:52.759054 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3280/6300] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:52 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:52.759467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:52.760061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:52.763307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:52.769539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:52.770061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:52.770498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:52.771199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:52.771677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:52.772180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:52.916046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:52.929917 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d27bcb04-eb48-4fe1-8a72-3de45bd2adf9 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1665 microversion: 2.1 time: 0.174002 Aug 24 04:18:52.930738 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3021/6301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:52 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1665 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:53.781807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:53.782527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:53.789899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:53.790394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:53.790843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:53.791546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:53.792046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:53.792589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:53.937522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:53.945617 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0fd4e53b-53c8-48da-adde-20c53d04ded9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.167764 Aug 24 04:18:53.946255 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3281/6302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:53 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:53.952045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:53.952702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:53.960542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:53.961094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:53.961498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:53.962211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:53.962673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:53.963107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:54.103078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:54.111638 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b031d10-77bd-468b-b797-470d3caf8fb2 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.163763 Aug 24 04:18:54.112228 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3022/6303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:53 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:54.132743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:54.133351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:54.139655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:54.140167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:54.140626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:54.141343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:54.141799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:54.142280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:54.310656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:54.318760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6a8e5086-a852-4f24-b233-422b92d80114 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1668 microversion: 2.1 time: 0.190127 Aug 24 04:18:54.319348 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3282/6304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:54 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:18:54.340644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:54.341128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:54.347394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:54.347937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:54.348379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:54.349065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:54.349514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:54.349938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:54.389309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:18:54.395764 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.api [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Working on deleting snapshot 82c50ed0-fa5e-43b6-ab01-b4f085fd1255 from shelved instance... Aug 24 04:18:54.966903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:54.967697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:54.976176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:54.976664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:54.977795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:54.978909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:54.979540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:54.980260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:55.007610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Doing local delete in cell a4fd8389-7871-477a-a6e5-d1946f0ded8f(cell1) {{(pid=122535) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 24 04:18:55.008361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:55.008846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:55.009284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:55.009711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.api [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 24 04:18:55.015199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] deallocate_for_instance() {{(pid=122535) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 24 04:18:55.136135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:55.144403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-04e03f16-b537-41ef-8a87-1f30e0a6874e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.181525 Aug 24 04:18:55.145039 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3283/6305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:54 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:55.533536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Updating instance_info_cache with network_info: [] {{(pid=122535) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 04:18:55.536090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-741984c8-161d-4ddc-a1ff-da8acfde3031 req-81b9b8a3-ac5b-4b31-ae5f-b6e9b3054cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff34e3d1-0d66-4263-9b17-a9852423f5db", "name": "network-vif-deleted", "tag": "ec778c34-01da-46ba-8d4c-e42c69666c5e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:55.544936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=60 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:55.549357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-741984c8-161d-4ddc-a1ff-da8acfde3031 req-81b9b8a3-ac5b-4b31-ae5f-b6e9b3054cb5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:55.549847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-741984c8-161d-4ddc-a1ff-da8acfde3031 req-81b9b8a3-ac5b-4b31-ae5f-b6e9b3054cb5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:55.550977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-741984c8-161d-4ddc-a1ff-da8acfde3031 req-81b9b8a3-ac5b-4b31-ae5f-b6e9b3054cb5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:55.565818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.compute.server_external_events [req-741984c8-161d-4ddc-a1ff-da8acfde3031 req-81b9b8a3-ac5b-4b31-ae5f-b6e9b3054cb5 service nova] Unable to find a host for instance ff34e3d1-0d66-4263-9b17-a9852423f5db. Dropping event network-vif-deleted {{(pid=122536) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 04:18:55.566919 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-741984c8-161d-4ddc-a1ff-da8acfde3031 req-81b9b8a3-ac5b-4b31-ae5f-b6e9b3054cb5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.034745 Aug 24 04:18:55.567755 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3284/6306] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 04:18:55.781941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=16,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:55.798336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8136c73d-d564-40d9-b618-16e287bf1729 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 204 len: 0 microversion: 2.1 time: 1.461882 Aug 24 04:18:55.799090 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3023/6307] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:18:54 2022] DELETE /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 0 bytes in 1463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:55.807541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:55.808235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: ff34e3d1-0d66-4263-9b17-a9852423f5db] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:55.814652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:55.815142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:55.815581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:55.816401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:55.816806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:55.817255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:55.832271 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] HTTP exception thrown: Instance ff34e3d1-0d66-4263-9b17-a9852423f5db could not be found. Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Request method failure captured: Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db HTTP/1.1 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaS1r6hk_54d5Fowo6qEH4lsorCdRVMQPDbywiekyuxytw6-jp0qNJFu-DWZy1VZS9KXSPHunAHvjYYFCYg_K68zFYmHmSYHsiMrPuFgfoXKlyVRdR37Q22etS8CC611DA9BcEGlPu1LDFMYsP1H7z6ec65Rlf7Ooj6Zk7hfrBOShKg Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-663356641 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: bbc89071f3d44e14ac21298ac15d7c33 Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance ff34e3d1-0d66-4263-9b17-a9852423f5db could not be found. Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'ff34e3d1-0d66-4263-9b17-a9852423f5db'} Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff34e3d1-0d66-4263-9b17-a9852423f5db could not be found. Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff34e3d1-0d66-4263-9b17-a9852423f5db could not be found. Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:18:55.833972 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff34e3d1-0d66-4263-9b17-a9852423f5db could not be found. Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Returning 404 to user: Instance ff34e3d1-0d66-4263-9b17-a9852423f5db could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d51673f1-9407-459c-8752-d5901a799cd1 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db" status: 404 len: 111 microversion: 2.1 time: 0.031877 Aug 24 04:18:55.839115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3285/6308] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:55 2022] GET /compute/v2.1/servers/ff34e3d1-0d66-4263-9b17-a9852423f5db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:18:55.845275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:55.845781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:55.854347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:55.855000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:55.855866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:55.856427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:55.856691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:55.857128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:55.884715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:18:55.971742 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-29047317-0685-4cf8-9abc-a5bd2a7244d5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 204 len: 0 microversion: 2.1 time: 0.130390 Aug 24 04:18:55.972646 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3024/6309] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:18:55 2022] DELETE /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:55.981729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:55.982337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:55.989230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:55.989715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:55.990168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:55.990889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:55.991375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:55.991854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:56.096035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:56.110732 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d7616bce-8b17-401d-a801-a06ab5c71d29 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1467 microversion: 2.1 time: 0.133144 Aug 24 04:18:56.111287 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3286/6310] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:55 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1467 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:56.166786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:56.167813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:56.174435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:56.174932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:56.175369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:56.176100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:56.176552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:56.177278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:56.323610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:56.336311 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-38a68a0c-d13e-4eea-ab8f-1c46e1428a2f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.173856 Aug 24 04:18:56.337123 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3025/6311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:56 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:56.771310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-933672ae-4b52-4681-b562-9bb825a68464 req-b722876e-c099-4a48-b054-739991db9076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f656b1-c72d-490c-bd9a-c5a7937dce39", "name": "network-vif-plugged", "status": "completed", "tag": "e5ca7507-2282-4e39-9971-06863bdc8341"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:56.783538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-933672ae-4b52-4681-b562-9bb825a68464 req-b722876e-c099-4a48-b054-739991db9076 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:56.784203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-933672ae-4b52-4681-b562-9bb825a68464 req-b722876e-c099-4a48-b054-739991db9076 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:56.784635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-933672ae-4b52-4681-b562-9bb825a68464 req-b722876e-c099-4a48-b054-739991db9076 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:56.799215 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-933672ae-4b52-4681-b562-9bb825a68464 req-b722876e-c099-4a48-b054-739991db9076 service nova] Creating event network-vif-plugged:e5ca7507-2282-4e39-9971-06863bdc8341 for instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 on n-h1-846470-15 Aug 24 04:18:56.806490 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-933672ae-4b52-4681-b562-9bb825a68464 req-b722876e-c099-4a48-b054-739991db9076 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038883 Aug 24 04:18:56.807371 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3287/6312] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:18:57.135587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:57.136353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:57.143891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:57.144385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:57.144831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:57.145565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:57.146022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:57.146449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:57.239173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:57.254455 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7abfb00b-6081-4f7c-b70b-d6e93b649a6d tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1467 microversion: 2.1 time: 0.123953 Aug 24 04:18:57.255725 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3026/6313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:57 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1467 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:57.360958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:57.362030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:57.372408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:57.372925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:57.373363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:57.374067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:57.374524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:57.374948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:57.528330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:57.536984 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa9c5c49-2ffe-4394-bec1-e474e7f11537 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1202 microversion: 2.1 time: 0.181054 Aug 24 04:18:57.537640 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3288/6314] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:57 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:58.274082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f77c96dd-0e8b-4a3f-a778-7df9736d17b4 req-64ae26f2-2b01-4514-ab96-01898b3a5b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4954ad56-4dc1-44c0-8410-07426be94cf9", "name": "network-vif-deleted", "tag": "1930fb6c-a163-4eee-aa40-e74b0b48975f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:18:58.289484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:58.292586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:58.305493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.306430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.306833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f77c96dd-0e8b-4a3f-a778-7df9736d17b4 req-64ae26f2-2b01-4514-ab96-01898b3a5b4b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.307220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:58.308491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f77c96dd-0e8b-4a3f-a778-7df9736d17b4 req-64ae26f2-2b01-4514-ab96-01898b3a5b4b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.308746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.309435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f77c96dd-0e8b-4a3f-a778-7df9736d17b4 req-64ae26f2-2b01-4514-ab96-01898b3a5b4b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:58.309570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.310410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:58.334565 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f77c96dd-0e8b-4a3f-a778-7df9736d17b4 req-64ae26f2-2b01-4514-ab96-01898b3a5b4b service nova] Creating event network-vif-deleted:1930fb6c-a163-4eee-aa40-e74b0b48975f for instance 4954ad56-4dc1-44c0-8410-07426be94cf9 on n-h2-846470-15 Aug 24 04:18:58.340814 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f77c96dd-0e8b-4a3f-a778-7df9736d17b4 req-64ae26f2-2b01-4514-ab96-01898b3a5b4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076472 Aug 24 04:18:58.342468 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3027/6315] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:18:58.422946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:58.438238 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-04502b24-e876-4135-93ac-1e1bb4728025 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 200 len: 1300 microversion: 2.1 time: 0.162999 Aug 24 04:18:58.440645 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3289/6316] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:58 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 1300 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:58.558936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:58.562451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:58.570093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.570578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.571206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:58.572086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.574058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.574633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:58.725912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:58.735169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-80475869-069d-4d71-b600-4208f0abea38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1389 microversion: 2.1 time: 0.180271 Aug 24 04:18:58.735795 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3028/6317] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:58 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1389 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:58.763915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:58.764614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:58.770980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.771474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.771932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:58.772676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.773175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.773774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:58.930891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:58.939575 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8fb7119-e919-4435-9e3f-0b88ac402d69 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1389 microversion: 2.1 time: 0.180295 Aug 24 04:18:58.940213 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3290/6318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:58 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1389 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:58.960819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:58.961160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:58.968123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.968642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.969110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:58.969972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:58.970446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:58.970904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.119581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:59.128784 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-885ab154-83e6-48a5-ae14-54883ae08b6a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1389 microversion: 2.1 time: 0.172700 Aug 24 04:18:59.129367 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3029/6319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:58 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1389 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:59.150547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:59.151407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:59.161108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.161982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.162581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.163623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.164235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.164670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.199379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:18:59.240602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:59.288780 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e33f224-f3b1-4aff-a5c3-c088049ac266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 204 len: 0 microversion: 2.1 time: 0.143065 Aug 24 04:18:59.289681 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3291/6320] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:18:59 2022] DELETE /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:59.301318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:59.302000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:59.312356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.312852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.313309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.314034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.314497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.314928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.462293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:59.463285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:59.464025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 4954ad56-4dc1-44c0-8410-07426be94cf9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:59.470795 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02b20863-f3d5-4433-92b7-e84e51bfee66 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1395 microversion: 2.1 time: 0.175848 Aug 24 04:18:59.471096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.471402 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3030/6321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:59 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1395 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:59.471577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.472058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.472778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.473263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.473689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.490560 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] HTTP exception thrown: Instance 4954ad56-4dc1-44c0-8410-07426be94cf9 could not be found. Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Request method failure captured: Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 HTTP/1.1 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaS1r6hk_54d5Fowo6qEH4lsorCdRVMQPDbywiekyuxytw6-jp0qNJFu-DWZy1VZS9KXSPHunAHvjYYFCYg_K68zFYmHmSYHsiMrPuFgfoXKlyVRdR37Q22etS8CC611DA9BcEGlPu1LDFMYsP1H7z6ec65Rlf7Ooj6Zk7hfrBOShKg Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-663356641 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: bbc89071f3d44e14ac21298ac15d7c33 Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 4954ad56-4dc1-44c0-8410-07426be94cf9 could not be found. Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '4954ad56-4dc1-44c0-8410-07426be94cf9'} Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4954ad56-4dc1-44c0-8410-07426be94cf9 could not be found. Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4954ad56-4dc1-44c0-8410-07426be94cf9 could not be found. Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:18:59.492408 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4954ad56-4dc1-44c0-8410-07426be94cf9 could not be found. Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Returning 404 to user: Instance 4954ad56-4dc1-44c0-8410-07426be94cf9 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55e8c5a6-3bcf-485c-9cde-1b5c5082b072 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9" status: 404 len: 111 microversion: 2.1 time: 0.035107 Aug 24 04:18:59.496911 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3292/6322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:59 2022] GET /compute/v2.1/servers/4954ad56-4dc1-44c0-8410-07426be94cf9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:18:59.504300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:59.504834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:59.511790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.512305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.512755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.513521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.514099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.514527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.541909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:18:59.642715 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b3dcf20b-c0b1-4d1c-a176-9b4f4969720f tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 204 len: 0 microversion: 2.1 time: 0.142344 Aug 24 04:18:59.643700 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3031/6323] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:18:59 2022] DELETE /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:59.657051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:18:59.658188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:18:59.666770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.667290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.667768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.668495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:18:59.668948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:18:59.669889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:18:59.816030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:18:59.824718 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-501d330c-542f-4a9b-8efb-782731eb9f37 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1507 microversion: 2.1 time: 0.176439 Aug 24 04:18:59.825464 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3293/6324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:18:59 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:00.496294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:00.497359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:00.509470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:00.510328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:00.511103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:00.512172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:00.512814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:00.513382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:00.667128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:00.675805 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d61c8b66-be44-436e-a839-f8bdef747d36 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1395 microversion: 2.1 time: 0.186046 Aug 24 04:19:00.676405 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3032/6325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:00 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1395 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:00.846894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:00.847493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:00.855385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:00.855916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:00.856396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:00.857265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:00.857743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:00.858193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:01.005865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:01.015194 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fdb1be7-a393-4501-88a1-5bc8f4bb8066 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1507 microversion: 2.1 time: 0.172371 Aug 24 04:19:01.015841 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3294/6326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:00 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:01.699060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:01.700041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:01.709804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:01.710316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:01.710767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:01.711515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:01.712012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:01.712454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:02.038510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:02.039117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:02.044531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:02.046956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:02.047710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:02.048150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:02.048898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:02.049365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:02.049795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:02.056095 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c9ebba0-444a-4225-8fed-fdebceaec58d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1395 microversion: 2.1 time: 0.362043 Aug 24 04:19:02.056776 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3033/6327] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:01 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1395 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:02.207221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:02.215553 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef577972-c241-462b-b291-6828c0101a23 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 200 len: 1507 microversion: 2.1 time: 0.181011 Aug 24 04:19:02.219828 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3295/6328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:02 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:02.335250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7ded928f-9779-4b41-9b3e-76b87ba3e71d req-ba69b054-fe41-4162-8535-d1adfcff3ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f656b1-c72d-490c-bd9a-c5a7937dce39", "name": "network-vif-deleted", "tag": "e5ca7507-2282-4e39-9971-06863bdc8341"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:02.349018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7ded928f-9779-4b41-9b3e-76b87ba3e71d req-ba69b054-fe41-4162-8535-d1adfcff3ecd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:02.349997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7ded928f-9779-4b41-9b3e-76b87ba3e71d req-ba69b054-fe41-4162-8535-d1adfcff3ecd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:02.350446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7ded928f-9779-4b41-9b3e-76b87ba3e71d req-ba69b054-fe41-4162-8535-d1adfcff3ecd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:02.364213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7ded928f-9779-4b41-9b3e-76b87ba3e71d req-ba69b054-fe41-4162-8535-d1adfcff3ecd service nova] Creating event network-vif-deleted:e5ca7507-2282-4e39-9971-06863bdc8341 for instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 on n-h1-846470-15 Aug 24 04:19:02.371325 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7ded928f-9779-4b41-9b3e-76b87ba3e71d req-ba69b054-fe41-4162-8535-d1adfcff3ecd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041717 Aug 24 04:19:02.373031 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3034/6329] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:03.090624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:03.092894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:03.103445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:03.104606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:03.105593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:03.107290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:03.108326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:03.109270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:03.190459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:03.200105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-33a85570-ba43-4be2-84cb-145c84f4e7be tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1187 microversion: 2.1 time: 0.125382 Aug 24 04:19:03.200865 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3296/6330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:03 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1187 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:03.237968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:03.238588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: d5901d7e-3d59-48a4-baee-02b93e921f35] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:03.246375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:03.246898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:03.248031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:03.248338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:03.248790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:03.249215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:03.268143 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] HTTP exception thrown: Instance d5901d7e-3d59-48a4-baee-02b93e921f35 could not be found. Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Request method failure captured: Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 HTTP/1.1 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaS1r6hk_54d5Fowo6qEH4lsorCdRVMQPDbywiekyuxytw6-jp0qNJFu-DWZy1VZS9KXSPHunAHvjYYFCYg_K68zFYmHmSYHsiMrPuFgfoXKlyVRdR37Q22etS8CC611DA9BcEGlPu1LDFMYsP1H7z6ec65Rlf7Ooj6Zk7hfrBOShKg Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: bbc89071f3d44e14ac21298ac15d7c33 Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance d5901d7e-3d59-48a4-baee-02b93e921f35 could not be found. Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd5901d7e-3d59-48a4-baee-02b93e921f35'} Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5901d7e-3d59-48a4-baee-02b93e921f35 could not be found. Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5901d7e-3d59-48a4-baee-02b93e921f35 could not be found. Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:03.269825 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5901d7e-3d59-48a4-baee-02b93e921f35 could not be found. Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Returning 404 to user: Instance d5901d7e-3d59-48a4-baee-02b93e921f35 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fa209401-3671-4ecb-92d9-a4f2d46514d8 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35" status: 404 len: 111 microversion: 2.1 time: 0.038108 Aug 24 04:19:03.275978 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3035/6331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:03 2022] GET /compute/v2.1/servers/d5901d7e-3d59-48a4-baee-02b93e921f35 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:19:03.282067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:03.282693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:03.290063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:03.290643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:03.291091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:03.291849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:03.292315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:03.292751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:03.322141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:19:03.423022 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0cb8ec8b-5fbc-4350-a6ec-b43a182e5b86 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 204 len: 0 microversion: 2.1 time: 0.145212 Aug 24 04:19:03.427766 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3297/6332] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:19:03 2022] DELETE /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:19:03.432485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:03.433173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:03.440610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:03.441107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:03.441544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:03.442258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:03.442891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:03.443489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:03.586048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:03.595129 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81a18bfe-5ac0-4c71-8910-a7f601d9e1a5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1494 microversion: 2.1 time: 0.166687 Aug 24 04:19:03.596057 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3036/6333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:03 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1494 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:04.222596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:04.223596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:04.231046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.231643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.232419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.233753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.234244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.234729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.305230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:04.314282 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa382beb-1734-4d4a-9145-78c5bfa584d2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1187 microversion: 2.1 time: 0.096268 Aug 24 04:19:04.314978 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3298/6334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:04 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:04.396522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a17634c7-bb37-4723-987d-c527b575f78d req-ce76f45b-9965-4fbc-9bdb-4072713ded1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5901d7e-3d59-48a4-baee-02b93e921f35", "name": "network-vif-deleted", "tag": "205cf9a4-a1f3-4b4e-b415-3d6ae0a96cf3"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:04.408209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a17634c7-bb37-4723-987d-c527b575f78d req-ce76f45b-9965-4fbc-9bdb-4072713ded1e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.408961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a17634c7-bb37-4723-987d-c527b575f78d req-ce76f45b-9965-4fbc-9bdb-4072713ded1e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.409717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a17634c7-bb37-4723-987d-c527b575f78d req-ce76f45b-9965-4fbc-9bdb-4072713ded1e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.423298 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a17634c7-bb37-4723-987d-c527b575f78d req-ce76f45b-9965-4fbc-9bdb-4072713ded1e service nova] Creating event network-vif-deleted:205cf9a4-a1f3-4b4e-b415-3d6ae0a96cf3 for instance d5901d7e-3d59-48a4-baee-02b93e921f35 on n-h2-846470-15 Aug 24 04:19:04.429103 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a17634c7-bb37-4723-987d-c527b575f78d req-ce76f45b-9965-4fbc-9bdb-4072713ded1e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036558 Aug 24 04:19:04.430167 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3299/6335] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:04.523830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:04.524353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:04.531181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.531708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.532155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.532863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.533326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.533755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.564021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:19:04.600506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:DELETE=2,nova_cell1:SELECT=92,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:04.625265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:04.626455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:04.634240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.635130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.636105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.637058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.637789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.638706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.671262 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ba2a5b4-c715-4a5b-851a-ff2f18f34fea tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "DELETE /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 204 len: 0 microversion: 2.1 time: 0.377245 Aug 24 04:19:04.671916 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3037/6336] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:19:04 2022] DELETE /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:19:04.680929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:04.681656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:04.689123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.689622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.690056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.690761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:04.691207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:04.691786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:04.798270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:04.807742 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0678d05d-29da-4ec2-a628-9fe5ea82aae5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1494 microversion: 2.1 time: 0.193802 Aug 24 04:19:04.808433 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3300/6337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:04 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1494 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:04.864401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:04.872514 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a105428d-4095-41dc-b971-be2cdc4ef7fb tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1731 microversion: 2.1 time: 0.196137 Aug 24 04:19:04.873304 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3038/6338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:04 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:05.337706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:05.339492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:05.349865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:05.350713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:05.351345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:05.352286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:05.352936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:05.353555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:05.463407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:05.473328 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a9e6b7e-49c5-426e-ba78-97cd49107eee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1187 microversion: 2.1 time: 0.140290 Aug 24 04:19:05.474598 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3301/6339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:05 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1187 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:05.829823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:05.830847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:05.838920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:05.839541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:05.840035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:05.840893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:05.841615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:05.842166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:05.879467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:05.879985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:05.880424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:05.881395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lazy-loading 'fault' on Instance uuid b4682e34-7b8a-4251-8259-ddceebb605cd {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:19:05.894940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:05.896292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:05.903195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:05.904598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:05.905130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:05.906328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:05.906730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:05.907236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:05.974389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:05.990627 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-313e5de9-8cf8-43df-b5fb-2f965a9fdc31 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 200 len: 1304 microversion: 2.1 time: 0.163970 Aug 24 04:19:05.992759 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3039/6340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:05 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:06.062847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:06.076883 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-017f1d5b-3b22-4b42-959f-96a82ab02fa6 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1731 microversion: 2.1 time: 0.184927 Aug 24 04:19:06.078657 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3302/6341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:05 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:06.470840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-67e3a703-8125-44d1-a648-70e94dca32cc req-c24bc448-d812-4d6c-bbba-0f71cfbfc081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4682e34-7b8a-4251-8259-ddceebb605cd", "name": "network-vif-deleted", "tag": "20795ab5-c5c9-4e7e-89b7-403b9f4398d7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:06.482908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-67e3a703-8125-44d1-a648-70e94dca32cc req-c24bc448-d812-4d6c-bbba-0f71cfbfc081 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:06.483455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-67e3a703-8125-44d1-a648-70e94dca32cc req-c24bc448-d812-4d6c-bbba-0f71cfbfc081 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:06.484180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-67e3a703-8125-44d1-a648-70e94dca32cc req-c24bc448-d812-4d6c-bbba-0f71cfbfc081 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:06.496980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:06.497807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:06.500300 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-67e3a703-8125-44d1-a648-70e94dca32cc req-c24bc448-d812-4d6c-bbba-0f71cfbfc081 service nova] Creating event network-vif-deleted:20795ab5-c5c9-4e7e-89b7-403b9f4398d7 for instance b4682e34-7b8a-4251-8259-ddceebb605cd on n-h1-846470-15 Aug 24 04:19:06.505286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:06.506062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:06.506668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:06.507558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:06.508286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:06.508891 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-67e3a703-8125-44d1-a648-70e94dca32cc req-c24bc448-d812-4d6c-bbba-0f71cfbfc081 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041778 Aug 24 04:19:06.509120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:06.510031 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3040/6342] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:06.588180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:06.596687 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cda38eea-f912-4ae8-a921-db4e80275f4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1187 microversion: 2.1 time: 0.104136 Aug 24 04:19:06.597345 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3303/6343] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:06 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:07.017307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:07.018927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: b4682e34-7b8a-4251-8259-ddceebb605cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:07.029869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.030822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.032066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.032916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.033638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.034360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.051187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] HTTP exception thrown: Instance b4682e34-7b8a-4251-8259-ddceebb605cd could not be found. Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Request method failure captured: Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd HTTP/1.1 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaS1r6hk_54d5Fowo6qEH4lsorCdRVMQPDbywiekyuxytw6-jp0qNJFu-DWZy1VZS9KXSPHunAHvjYYFCYg_K68zFYmHmSYHsiMrPuFgfoXKlyVRdR37Q22etS8CC611DA9BcEGlPu1LDFMYsP1H7z6ec65Rlf7Ooj6Zk7hfrBOShKg Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: bbc89071f3d44e14ac21298ac15d7c33 Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance b4682e34-7b8a-4251-8259-ddceebb605cd could not be found. Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'b4682e34-7b8a-4251-8259-ddceebb605cd'} Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4682e34-7b8a-4251-8259-ddceebb605cd could not be found. Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4682e34-7b8a-4251-8259-ddceebb605cd could not be found. Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:07.053001 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4682e34-7b8a-4251-8259-ddceebb605cd could not be found. Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Returning 404 to user: Instance b4682e34-7b8a-4251-8259-ddceebb605cd could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b74a362c-680f-4333-b481-44edc7991dce tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd" status: 404 len: 111 microversion: 2.1 time: 0.045234 Aug 24 04:19:07.057169 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3041/6344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:07 2022] GET /compute/v2.1/servers/b4682e34-7b8a-4251-8259-ddceebb605cd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:19:07.072667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:07.073383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:07.081513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.082041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.082474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.083420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.083930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.084360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.101425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:07.102205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:07.109143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.109756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.110312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.111123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.111649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.112315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.117033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:19:07.150668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.151266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.151805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.152409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lazy-loading 'fault' on Instance uuid 19872732-a66c-4260-9b3b-5b9b9d63244c {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:19:07.213944 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6237a7dd-28f7-45d4-8095-5cd37d58e9e0 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "DELETE /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 204 len: 0 microversion: 2.1 time: 0.152798 Aug 24 04:19:07.215756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912e2ffef1da4908ba0d1bd92920e939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754b63504b3f4a20b00c958e82d95d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:07.220004 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3304/6345] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:19:07 2022] DELETE /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:19:07.227855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:07.229219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:07.229799 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7981b7b7-91ff-4958-9f2a-4b1a30c99afa tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 200 len: 1387 microversion: 2.1 time: 0.132372 Aug 24 04:19:07.237340 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3042/6346] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:07 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 1387 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:19:07.237546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.237546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.237546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.237546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.237955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.238077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.396782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:07.399350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:07.407070 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-38af159c-251b-437c-856e-6c254d52cf7a tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1674 microversion: 2.1 time: 0.186041 Aug 24 04:19:07.407673 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3305/6347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:07 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:07.618667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:07.619294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:07.627404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.627940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.628388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.629123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.629827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.630488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.677200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:07.677785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:07.678228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:07.678686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lazy-loading 'fault' on Instance uuid c8f656b1-c72d-490c-bd9a-c5a7937dce39 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:19:07.728846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:07.740337 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a9eb3c2-446b-47e3-b51b-b5310e73792c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 200 len: 1146 microversion: 2.1 time: 0.125570 Aug 24 04:19:07.741374 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3043/6348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:07 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 1146 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:08.253910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:08.254553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:08.263499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.263962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.264444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.265211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.265661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.266123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.282950 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] HTTP exception thrown: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Request method failure captured: Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c HTTP/1.1 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaVSk7UDCYyDnmcQgfaIFpuU65hshWttwcqxNhoNsU37267UfHZAAHu9AsSmeR07CJNzxIFZS2x_ZT-ilF3ekiSnAawNnT6TA-KWyvp9-71XSugWdu7Gbp7QNJ8eJ8nEboNfBGYAFXSSzbWP_spmJmMkBV8XQUCHZpfayf2SPURaBYw Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 754b63504b3f4a20b00c958e82d95d12 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestServerBasicOps-269934336 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestServerBasicOps-269934336 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 754b63504b3f4a20b00c958e82d95d12 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestServerBasicOps-269934336 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestServerBasicOps-269934336-project Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 912e2ffef1da4908ba0d1bd92920e939 Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestServerBasicOps-269934336-project Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '19872732-a66c-4260-9b3b-5b9b9d63244c'} Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:08.284814 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Returning 404 to user: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b89a0fa7-5855-4dfd-9d37-df875c7ee012 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 404 len: 111 microversion: 2.1 time: 0.037300 Aug 24 04:19:08.290415 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3306/6349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:08 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:19:08.428923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:08.429538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:08.437520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.438144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.438681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.439470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.440018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.440448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.531149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-8cbdfa5f-ca10-451c-92ce-1a9cd8b65b07 req-35529f48-ab46-447b-be08-4ed2dfd69585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19872732-a66c-4260-9b3b-5b9b9d63244c", "name": "network-vif-deleted", "tag": "0deab4a6-e41c-4bef-9467-b4f65ceaee0a"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:08.541684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cbdfa5f-ca10-451c-92ce-1a9cd8b65b07 req-35529f48-ab46-447b-be08-4ed2dfd69585 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.542308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cbdfa5f-ca10-451c-92ce-1a9cd8b65b07 req-35529f48-ab46-447b-be08-4ed2dfd69585 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.542808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cbdfa5f-ca10-451c-92ce-1a9cd8b65b07 req-35529f48-ab46-447b-be08-4ed2dfd69585 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.556995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-8cbdfa5f-ca10-451c-92ce-1a9cd8b65b07 req-35529f48-ab46-447b-be08-4ed2dfd69585 service nova] Creating event network-vif-deleted:0deab4a6-e41c-4bef-9467-b4f65ceaee0a for instance 19872732-a66c-4260-9b3b-5b9b9d63244c on n-h1-846470-15 Aug 24 04:19:08.562145 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-8cbdfa5f-ca10-451c-92ce-1a9cd8b65b07 req-35529f48-ab46-447b-be08-4ed2dfd69585 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035121 Aug 24 04:19:08.562764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3307/6350] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:08.670349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:08.681805 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0edb4f9c-f279-4cc5-a701-3152ad9d20c5 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1674 microversion: 2.1 time: 0.257080 Aug 24 04:19:08.682846 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3044/6351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:08 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1674 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:08.765613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:08.767348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: c8f656b1-c72d-490c-bd9a-c5a7937dce39] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:08.777952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.778987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.779976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.781562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.782383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.783173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.810334 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 could not be found. Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 HTTP/1.1 Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 could not be found. Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'c8f656b1-c72d-490c-bd9a-c5a7937dce39'} Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 could not be found. Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 could not be found. Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:08.813721 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 could not be found. Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance c8f656b1-c72d-490c-bd9a-c5a7937dce39 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e9e42f0-5829-49b7-a41f-96a1caac9e1b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39" status: 404 len: 111 microversion: 2.1 time: 0.056002 Aug 24 04:19:08.828505 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3308/6352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:08 2022] GET /compute/v2.1/servers/c8f656b1-c72d-490c-bd9a-c5a7937dce39 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:19:08.920949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:08.921933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:08.929437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.930172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.930826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.931555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.932240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.932902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.949046 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] HTTP exception thrown: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Request method failure captured: Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c HTTP/1.1 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaVSk7UDCYyDnmcQgfaIFpuU65hshWttwcqxNhoNsU37267UfHZAAHu9AsSmeR07CJNzxIFZS2x_ZT-ilF3ekiSnAawNnT6TA-KWyvp9-71XSugWdu7Gbp7QNJ8eJ8nEboNfBGYAFXSSzbWP_spmJmMkBV8XQUCHZpfayf2SPURaBYw Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 754b63504b3f4a20b00c958e82d95d12 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestServerBasicOps-269934336 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestServerBasicOps-269934336 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 754b63504b3f4a20b00c958e82d95d12 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestServerBasicOps-269934336 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestServerBasicOps-269934336-project Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 912e2ffef1da4908ba0d1bd92920e939 Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestServerBasicOps-269934336-project Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '19872732-a66c-4260-9b3b-5b9b9d63244c'} Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:08.951025 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:08.956222 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:08.957843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Returning 404 to user: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:08.958922 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8448ecf3-5ac9-452c-a452-e09a471a5a52 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "DELETE /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 404 len: 111 microversion: 2.1 time: 0.042773 Aug 24 04:19:08.963509 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3045/6353] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:19:08 2022] DELETE /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:19:08.973805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:08.974694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] [instance: 19872732-a66c-4260-9b3b-5b9b9d63244c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:08.983948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.984790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.985561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:08.986767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:08.987585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:08.988385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:09.011026 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] HTTP exception thrown: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Request method failure captured: Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c HTTP/1.1 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaVSk7UDCYyDnmcQgfaIFpuU65hshWttwcqxNhoNsU37267UfHZAAHu9AsSmeR07CJNzxIFZS2x_ZT-ilF3ekiSnAawNnT6TA-KWyvp9-71XSugWdu7Gbp7QNJ8eJ8nEboNfBGYAFXSSzbWP_spmJmMkBV8XQUCHZpfayf2SPURaBYw Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 754b63504b3f4a20b00c958e82d95d12 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestServerBasicOps-269934336 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/754b63504b3f4a20b00c958e82d95d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestServerBasicOps-269934336 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 754b63504b3f4a20b00c958e82d95d12 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestServerBasicOps-269934336 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestServerBasicOps-269934336-project Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 912e2ffef1da4908ba0d1bd92920e939 Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestServerBasicOps-269934336-project Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '19872732-a66c-4260-9b3b-5b9b9d63244c'} Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:09.013443 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Returning 404 to user: Instance 19872732-a66c-4260-9b3b-5b9b9d63244c could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:09.021881 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a75dd927-2baf-4692-9630-44f9a513273d tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c" status: 404 len: 111 microversion: 2.1 time: 0.049825 Aug 24 04:19:09.027645 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3309/6354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:08 2022] GET /compute/v2.1/servers/19872732-a66c-4260-9b3b-5b9b9d63244c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:19:09.209460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c82ba87c-23b4-46de-bb4d-9136cdb7d090 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] Calling method '.version_select at 0x7f1029f52dc0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:09.241981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c82ba87c-23b4-46de-bb4d-9136cdb7d090 tempest-TestServerBasicOps-269934336 tempest-TestServerBasicOps-269934336-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-879432176" status: 202 len: 0 microversion: 2.1 time: 0.036522 Aug 24 04:19:09.252105 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3046/6355] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 04:19:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-879432176 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:19:09.714692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:09.717223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:09.728316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:09.729284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:09.729948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:09.733936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:09.734728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:09.735338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:09.880513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:09.901853 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5249563-9e1e-4432-bf4e-3c4729392906 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1607 microversion: 2.1 time: 0.192534 Aug 24 04:19:09.917961 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3310/6356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:09 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1607 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:10.579883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-00f5e40f-2d96-485a-aa18-73136e943c72 req-9c85744f-4453-42e0-9941-c5b3d2deef13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ef27b8-4d47-4c22-8f03-87d9d7b2e883", "name": "network-vif-deleted", "tag": "0654d4ee-9efe-4076-a91a-1a3daf61fa18"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:10.592443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-00f5e40f-2d96-485a-aa18-73136e943c72 req-9c85744f-4453-42e0-9941-c5b3d2deef13 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:10.593237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-00f5e40f-2d96-485a-aa18-73136e943c72 req-9c85744f-4453-42e0-9941-c5b3d2deef13 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:10.593900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-00f5e40f-2d96-485a-aa18-73136e943c72 req-9c85744f-4453-42e0-9941-c5b3d2deef13 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:10.606360 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-00f5e40f-2d96-485a-aa18-73136e943c72 req-9c85744f-4453-42e0-9941-c5b3d2deef13 service nova] Creating event network-vif-deleted:0654d4ee-9efe-4076-a91a-1a3daf61fa18 for instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 on n-h2-846470-15 Aug 24 04:19:10.613579 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-00f5e40f-2d96-485a-aa18-73136e943c72 req-9c85744f-4453-42e0-9941-c5b3d2deef13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039091 Aug 24 04:19:10.614925 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3047/6357] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:10.926291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:10.926900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:10.936068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:10.936890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:10.937523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:10.938404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:10.939036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:10.939624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:10.974231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:10.974987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:10.975582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:10.976243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lazy-loading 'fault' on Instance uuid 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:19:11.075400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc89071f3d44e14ac21298ac15d7c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f788bb5b144dc4ba4c2583b50165f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:11.091124 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-45e4fc2a-deab-433c-88cf-35769c7bed05 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 200 len: 1327 microversion: 2.1 time: 0.166691 Aug 24 04:19:11.094185 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3311/6358] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:10 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 1327 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:12.119131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:12.120112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] [instance: 05ef27b8-4d47-4c22-8f03-87d9d7b2e883] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:12.128308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:12.128930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:12.129443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:12.130167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:12.130631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:12.131097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:12.149249 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] HTTP exception thrown: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 could not be found. Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Request method failure captured: Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 HTTP/1.1 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaS1r6hk_54d5Fowo6qEH4lsorCdRVMQPDbywiekyuxytw6-jp0qNJFu-DWZy1VZS9KXSPHunAHvjYYFCYg_K68zFYmHmSYHsiMrPuFgfoXKlyVRdR37Q22etS8CC611DA9BcEGlPu1LDFMYsP1H7z6ec65Rlf7Ooj6Zk7hfrBOShKg Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3f788bb5b144dc4ba4c2583b50165f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: f3f788bb5b144dc4ba4c2583b50165f6 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-663356641 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: bbc89071f3d44e14ac21298ac15d7c33 Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-663356641-project Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 could not be found. Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '05ef27b8-4d47-4c22-8f03-87d9d7b2e883'} Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 could not be found. Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 could not be found. Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:12.151030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:12.156873 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:12.156873 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:12.156873 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:12.156873 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:12.156873 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:12.156873 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 could not be found. Aug 24 04:19:12.156873 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:12.158544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Returning 404 to user: Instance 05ef27b8-4d47-4c22-8f03-87d9d7b2e883 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:12.159718 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c7c7fb3-f449-4fcf-953b-908b79007ce4 tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883" status: 404 len: 111 microversion: 2.1 time: 0.049051 Aug 24 04:19:12.160535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3048/6359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:12 2022] GET /compute/v2.1/servers/05ef27b8-4d47-4c22-8f03-87d9d7b2e883 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:19:12.170208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb730de3-538f-4425-9247-0f7fc8f2d8cc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] Calling method '.version_select at 0x7f1022803040>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:12.206468 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bb730de3-538f-4425-9247-0f7fc8f2d8cc tempest-ServerActionsTestJSON-663356641 tempest-ServerActionsTestJSON-663356641-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650904832" status: 202 len: 0 microversion: 2.1 time: 0.040797 Aug 24 04:19:12.212378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3312/6360] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 04:19:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650904832 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:19:16.486379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-98091557", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "882d03e0-7ad5-496e-926e-736b062fcd5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9935c908-0959-4c8b-be4e-161d3600b222"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:16.571571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] validate_networks() for [('9935c908-0959-4c8b-be4e-161d3600b222', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:19:17.726988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:19:17.727699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:19:17.727980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:19:17.728389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:19:17.729179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:19:17.748381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:17.749135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:17.749732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:17.750665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:17.760397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:17.761165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:17.802109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:19:17.816194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:19:17.837930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:17.952330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:19:17.955034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='882d03e0-7ad5-496e-926e-736b062fcd5d',volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:19:18.194541 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be044294-8c1f-4095-aaa6-948c148bf064 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714322 Aug 24 04:19:18.195380 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3049/6361] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:19:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:19:18.209183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1529b71-1aaf-43c5-9f1d-f4ad99310409 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:18.210549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1529b71-1aaf-43c5-9f1d-f4ad99310409 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:18.360590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f1529b71-1aaf-43c5-9f1d-f4ad99310409 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:18.372758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1529b71-1aaf-43c5-9f1d-f4ad99310409 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1055 microversion: 2.1 time: 0.168577 Aug 24 04:19:18.376311 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3313/6362] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:18 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1055 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:19.398992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:19.400306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:19.413186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:19.413735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:19.414266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:19.415060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:19.415583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:19.416527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:19.509417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:19.520008 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-30ab1415-784d-461d-8e29-e1555e9a5325 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1097 microversion: 2.1 time: 0.127245 Aug 24 04:19:19.521013 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3050/6363] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:19 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1097 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:20.470306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-548770437", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": "none"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:20.548064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:20.549355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:20.578031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:19:20.580142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:20.581370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:19:20.582969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:20.583765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:19:20.584442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:20.586679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:20.586971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:19:20.587714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:19:20.589793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:20.592426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:20.612076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:20.618323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:20.619217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:20.621516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:20.622623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:20.623305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:20.655487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Getting quotas for project e82b9d7883eb43deacdd0725f1cf9019. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:19:20.662746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Getting quotas for user 6fe086379900424ba040dac38cf97c91 and project e82b9d7883eb43deacdd0725f1cf9019. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:19:20.679828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:19:20.684513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:19:20.739290 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d943981b-86bd-4e96-be6f-1743009b5ee1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.630521 Aug 24 04:19:20.740744 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3314/6364] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 04:19:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 04:19:20.762852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10e3164a-56a5-4628-a69a-7b65ff7dbfec tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:20.764291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10e3164a-56a5-4628-a69a-7b65ff7dbfec tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:20.768371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:20.785821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:20.796419 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9550a11d-44f8-48fc-a39d-361a7cf169d7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1171 microversion: 2.1 time: 0.252862 Aug 24 04:19:20.797685 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3051/6365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:20 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1171 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:20.876828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10e3164a-56a5-4628-a69a-7b65ff7dbfec tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:20.892447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10e3164a-56a5-4628-a69a-7b65ff7dbfec tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:20.899290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10e3164a-56a5-4628-a69a-7b65ff7dbfec tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:20.904580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10e3164a-56a5-4628-a69a-7b65ff7dbfec tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1280 microversion: 2.47 time: 0.150609 Aug 24 04:19:20.906485 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3315/6366] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:20 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:19:21.833587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:21.834882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:21.843414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:21.843951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:21.844401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:21.845139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:21.845594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:21.846890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:21.938612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c66c516c-344c-45b1-887b-eb1c7f6fdaa4 req-113efb06-e4dc-4063-b46c-4ef3403c059a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f879f6-d696-454f-9fb5-9d31c8ac93fd", "tag": "a1297b0b-cb86-41a2-9bfd-0b97118f929b"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:21.951549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c66c516c-344c-45b1-887b-eb1c7f6fdaa4 req-113efb06-e4dc-4063-b46c-4ef3403c059a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:21.965442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c66c516c-344c-45b1-887b-eb1c7f6fdaa4 req-113efb06-e4dc-4063-b46c-4ef3403c059a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:21.966475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c66c516c-344c-45b1-887b-eb1c7f6fdaa4 req-113efb06-e4dc-4063-b46c-4ef3403c059a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:21.982945 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c66c516c-344c-45b1-887b-eb1c7f6fdaa4 req-113efb06-e4dc-4063-b46c-4ef3403c059a service nova] Creating event network-changed:a1297b0b-cb86-41a2-9bfd-0b97118f929b for instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd on n-h1-846470-15 Aug 24 04:19:21.995839 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c66c516c-344c-45b1-887b-eb1c7f6fdaa4 req-113efb06-e4dc-4063-b46c-4ef3403c059a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061148 Aug 24 04:19:22.000801 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3316/6367] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:22.009079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:22.010208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:22.019849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:22.020794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:22.021559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:22.022816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:22.023813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:22.024722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:22.118070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:22.122746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:22.134456 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5179306-0b07-455c-966a-0e47b1581915 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1213 microversion: 2.1 time: 0.305321 Aug 24 04:19:22.134870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:22.147693 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3052/6368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:21 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1213 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:22.147901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:22.147901 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7c57aecd-d379-48da-b1b6-e73605e7c9d1 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1332 microversion: 2.47 time: 0.137090 Aug 24 04:19:22.147901 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3317/6369] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:22 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1332 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:23.158842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:23.160192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:23.164298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:23.165493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:23.170240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:23.171108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:23.171840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:23.172727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:23.173340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:23.173921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:23.174340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:23.174928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:23.175456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:23.176427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:23.177160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:23.177803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:23.259854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:23.269426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:23.271348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:23.272807 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05299208-135b-4889-8007-5ec3b13a7427 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1338 microversion: 2.47 time: 0.112603 Aug 24 04:19:23.273621 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3318/6370] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:23 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:23.353904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:23.362644 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15a0f556-4468-49a8-82a2-c1901809319d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1213 microversion: 2.1 time: 0.210030 Aug 24 04:19:23.363374 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3053/6371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:23 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:24.298180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:24.299261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:24.307206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:24.307942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:24.308452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:24.309412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:24.309930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:24.310296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:24.385593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:24.386095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:24.386229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:24.395735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:24.396238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:24.396609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:24.397053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:24.397822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:24.397989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:24.398458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:24.399214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:24.399416 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b10a6d42-47a0-4e66-b520-11922b732957 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1338 microversion: 2.47 time: 0.105856 Aug 24 04:19:24.400707 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3319/6372] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:24 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1338 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:24.559220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:24.568258 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-510f830b-8879-48ee-9339-797621318d38 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1213 microversion: 2.1 time: 0.187973 Aug 24 04:19:24.569142 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3054/6373] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:24 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:25.424129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:25.424729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:25.432623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:25.433120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:25.433563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:25.434371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:25.434834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:25.435266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:25.507014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:25.519911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:25.522031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:25.524051 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9896bd3-a61e-48df-ba1c-f21c06da5759 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1338 microversion: 2.47 time: 0.104172 Aug 24 04:19:25.524934 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3320/6374] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:25 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:25.591180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:25.592104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:25.600010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:25.600518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:25.600960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:25.601681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:25.602146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:25.602566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:25.745123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:25.753708 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b9199dc7-cd5e-48ae-ba56-d4a722cd305c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1213 microversion: 2.1 time: 0.166596 Aug 24 04:19:25.754293 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3055/6375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:25 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:26.552806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:26.553664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:26.564124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:26.564771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:26.565286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:26.566339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:26.566905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:26.567404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:26.651544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:26.663842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:26.665789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:26.666791 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a22a0416-bb5e-43a1-914c-4cad9afe9d52 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1359 microversion: 2.47 time: 0.120172 Aug 24 04:19:26.667847 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3321/6376] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:26 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1359 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:26.690918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-438501349"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:26.694734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:26.702527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:26.703021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:26.703455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:26.704196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:26.704653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:26.706042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:26.776130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:26.776955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:26.783645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:26.784275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:26.784804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:26.785626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:26.786184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:26.786737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:26.875318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:26.897545 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-181827d3-5c37-4402-abfd-4ce98dacd1cf tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "POST /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2/action" status: 202 len: 52 microversion: 2.47 time: 0.211250 Aug 24 04:19:26.899181 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3056/6377] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 24 04:19:26 2022] POST /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2/action => generated 52 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:26.911168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:26.911951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:26.921862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:26.922451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:26.922968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:26.923782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:26.924187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:26.924607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:26.935190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:26.943542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9eede7f-f624-4b64-8044-69940206dfa9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.171520 Aug 24 04:19:26.944484 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3322/6378] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:26 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:26.956556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:19:27.041876 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a2ec47cc-bf62-4550-b3e5-f2506d862000 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 204 len: 0 microversion: 2.47 time: 0.135012 Aug 24 04:19:27.042799 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3057/6379] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 04:19:26 2022] DELETE /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 04:19:27.051147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:27.051808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:27.057994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:27.058481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:27.058951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:27.059908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:27.060374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:27.060825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:27.136250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:27.145545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:27.147111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:27.148401 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0fa531d7-1c04-486f-93f4-d68e103129f4 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1365 microversion: 2.47 time: 0.101243 Aug 24 04:19:27.148958 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3323/6380] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:27 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:27.973586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:27.974275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:27.977528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:27.978186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:27.984715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:27.985216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:27.986031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:27.986745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:27.987231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:27.987675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:28.125481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:28.133945 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3650991e-60b6-45b1-b76f-53a13a806576 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.168746 Aug 24 04:19:28.134512 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3058/6381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:27 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:28.172775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:28.173409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:28.181084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:28.181555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:28.181993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:28.182727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:28.183184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:28.183640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:28.262780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:28.271406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:28.272986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:28.274181 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c68348c9-61f4-4f85-ba62-64befb727c6a tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1365 microversion: 2.47 time: 0.105599 Aug 24 04:19:28.274792 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3324/6382] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:28 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:29.160227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:29.161089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:29.169395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:29.170118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:29.170712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:29.171611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:29.172308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:29.172871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:29.298961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:29.299552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:29.306362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:29.306933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:29.307434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:29.308166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:29.308620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:29.309274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:29.332504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:29.340348 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1851c1c7-8a5d-4283-a86b-22e2ee0b6220 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.187382 Aug 24 04:19:29.341071 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3059/6383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:29 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:29.377273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:29.389550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:29.391067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:29.392315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-449dfde8-2e0a-4da1-bc31-c98ea45a166d tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1365 microversion: 2.47 time: 0.098717 Aug 24 04:19:29.392921 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3325/6384] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:29 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:19:30.363769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:30.364345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:30.374753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:30.375324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:30.375967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:30.377059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:30.377499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:30.377967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:30.415798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:30.416420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:30.424413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:30.424911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:30.425357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:30.426901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:30.426901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:30.427224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:30.493277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:30.502575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:30.504090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:30.505318 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bbf525ff-6001-43f1-a49e-e2b29f5bb105 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1365 microversion: 2.47 time: 0.093720 Aug 24 04:19:30.506206 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3326/6385] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:30 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:30.524566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:30.533475 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26dac3d2-e347-4a93-b815-266c4322fc49 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.175086 Aug 24 04:19:30.534027 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3060/6386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:30 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:31.528415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:31.529247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:31.531338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:31.532141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=10 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:31.539076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:31.539733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:31.540209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:31.540927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:31.541392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:31.541826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:31.554893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:31.555450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:31.562963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:31.563616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:31.564096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:31.564806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:31.565279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:31.565704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:31.582223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:31.582720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:31.583163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:31.583881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lazy-loading 'fault' on Instance uuid 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:19:31.628867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:31.641634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:31.643196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fe086379900424ba040dac38cf97c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b9d7883eb43deacdd0725f1cf9019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:31.644514 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3aef4ce3-a545-4b33-9a31-d98ae4e083aa tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 200 len: 1370 microversion: 2.47 time: 0.120397 Aug 24 04:19:31.645893 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3327/6387] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:31 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 1370 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:19:31.714945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:31.719577 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19a5c84e-ec70-4a47-b14d-4d85e4e555cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.168852 Aug 24 04:19:31.720189 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3061/6388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:31 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:32.669284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:32.670004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] [instance: 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:32.677498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:32.677992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:32.678433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:32.679145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:32.679595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:32.680073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:32.698326 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] HTTP exception thrown: Instance 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 could not be found. Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Request method failure captured: Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 HTTP/1.1 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBabHl2uctvZCbIqPkwAPGV3InYkka8S4yKx7W0A5-XiqDQPCjRy4XOJSdwTH0rRXZzXwg18O3q1eErXJUuODZt2QhHXQF-D3R91RHnnEyTp016Re50Gr_f_RCF1YoVxtWFD93-D8LPp7kIbtYOF_pX8MubYsi7Gl6j49a8-rPD2jG6E Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: e82b9d7883eb43deacdd0725f1cf9019 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAaction247Test-1416128162 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e82b9d7883eb43deacdd0725f1cf9019"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e82b9d7883eb43deacdd0725f1cf9019"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e82b9d7883eb43deacdd0725f1cf9019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e82b9d7883eb43deacdd0725f1cf9019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAaction247Test-1416128162 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: e82b9d7883eb43deacdd0725f1cf9019 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAaction247Test-1416128162 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAaction247Test-1416128162-project Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6fe086379900424ba040dac38cf97c91 Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAaction247Test-1416128162-project Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 could not be found. Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2'} Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 could not be found. Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 could not be found. Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:32.700126 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 could not be found. Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] Returning 404 to user: Instance 9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b571184b-bfd5-483c-9cd2-7cca31e1cc50 tempest-ServersAaction247Test-1416128162 tempest-ServersAaction247Test-1416128162-project] 10.222.0.58 "GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2" status: 404 len: 111 microversion: 2.47 time: 0.037043 Aug 24 04:19:32.705953 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3328/6389] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:19:32 2022] GET /compute/v2.1/servers/9f47dcc6-bfb8-4ee6-ac2b-3cf5f451a6a2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:19:32.741000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:32.743265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:32.749000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:32.749496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:32.749929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:32.750805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:32.751081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:32.751501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:32.901907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:32.912221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d0e0654-6275-4f9d-a4d5-4778db1e3e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.175109 Aug 24 04:19:32.912584 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3062/6390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:32 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:33.934566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:33.935188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:33.942287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:33.942777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:33.943212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:33.943948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:33.944407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:33.944841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:33.961395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:34.102737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:34.112270 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8f6e0b99-1419-4155-9367-b1875ff43a07 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.181514 Aug 24 04:19:34.112841 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3329/6391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:33 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:35.134133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:35.134813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:35.142390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:35.142848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:35.143508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:35.144454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:35.144941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:35.145367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:35.305008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:35.317187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee4baeb1-6de6-4e06-94b8-b8a3bbf7c226 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.186935 Aug 24 04:19:35.318578 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3063/6392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:35 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:36.339322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:36.340029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:36.347323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:36.347880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:36.348316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:36.349016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:36.349713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:36.350140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:36.774583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:36.789492 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-78da0954-3863-46fa-a025-92f8d27e694c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.454686 Aug 24 04:19:36.790269 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3330/6393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:36 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:37.564710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-75bb605e-6422-4d73-9aac-eec443179549 req-7bfdae8d-d8ef-48da-96ef-c975f8b3a022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f879f6-d696-454f-9fb5-9d31c8ac93fd", "name": "network-vif-plugged", "status": "completed", "tag": "a1297b0b-cb86-41a2-9bfd-0b97118f929b"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:37.576861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-75bb605e-6422-4d73-9aac-eec443179549 req-7bfdae8d-d8ef-48da-96ef-c975f8b3a022 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:37.577634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-75bb605e-6422-4d73-9aac-eec443179549 req-7bfdae8d-d8ef-48da-96ef-c975f8b3a022 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:37.578073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-75bb605e-6422-4d73-9aac-eec443179549 req-7bfdae8d-d8ef-48da-96ef-c975f8b3a022 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:37.591564 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-75bb605e-6422-4d73-9aac-eec443179549 req-7bfdae8d-d8ef-48da-96ef-c975f8b3a022 service nova] Creating event network-vif-plugged:a1297b0b-cb86-41a2-9bfd-0b97118f929b for instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd on n-h1-846470-15 Aug 24 04:19:37.596839 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-75bb605e-6422-4d73-9aac-eec443179549 req-7bfdae8d-d8ef-48da-96ef-c975f8b3a022 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Aug 24 04:19:37.597479 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3064/6394] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:37.814053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:37.815656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:37.833130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:37.834645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:37.835450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:37.836625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:37.837640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:37.838393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:38.051901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:38.062035 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-85841c91-734f-4684-be97-a6d99c67a0c3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.254707 Aug 24 04:19:38.072509 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3331/6395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:37 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:38.845249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-786579396", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:38.902175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] validate_networks() for [('ced95019-c316-44b0-b100-8218ac6cea18', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:19:39.084601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:39.085274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:39.095806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:39.096739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:39.097362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:39.098265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:39.098898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:39.099495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:39.282135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:39.302604 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b27e5dd-6854-45e8-9955-10537420a813 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1201 microversion: 2.1 time: 0.222765 Aug 24 04:19:39.303394 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3332/6396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:39 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1201 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:19:39.693602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:19:39.694021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:19:39.694491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:19:39.694896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:19:39.695300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:19:39.711289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:39.711865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:39.712426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:39.713244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:39.713888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:39.714504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:39.736483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Getting quotas for project 80b565a749864bc6801910e6d70f3a37. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:19:39.742825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Getting quotas for user 6bf7e4965a6d45c083c84e714edee9d7 and project 80b565a749864bc6801910e6d70f3a37. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:19:39.757884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:19:39.760400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:19:39.812197 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e4536a7f-514c-465a-b2f1-3582080f2d17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.092003 Aug 24 04:19:39.813130 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3065/6397] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:19:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:19:39.824412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96358605-3e9c-4cdb-aa12-e42d65daa341 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:39.825746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96358605-3e9c-4cdb-aa12-e42d65daa341 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:39.899992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96358605-3e9c-4cdb-aa12-e42d65daa341 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:39.908047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96358605-3e9c-4cdb-aa12-e42d65daa341 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1221 microversion: 2.1 time: 0.087759 Aug 24 04:19:39.908719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3333/6398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:39 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:39.976305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-484364005", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:40.034517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] validate_networks() for [('ced95019-c316-44b0-b100-8218ac6cea18', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:19:40.324695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:40.325477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:40.334271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.335077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.335521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:40.336269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.336724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.337328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:40.477907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:19:40.479309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:19:40.479861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:19:40.480283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:19:40.480806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:19:40.489643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:40.493385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.494436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.494875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:40.495602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.496159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.496564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:40.502629 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1aca4556-f5a2-4da0-bc7c-851e55fba00e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1388 microversion: 2.1 time: 0.182299 Aug 24 04:19:40.503561 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3334/6399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:40 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1388 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:40.515758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Getting quotas for project 80b565a749864bc6801910e6d70f3a37. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:19:40.523066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Getting quotas for user 6bf7e4965a6d45c083c84e714edee9d7 and project 80b565a749864bc6801910e6d70f3a37. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:19:40.525833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:40.527069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:40.534197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.534781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.535370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:40.536307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.536922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.537090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:19:40.537484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:40.539271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:19:40.595473 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9f428cf8-0c8f-435f-b1a5-32a1e83a342e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.624272 Aug 24 04:19:40.615782 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3066/6400] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:19:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:19:40.631613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-958144f2-4d74-4909-941f-8b5d0f18c844 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:40.633472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-958144f2-4d74-4909-941f-8b5d0f18c844 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:40.696951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-958144f2-4d74-4909-941f-8b5d0f18c844 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:40.706250 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-958144f2-4d74-4909-941f-8b5d0f18c844 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1221 microversion: 2.1 time: 0.085434 Aug 24 04:19:40.707026 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3067/6401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:40 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:19:40.724690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:40.733166 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-930b7a19-da01-4cd4-9cc3-44dbc44eb857 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1388 microversion: 2.1 time: 0.211446 Aug 24 04:19:40.739172 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3335/6402] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:40 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1388 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:19:40.753685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:40.754361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:40.762558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.762967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.763409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:40.764266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.764679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.765060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:40.927418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:40.936518 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7394de39-4850-4d09-a637-bc1220d76723 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1388 microversion: 2.1 time: 0.186873 Aug 24 04:19:40.937109 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3068/6403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:40 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1388 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:40.985887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:40.986998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:40.996054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:40.997834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:40.999957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:41.001116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:41.004260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:41.005044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:41.056030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:19:41.224105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2acf97cf-b725-433d-a2ac-d165ce14e605 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 204 len: 0 microversion: 2.1 time: 0.254619 Aug 24 04:19:41.227209 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3336/6404] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:19:40 2022] DELETE /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:19:41.237985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:41.238659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:41.245396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:41.246421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:41.247197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:41.248324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:41.248978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:41.249578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:41.537477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:41.551858 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c2643c65-ee5d-47d2-aa2d-469889a6df6c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1394 microversion: 2.1 time: 0.318609 Aug 24 04:19:41.562643 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3069/6405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:41 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1394 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:41.728686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:41.730078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:41.739096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:41.739586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:41.740228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:41.741159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:41.742025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:41.742389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:41.825130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:41.835624 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d889d9b6-153d-45b6-9265-169ea267f137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1273 microversion: 2.1 time: 0.111240 Aug 24 04:19:41.836260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3337/6406] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:41 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:42.586924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:42.590932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:42.632914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:42.636337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:42.641664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:42.642818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:42.644272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:42.645117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:42.853993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6f3b1cb6-2e7d-47a3-a9f3-61566ecf96fd req-981415e2-902e-41a4-b540-49cef74b3cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb20b75-b852-4d45-8e50-7e43051e3493", "tag": "5d0d9eb0-b914-4fac-bde0-6c29b2b4c267"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:42.867523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6f3b1cb6-2e7d-47a3-a9f3-61566ecf96fd req-981415e2-902e-41a4-b540-49cef74b3cc1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:42.868411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6f3b1cb6-2e7d-47a3-a9f3-61566ecf96fd req-981415e2-902e-41a4-b540-49cef74b3cc1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:42.869013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6f3b1cb6-2e7d-47a3-a9f3-61566ecf96fd req-981415e2-902e-41a4-b540-49cef74b3cc1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:42.883464 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6f3b1cb6-2e7d-47a3-a9f3-61566ecf96fd req-981415e2-902e-41a4-b540-49cef74b3cc1 service nova] Creating event network-changed:5d0d9eb0-b914-4fac-bde0-6c29b2b4c267 for instance 4fb20b75-b852-4d45-8e50-7e43051e3493 on n-h2-846470-15 Aug 24 04:19:42.889637 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6f3b1cb6-2e7d-47a3-a9f3-61566ecf96fd req-981415e2-902e-41a4-b540-49cef74b3cc1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042227 Aug 24 04:19:42.891329 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3338/6407] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:19:42.898699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:42.900224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:42.907715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:42.908493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:42.909115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:42.910060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:42.910802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:42.911396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:42.994843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:43.015195 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5cd6b6f0-1413-4c44-aaa2-480ed0f0cf68 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1394 microversion: 2.1 time: 0.443644 Aug 24 04:19:43.023401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3070/6408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:42 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1394 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:43.331997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:43.344497 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe7a0fff-01a4-45fe-9f44-710ba1cbcdee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.450910 Aug 24 04:19:43.346642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3339/6409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:42 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:44.044499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:44.045480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:44.057188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:44.058156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:44.058156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:44.058965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:44.059956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:44.060565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:44.117388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1c25737a-4e36-427e-b001-0114077cf983 req-69aa7cdd-84ec-444a-b0a9-8bbfd9320bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cd99d3-7c7c-4f1e-8360-452d24e3e50a", "tag": "3872c731-e1cf-4353-a6c5-74bd5510f97e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:44.143538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1c25737a-4e36-427e-b001-0114077cf983 req-69aa7cdd-84ec-444a-b0a9-8bbfd9320bb9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:44.144068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1c25737a-4e36-427e-b001-0114077cf983 req-69aa7cdd-84ec-444a-b0a9-8bbfd9320bb9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:44.144521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1c25737a-4e36-427e-b001-0114077cf983 req-69aa7cdd-84ec-444a-b0a9-8bbfd9320bb9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:44.164239 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1c25737a-4e36-427e-b001-0114077cf983 req-69aa7cdd-84ec-444a-b0a9-8bbfd9320bb9 service nova] Creating event network-changed:3872c731-e1cf-4353-a6c5-74bd5510f97e for instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a on n-h2-846470-15 Aug 24 04:19:44.171640 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1c25737a-4e36-427e-b001-0114077cf983 req-69aa7cdd-84ec-444a-b0a9-8bbfd9320bb9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057959 Aug 24 04:19:44.172499 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3340/6410] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:19:44.181867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:44.193766 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-40725767-36b2-41af-a769-a48fdd84aecf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1186 microversion: 2.1 time: 0.156748 Aug 24 04:19:44.194398 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3071/6411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:44 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1186 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:44.367538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:44.368251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:44.375563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:44.376088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:44.376530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:44.377233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:44.377690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:44.378160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:44.526748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:44.535600 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c63e8550-fbae-4bdc-9267-4f826e7efb7a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.172487 Aug 24 04:19:44.536214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3341/6412] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:44 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:44.911648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a3bb1e48-4733-4deb-b2da-d0d62772af80 req-c860841a-ae74-4753-a2fa-477e3b47f400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f879f6-d696-454f-9fb5-9d31c8ac93fd", "name": "network-vif-deleted", "tag": "a1297b0b-cb86-41a2-9bfd-0b97118f929b"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:44.923596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3bb1e48-4733-4deb-b2da-d0d62772af80 req-c860841a-ae74-4753-a2fa-477e3b47f400 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:44.924230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3bb1e48-4733-4deb-b2da-d0d62772af80 req-c860841a-ae74-4753-a2fa-477e3b47f400 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:44.924751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3bb1e48-4733-4deb-b2da-d0d62772af80 req-c860841a-ae74-4753-a2fa-477e3b47f400 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:44.940615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a3bb1e48-4733-4deb-b2da-d0d62772af80 req-c860841a-ae74-4753-a2fa-477e3b47f400 service nova] Creating event network-vif-deleted:a1297b0b-cb86-41a2-9bfd-0b97118f929b for instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd on n-h1-846470-15 Aug 24 04:19:44.946310 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a3bb1e48-4733-4deb-b2da-d0d62772af80 req-c860841a-ae74-4753-a2fa-477e3b47f400 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038955 Aug 24 04:19:44.947292 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3072/6413] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:45.221840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:45.222767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:45.232110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:45.232417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:45.233104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:45.233897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:45.234447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:45.234892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:45.301587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:45.310810 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c7be9d8-1e71-4b47-b9f2-b2d50df6e68a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1186 microversion: 2.1 time: 0.095716 Aug 24 04:19:45.311409 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3342/6414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:45 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1186 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:45.559272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:45.560008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:45.567645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:45.568420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:45.568937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:45.569890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:45.570444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:45.570980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:45.727267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:45.743419 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4fdfc346-9f84-480f-a25a-92ce9d81dc0d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.189567 Aug 24 04:19:45.744504 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3073/6415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:45 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:46.332773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:46.333352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:46.341347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:46.342016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:46.342470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:46.343197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:46.343835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:46.344283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:46.486252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:46.496766 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b00e5c74-9495-4bc7-a8ff-c5352aab1619 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1186 microversion: 2.1 time: 0.168481 Aug 24 04:19:46.509747 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3343/6416] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:46 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1186 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:46.766699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:46.767524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:46.775040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:46.775692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:46.776239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:46.777098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:46.777711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:46.778634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:46.925730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:46.933975 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e9fcd748-5d15-4425-a2d7-80b5ddea2f3c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.172636 Aug 24 04:19:46.934551 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3074/6417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:46 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:47.518942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:47.519639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:47.528372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:47.529284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:47.530506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:47.531240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:47.532227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:47.533068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:47.606696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:47.618418 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b9fe90de-78d5-4304-9e7c-66ff1d44dc9c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1186 microversion: 2.1 time: 0.103483 Aug 24 04:19:47.620030 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3344/6418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:47 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1186 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:47.956277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:47.957227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:47.960379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:47.967420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:47.968050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:47.968559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:47.969337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:47.969805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:47.970236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:47.974426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:48.128548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:48.137046 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e047af0-3338-4780-9db7-d36f14b1da18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.186119 Aug 24 04:19:48.137912 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3075/6419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:47 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:48.643123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:48.644133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:48.655442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:48.655990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:48.656440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:48.657164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:48.657613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:48.658042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:48.691963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:48.692519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:48.693099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:48.693590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lazy-loading 'fault' on Instance uuid 93f879f6-d696-454f-9fb5-9d31c8ac93fd {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:19:48.744282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:48.753242 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-174b9c94-49eb-4030-b589-12fa2c961564 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 200 len: 1191 microversion: 2.1 time: 0.116311 Aug 24 04:19:48.753847 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3345/6420] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:48 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 1191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:49.159882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:49.160469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:49.168092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:49.168884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:49.169337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:49.170075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:49.170537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:49.170968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:49.320713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:49.332457 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d629dc6e-3a55-46e4-a5c8-ba9ea9917bdf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.176655 Aug 24 04:19:49.333339 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3076/6421] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:49 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:49.720442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-024ddb52-3131-4dcb-8561-500c0d177d24 req-87c73bf1-236d-4c91-8c92-9606233510f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb20b75-b852-4d45-8e50-7e43051e3493", "name": "network-vif-plugged", "status": "completed", "tag": "5d0d9eb0-b914-4fac-bde0-6c29b2b4c267"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:49.731599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-024ddb52-3131-4dcb-8561-500c0d177d24 req-87c73bf1-236d-4c91-8c92-9606233510f9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:49.732122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-024ddb52-3131-4dcb-8561-500c0d177d24 req-87c73bf1-236d-4c91-8c92-9606233510f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:49.732555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-024ddb52-3131-4dcb-8561-500c0d177d24 req-87c73bf1-236d-4c91-8c92-9606233510f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:49.745132 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-024ddb52-3131-4dcb-8561-500c0d177d24 req-87c73bf1-236d-4c91-8c92-9606233510f9 service nova] Creating event network-vif-plugged:5d0d9eb0-b914-4fac-bde0-6c29b2b4c267 for instance 4fb20b75-b852-4d45-8e50-7e43051e3493 on n-h2-846470-15 Aug 24 04:19:49.750708 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-024ddb52-3131-4dcb-8561-500c0d177d24 req-87c73bf1-236d-4c91-8c92-9606233510f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034101 Aug 24 04:19:49.751548 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3346/6422] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:49.775894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:49.777335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 93f879f6-d696-454f-9fb5-9d31c8ac93fd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:49.788322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:49.789028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:49.789332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:49.790777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:49.791275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:49.791757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:49.809242 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd could not be found. Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd HTTP/1.1 Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd could not be found. Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '93f879f6-d696-454f-9fb5-9d31c8ac93fd'} Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd could not be found. Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd could not be found. Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:19:49.811444 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd could not be found. Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance 93f879f6-d696-454f-9fb5-9d31c8ac93fd could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db5bc3ac-0354-4c17-8468-d1cd58451100 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd" status: 404 len: 111 microversion: 2.1 time: 0.042445 Aug 24 04:19:49.816566 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3077/6423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:49 2022] GET /compute/v2.1/servers/93f879f6-d696-454f-9fb5-9d31c8ac93fd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:19:50.353694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:50.358893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:50.359647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:50.366855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:50.367372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:50.367886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:50.368556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:50.369015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:50.369445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:50.372684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:50.515087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:50.523840 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d76dfe87-6ab0-4478-ae70-91a0d2763067 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.171126 Aug 24 04:19:50.524480 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3347/6424] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:50 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:51.546807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:51.547434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:51.551621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:51.552513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=14 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:51.557629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:51.558440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:51.558911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:51.559611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:51.560122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:51.560545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:51.739950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:51.749938 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3f28bccf-dbff-4510-8ef5-8599646e23bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.207303 Aug 24 04:19:51.750626 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3078/6425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:51 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:19:51.765896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1704aae2-2eb6-4a7b-b531-9abf225ae919 req-2d9b7db6-5b03-4aa6-a88e-b91f345041ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cd99d3-7c7c-4f1e-8360-452d24e3e50a", "name": "network-vif-plugged", "status": "completed", "tag": "3872c731-e1cf-4353-a6c5-74bd5510f97e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:51.772315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:51.779052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1704aae2-2eb6-4a7b-b531-9abf225ae919 req-2d9b7db6-5b03-4aa6-a88e-b91f345041ff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:51.779582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1704aae2-2eb6-4a7b-b531-9abf225ae919 req-2d9b7db6-5b03-4aa6-a88e-b91f345041ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:51.780088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1704aae2-2eb6-4a7b-b531-9abf225ae919 req-2d9b7db6-5b03-4aa6-a88e-b91f345041ff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:51.792820 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1704aae2-2eb6-4a7b-b531-9abf225ae919 req-2d9b7db6-5b03-4aa6-a88e-b91f345041ff service nova] Creating event network-vif-plugged:3872c731-e1cf-4353-a6c5-74bd5510f97e for instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a on n-h2-846470-15 Aug 24 04:19:51.797864 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1704aae2-2eb6-4a7b-b531-9abf225ae919 req-2d9b7db6-5b03-4aa6-a88e-b91f345041ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036076 Aug 24 04:19:51.798764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3348/6426] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:19:52.771116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:52.771938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:52.778941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:52.779446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:52.779918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:52.780623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:52.781082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:52.781504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:52.930410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:52.938998 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8bb8c21b-6a07-4632-bb06-32c91a6c944b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1321 microversion: 2.1 time: 0.171744 Aug 24 04:19:52.939590 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3079/6427] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:52 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:53.961808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:53.963318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:53.970756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:53.971417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:53.971919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:53.972629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:53.973087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:53.973940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:54.143851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:54.154275 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8dd028c4-4779-42ed-be25-cfebc8be9915 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1514 microversion: 2.1 time: 0.197470 Aug 24 04:19:54.155452 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3349/6428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:53 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:54.177690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:19:54.180238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:54.187730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:54.188359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:54.188861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:54.189669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:54.190218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:54.190713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:54.215603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lazy-loading 'flavor' on Instance uuid e8cd99d3-7c7c-4f1e-8360-452d24e3e50a {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:19:54.293702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-234271b2-076e-494a-b316-cd9bfab2fdf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a/action" status: 200 len: 32 microversion: 2.1 time: 0.122046 Aug 24 04:19:54.294377 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3080/6429] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:19:54 2022] POST /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a/action => generated 32 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:19:54.305384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:54.306025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:54.320641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:54.321131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:54.321557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:54.322561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:54.323051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:54.323463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:54.501229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:54.510332 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b705e3a7-c4a9-4eb0-a9e8-8ed997d3f3fd tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.208779 Aug 24 04:19:54.510928 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3350/6430] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:54 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:55.532237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:55.532944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:55.539914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:55.540581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:55.541047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:55.541785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:55.542371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:55.542790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:55.688692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:55.697039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab684d29-ce0e-40cc-9072-8ee13fd0a0c2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.170256 Aug 24 04:19:55.697623 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3081/6431] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:55 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:56.719138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:56.719717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:56.727502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:56.728129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:56.728620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:56.729340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:56.729921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:56.730613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:56.884679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:56.893535 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eac263ac-eb21-4ac8-a476-5e2767caefb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.178991 Aug 24 04:19:56.894139 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3351/6432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:56 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:57.914356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:57.914978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:57.924358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:57.924870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:57.925332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:57.926064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:57.926554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:57.926987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:58.075259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:58.083936 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4cc6f32f-86a8-4796-b632-b0004eb17cea tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.173400 Aug 24 04:19:58.084734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3082/6433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:57 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:19:59.105755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:19:59.106580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:19:59.114965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:59.115509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:59.116067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:59.116874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:19:59.117433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:19:59.117906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:19:59.260070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:19:59.268403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f2db31d-4d37-4689-95dc-090092794318 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.166787 Aug 24 04:19:59.269285 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3352/6434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:19:59 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:00.293426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:00.294506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:00.301966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:00.302454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:00.305544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:00.306324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:00.306818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:00.307258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:00.449646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:00.458675 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47602a8d-1574-4f26-832a-edb6997adb55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.171929 Aug 24 04:20:00.459508 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3083/6435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:00 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:01.481457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:01.482301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:01.491132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:01.491620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:01.492096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:01.492787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:01.493252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:01.493682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:01.654671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:01.663423 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-be261dd8-a16f-49c4-889d-c2280220b817 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.186608 Aug 24 04:20:01.664117 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3353/6436] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:01 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:02.685825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:02.686628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:02.694736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:02.695237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:02.695714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:02.696489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:02.697129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:02.697570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:02.855402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:02.864388 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-62f0aa87-1785-44cc-ae91-a19c5308299c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.182595 Aug 24 04:20:02.865013 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3084/6437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:02 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:03.886885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:03.887657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:03.895983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:03.896481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:03.896925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:03.897670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:03.898126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:03.898557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:04.039871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:04.048038 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e1c3ccf-b473-4043-a219-57327e44ba1d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.165374 Aug 24 04:20:04.048654 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3354/6438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:03 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:05.070038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:05.071383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:05.078967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:05.079549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:05.080537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:05.081151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:05.081608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:05.082034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:05.230335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:05.239790 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cbee0e8c-24f9-42ac-9d93-9fc11bd17abe tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.173396 Aug 24 04:20:05.240622 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3085/6439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:05 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:06.261282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:06.261932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:06.269119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:06.269602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:06.270014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:06.270748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:06.271201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:06.271621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:06.420876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:06.430495 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1719dc3f-e5e5-4ad0-b4b1-8f27028cfcc7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.173455 Aug 24 04:20:06.431113 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3355/6440] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:06 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:20:07.453534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:07.454159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:07.462204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:07.462701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:07.463141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:07.463930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:07.464421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:07.464821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:07.606253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:07.614686 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0b594b48-a6b8-4eb7-91c8-5d22de006cb3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.165482 Aug 24 04:20:07.615315 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3086/6441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:07 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:08.638232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:08.638982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:08.648952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:08.649470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:08.650052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:08.650851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:08.651472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:08.651888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:08.817189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:08.825597 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed019de2-e704-4d09-a6aa-e28d568cf465 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.192767 Aug 24 04:20:08.826212 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3356/6442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:08 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:09.851144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:09.851807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:09.861720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:09.862293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:09.862737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:09.863461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:09.864030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:09.864460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:10.013771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:10.027317 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-08fac81e-138c-4234-9026-24596ffe2c4e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.182658 Aug 24 04:20:10.028305 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3087/6443] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:09 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:11.051697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:11.052317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:11.059761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:11.060255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:11.060714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:11.061428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:11.061891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:11.062357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:11.209198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:11.217896 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7224123-c89a-4dd6-8208-0114bd652707 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.170867 Aug 24 04:20:11.218492 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3357/6444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:11 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:12.238811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:12.239427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:12.247900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:12.248396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:12.248839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:12.249577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:12.250040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:12.250468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:12.392270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:12.401123 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cbebbc81-2416-4b7c-963f-4800bbb68963 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.166378 Aug 24 04:20:12.401716 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3088/6445] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:12 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:13.078561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1522451117", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "84d867a3-a980-43f1-a09b-291503fa3efe", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9935c908-0959-4c8b-be4e-161d3600b222"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:13.172194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] validate_networks() for [('9935c908-0959-4c8b-be4e-161d3600b222', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:20:13.425898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:13.426667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:13.434101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:13.434669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:13.435272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:13.436038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:13.436570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:13.437198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:13.574868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:13.584462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5f55d72d-32dd-4031-a7e3-3896c8c75c57 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.164484 Aug 24 04:20:13.585040 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3089/6446] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:13 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:13.652034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:20:13.652451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:20:13.652927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:20:13.653330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:20:13.653735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:20:13.663174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:13.663744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:13.664227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:13.664986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:13.665557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:13.666026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:13.684461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:20:13.690462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:20:13.704307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:20:13.706909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='84d867a3-a980-43f1-a09b-291503fa3efe',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:20:13.788337 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3a7542a4-b222-4b84-a418-ed1b900a3e31 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713690 Aug 24 04:20:13.788989 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3358/6447] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:20:13.800700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9abcad36-52a8-4dcc-a890-1e64d1e37455 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:13.801507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9abcad36-52a8-4dcc-a890-1e64d1e37455 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:13.859531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9abcad36-52a8-4dcc-a890-1e64d1e37455 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:13.869173 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9abcad36-52a8-4dcc-a890-1e64d1e37455 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1057 microversion: 2.1 time: 0.072714 Aug 24 04:20:13.869775 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3090/6448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:13 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1057 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:14.607325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:14.607916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:14.616235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:14.616859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:14.617525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:14.618507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:14.619113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:14.619626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:14.770915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:14.779432 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a6fb26f-7328-4051-97fe-cee70c0e98c1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.176877 Aug 24 04:20:14.779962 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3359/6449] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:14 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:14.889547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:14.890183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:14.899305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:14.899834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:14.900272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:14.900976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:14.901431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:14.901857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:14.922456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:15.052742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:15.061734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b09c73d4-36bd-4744-9053-b6f4cdaf8473 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1117 microversion: 2.1 time: 0.176052 Aug 24 04:20:15.062391 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3091/6450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:14 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1117 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:15.801752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:15.802293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:15.809485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:15.809944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:15.810611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:15.811326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:15.811802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:15.812220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:15.965958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:15.989985 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-04835e98-01a3-48ec-81ee-54529fcd7d9a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.191614 Aug 24 04:20:16.000861 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3360/6451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:15 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:20:16.083280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:16.083988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:16.096309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:16.097510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:16.098694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:16.099978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:16.101616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:16.102401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:16.365271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:16.375735 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2d419dc-e4a8-48c0-9ed1-c417c5494c70 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.296844 Aug 24 04:20:16.376695 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3092/6452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:16 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:16.773420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2f9a9124-b55e-49c7-911d-0bb1a3612806 req-04993794-9792-4512-8278-e430f732d291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f278bd11-ef77-48c8-99fa-5800b5ceb038", "tag": "c0933787-6dc3-43d2-a22f-74307523893e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:16.784745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2f9a9124-b55e-49c7-911d-0bb1a3612806 req-04993794-9792-4512-8278-e430f732d291 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:16.785601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2f9a9124-b55e-49c7-911d-0bb1a3612806 req-04993794-9792-4512-8278-e430f732d291 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:16.786109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2f9a9124-b55e-49c7-911d-0bb1a3612806 req-04993794-9792-4512-8278-e430f732d291 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:16.798367 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2f9a9124-b55e-49c7-911d-0bb1a3612806 req-04993794-9792-4512-8278-e430f732d291 service nova] Creating event network-changed:c0933787-6dc3-43d2-a22f-74307523893e for instance f278bd11-ef77-48c8-99fa-5800b5ceb038 on n-h1-846470-15 Aug 24 04:20:16.804580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2f9a9124-b55e-49c7-911d-0bb1a3612806 req-04993794-9792-4512-8278-e430f732d291 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035021 Aug 24 04:20:16.805516 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3361/6453] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:20:17.011100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:17.011767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:17.018211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:17.018915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:17.019361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:17.020101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:17.020556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:17.020982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:17.255924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:17.264423 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9c412404-0f4c-4228-bfe9-84ddffbebe82 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.257535 Aug 24 04:20:17.265142 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3093/6454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:17 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:17.399357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:17.400092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:17.407418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:17.408061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:17.408756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:17.409881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:17.410347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:17.410813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:17.583774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:17.591767 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ad157389-a543-4c55-bff0-156cd91bfc44 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.197830 Aug 24 04:20:17.592719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3362/6455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:17 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:18.286318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:18.286914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:18.289523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=40 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:18.295642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:18.296158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:18.296599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:18.297306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:18.297773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:18.298217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:18.435892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:18.444382 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c0b6205b-f251-40ae-a5ba-0303437ebbf0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.162364 Aug 24 04:20:18.444985 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3094/6456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:18 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:18.612781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:18.614165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:18.621738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:18.622415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:18.623114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:18.624156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:18.624778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:18.625209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:18.803056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:18.811597 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b03431f-5315-47a6-8cab-8bf7998fa1e6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.203184 Aug 24 04:20:18.812401 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3363/6457] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:18 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:19.465955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:19.466723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:19.475864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:19.476688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:19.477531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:19.478266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:19.478958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:19.480388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:19.701685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:19.723079 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9bce0624-04d0-48de-ab38-07ebb7aef99a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.260824 Aug 24 04:20:19.724058 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3095/6458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:19 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:19.834754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:19.836433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:19.846365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:19.846889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:19.847506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:19.848355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:19.848893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:19.849262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:20.057318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:20.068677 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5dcc13b-0872-4451-8b3d-35965ae500ad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.239688 Aug 24 04:20:20.073056 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3364/6459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:19 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:20.750460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:20.751079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:20.761651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:20.762482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:20.762876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:20.764266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:20.764266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:20.764911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:20.977381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:20.992230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6dcfcd20-ea4c-4f89-b287-6f5f7c569cb6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.247104 Aug 24 04:20:20.992842 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3096/6460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:20 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:20:21.117703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:21.118311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:21.125941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:21.126451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:21.126936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:21.127861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:21.128330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:21.128887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:21.132083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:21.296841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:21.308132 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65450c64-2dd2-4304-9fda-2f64a85309b0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.194417 Aug 24 04:20:21.311104 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3365/6461] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:21 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:22.016487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:22.018077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:22.026142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:22.026613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:22.027178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:22.027930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:22.028377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:22.028809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:22.177610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:22.186192 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-71380c3b-ca36-40d6-925a-a279ebaee4d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1520 microversion: 2.1 time: 0.173731 Aug 24 04:20:22.186808 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3097/6462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:22 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:22.333205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:22.334577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:22.336870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:22.342214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:22.342996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:22.343709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:22.344953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:22.345977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:22.345977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:22.503141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:22.511803 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-030cec7d-36ae-4811-870f-9f6c00e6ef71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.184181 Aug 24 04:20:22.525884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3366/6463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:22 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:23.209029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:23.210493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:23.218634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.219221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.220197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.221810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.221810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.222949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.445896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:23.466231 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7b3b3690-cd88-44e5-9561-9edab3bc462c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1500 microversion: 2.1 time: 0.261836 Aug 24 04:20:23.471840 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3098/6464] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:23 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1500 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:23.491838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:23.492648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:23.503469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.504670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.505337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.507950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.508667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.510147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.535639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:23.536505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:23.545271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.545434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.545818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.546619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.547066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.547547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.674008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:23.690415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:23.697092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:23.699748 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-060a24fb-b1b1-416d-8c93-3850afe0f047 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1514 microversion: 2.1 time: 0.213171 Aug 24 04:20:23.700373 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3367/6465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:23 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:23.722415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2543c73e-94f5-433f-9f33-87db6aa278c8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:23.724036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:23.725368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2543c73e-94f5-433f-9f33-87db6aa278c8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 247db1df-1beb-4fbc-9d59-661923079e74] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:23.731621 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-2543c73e-94f5-433f-9f33-87db6aa278c8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Instance 247db1df-1beb-4fbc-9d59-661923079e74 could not be found. Aug 24 04:20:23.732545 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3584b2dc-2f5d-49ab-bad9-f6961194ffc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.202941 Aug 24 04:20:23.733165 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3099/6466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:23 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2543c73e-94f5-433f-9f33-87db6aa278c8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/247db1df-1beb-4fbc-9d59-661923079e74/action HTTP/1.1 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 14 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: {"rescue": {}} Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 247db1df-1beb-4fbc-9d59-661923079e74 could not be found. Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '247db1df-1beb-4fbc-9d59-661923079e74', 'body': {'rescue': {}}} Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 247db1df-1beb-4fbc-9d59-661923079e74 could not be found. Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 247db1df-1beb-4fbc-9d59-661923079e74 could not be found. Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:23.741842 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 247db1df-1beb-4fbc-9d59-661923079e74 could not be found. Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2543c73e-94f5-433f-9f33-87db6aa278c8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 404 to user: Instance 247db1df-1beb-4fbc-9d59-661923079e74 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2543c73e-94f5-433f-9f33-87db6aa278c8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/247db1df-1beb-4fbc-9d59-661923079e74/action" status: 404 len: 111 microversion: 2.1 time: 0.027470 Aug 24 04:20:23.747491 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3368/6467] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:20:23 2022] POST /compute/v2.1/servers/247db1df-1beb-4fbc-9d59-661923079e74/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:20:23.756313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:23.756853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:23.763562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.764083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.764521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.765208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.765666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.766093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.842229 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff7c2f74-9876-4c57-b6a2-87aa8ebf6d07 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action" status: 202 len: 0 microversion: 2.1 time: 0.089565 Aug 24 04:20:23.842965 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3100/6468] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:20:23 2022] POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:20:23.853195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:23.853847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:23.861458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.862068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.862654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:23.863408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:23.863903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:23.864322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:24.023837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:24.032943 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9748769d-f465-4bc6-9776-6b3d869228bc tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1519 microversion: 2.1 time: 0.183898 Aug 24 04:20:24.044432 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3369/6469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:23 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:24.751606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:24.757544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:24.758267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:24.766754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:24.767281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:24.767953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:24.768566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:24.769035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:24.769464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:24.937815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:24.950252 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-831092ed-ed86-4357-98c5-eb1ef893e263 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.199260 Aug 24 04:20:24.951378 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3101/6470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:24 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:25.055849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:25.056988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:25.066311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.066972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.067691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.069046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.070111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.070961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.229463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:25.240435 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3e0a5e37-c406-4e17-bd1d-ace5f66cf737 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1499 microversion: 2.1 time: 0.189327 Aug 24 04:20:25.241065 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3370/6471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:25 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1499 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:25.261793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:25.264421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:25.271012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.271507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.271984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.272697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.273149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.277613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.299284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lazy-loading 'flavor' on Instance uuid 4fb20b75-b852-4d45-8e50-7e43051e3493 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:20:25.311985 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Cannot 'rescue' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state paused Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action HTTP/1.1 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 14 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: {"rescue": {}} Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot 'rescue' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state paused Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '4fb20b75-b852-4d45-8e50-7e43051e3493', 'body': {'rescue': {}}} Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fb20b75-b852-4d45-8e50-7e43051e3493 in vm_state paused. Cannot rescue while the instance is in this state. Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state paused Aug 24 04:20:25.313998 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state paused Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 409 to user: Cannot 'rescue' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state paused {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad8175cf-61de-43df-aa66-1040c800203d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action" status: 409 len: 144 microversion: 2.1 time: 0.058038 Aug 24 04:20:25.319090 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3102/6472] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:20:25 2022] POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action => generated 144 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:20:25.324973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:25.325394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:25.332533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.333022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.333464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.334172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.334659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.335084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.406951 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd18fab3-d148-4614-940f-7ea3dc9e346e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action" status: 202 len: 0 microversion: 2.1 time: 0.085649 Aug 24 04:20:25.407848 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3371/6473] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:20:25 2022] POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:20:25.417085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:25.418038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:25.425064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.425876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.426653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.427485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.428127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.428525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.585142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:25.594776 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6c0e091d-0c76-433e-9037-08ac175b9def tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1506 microversion: 2.1 time: 0.181990 Aug 24 04:20:25.595388 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3103/6474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:25 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:25.978953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:25.979701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:25.986783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.987299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.987768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:25.988493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:25.988954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:25.989406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:26.178444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:26.189500 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-140f4b77-96cf-4aaa-88e1-afd4573471f3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.214644 Aug 24 04:20:26.190295 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3372/6475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:25 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:26.616831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:26.617445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:26.625358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:26.625892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:26.626307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:26.627431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:26.628039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:26.628399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:26.774077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:26.782648 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f1851a09-7860-4887-bf65-09247a817a55 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1514 microversion: 2.1 time: 0.169997 Aug 24 04:20:26.783287 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3104/6476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:26 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:27.211478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:27.212284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:27.220884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:27.221220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:27.221802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:27.222663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:27.223452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:27.224027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:27.388774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:27.406322 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac64e0ac-82b2-4986-96d7-5e5874d7e113 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.198933 Aug 24 04:20:27.406993 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3373/6477] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:27 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:28.199084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:28.201504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:28.209054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:28.209557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:28.210002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:28.210714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:28.211175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:28.211609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:28.236435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lazy-loading 'flavor' on Instance uuid 4fb20b75-b852-4d45-8e50-7e43051e3493 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:20:28.282812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:28.319995 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e0376a57-efa7-4b18-ba21-68b1c10f191b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action" status: 200 len: 32 microversion: 2.1 time: 0.128099 Aug 24 04:20:28.320875 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3105/6478] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:20:28 2022] POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action => generated 32 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:20:28.331711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:28.332676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:28.341101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:28.341700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:28.342403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:28.343234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:28.343791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:28.344287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:28.431069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:28.432115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:28.440046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:28.440854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:28.441752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:28.442653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:28.443326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:28.443801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:28.496241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:28.504982 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9353afb6-2e92-4d73-8689-26978e76d0c0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.178369 Aug 24 04:20:28.513373 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3374/6479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:28 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:28.700470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:28.711513 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-465c174e-e3cb-4f51-8379-3faeb3fa2549 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.287610 Aug 24 04:20:28.712207 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3106/6480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:28 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:29.526665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:29.527445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:29.537194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:29.537696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:29.538135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:29.538875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:29.539326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:29.539796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:29.688869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:29.697397 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d98956cd-5226-48ce-af97-231498380d14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.175013 Aug 24 04:20:29.698101 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3375/6481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:29 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:29.732705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:29.733308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:29.741369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:29.741863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:29.742304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:29.743074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:29.743473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:29.743928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:29.895924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:29.904963 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2345f796-4f15-4176-be3c-a519f5effa0c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1169 microversion: 2.1 time: 0.176019 Aug 24 04:20:29.906795 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3107/6482] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:29 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:30.723797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:30.724428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:30.734802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:30.735655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:30.736585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:30.737287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:30.737744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:30.738170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:30.892459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:30.900947 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9f682987-bdb0-4c20-aef3-fb8fa8d467c7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.182424 Aug 24 04:20:30.901543 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3376/6483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:30 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:30.927428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:30.928053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:30.935886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:30.936387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:30.936836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:30.937543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:30.938010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:30.938444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:31.096583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:31.105702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c54dffbc-1056-434b-91e3-d2cc22e21998 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.182861 Aug 24 04:20:31.106295 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3108/6484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:30 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:31.922204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:31.922898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:31.930860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:31.931358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:31.931819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:31.932552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:31.933017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:31.933452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:32.090153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:32.100542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16b085e8-00b5-460b-9ece-9fd3ce5a6394 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.182380 Aug 24 04:20:32.101259 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3377/6485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:31 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:32.126868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:32.127570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:32.135030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:32.135506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:32.135977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:32.136715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:32.137169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:32.137606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:32.279400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:32.291298 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e59250c8-6e6c-4381-aef4-0b7897ec9af8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.168335 Aug 24 04:20:32.292248 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3109/6486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:32 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:33.121374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:33.122005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:33.129750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:33.130249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:33.130694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:33.131404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:33.131906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:33.132330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:33.278059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:33.288957 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-57c03bc4-22bc-4b54-8866-040396740bf5 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.171507 Aug 24 04:20:33.289479 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3378/6487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:33 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:20:33.315048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:33.315708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:33.323613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:33.324159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:33.324602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:33.325324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:33.325788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:33.326228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:33.487282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:33.499719 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c32c37b-2fdf-48dd-8b37-0f7f59154e81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.188449 Aug 24 04:20:33.500630 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3110/6488] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:33 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:34.310460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:34.311097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:34.318662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:34.319152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:34.319590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:34.320331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:34.320791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:34.321201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:34.469824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:34.479729 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-435c3706-3dea-48ba-afee-8ba345ed5d8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.173401 Aug 24 04:20:34.480385 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3379/6489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:34 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:34.523246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:34.523900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:34.531340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:34.531881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:34.532320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:34.533038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:34.533493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:34.533925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:34.676947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:34.685581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a17a8e7c-374a-435b-8d46-b1eb9a5aae81 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.166952 Aug 24 04:20:34.686202 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3111/6490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:34 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:35.505196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:35.505945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:35.513682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:35.514174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:35.514658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:35.515386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:35.515910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:35.516352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:35.680064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:35.688458 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c3724bb-4c48-4b87-9c50-9e2a801caf18 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.189265 Aug 24 04:20:35.689184 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3380/6491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:35 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:35.707515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:35.708700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:35.716582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:35.717054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:35.717494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:35.718201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:35.718654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:35.719081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:35.907486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:35.915701 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-600677a7-7c0f-4cf7-8db1-a563e5f43d97 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.213044 Aug 24 04:20:35.916347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3112/6492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:35 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:36.711591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:36.712263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:36.719773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:36.720273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:36.720710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:36.721418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:36.721869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:36.722291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:36.879255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:36.883346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:36.890793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ee164f0-bdca-4de2-8163-bcb57c5267cf tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.183950 Aug 24 04:20:36.891417 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3381/6493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:36 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:36.940915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:36.941533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:36.949237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:36.949737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:36.950170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:36.951080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:36.951526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:36.951972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:37.108433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:37.116903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c69ad19d-e6bf-4284-95ef-f1d302925b4e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.182046 Aug 24 04:20:37.117495 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3113/6494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:36 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:37.914206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:37.915055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:37.926205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:37.926855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:37.927386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:37.928356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:37.928865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:37.929484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.086914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:38.097091 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d96abcfe-b7fb-4bc5-871b-e6a7a189a439 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1500 microversion: 2.1 time: 0.187148 Aug 24 04:20:38.097728 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3382/6495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:37 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1500 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:38.124509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a95f8ee-382a-4544-9957-fa20e656bf02"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:38.126848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:38.134796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:38.135290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:38.135763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.136463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:38.137232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:38.137638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.142318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:38.142952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:38.149421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:38.149878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:38.150312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.151009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:38.151460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:38.151909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.164977 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Cannot 'attach_volume' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state rescued Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/os-volume_attachments HTTP/1.1 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 74 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: {"volumeAttachment": {"volumeId": "8a95f8ee-382a-4544-9957-fa20e656bf02"}} Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot 'attach_volume' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state rescued Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': '4fb20b75-b852-4d45-8e50-7e43051e3493', 'body': {'volumeAttachment': {'volumeId': '8a95f8ee-382a-4544-9957-fa20e656bf02'}}} Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fb20b75-b852-4d45-8e50-7e43051e3493 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 04:20:38.166629 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state rescued Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state rescued Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 409 to user: Cannot 'attach_volume' instance 4fb20b75-b852-4d45-8e50-7e43051e3493 while it is in vm_state rescued {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47564322-82e4-4815-883f-bbe80ec99872 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047832 Aug 24 04:20:38.171286 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3114/6496] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:20:38 2022] POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:20:38.177298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:38.177991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:38.184487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:38.184990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:38.185434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.186145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:38.186610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:38.187043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.264444 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5feb2a69-348f-425f-bcbc-cc28454070d2 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action" status: 202 len: 0 microversion: 2.1 time: 0.090894 Aug 24 04:20:38.265296 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3115/6497] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:20:38 2022] POST /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:20:38.275103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:38.275957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:38.282449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:38.282932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:38.283369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.284102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:38.284559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:38.284987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:38.297381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:38.306971 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0ee6d2b3-4174-430a-b792-47a4350d1a87 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.168634 Aug 24 04:20:38.307565 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3383/6498] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:38 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:20:38.518456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:38.527293 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e4fcc76-a2cc-45c4-ae63-ff0925e509b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1508 microversion: 2.1 time: 0.257181 Aug 24 04:20:38.527921 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3116/6499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:38 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:20:39.328691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:39.329570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:39.337106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:39.337597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:39.338034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:39.338803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:39.339259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:39.339696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:39.493030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:39.501473 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a33dc23c-12d8-49fb-b5c1-c939192247b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.176811 Aug 24 04:20:39.502101 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3384/6500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:39 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:39.553950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:39.554564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:39.561744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:39.562240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:39.562678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:39.563704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:39.564493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:39.564908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:39.705959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:39.714522 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e251ad30-5e79-44f8-ace3-ac76616ad224 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1508 microversion: 2.1 time: 0.167197 Aug 24 04:20:39.715124 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3117/6501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:39 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:40.524773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:40.525374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:40.532530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:40.533037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:40.533463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:40.534167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:40.534632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:40.535059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:40.677571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:40.686361 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b246091d-631b-4d4e-af2d-9ee8dbf89e67 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.166594 Aug 24 04:20:40.686953 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3385/6502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:40 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:40.738599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:40.739489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:40.749087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:40.749602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:40.750042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:40.750820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:40.751247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:40.751697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:40.905118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:40.916136 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4cc7b3a-d1c3-4c99-9f9f-a32a11450b19 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1508 microversion: 2.1 time: 0.183985 Aug 24 04:20:40.916726 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3118/6503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:40 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:41.231736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d7ba0ed9-0809-4349-a45d-ecf3cc63e357 req-20267967-eb8d-4c34-bcfb-9ac615c06794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f278bd11-ef77-48c8-99fa-5800b5ceb038", "name": "network-vif-plugged", "status": "completed", "tag": "c0933787-6dc3-43d2-a22f-74307523893e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:41.241540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d7ba0ed9-0809-4349-a45d-ecf3cc63e357 req-20267967-eb8d-4c34-bcfb-9ac615c06794 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:41.242196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d7ba0ed9-0809-4349-a45d-ecf3cc63e357 req-20267967-eb8d-4c34-bcfb-9ac615c06794 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:41.242482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d7ba0ed9-0809-4349-a45d-ecf3cc63e357 req-20267967-eb8d-4c34-bcfb-9ac615c06794 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:41.254412 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d7ba0ed9-0809-4349-a45d-ecf3cc63e357 req-20267967-eb8d-4c34-bcfb-9ac615c06794 service nova] Creating event network-vif-plugged:c0933787-6dc3-43d2-a22f-74307523893e for instance f278bd11-ef77-48c8-99fa-5800b5ceb038 on n-h1-846470-15 Aug 24 04:20:41.259945 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d7ba0ed9-0809-4349-a45d-ecf3cc63e357 req-20267967-eb8d-4c34-bcfb-9ac615c06794 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031997 Aug 24 04:20:41.260550 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3386/6504] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:20:41.710056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:41.710749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:41.717439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:41.717930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:41.718401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:41.719092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:41.719546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:41.720011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:41.865146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:41.874731 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4324795-434a-45ed-9454-7f88d1a278cc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1203 microversion: 2.1 time: 0.168793 Aug 24 04:20:41.875358 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3119/6505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:41 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:41.946099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:41.946795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:41.956640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:41.957272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:41.957790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:41.958706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:41.959163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:41.959742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:42.106055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:42.114337 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed6bd662-7e64-43b9-84c0-30eb7d003905 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1514 microversion: 2.1 time: 0.175596 Aug 24 04:20:42.114913 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3387/6506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:41 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:42.897650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:42.898510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:42.905859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:42.906359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:42.906802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:42.907521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:42.908011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:42.908736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.051192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:43.060728 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e50f7a1e-42df-4277-94a1-ae5d79f9a3b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1389 microversion: 2.1 time: 0.168013 Aug 24 04:20:43.061616 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3120/6507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:42 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:43.083051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:43.083696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:43.091010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:43.091575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:43.091985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.092701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:43.093159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:43.093682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.249978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:43.259924 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-deec558d-8c35-4189-b505-b8aa35250a5b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1389 microversion: 2.1 time: 0.181100 Aug 24 04:20:43.260544 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3388/6508] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:43 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1389 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:43.280650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:43.281310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:43.287658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:43.288172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:43.288665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.289432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:43.289887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:43.290319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.294658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:43.435331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:43.449555 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6039a03c-6055-473e-bcbb-f9466f022684 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1389 microversion: 2.1 time: 0.172728 Aug 24 04:20:43.450348 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3121/6509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:43 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1389 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:20:43.505989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c02b76c-37c6-4384-a1a4-ee45ddf4331a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'create', calling method: .version_select at 0x7f10226519d0>, body: {"keypair": {"name": "tempest-keypair-846754930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/AE3EFdcW953chzWdDGPpyT7VZ7s0JJeux1XU+Vcah4deFlFwPpnEXvSNW+roF7lrjUmq1e3JWmIfISZsknpD3c9jfud3btQWJe+SA2SxjawjFng29SGpvkUrPnMzBYg=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:43.523052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-9c02b76c-37c6-4384-a1a4-ee45ddf4331a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Getting quotas for project 80b565a749864bc6801910e6d70f3a37. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:20:43.528726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-9c02b76c-37c6-4384-a1a4-ee45ddf4331a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Getting quotas for user 6bf7e4965a6d45c083c84e714edee9d7 and project 80b565a749864bc6801910e6d70f3a37. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:20:43.529583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:43.530091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:43.536398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:43.536895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:43.537340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.538046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:43.538512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:43.539302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.556467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9c02b76c-37c6-4384-a1a4-ee45ddf4331a tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054337 Aug 24 04:20:43.557107 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3389/6510] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:20:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:20:43.565556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:20:43.653642 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e7cbf961-ff08-42b7-a70c-4b1c158812ef tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 204 len: 0 microversion: 2.1 time: 0.127421 Aug 24 04:20:43.654595 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3122/6511] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:20:43 2022] DELETE /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:20:43.664243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:43.664769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:43.671335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:43.671968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:43.672470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.673235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:43.673787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:43.674272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:43.852185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:43.861182 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-444e5d0b-0890-44d7-a7e6-d970d402d8d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1395 microversion: 2.1 time: 0.202019 Aug 24 04:20:43.861763 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3390/6512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:43 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1395 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:44.885277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:44.886016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:44.895211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:44.895647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:44.896120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:44.896918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:44.897384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:44.903497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:44.968342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1980414941", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ced95019-c316-44b0-b100-8218ac6cea18"}], "security_groups": [{"name": "tempest-securitygroup--1767770374"}], "key_name": "tempest-keypair-846754930", "user_data": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:45.052982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:45.061545 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5ad1e4cc-02a7-44f2-9e2a-407044dcb1a6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1395 microversion: 2.1 time: 0.180975 Aug 24 04:20:45.068688 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3123/6513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:44 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1395 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:45.096239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] validate_networks() for [('ced95019-c316-44b0-b100-8218ac6cea18', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:20:45.784987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:20:45.785416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:20:45.785922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:20:45.786352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:20:45.786778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:20:45.797738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:45.798245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:45.798679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:45.799424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:45.799911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:45.800339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:45.819382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Getting quotas for project 80b565a749864bc6801910e6d70f3a37. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:20:45.825571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Getting quotas for user 6bf7e4965a6d45c083c84e714edee9d7 and project 80b565a749864bc6801910e6d70f3a37. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:20:45.841919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:20:45.844517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:20:45.896959 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4a1a929-2616-476d-9615-61e115c6122f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.933188 Aug 24 04:20:45.897917 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3391/6514] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:20:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:20:45.909250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a1dcdad-c8c5-41cc-9221-c56dd5a89b68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:45.909963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a1dcdad-c8c5-41cc-9221-c56dd5a89b68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:45.998921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a1dcdad-c8c5-41cc-9221-c56dd5a89b68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:46.006443 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a1dcdad-c8c5-41cc-9221-c56dd5a89b68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1245 microversion: 2.1 time: 0.101220 Aug 24 04:20:46.007114 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3124/6515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:45 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:46.095584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:46.096414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:46.105618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:46.106219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:46.106748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:46.107525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:46.108106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:46.108803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:46.314318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:46.327055 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a081ce5d-fe1a-47cb-a7db-edc8c3e2a020 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1395 microversion: 2.1 time: 0.236079 Aug 24 04:20:46.327951 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3392/6516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:46 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1395 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:46.372507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-69901868-880c-4b11-95c4-f687ca1792d2 req-f068d952-dd4b-4432-a472-1f51cbae9f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f278bd11-ef77-48c8-99fa-5800b5ceb038", "name": "network-vif-deleted", "tag": "c0933787-6dc3-43d2-a22f-74307523893e"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:46.392958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-69901868-880c-4b11-95c4-f687ca1792d2 req-f068d952-dd4b-4432-a472-1f51cbae9f45 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:46.393735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-69901868-880c-4b11-95c4-f687ca1792d2 req-f068d952-dd4b-4432-a472-1f51cbae9f45 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:46.394414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-69901868-880c-4b11-95c4-f687ca1792d2 req-f068d952-dd4b-4432-a472-1f51cbae9f45 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:46.411523 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-69901868-880c-4b11-95c4-f687ca1792d2 req-f068d952-dd4b-4432-a472-1f51cbae9f45 service nova] Creating event network-vif-deleted:c0933787-6dc3-43d2-a22f-74307523893e for instance f278bd11-ef77-48c8-99fa-5800b5ceb038 on n-h1-846470-15 Aug 24 04:20:46.418222 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-69901868-880c-4b11-95c4-f687ca1792d2 req-f068d952-dd4b-4432-a472-1f51cbae9f45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050939 Aug 24 04:20:46.420080 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3125/6517] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:20:47.027430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:47.028076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:47.034538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:47.035035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:47.035472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:47.036208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:47.036667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:47.037078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:47.107463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:47.117406 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c1c14259-fb16-4ca5-be1d-56882f6bbed4 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1297 microversion: 2.1 time: 0.093391 Aug 24 04:20:47.118021 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3393/6518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:47 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:47.351120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:47.351892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:47.359243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:47.360172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:47.360895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:47.361899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:47.362453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:47.362964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:47.460585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:47.470396 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-799bb90b-3102-46e4-ba86-1a6596abdb9f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1188 microversion: 2.1 time: 0.124662 Aug 24 04:20:47.471292 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3126/6519] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:47 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:48.141160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:48.142480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:48.152945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:48.153780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:48.154544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:48.155473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:48.155967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:48.156588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:48.337373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:48.346034 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5aac2e4c-2c12-4eda-89d6-e8876386a360 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1371 microversion: 2.1 time: 0.210337 Aug 24 04:20:48.356164 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3394/6520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:48 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:48.492952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:48.493602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:48.498762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:48.504993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:48.505736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:48.506179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:48.506922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:48.508128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:48.508568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:48.592263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:48.601904 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb1fdc90-d438-489f-8e2a-6e8fd427a9a1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1188 microversion: 2.1 time: 0.114046 Aug 24 04:20:48.604675 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3127/6521] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:48 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:48.748406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f532042f-ab51-442a-88b4-70766ca028a9 req-d9b66c0a-beea-408d-b726-624a04364448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46840e8c-528b-45ff-84cb-270ef6a0c65b", "tag": "a4f35b49-2398-4308-a251-23130373d359"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:48.761189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f532042f-ab51-442a-88b4-70766ca028a9 req-d9b66c0a-beea-408d-b726-624a04364448 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:48.761813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f532042f-ab51-442a-88b4-70766ca028a9 req-d9b66c0a-beea-408d-b726-624a04364448 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:48.762344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f532042f-ab51-442a-88b4-70766ca028a9 req-d9b66c0a-beea-408d-b726-624a04364448 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:48.776575 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f532042f-ab51-442a-88b4-70766ca028a9 req-d9b66c0a-beea-408d-b726-624a04364448 service nova] Creating event network-changed:a4f35b49-2398-4308-a251-23130373d359 for instance 46840e8c-528b-45ff-84cb-270ef6a0c65b on n-h1-846470-15 Aug 24 04:20:48.782429 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f532042f-ab51-442a-88b4-70766ca028a9 req-d9b66c0a-beea-408d-b726-624a04364448 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038406 Aug 24 04:20:48.783615 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3395/6522] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:20:49.369354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:49.369882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:49.376384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:49.376883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:49.377318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:49.378023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:49.378479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:49.378966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:49.523406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:49.532272 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-83a55b1b-a896-4428-8056-cc460fbf0dee tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1371 microversion: 2.1 time: 0.167808 Aug 24 04:20:49.532855 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3128/6523] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:49 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:49.625921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:49.626632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:49.633911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:49.634407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:49.634848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:49.635597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:49.636085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:49.636521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:49.705094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:49.714071 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a49bbcb-0a1d-4ee3-84e7-8a01b7d380a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1188 microversion: 2.1 time: 0.093614 Aug 24 04:20:49.714666 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3396/6524] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:49 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:50.553438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:50.555074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:50.562607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:50.563098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:50.563541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:50.564285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:50.564765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:50.565197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:50.710137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:50.718269 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f96377c-a0a2-425e-8f6d-29b235a8e735 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1371 microversion: 2.1 time: 0.168886 Aug 24 04:20:50.719082 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3129/6525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:50 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:50.738747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:50.740225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:50.747656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:50.748186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:50.748619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:50.749335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:50.749784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:50.750209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:50.830686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:50.839760 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac992990-ccbb-4c46-b92c-7e3ddca8b235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1188 microversion: 2.1 time: 0.105503 Aug 24 04:20:50.840398 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3397/6526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:50 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:51.741758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:51.742426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:51.750111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:51.750617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:51.751072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:51.751799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:51.752265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:51.752705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:51.866141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:51.866979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:51.885577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:51.886492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:51.887166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:51.888148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:51.888798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:51.889429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:51.927388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:51.928198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:51.928936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:51.929596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lazy-loading 'fault' on Instance uuid f278bd11-ef77-48c8-99fa-5800b5ceb038 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:20:51.976345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:51.992175 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e917112b-b83c-46c8-b2e7-a7d59338e939 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 200 len: 1147 microversion: 2.1 time: 0.132382 Aug 24 04:20:52.008375 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3398/6527] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:51 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 1147 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:52.093609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:52.103694 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4345121d-889c-4d98-bea7-ab834362a7d9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1371 microversion: 2.1 time: 0.366428 Aug 24 04:20:52.104737 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3130/6528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:51 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:53.014872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:53.015526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:53.018625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:53.025032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:53.025533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:53.025971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:53.026698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:53.027148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:53.027564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:53.043639 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 HTTP/1.1 Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'f278bd11-ef77-48c8-99fa-5800b5ceb038'} Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:53.045394 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9affaa79-72d6-4a3c-9964-187bf387df03 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 404 len: 111 microversion: 2.1 time: 0.036069 Aug 24 04:20:53.055213 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3399/6529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:53 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:20:53.128240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:53.128852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:53.136796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:53.137288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:53.137773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:53.138431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:53.138886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:53.139313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:53.291983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:53.301624 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d98fb320-560f-4332-bc3a-6356580c38e6 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1371 microversion: 2.1 time: 0.177331 Aug 24 04:20:53.302207 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3131/6530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:53 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:54.325394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:54.325964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:54.333568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:54.334047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:54.334488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:54.335287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:54.335780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:54.336202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:54.480732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:54.489679 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd261c21-8b62-464a-bb28-bcdd9dfaaec7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1371 microversion: 2.1 time: 0.168335 Aug 24 04:20:54.490268 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3400/6531] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:54 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:55.202975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:55.203545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:55.212058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:55.212561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:55.212999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:55.213713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:55.214166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:55.214591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:55.235755 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 HTTP/1.1 Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'f278bd11-ef77-48c8-99fa-5800b5ceb038'} Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:20:55.239962 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c8f58f36-8e42-446e-b70e-35fcfe1c19b9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 404 len: 111 microversion: 2.1 time: 0.042992 Aug 24 04:20:55.246844 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3132/6532] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:20:55 2022] DELETE /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:20:55.252549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:55.253283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: f278bd11-ef77-48c8-99fa-5800b5ceb038] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:55.260593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:55.261368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:55.261904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:55.262892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:55.263406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:55.263940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:55.280107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 HTTP/1.1 Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'f278bd11-ef77-48c8-99fa-5800b5ceb038'} Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:20:55.282464 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance f278bd11-ef77-48c8-99fa-5800b5ceb038 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:20:55.288192 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-075b6d93-f543-4436-be1f-b95910b157c6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038" status: 404 len: 111 microversion: 2.1 time: 0.037463 Aug 24 04:20:55.292244 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3401/6533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:55 2022] GET /compute/v2.1/servers/f278bd11-ef77-48c8-99fa-5800b5ceb038 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:20:55.301317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bf78db68-63d3-42d6-8cac-d37bd33d4f73 req-2b0f08f6-c5b2-4502-8f6f-fa9dda669280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46840e8c-528b-45ff-84cb-270ef6a0c65b", "name": "network-vif-plugged", "status": "completed", "tag": "a4f35b49-2398-4308-a251-23130373d359"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:55.312318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bf78db68-63d3-42d6-8cac-d37bd33d4f73 req-2b0f08f6-c5b2-4502-8f6f-fa9dda669280 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:55.312805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bf78db68-63d3-42d6-8cac-d37bd33d4f73 req-2b0f08f6-c5b2-4502-8f6f-fa9dda669280 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:55.313234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bf78db68-63d3-42d6-8cac-d37bd33d4f73 req-2b0f08f6-c5b2-4502-8f6f-fa9dda669280 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:55.326015 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bf78db68-63d3-42d6-8cac-d37bd33d4f73 req-2b0f08f6-c5b2-4502-8f6f-fa9dda669280 service nova] Creating event network-vif-plugged:a4f35b49-2398-4308-a251-23130373d359 for instance 46840e8c-528b-45ff-84cb-270ef6a0c65b on n-h1-846470-15 Aug 24 04:20:55.331518 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bf78db68-63d3-42d6-8cac-d37bd33d4f73 req-2b0f08f6-c5b2-4502-8f6f-fa9dda669280 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047501 Aug 24 04:20:55.332539 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3133/6534] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:20:55.511838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:55.512387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:55.519618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:55.520232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:55.520622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:55.521356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:55.521813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:55.522507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:55.541016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:55.660361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:55.668472 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d4386af3-e6c9-41a2-a300-a227347ffb54 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1371 microversion: 2.1 time: 0.161100 Aug 24 04:20:55.669081 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3402/6535] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:55 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:56.688052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:56.693555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:56.694385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:56.701680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:56.702175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:56.702629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:56.703402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:56.704285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:56.704871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:56.856414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:56.864829 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3eaf24d0-37d7-4e48-b8c0-7ed668a5f73b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1371 microversion: 2.1 time: 0.177889 Aug 24 04:20:56.865436 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3134/6536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:56 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:57.886972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:57.887546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:57.889573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:57.890249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=10 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:57.899321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:57.899853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:57.900299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:57.901013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:57.901474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:57.901902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:58.047415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:20:58.055803 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c19954ea-a1d1-4101-94c4-8b8a2ec93fab tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1564 microversion: 2.1 time: 0.173192 Aug 24 04:20:58.056410 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3403/6537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:20:57 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:20:58.076924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:20:58.077802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:20:58.085805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:58.086318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:58.086754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:58.087463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:58.087966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:58.088395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:58.182096 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bb74421d-45d6-4849-a411-e812098978f0 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109066 Aug 24 04:20:58.182373 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3135/6538] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:20:58 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:20:59.250297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-4a1b58c7-2e71-443a-b64a-8c8680a542d8 req-6be294b9-63bc-4afb-937c-748e28be60d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46840e8c-528b-45ff-84cb-270ef6a0c65b", "tag": "a4f35b49-2398-4308-a251-23130373d359"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:20:59.261583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4a1b58c7-2e71-443a-b64a-8c8680a542d8 req-6be294b9-63bc-4afb-937c-748e28be60d2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:20:59.262074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4a1b58c7-2e71-443a-b64a-8c8680a542d8 req-6be294b9-63bc-4afb-937c-748e28be60d2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:20:59.262516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4a1b58c7-2e71-443a-b64a-8c8680a542d8 req-6be294b9-63bc-4afb-937c-748e28be60d2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:20:59.275981 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-4a1b58c7-2e71-443a-b64a-8c8680a542d8 req-6be294b9-63bc-4afb-937c-748e28be60d2 service nova] Creating event network-changed:a4f35b49-2398-4308-a251-23130373d359 for instance 46840e8c-528b-45ff-84cb-270ef6a0c65b on n-h1-846470-15 Aug 24 04:20:59.281360 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-4a1b58c7-2e71-443a-b64a-8c8680a542d8 req-6be294b9-63bc-4afb-937c-748e28be60d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034881 Aug 24 04:20:59.285117 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3404/6539] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:21:17.393486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=17 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:17.394297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:17.398755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-683864896", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "51f4ecc3-fef1-4378-92ed-079b76074d6c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9935c908-0959-4c8b-be4e-161d3600b222"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:21:17.476266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] validate_networks() for [('9935c908-0959-4c8b-be4e-161d3600b222', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:21:17.980910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:21:17.981609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:21:17.982851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:21:17.984246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:21:17.985201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:21:18.002385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:18.003324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:18.003933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:18.004770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:18.005249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:18.005677 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:18.025983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:21:18.032345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:21:18.123708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:21:18.126917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51f4ecc3-fef1-4378-92ed-079b76074d6c',volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:21:18.304812 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ebc6f30a-c08b-4702-887a-355617279a12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913120 Aug 24 04:21:18.305755 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3136/6540] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:21:18.318180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=11 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:18.319499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=11 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:18.328922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f969d17-8427-47d9-b636-740b90e1fc4a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:18.329978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f969d17-8427-47d9-b636-740b90e1fc4a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:18.407092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f969d17-8427-47d9-b636-740b90e1fc4a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:18.416465 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f969d17-8427-47d9-b636-740b90e1fc4a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1070 microversion: 2.1 time: 0.101776 Aug 24 04:21:18.417102 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3405/6541] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:18 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1070 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:19.441276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:19.442024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:19.450672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:19.451150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:19.451622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:19.452357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:19.452823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:19.453281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:19.535109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:19.548735 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a372ab43-cf29-40e7-951c-ed6f48d4d5fa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1168 microversion: 2.1 time: 0.112270 Aug 24 04:21:19.549739 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3137/6542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:19 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1168 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:20.580648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:20.582679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:20.595143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:20.595814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:20.596571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:20.597933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:20.598596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:20.599278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:20.779399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:20.789629 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5a17215-afca-4ba8-8d7d-5cbde0a507cb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1228 microversion: 2.1 time: 0.214674 Aug 24 04:21:20.790589 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3406/6543] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:20 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1228 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:21.816014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:21.816863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:21.825943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:21.826551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:21.827063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:21.828037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:21.828910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:21.829577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:21.902900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5af8f074-9296-4e4b-9f9e-24068a86522f req-be414420-c089-47b0-ad31-95caca382e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70afefe-0acb-4281-8298-133d346f41a6", "tag": "cb17371a-6e06-4b0f-9236-816e24012cf5"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:21:21.928858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5af8f074-9296-4e4b-9f9e-24068a86522f req-be414420-c089-47b0-ad31-95caca382e19 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:21.929716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5af8f074-9296-4e4b-9f9e-24068a86522f req-be414420-c089-47b0-ad31-95caca382e19 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:21.930590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5af8f074-9296-4e4b-9f9e-24068a86522f req-be414420-c089-47b0-ad31-95caca382e19 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:21.950629 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5af8f074-9296-4e4b-9f9e-24068a86522f req-be414420-c089-47b0-ad31-95caca382e19 service nova] Creating event network-changed:cb17371a-6e06-4b0f-9236-816e24012cf5 for instance a70afefe-0acb-4281-8298-133d346f41a6 on n-h1-846470-15 Aug 24 04:21:21.958496 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5af8f074-9296-4e4b-9f9e-24068a86522f req-be414420-c089-47b0-ad31-95caca382e19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063210 Aug 24 04:21:21.962100 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3407/6544] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:21:22.147827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:22.159209 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24554f59-b7e4-4a1e-b015-737ab3c92ac7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1228 microversion: 2.1 time: 0.349621 Aug 24 04:21:22.160564 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3138/6545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:21 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1228 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:23.187620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:23.189098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:23.196232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:23.197084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:23.197803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:23.198775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:23.199475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:23.200164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:23.395322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:23.405286 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dfcbcc8b-32a9-4763-82bf-9d11bf546e11 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1228 microversion: 2.1 time: 0.223921 Aug 24 04:21:23.406533 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3408/6546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:23 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1228 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:24.428785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:24.429770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:24.437812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:24.438616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:24.439062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:24.439825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:24.440282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:24.440707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:24.594032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:24.603091 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6958cdb0-5525-466b-837e-17bdf60b62db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1228 microversion: 2.1 time: 0.179037 Aug 24 04:21:24.603877 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3139/6547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:24 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1228 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:25.625630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:25.626307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:25.634165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:25.634673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:25.635428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:25.636207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:25.636856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:25.637209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:25.829833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:25.839237 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d7313f5-bb1c-45be-8999-a2ed59ed5801 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1228 microversion: 2.1 time: 0.218424 Aug 24 04:21:25.840110 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3409/6548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:25 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1228 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:21:26.877597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:26.878807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:26.891297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:26.892118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:26.892832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:26.894051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:26.894834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:26.895555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:27.173386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:27.184218 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6169ae39-c67b-472e-a321-33adcf3a7ccd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.314093 Aug 24 04:21:27.184859 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3140/6549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:26 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:21:28.214335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:28.214992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:28.222885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:28.223389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:28.223877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:28.224607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:28.225097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:28.225553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:28.389273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:28.400975 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2395dfaa-7bb3-4772-a6d0-1eb614d89f23 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.190726 Aug 24 04:21:28.401596 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3410/6550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:28 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:29.423525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:29.424447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:29.427104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:29.428008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:29.435884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:29.436441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:29.436942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:29.437742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:29.438237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:29.438755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:29.594402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:29.603214 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e6604332-eed9-4fbe-bef5-3a04b10a9bf6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.184012 Aug 24 04:21:29.603849 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3141/6551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:29 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:30.624804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:30.625723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:30.628522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:30.635158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:30.635654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:30.636149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:30.636847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:30.637310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:30.637748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:30.795264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:30.805473 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-38003a1e-f77c-4432-b496-e47b0dc7abe5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.184765 Aug 24 04:21:30.806154 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3411/6552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:30 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:31.829036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:31.829915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:31.839717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:31.840326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:31.840787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:31.841589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:31.842089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:31.842571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:32.001804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:32.013314 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5de4583c-f474-4a22-a533-d0c4d44b9082 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.188564 Aug 24 04:21:32.014008 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3142/6553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:31 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:33.044088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:33.044798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:33.053371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:33.053870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:33.054305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:33.055021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:33.055472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:33.055936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:33.207795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:33.216605 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a12e6aad-b721-4b6a-9636-c3f4df10c7ba tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.176610 Aug 24 04:21:33.217268 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3412/6554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:33 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:34.241695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:34.242338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:34.249852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:34.250343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:34.250764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:34.251488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:34.252109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:34.252554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:34.500283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:34.510157 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0dbff315-b91d-4b20-8e3d-c2b0de76ae2c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.272121 Aug 24 04:21:34.511225 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3143/6555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:34 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:35.537475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:35.538154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:35.545022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:35.545520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:35.545978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:35.546662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:35.547128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:35.547813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:35.691983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:35.700060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7cb7cdf5-9d01-43fe-9d92-240104977818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.168022 Aug 24 04:21:35.700692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3413/6556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:35 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:36.721684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:36.722314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:36.730249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:36.730737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:36.731178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:36.731927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:36.732389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:36.732823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:36.880489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:36.888692 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-675dee72-b903-4a4c-90ae-2270db50733e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.171043 Aug 24 04:21:36.889290 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3144/6557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:36 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:37.529812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c0e44ee8-8ade-4914-bf57-c034aef8acb2 req-616a53e5-b065-4e5a-96d4-9bae2a49789f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70afefe-0acb-4281-8298-133d346f41a6", "name": "network-vif-plugged", "status": "completed", "tag": "cb17371a-6e06-4b0f-9236-816e24012cf5"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:21:37.543200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c0e44ee8-8ade-4914-bf57-c034aef8acb2 req-616a53e5-b065-4e5a-96d4-9bae2a49789f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:37.543731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c0e44ee8-8ade-4914-bf57-c034aef8acb2 req-616a53e5-b065-4e5a-96d4-9bae2a49789f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:37.544217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c0e44ee8-8ade-4914-bf57-c034aef8acb2 req-616a53e5-b065-4e5a-96d4-9bae2a49789f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:37.557650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c0e44ee8-8ade-4914-bf57-c034aef8acb2 req-616a53e5-b065-4e5a-96d4-9bae2a49789f service nova] Creating event network-vif-plugged:cb17371a-6e06-4b0f-9236-816e24012cf5 for instance a70afefe-0acb-4281-8298-133d346f41a6 on n-h1-846470-15 Aug 24 04:21:37.563908 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c0e44ee8-8ade-4914-bf57-c034aef8acb2 req-616a53e5-b065-4e5a-96d4-9bae2a49789f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038076 Aug 24 04:21:37.564695 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3414/6558] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:21:37.911555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:37.912218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:37.919737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:37.920228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:37.920680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:37.921406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:37.921871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:37.922344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:38.084075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:38.092734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac1580fd-8a18-4b26-ae1c-a25ffe002b30 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.185713 Aug 24 04:21:38.093346 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3145/6559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:37 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:39.116571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:39.117279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:39.124208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:39.124735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:39.125235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:39.125871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:39.126329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:39.126761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:39.280881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:39.289691 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-607e9527-1d4a-4535-9241-0548849de331 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1216 microversion: 2.1 time: 0.179007 Aug 24 04:21:39.290293 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3415/6560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:39 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1216 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:40.311347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:40.312129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:40.321101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:40.321696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:40.323102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:40.323529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:40.324027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:40.324462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:40.477205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:40.486661 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c766e00d-7223-480e-9463-ac6628fc6d3b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1402 microversion: 2.1 time: 0.179625 Aug 24 04:21:40.487359 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3146/6561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:40 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1402 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:40.510476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:40.511132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:40.518902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:40.519437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:40.520197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:40.521053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:40.521526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:40.521989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:40.673985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:40.683308 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3a1bd9f2-36d1-488d-9a82-833f4f100bad tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1402 microversion: 2.1 time: 0.176887 Aug 24 04:21:40.684027 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3416/6562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:40 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1402 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:40.705527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-407514354"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:21:40.708161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:40.714929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:40.715434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:40.715924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:40.716642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:40.717104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:40.717583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:40.827089 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.api [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Attempting to quiesce instance before volume snapshot. Aug 24 04:21:40.897193 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.api [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 24 04:21:40.990556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Creating snapshot from volume 51f4ecc3-fef1-4378-92ed-079b76074d6c. {{(pid=122535) snapshot_instance /opt/stack/nova/nova/compute/api.py:3496}} Aug 24 04:21:42.080242 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3eaafa0e-cc0c-4aa4-87ce-19b1e63c0ff0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6/action" status: 202 len: 0 microversion: 2.1 time: 1.378915 Aug 24 04:21:42.082237 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3147/6563] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:21:40 2022] POST /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6/action => generated 0 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 04:21:43.264093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1490181737", "imageRef": "c6d3c1ac-8394-4bc5-9f70-ced12284b70a", "flavorRef": "452", "networks": [{"uuid": "9935c908-0959-4c8b-be4e-161d3600b222"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:21:43.333068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] validate_networks() for [('9935c908-0959-4c8b-be4e-161d3600b222', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:21:43.782410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:21:43.782833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:21:43.783357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:21:43.784299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:21:43.786557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:21:43.798073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:43.798759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:43.799250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:43.800147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:43.800684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:43.801225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:43.822085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:21:43.828583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:21:43.845324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:21:43.848070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b090c28c-65c7-4bce-a032-87a6c145c345',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:21:43.935352 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e34527c2-efae-40e0-8d21-12db24a62951 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675423 Aug 24 04:21:43.936068 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3417/6564] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:21:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:21:43.950277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-34f0ab0e-8f6a-41a6-8c10-368af380a0eb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:43.951466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-34f0ab0e-8f6a-41a6-8c10-368af380a0eb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:44.012612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-34f0ab0e-8f6a-41a6-8c10-368af380a0eb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:44.021864 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-34f0ab0e-8f6a-41a6-8c10-368af380a0eb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1230 microversion: 2.1 time: 0.077373 Aug 24 04:21:44.022691 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3148/6565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:43 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1230 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:45.047090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:45.047891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:45.056603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:45.057102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:45.057545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:45.058305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:45.058766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:45.059191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:45.161028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:45.170621 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-805a1824-a491-4763-8e5c-c9cd82eb0a55 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1282 microversion: 2.1 time: 0.128336 Aug 24 04:21:45.171426 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3418/6566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:45 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:46.194410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:46.195023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:46.224662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:46.227427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:46.231099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:46.234588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:46.237806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:46.239840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:46.594169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:46.608042 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8b365359-e707-42bd-b792-01f060e8ba4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.418434 Aug 24 04:21:46.609450 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3149/6567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:46 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:47.392331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5e7c97b0-36ff-4790-855f-ee3316da7492 req-13d52171-0f59-4d35-a985-4d78645fe180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed88b85-bcc2-41bb-97f1-859a3e907e80", "tag": "f635b370-82a1-4f9c-9fed-a331b29b3f32"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:21:47.411486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5e7c97b0-36ff-4790-855f-ee3316da7492 req-13d52171-0f59-4d35-a985-4d78645fe180 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:47.412858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5e7c97b0-36ff-4790-855f-ee3316da7492 req-13d52171-0f59-4d35-a985-4d78645fe180 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:47.413333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5e7c97b0-36ff-4790-855f-ee3316da7492 req-13d52171-0f59-4d35-a985-4d78645fe180 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:47.439942 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5e7c97b0-36ff-4790-855f-ee3316da7492 req-13d52171-0f59-4d35-a985-4d78645fe180 service nova] Creating event network-changed:f635b370-82a1-4f9c-9fed-a331b29b3f32 for instance bed88b85-bcc2-41bb-97f1-859a3e907e80 on n-h2-846470-15 Aug 24 04:21:47.449708 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5e7c97b0-36ff-4790-855f-ee3316da7492 req-13d52171-0f59-4d35-a985-4d78645fe180 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068262 Aug 24 04:21:47.450348 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3419/6568] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:21:47.634680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:47.635507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:47.637683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:47.644187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:47.644785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:47.645269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:47.646025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:47.646518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:47.646985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:47.651551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:47.922944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:47.932966 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-18614397-5656-41d6-98f2-dbfa0b311b7c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.303376 Aug 24 04:21:47.933859 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3150/6569] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:47 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:48.968552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:48.970007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:48.973891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:48.982383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:48.983056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:48.983654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:48.984742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:48.985221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:48.985909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:48.993102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=69 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:49.170147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:49.179608 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcf08e3f-fe1c-4d33-98ee-5cbf12844757 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.216547 Aug 24 04:21:49.180380 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3420/6570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:48 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:50.212197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:50.214409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:50.225518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:50.226068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:50.226530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:50.227588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:50.228438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:50.229210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:50.415227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:50.431583 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2fa9955-6d4a-43b7-bc22-4733601364aa tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.224736 Aug 24 04:21:50.432798 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3151/6571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:50 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:51.466839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:51.468436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:51.481267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:51.483646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:51.483646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:51.484922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:51.485610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:51.486693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:51.727276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:51.751785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a033a026-7064-4c01-b2ad-39f23f91c8b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.289805 Aug 24 04:21:51.752905 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3421/6572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:51 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:52.778917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:52.779788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:52.792534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:52.793193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:52.793883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:52.794624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:52.795430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:52.795917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:52.980560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:52.992583 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-73be44ac-b85c-448f-8c35-840f1989d012 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.217675 Aug 24 04:21:52.995854 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3152/6573] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:52 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:21:54.014945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:54.015538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:54.018395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:54.019642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:54.026001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:54.026474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:54.026864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:54.027581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:54.028062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:54.028522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:54.182722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:54.191026 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-69c257d6-9790-48a7-a596-e5ee25dd6c71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.179949 Aug 24 04:21:54.191828 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3422/6574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:54 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:55.213720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:55.214346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:55.217386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:55.223608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:55.224277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:55.224735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:55.225550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:55.226005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:55.226514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:55.394463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:55.402838 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d99db4ad-2cd0-44a3-bb3a-6f1ba9198386 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.192935 Aug 24 04:21:55.403443 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3153/6575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:55 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:56.425003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:56.425594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:56.433617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:56.434154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:56.434580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:56.435309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:56.435927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:56.436366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:56.588495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:56.597071 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0aba8448-e2ce-4745-854d-54edf1ae02d4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.176306 Aug 24 04:21:56.597693 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3423/6576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:56 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:56.757264 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:21:56.757969 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:21:57.619196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:57.619973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:57.627705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:57.628218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:57.628687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:57.629839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:57.630331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:57.630960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:57.777586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:57.785883 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-54c3e811-a563-46d7-b114-35e9db36bcfe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.170733 Aug 24 04:21:57.786611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3154/6577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:57 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:21:58.810200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:21:58.811059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:21:58.821608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:58.822169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:58.822649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:58.823479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:21:58.823935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:21:58.824380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:21:58.989935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:21:59.002440 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8831fed2-216a-417e-84f3-f3e070ac4e28 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.197660 Aug 24 04:21:59.003239 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3424/6578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:21:58 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:00.026534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:00.027200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:00.035342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:00.036120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:00.036621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:00.037363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:00.037878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:00.038559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:00.226256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:00.234471 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15ee9c1e-d13d-4d8c-a959-302ee6857a42 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1342 microversion: 2.1 time: 0.212378 Aug 24 04:22:00.235149 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3155/6579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:00 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:01.256700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:01.257342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:01.265376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:01.265930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:01.266374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:01.266809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:01.267278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:01.267700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:01.442131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:01.451544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3b5ed151-8bad-415a-a259-aad5c4724dc1 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.199338 Aug 24 04:22:01.452154 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3425/6580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:01 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:02.475069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:02.476159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:02.485827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:02.486350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:02.486841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:02.487616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:02.488207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:02.488655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:02.666461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:02.676140 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c55ca5e-ddd9-4671-8ea9-4f4945602411 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.206600 Aug 24 04:22:02.676992 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3156/6581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:02 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:03.702444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:03.703762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:03.712511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:03.713060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:03.713526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:03.714375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:03.714888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:03.715330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:03.900519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:03.919968 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b148140b-039e-4b9b-9bb4-c2e0d2d24854 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.224545 Aug 24 04:22:03.921394 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3426/6582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:03 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:04.948174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:04.948963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:04.957688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:04.966627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:04.966627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:04.966627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:04.966627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:04.966627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:05.143033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:05.152673 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6231dfbd-dc32-475b-bd3b-914ac3a5f430 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.209031 Aug 24 04:22:05.153280 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3157/6583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:04 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:06.178685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:06.179285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:06.186813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:06.187518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:06.188101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:06.189067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:06.189635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:06.190204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:06.366330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:06.375313 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7366882-90c4-4d1a-8906-48d8ef86b339 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.200872 Aug 24 04:22:06.375966 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3427/6584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:06 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:07.403583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:07.404461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:07.414119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:07.414715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:07.415263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:07.416374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:07.416959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:07.417559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:07.575065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:07.586579 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4f30da19-bfc2-4278-b900-480c61078dc5 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.188123 Aug 24 04:22:07.588275 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3158/6585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:07 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:08.610919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:08.611511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:08.623293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:08.623939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:08.624666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:08.625614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:08.626066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:08.626526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:08.786732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:08.796340 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76ef0e06-26ec-4524-9276-2e36e0c79065 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.189785 Aug 24 04:22:08.796340 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3428/6586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:08 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:09.820267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:09.820889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:09.828925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:09.829467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:09.829928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:09.830827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:09.831350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:09.831859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:09.986675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:09.996752 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-227cb629-ca4c-445e-9f0b-0fad54d7e7dc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.181173 Aug 24 04:22:09.997354 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3159/6587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:09 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:10.208969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-91593748-f70d-40f2-a150-05e9c7a83558 req-88fc697f-ecd1-4e64-9210-cf027768fab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed88b85-bcc2-41bb-97f1-859a3e907e80", "name": "network-vif-plugged", "status": "completed", "tag": "f635b370-82a1-4f9c-9fed-a331b29b3f32"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:10.222848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-91593748-f70d-40f2-a150-05e9c7a83558 req-88fc697f-ecd1-4e64-9210-cf027768fab1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:10.223452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-91593748-f70d-40f2-a150-05e9c7a83558 req-88fc697f-ecd1-4e64-9210-cf027768fab1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:10.224442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-91593748-f70d-40f2-a150-05e9c7a83558 req-88fc697f-ecd1-4e64-9210-cf027768fab1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:10.237292 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-91593748-f70d-40f2-a150-05e9c7a83558 req-88fc697f-ecd1-4e64-9210-cf027768fab1 service nova] Creating event network-vif-plugged:f635b370-82a1-4f9c-9fed-a331b29b3f32 for instance bed88b85-bcc2-41bb-97f1-859a3e907e80 on n-h2-846470-15 Aug 24 04:22:10.242847 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-91593748-f70d-40f2-a150-05e9c7a83558 req-88fc697f-ecd1-4e64-9210-cf027768fab1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037921 Aug 24 04:22:10.243506 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3429/6588] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:22:11.022267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:11.023213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:11.032254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:11.032817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:11.033302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:11.034144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:11.034672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:11.035251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:11.199527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:11.209720 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c214a61e-e726-4c25-8815-9d5b33246e71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1376 microversion: 2.1 time: 0.192218 Aug 24 04:22:11.210369 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3160/6589] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:11 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1376 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:12.235720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:12.236605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:12.246129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:12.246694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:12.247175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:12.248296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:12.248888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:12.249405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:12.414362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:12.424618 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72e1cd97-fc8c-4213-a33f-b93ccfc5828b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1562 microversion: 2.1 time: 0.196579 Aug 24 04:22:12.425343 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3430/6590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:12 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1562 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:12.447993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:12.448885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:12.457928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:12.458575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:12.459129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:12.460352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:12.460964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:12.461640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:12.633924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:12.645004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff1ef9bf-91b7-4e53-bc79-868bc53ef8d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1562 microversion: 2.1 time: 0.201588 Aug 24 04:22:12.645692 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3161/6591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:12 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1562 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:12.742385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:12.742903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:12.750399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:12.750939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:12.751420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:12.752191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:12.752686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:12.753161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:12.787316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:22:12.892949 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3e3a6519-709b-4ea0-b9af-2ade5fafbbc4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 204 len: 0 microversion: 2.1 time: 0.154492 Aug 24 04:22:12.893544 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3431/6592] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:22:12 2022] DELETE /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:22:12.903379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:12.904205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:12.912097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:12.912697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:12.913270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:12.914197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:12.914789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:12.915277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:13.071441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:13.082609 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-482811ec-d8dd-4edc-84d4-944fdd814fee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1568 microversion: 2.1 time: 0.183252 Aug 24 04:22:13.083116 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3162/6593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:12 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:13.936024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa6b6d5c-4e2e-489a-8be8-2bdb5a70d6e2"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:13.938536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:13.946583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:13.947036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:13.947499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:13.948219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:13.948674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:13.949096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:14.110776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:14.111924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:14.120763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:14.121284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:14.121789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:14.122511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:14.123051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:14.123652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:14.307058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:14.314122 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ace7d9b6-c9e4-4d1d-ad11-95c399f06e39 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382696 Aug 24 04:22:14.320941 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3432/6594] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:22:13 2022] POST /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:22:14.321263 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88aa5936-7d5e-410f-b0f8-3cf13eb8d373 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1568 microversion: 2.1 time: 0.212011 Aug 24 04:22:14.321263 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3163/6595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:14 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:15.183523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1a77f08a-40c1-4d8c-98f8-8fd393026691 req-b77a2f61-8b4e-4640-8c0e-1c39a14b8f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed88b85-bcc2-41bb-97f1-859a3e907e80", "name": "network-vif-deleted", "tag": "f635b370-82a1-4f9c-9fed-a331b29b3f32"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:15.203622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1a77f08a-40c1-4d8c-98f8-8fd393026691 req-b77a2f61-8b4e-4640-8c0e-1c39a14b8f98 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:15.204447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1a77f08a-40c1-4d8c-98f8-8fd393026691 req-b77a2f61-8b4e-4640-8c0e-1c39a14b8f98 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:15.205067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1a77f08a-40c1-4d8c-98f8-8fd393026691 req-b77a2f61-8b4e-4640-8c0e-1c39a14b8f98 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:15.223171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1a77f08a-40c1-4d8c-98f8-8fd393026691 req-b77a2f61-8b4e-4640-8c0e-1c39a14b8f98 service nova] Creating event network-vif-deleted:f635b370-82a1-4f9c-9fed-a331b29b3f32 for instance bed88b85-bcc2-41bb-97f1-859a3e907e80 on n-h2-846470-15 Aug 24 04:22:15.231317 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1a77f08a-40c1-4d8c-98f8-8fd393026691 req-b77a2f61-8b4e-4640-8c0e-1c39a14b8f98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060533 Aug 24 04:22:15.232839 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3433/6596] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:22:15.346136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:15.347038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:15.358920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:15.359770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:15.360457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:15.361444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:15.362102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:15.362534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:15.454150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:15.463709 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a17b8663-b655-45de-a0ea-ead928877b84 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1361 microversion: 2.1 time: 0.125516 Aug 24 04:22:15.473885 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3164/6597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:15 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1361 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:16.487721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:16.488447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:16.496837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:16.497353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:16.497805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:16.498570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:16.499044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:16.499528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:16.572914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:16.582911 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76f70968-e5e5-4385-a0ce-1d1b886523a3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1361 microversion: 2.1 time: 0.099697 Aug 24 04:22:16.583565 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3434/6598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:16 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1361 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:17.605559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:17.606387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:17.614723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:17.615260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:17.615767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:17.616584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:17.617192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:17.618018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:17.691437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:17.700479 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-549f9a93-7c31-4065-bdc5-ab3a34b6c2ee tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1361 microversion: 2.1 time: 0.099213 Aug 24 04:22:17.701119 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3165/6599] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:17 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1361 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:18.728886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:18.729608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:18.739146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:18.739146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:18.739146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:18.739146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:18.739747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:18.740030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:18.743218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:18.821944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:18.833434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db16847f-214b-46bb-9b55-6543f54a7292 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1361 microversion: 2.1 time: 0.112830 Aug 24 04:22:18.834055 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3435/6600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:18 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1361 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:19.874703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:19.876613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:19.881166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=32 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:19.885308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:19.886261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:19.887361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:19.888526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:19.889415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:19.890045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:19.894146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:19.998840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:20.009439 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0b6142b-8e44-4f57-b14a-2cffba62541d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 200 len: 1361 microversion: 2.1 time: 0.149777 Aug 24 04:22:20.010047 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3166/6601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:19 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:21.032185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:21.032925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:21.036023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:21.049763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:21.050423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:21.050962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:21.051824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:21.052398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:21.052913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:21.070626 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 HTTP/1.1 Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'bed88b85-bcc2-41bb-97f1-859a3e907e80'} Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:21.073108 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d977bf19-4657-4a13-8357-57aab9d5e818 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 404 len: 111 microversion: 2.1 time: 0.047595 Aug 24 04:22:21.078876 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3436/6602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:21 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:22:27.550121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:27.550740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:27.558739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:27.559250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:27.559799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:27.560643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:27.561116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:27.561546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:27.591227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:22:27.675775 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58b55517-6ce9-4f94-804f-e71d9a8acc71 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 204 len: 0 microversion: 2.1 time: 0.129768 Aug 24 04:22:27.677048 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3167/6603] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:22:27 2022] DELETE /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:22:27.685193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:27.685803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:27.693449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:27.693939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:27.694415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:27.695223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:27.695810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:27.696243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:27.842816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:27.852005 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-233cf16a-8b2b-45b0-baed-2959bf6b0ea4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1408 microversion: 2.1 time: 0.170511 Aug 24 04:22:27.852762 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3437/6604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:27 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:28.877453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:28.878321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:28.888680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:28.889204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:28.889663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:28.891219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:28.892029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:28.892490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:29.216000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:29.227105 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-65e3a2f0-2980-440e-9e9e-8479149fecb2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1408 microversion: 2.1 time: 0.355575 Aug 24 04:22:29.239744 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3168/6605] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:28 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:30.210182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b08e9ff2-da3d-4176-ba7e-a7b47e439d4e req-0d5b1d72-4909-46f6-a806-1c8e92e36ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70afefe-0acb-4281-8298-133d346f41a6", "name": "network-vif-deleted", "tag": "cb17371a-6e06-4b0f-9236-816e24012cf5"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:30.222623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b08e9ff2-da3d-4176-ba7e-a7b47e439d4e req-0d5b1d72-4909-46f6-a806-1c8e92e36ff5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:30.223182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b08e9ff2-da3d-4176-ba7e-a7b47e439d4e req-0d5b1d72-4909-46f6-a806-1c8e92e36ff5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:30.223775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b08e9ff2-da3d-4176-ba7e-a7b47e439d4e req-0d5b1d72-4909-46f6-a806-1c8e92e36ff5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:30.236293 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b08e9ff2-da3d-4176-ba7e-a7b47e439d4e req-0d5b1d72-4909-46f6-a806-1c8e92e36ff5 service nova] Creating event network-vif-deleted:cb17371a-6e06-4b0f-9236-816e24012cf5 for instance a70afefe-0acb-4281-8298-133d346f41a6 on n-h1-846470-15 Aug 24 04:22:30.243510 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b08e9ff2-da3d-4176-ba7e-a7b47e439d4e req-0d5b1d72-4909-46f6-a806-1c8e92e36ff5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115799 Aug 24 04:22:30.244527 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3438/6606] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:22:30.251606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:30.252306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:30.260589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:30.261088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:30.261550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:30.262289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:30.262756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:30.263197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:30.338591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:30.347126 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6ab6aac8-6995-4731-94fa-eb0e7ddc9b1c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1201 microversion: 2.1 time: 0.100142 Aug 24 04:22:30.347610 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3169/6607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:30 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:31.370294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:31.370993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:31.377866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:31.378355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:31.378788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:31.379511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:31.379999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:31.380420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:31.451154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:31.460242 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-76ba6510-ca30-40ad-a37d-0e69263dec05 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1201 microversion: 2.1 time: 0.095287 Aug 24 04:22:31.461232 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3439/6608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:31 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:31.797809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:31.800226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:31.808094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:31.808595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:31.809046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:31.809772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:31.810230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:31.810658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:31.836996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lazy-loading 'flavor' on Instance uuid 46840e8c-528b-45ff-84cb-270ef6a0c65b {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:22:31.984772 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1593f95a-6637-4955-854a-d8ff76bdf1d7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/action" status: 200 len: 32 microversion: 2.1 time: 0.190866 Aug 24 04:22:31.985708 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3170/6609] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:22:31 2022] POST /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:22:31.996598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:31.997328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:32.006055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:32.006682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:32.007395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:32.009070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:32.009547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:32.010204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:32.197929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:32.207594 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8f06a962-4577-4693-beb8-2f5ef8395527 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.215347 Aug 24 04:22:32.208187 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3440/6610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:31 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:32.484106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:32.485183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:32.493480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:32.494363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:32.495052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:32.495930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:32.496482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:32.496999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:32.593762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:32.603340 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba62b680-c7b1-4e2c-a922-0f76286126b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1201 microversion: 2.1 time: 0.124151 Aug 24 04:22:32.605436 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3171/6611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:32 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1201 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:22:33.231885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:33.232498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:33.240319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:33.240776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:33.242634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:33.242634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:33.242634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:33.243109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:33.392493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:33.402577 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-294c810f-d3ab-42b0-a2a6-73f145a84e79 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.175409 Aug 24 04:22:33.403178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3441/6612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:33 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:33.628280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:33.628931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:33.637003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:33.637525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:33.637961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:33.638692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:33.639159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:33.639595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:33.713962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:33.723510 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5d33c76-2482-4ba0-8f8e-ce1a42cd0bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1201 microversion: 2.1 time: 0.099285 Aug 24 04:22:33.724418 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3172/6613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:33 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:34.425219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:34.425859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:34.434898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:34.435405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:34.435882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:34.436600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:34.437067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:34.437814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:34.598173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:34.607863 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7d13808b-3930-4ce9-af40-25ca410cbaf9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.186704 Aug 24 04:22:34.608563 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3442/6614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:34 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:34.747731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:34.748643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:34.760866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:34.761485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:34.761939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:34.762657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:34.764020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:34.765096 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:34.880742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:34.893138 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef755e5e-79b7-45f2-98e4-98e213fcac80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 200 len: 1201 microversion: 2.1 time: 0.151433 Aug 24 04:22:34.893745 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3173/6615] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:34 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 1201 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:35.631195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:35.632047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:35.640430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:35.641140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:35.641701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:35.642566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:35.643169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:35.643732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:35.795091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:35.804261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81344b86-8343-4248-a6a4-4344bddcf13f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.177528 Aug 24 04:22:35.804905 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3443/6616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:35 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:35.916681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:35.917257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:35.924897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:35.925415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:35.925878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:35.926609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:35.927088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:35.927542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:35.942468 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 HTTP/1.1 Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a70afefe-0acb-4281-8298-133d346f41a6'} Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:35.944277 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dcaef8bf-9875-4ebf-9af1-4ad7c3008c7a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 404 len: 111 microversion: 2.1 time: 0.033449 Aug 24 04:22:35.952559 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3174/6617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:35 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:22:36.826523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:36.827370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:36.835162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:36.835656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:36.836115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:36.836876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:36.837364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:36.837740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:37.028274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:37.037546 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a1aac72-f3a4-4cb5-ab32-271d2815d421 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.215063 Aug 24 04:22:37.038425 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3444/6618] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:36 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:38.059975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:38.060641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:38.069178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.069716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.070156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.071024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.071494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.071964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.111559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:38.112141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:38.120441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.120950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.121394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.122498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.122952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.123721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.140924 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 HTTP/1.1 Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'bed88b85-bcc2-41bb-97f1-859a3e907e80'} Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:22:38.142661 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-39b7369b-cc6f-43a5-8d94-5bcf9190d2b4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 404 len: 111 microversion: 2.1 time: 0.036842 Aug 24 04:22:38.147643 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3445/6619] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:22:38 2022] DELETE /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:22:38.154271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:38.155077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: bed88b85-bcc2-41bb-97f1-859a3e907e80] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:38.161856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.162483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.163071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.164072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.164788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.165594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.185024 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 HTTP/1.1 Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'bed88b85-bcc2-41bb-97f1-859a3e907e80'} Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:38.186742 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance bed88b85-bcc2-41bb-97f1-859a3e907e80 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-144981f3-cf5e-4ff6-9d2f-bba8f9ae36dd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80" status: 404 len: 111 microversion: 2.1 time: 0.039891 Aug 24 04:22:38.193057 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3446/6620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:38 2022] GET /compute/v2.1/servers/bed88b85-bcc2-41bb-97f1-859a3e907e80 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:22:38.246978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:38.256504 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-178dc7d4-ef90-422a-b09a-709efc00b2ff tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.200806 Aug 24 04:22:38.257676 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3175/6621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:38 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:38.618940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:38.619878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:38.626304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.626805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.627241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.627975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.628433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.628857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.644134 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 HTTP/1.1 Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'a70afefe-0acb-4281-8298-133d346f41a6'} Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:22:38.645763 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd0c900f-351d-46be-813f-e4c2693e3e12 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 404 len: 111 microversion: 2.1 time: 0.032542 Aug 24 04:22:38.651144 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3447/6622] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:22:38 2022] DELETE /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:22:38.658550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:38.659194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: a70afefe-0acb-4281-8298-133d346f41a6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:38.665963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.667319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.667319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.668041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:38.668521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:38.668999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:38.687069 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 HTTP/1.1 Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'a70afefe-0acb-4281-8298-133d346f41a6'} Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:38.688722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance a70afefe-0acb-4281-8298-133d346f41a6 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06471c95-4867-46a5-90fd-0dc5f9692f01 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6" status: 404 len: 111 microversion: 2.1 time: 0.036242 Aug 24 04:22:38.694094 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3176/6623] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:38 2022] GET /compute/v2.1/servers/a70afefe-0acb-4281-8298-133d346f41a6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:22:38.770312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0aa2b9dd-810b-448b-a140-3f103d3b9254 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: .version_select at 0x7f1022f1db80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1371241705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmlenVnHSVDedpNW2O+wpWj+Jl1lgWlPRblm1LUUE5P0MjZJgtmOD0vJd/F3AIg4Ci9kGkkxi/2lxpsnfXXxkWthFgQtnbVfAm+Rc036kpOABq2/PPXxQIcpBAPcnbeLA=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:38.787238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0aa2b9dd-810b-448b-a140-3f103d3b9254 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:22:38.793037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0aa2b9dd-810b-448b-a140-3f103d3b9254 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:22:38.827449 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0aa2b9dd-810b-448b-a140-3f103d3b9254 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.061087 Aug 24 04:22:38.828512 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3448/6624] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:22:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:22:39.282765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:39.284118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:39.299514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:39.300465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:39.301282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:39.302558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:39.303409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:39.304265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:39.498882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:39.508259 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4dc4b4f7-5ea5-4b5a-802f-6061e26caa17 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.232509 Aug 24 04:22:39.509085 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3177/6625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:39 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:40.535207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:40.535853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:40.544684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:40.545309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:40.545781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:40.546483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:40.546950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:40.547383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:40.702309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:40.711916 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ea8f25a2-993b-48d2-a62e-89f2c90574b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.182404 Aug 24 04:22:40.712519 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3449/6626] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:40 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:41.733728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:41.734374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:41.742440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:41.743111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:41.743634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:41.744477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:41.744941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:41.745413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:41.890220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:41.899812 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ec11b546-7778-42b4-89de-21b9d4c07be3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.170016 Aug 24 04:22:41.900433 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3178/6627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:41 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:22:42.922134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:42.923066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:42.930408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:42.930939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:42.931515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:42.932383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:42.932769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:42.933216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:43.091423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:43.100584 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5671d788-bb51-4577-bd84-52ce83e7d998 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.182488 Aug 24 04:22:43.101185 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3450/6628] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:42 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:44.124109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:44.124884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:44.134195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:44.134195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:44.134195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:44.134792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:44.135271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:44.135731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:44.284604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:44.293738 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-10877e34-8a5c-4a4f-b0e6-820834c6f428 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.173962 Aug 24 04:22:44.294259 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3179/6629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:44 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:45.316265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:45.316861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:45.327142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:45.327857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:45.328307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:45.329028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:45.329502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:45.329905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:45.484965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:45.495107 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c94e0bfe-ae9e-454d-a67f-b5833c1ee8ae tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1734 microversion: 2.1 time: 0.182755 Aug 24 04:22:45.496099 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3451/6630] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:45 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:46.517292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:46.517923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:46.526854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:46.527522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:46.528005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:46.529052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:46.529552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:46.529983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:46.547398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:46.690485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:46.699867 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-addf6a87-f947-4ead-987f-07c61c70a56b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1714 microversion: 2.1 time: 0.186521 Aug 24 04:22:46.716480 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3180/6631] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:46 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1714 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:46.774087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:46.774757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:46.786440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:46.787146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:46.787843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:46.788898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:46.789654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:46.790292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:46.886247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Cannot 'detach_volume' instance 46840e8c-528b-45ff-84cb-270ef6a0c65b while it is in vm_state rescued Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments/fa6b6d5c-4e2e-489a-8be8-2bdb5a70d6e2 HTTP/1.1 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: exception: Cannot 'detach_volume' instance 46840e8c-528b-45ff-84cb-270ef6a0c65b while it is in vm_state rescued Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': '46840e8c-528b-45ff-84cb-270ef6a0c65b', 'id': 'fa6b6d5c-4e2e-489a-8be8-2bdb5a70d6e2'} Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 46840e8c-528b-45ff-84cb-270ef6a0c65b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 46840e8c-528b-45ff-84cb-270ef6a0c65b while it is in vm_state rescued Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:46.888370 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 46840e8c-528b-45ff-84cb-270ef6a0c65b while it is in vm_state rescued Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 409 to user: Cannot 'detach_volume' instance 46840e8c-528b-45ff-84cb-270ef6a0c65b while it is in vm_state rescued {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dfff81e7-c98d-42de-bc9f-eace79b002b8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments/fa6b6d5c-4e2e-489a-8be8-2bdb5a70d6e2" status: 409 len: 152 microversion: 2.1 time: 0.123393 Aug 24 04:22:46.893848 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3452/6632] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:22:46 2022] DELETE /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments/fa6b6d5c-4e2e-489a-8be8-2bdb5a70d6e2 => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 04:22:46.902228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:46.902774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:46.911175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:46.912395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:46.913135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:46.914696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:46.915850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:46.916717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:47.010175 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d544b208-f9c9-466b-9019-e540e9f5dae8 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/action" status: 202 len: 0 microversion: 2.1 time: 0.110248 Aug 24 04:22:47.011251 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3181/6633] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:22:46 2022] POST /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:22:47.022144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:47.022926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:47.031548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:47.032056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:47.032490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:47.033481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:47.033930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:47.034352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:47.200634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:47.210957 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3160b6dd-a47b-4144-a86f-31bc4882cf8b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1722 microversion: 2.1 time: 0.193325 Aug 24 04:22:47.212065 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3453/6634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:47 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:48.235331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:48.236062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:48.243932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:48.244487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:48.244937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:48.245685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:48.246161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:48.247143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:48.409756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:48.420066 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-23f0941a-2f57-4fed-b281-db50e262d1ef tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1722 microversion: 2.1 time: 0.189041 Aug 24 04:22:48.420808 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3182/6635] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:48 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:49.442457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:49.443096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:49.446120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:49.452230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:49.453324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:49.453757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:49.454474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:49.454934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:49.455369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:49.458399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=88 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:49.621747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:49.631144 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eaa51817-a82b-4888-9299-1c203bf241e3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1722 microversion: 2.1 time: 0.192760 Aug 24 04:22:49.631781 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3454/6636] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:49 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:50.652973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:50.653632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:50.657646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:50.663636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:50.664175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:50.664629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:50.665428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:50.665870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:50.666295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:50.845946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:50.854818 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac758c8b-62da-455c-ad15-4fa119f46e2e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1728 microversion: 2.1 time: 0.205760 Aug 24 04:22:50.855394 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3183/6637] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:50 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:50.876188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:50.876713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:50.884036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:50.884643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:50.885114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:50.886151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:50.886772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:50.887205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:50.979972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3f93c17c-c3f0-42f5-837f-707ab1e8758c tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107661 Aug 24 04:22:50.980865 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3455/6638] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:22:50 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:22:51.986748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5dc762dd-a17b-40d7-8e8d-0946325a5313 req-dadc5bbb-2eea-4ce6-9a04-33dc1d8345ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46840e8c-528b-45ff-84cb-270ef6a0c65b", "tag": "a4f35b49-2398-4308-a251-23130373d359"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:51.999173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5dc762dd-a17b-40d7-8e8d-0946325a5313 req-dadc5bbb-2eea-4ce6-9a04-33dc1d8345ec service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:52.000616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5dc762dd-a17b-40d7-8e8d-0946325a5313 req-dadc5bbb-2eea-4ce6-9a04-33dc1d8345ec service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:52.001324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5dc762dd-a17b-40d7-8e8d-0946325a5313 req-dadc5bbb-2eea-4ce6-9a04-33dc1d8345ec service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:52.015453 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5dc762dd-a17b-40d7-8e8d-0946325a5313 req-dadc5bbb-2eea-4ce6-9a04-33dc1d8345ec service nova] Creating event network-changed:a4f35b49-2398-4308-a251-23130373d359 for instance 46840e8c-528b-45ff-84cb-270ef6a0c65b on n-h1-846470-15 Aug 24 04:22:52.021263 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5dc762dd-a17b-40d7-8e8d-0946325a5313 req-dadc5bbb-2eea-4ce6-9a04-33dc1d8345ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038250 Aug 24 04:22:52.022253 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3184/6639] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:22:54.038317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a354d4f3-4250-4150-a2a5-38878d313064 req-21644a97-cdaf-4a0c-88e4-4ac97c6a9cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46840e8c-528b-45ff-84cb-270ef6a0c65b", "tag": "a4f35b49-2398-4308-a251-23130373d359"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:54.044158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:54.051441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a354d4f3-4250-4150-a2a5-38878d313064 req-21644a97-cdaf-4a0c-88e4-4ac97c6a9cc0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:54.051957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a354d4f3-4250-4150-a2a5-38878d313064 req-21644a97-cdaf-4a0c-88e4-4ac97c6a9cc0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:54.052456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a354d4f3-4250-4150-a2a5-38878d313064 req-21644a97-cdaf-4a0c-88e4-4ac97c6a9cc0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:54.068145 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a354d4f3-4250-4150-a2a5-38878d313064 req-21644a97-cdaf-4a0c-88e4-4ac97c6a9cc0 service nova] Creating event network-changed:a4f35b49-2398-4308-a251-23130373d359 for instance 46840e8c-528b-45ff-84cb-270ef6a0c65b on n-h1-846470-15 Aug 24 04:22:54.073716 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a354d4f3-4250-4150-a2a5-38878d313064 req-21644a97-cdaf-4a0c-88e4-4ac97c6a9cc0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040305 Aug 24 04:22:54.074900 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3456/6640] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:22:57.517146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-370160138", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1371241705", "security_groups": [{"name": "tempest-secgroup-smoke-1748538127"}], "block_device_mapping_v2": [{"uuid": "187651b1-139f-4266-b669-f5e58453fa84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9935c908-0959-4c8b-be4e-161d3600b222"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:22:57.654813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] validate_networks() for [('9935c908-0959-4c8b-be4e-161d3600b222', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:22:58.129283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:22:58.129767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:22:58.130190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:22:58.130642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:22:58.131057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:22:58.140861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:58.141386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:58.141955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:58.142838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:58.143501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:58.144100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:58.162789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:22:58.168978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:22:58.235253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:22:58.238581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='187651b1-139f-4266-b669-f5e58453fa84',volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:22:58.395448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d25cffca-418b-44ef-b295-b061d97a0b7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.883765 Aug 24 04:22:58.396063 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3185/6641] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:22:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:22:58.408973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2133ab3-d5c3-4323-ad05-0d768c0503d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:58.410422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d2133ab3-d5c3-4323-ad05-0d768c0503d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:58.470985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d2133ab3-d5c3-4323-ad05-0d768c0503d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:58.478353 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d2133ab3-d5c3-4323-ad05-0d768c0503d9 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1094 microversion: 2.1 time: 0.074509 Aug 24 04:22:58.478856 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3457/6642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:58 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:22:59.500164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:22:59.500802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:22:59.509468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:59.510035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:59.510511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:59.511395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:22:59.511895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:22:59.512702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:22:59.608718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:22:59.618865 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-91c084d8-ec9a-44eb-b5ce-5f3c090656fb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1200 microversion: 2.1 time: 0.124010 Aug 24 04:22:59.620079 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3186/6643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:22:59 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1200 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:00.643005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:00.645026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:00.656189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:00.657204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:00.657859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:00.658779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:00.659600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:00.660685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:00.819547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:00.829779 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d2414b5e-d84e-4e1b-a464-6867f89a6927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1278 microversion: 2.1 time: 0.191366 Aug 24 04:23:00.830579 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3458/6644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:00 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:01.169051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c6438317-1651-4bae-a02e-e6ef6fd816bf req-19f8c209-e71a-47ee-98f5-a7b36d362374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad81d7f-1a94-4b3f-b7ef-df7583b6e649", "tag": "affa09d3-2d45-45a0-968a-8e6d521182bd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:23:01.183123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c6438317-1651-4bae-a02e-e6ef6fd816bf req-19f8c209-e71a-47ee-98f5-a7b36d362374 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:01.184073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c6438317-1651-4bae-a02e-e6ef6fd816bf req-19f8c209-e71a-47ee-98f5-a7b36d362374 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:01.184923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c6438317-1651-4bae-a02e-e6ef6fd816bf req-19f8c209-e71a-47ee-98f5-a7b36d362374 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:01.200949 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c6438317-1651-4bae-a02e-e6ef6fd816bf req-19f8c209-e71a-47ee-98f5-a7b36d362374 service nova] Creating event network-changed:affa09d3-2d45-45a0-968a-8e6d521182bd for instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 on n-h2-846470-15 Aug 24 04:23:01.208323 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c6438317-1651-4bae-a02e-e6ef6fd816bf req-19f8c209-e71a-47ee-98f5-a7b36d362374 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044664 Aug 24 04:23:01.209085 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3187/6645] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:23:01.850497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:01.851756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:01.858949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:01.859446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:01.859918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:01.860866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:01.861327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:01.861753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:02.022538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:02.032687 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-adc32c42-7a69-453d-af6b-47deebdcd769 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1278 microversion: 2.1 time: 0.185995 Aug 24 04:23:02.034719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3459/6646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:01 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:03.057027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:03.057648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:03.065429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:03.065938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:03.066395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:03.067129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:03.067610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:03.068070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:03.232630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:03.241431 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98cbb119-0f5b-41c1-8b46-04a00e8a3a63 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1278 microversion: 2.1 time: 0.189678 Aug 24 04:23:03.242144 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3188/6647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:03 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:23:04.264553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:04.265291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:04.273366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:04.273855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:04.274297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:04.275020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:04.275499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:04.277433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:04.423021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:04.433402 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6074f85-a968-4abe-8d5b-c903c69bf5ac tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1278 microversion: 2.1 time: 0.172993 Aug 24 04:23:04.434011 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3460/6648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:04 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:05.455344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:05.455973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:05.463153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:05.463640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:05.464238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:05.465140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:05.465713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:05.466242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:05.610911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:05.619231 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b12fe0b3-de39-42a6-9b4c-39f270949554 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.168176 Aug 24 04:23:05.619837 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3189/6649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:05 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:06.642352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:06.643051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:06.650511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:06.650982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:06.651738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:06.652457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:06.652939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:06.653465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:06.799646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:06.808027 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9425b592-af4c-40fc-96b2-88181496daa0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.170083 Aug 24 04:23:06.809030 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3461/6650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:06 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:07.831760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:07.832643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:07.842060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:07.842662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:07.843110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:07.843883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:07.844347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:07.844784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:08.008816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:08.022517 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-63f21eba-7001-4d07-a3b8-9ae78a723927 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.196368 Aug 24 04:23:08.023122 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3190/6651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:07 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:09.047254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:09.048008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:09.052401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:09.060226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:09.060719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:09.061155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:09.061865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:09.062357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:09.062783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:09.219269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:09.227333 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e38b5bdc-d0ff-4074-8921-ee1759dfe657 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.185782 Aug 24 04:23:09.227956 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3462/6652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:09 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:10.249206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:10.249824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:10.251919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:10.252762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:10.259357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:10.259921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:10.260433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:10.261225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:10.261827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:10.263119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:10.408400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:10.416652 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f67f2276-754a-41de-a2c8-12cca59d7698 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.172259 Aug 24 04:23:10.417244 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3191/6653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:10 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:11.441333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:11.442038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:11.449242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:11.449819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:11.450355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:11.451657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:11.452576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:11.453061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:11.605727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:11.616977 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2de4a4c3-c980-493b-843e-1df528515cfc tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.178946 Aug 24 04:23:11.618483 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3463/6654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:11 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:23:12.641187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:12.641780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:12.650609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:12.651089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:12.651543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:12.652845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:12.653333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:12.653802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:12.798269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:12.809508 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a3923aa7-9936-441f-92fd-a6f97dbbd6da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.173472 Aug 24 04:23:12.810637 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3192/6655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:12 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:13.841880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:13.842746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:13.852741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:13.853356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:13.854087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:13.855256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:13.855990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:13.856615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:14.020837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:14.029622 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eddbf77d-b81e-4a0a-9da3-48a7ee9f7cea tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.195291 Aug 24 04:23:14.030211 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3464/6656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:13 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:14.572256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3d1ecfb3-b3d5-4f40-8369-6d044f68fd87 req-a8eccbb1-ded1-42f8-82fc-5ab5b62e092d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad81d7f-1a94-4b3f-b7ef-df7583b6e649", "name": "network-vif-plugged", "status": "completed", "tag": "affa09d3-2d45-45a0-968a-8e6d521182bd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:23:14.583392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3d1ecfb3-b3d5-4f40-8369-6d044f68fd87 req-a8eccbb1-ded1-42f8-82fc-5ab5b62e092d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:14.583924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3d1ecfb3-b3d5-4f40-8369-6d044f68fd87 req-a8eccbb1-ded1-42f8-82fc-5ab5b62e092d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:14.584372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3d1ecfb3-b3d5-4f40-8369-6d044f68fd87 req-a8eccbb1-ded1-42f8-82fc-5ab5b62e092d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:14.597680 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3d1ecfb3-b3d5-4f40-8369-6d044f68fd87 req-a8eccbb1-ded1-42f8-82fc-5ab5b62e092d service nova] Creating event network-vif-plugged:affa09d3-2d45-45a0-968a-8e6d521182bd for instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 on n-h2-846470-15 Aug 24 04:23:14.602871 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3d1ecfb3-b3d5-4f40-8369-6d044f68fd87 req-a8eccbb1-ded1-42f8-82fc-5ab5b62e092d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128518 Aug 24 04:23:14.603579 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3193/6657] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:23:15.054010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:15.054756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:15.062267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:15.062766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:15.063200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:15.063936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:15.064393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:15.064824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:15.221597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:15.232195 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b22b493-cacb-4178-a483-999f4e4e9ce0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1266 microversion: 2.1 time: 0.184276 Aug 24 04:23:15.232809 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3465/6658] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:15 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:16.256707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:16.257739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:16.265577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:16.266064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:16.266524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:16.267274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:16.267770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:16.268209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:16.437887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:16.447566 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fe63974d-d7fb-42bb-9a9c-404180540acf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1453 microversion: 2.1 time: 0.196888 Aug 24 04:23:16.448297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3194/6659] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:16 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:16.483623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:16.484254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:16.491617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:16.492125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:16.492569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:16.493280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:16.493740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:16.494165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:16.648220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:16.657272 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ecaa55bc-8e8f-4273-9f51-041c2bbfb0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1453 microversion: 2.1 time: 0.178327 Aug 24 04:23:16.657862 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3466/6660] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:16 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:18.791765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4a455bb3-8dd0-4434-90bb-0022c600d298 req-4ca0dfb4-23e0-46d6-83e0-a45ef97ce531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad81d7f-1a94-4b3f-b7ef-df7583b6e649", "tag": "affa09d3-2d45-45a0-968a-8e6d521182bd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:23:18.801766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a455bb3-8dd0-4434-90bb-0022c600d298 req-4ca0dfb4-23e0-46d6-83e0-a45ef97ce531 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:18.802255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a455bb3-8dd0-4434-90bb-0022c600d298 req-4ca0dfb4-23e0-46d6-83e0-a45ef97ce531 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:18.802725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4a455bb3-8dd0-4434-90bb-0022c600d298 req-4ca0dfb4-23e0-46d6-83e0-a45ef97ce531 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:18.805651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:18.816916 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4a455bb3-8dd0-4434-90bb-0022c600d298 req-4ca0dfb4-23e0-46d6-83e0-a45ef97ce531 service nova] Creating event network-changed:affa09d3-2d45-45a0-968a-8e6d521182bd for instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 on n-h2-846470-15 Aug 24 04:23:18.822951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4a455bb3-8dd0-4434-90bb-0022c600d298 req-4ca0dfb4-23e0-46d6-83e0-a45ef97ce531 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110032 Aug 24 04:23:18.824399 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3195/6661] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:23:48.003347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:48.004100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:48.005981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=23 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:48.006616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=65 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:48.014082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:48.014585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:48.015024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:48.015831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:48.016276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:48.016694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:48.122788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lazy-loading 'services' on Instance uuid 46840e8c-528b-45ff-84cb-270ef6a0c65b {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:23:48.205440 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c72e3b3-b9e8-425f-96ba-84eff94caf14 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments/fa6b6d5c-4e2e-489a-8be8-2bdb5a70d6e2" status: 202 len: 0 microversion: 2.1 time: 0.206235 Aug 24 04:23:48.206099 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3467/6662] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:23:47 2022] DELETE /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments/fa6b6d5c-4e2e-489a-8be8-2bdb5a70d6e2 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:23:48.214927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:48.220389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:48.222892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:48.232899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:48.233406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:48.233865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:48.234588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:48.235184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:48.235793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:48.271826 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09de9edf-9feb-493f-a8f2-aeb135441bc9 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060423 Aug 24 04:23:48.272484 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3196/6663] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:23:48 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:23:49.286637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:49.289528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:49.296531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:49.297010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:49.297454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:49.298199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:49.298656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:49.299079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:49.334904 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a63e2bab-ab3f-4dce-a6ec-577bbae686e1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053564 Aug 24 04:23:49.335400 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3468/6664] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:23:49 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:23:50.348815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:50.350952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:50.358587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:50.359106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:50.359557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:50.360315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:50.360886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:50.361352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:50.397319 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4f285a0-4501-43f8-be94-e0b9d78bc6d1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052986 Aug 24 04:23:50.397920 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3197/6665] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:23:50 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:23:51.410857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:51.413197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:51.421346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:51.421569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:51.421966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:51.422675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:51.423136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:51.423555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:51.458502 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05e637df-81e8-48e7-ac0b-4f1768e3ea1e tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051710 Aug 24 04:23:51.459100 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3469/6666] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:23:51 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:23:52.470568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:52.472693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:52.480250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:52.480942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:52.481440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:52.482219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:52.482780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:52.483313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:52.518083 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1d0bdd7c-c604-4609-85f1-e72783abce89 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051772 Aug 24 04:23:52.518759 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3198/6667] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:23:52 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:23:53.533986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:53.537025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:53.546960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.547505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.548050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.548725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.549182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.549649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.583464 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7cb64cc-fd3f-421b-8fdb-b97fb8d9438f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056252 Aug 24 04:23:53.584076 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3470/6668] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:23:53 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:23:53.665297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:23:53.667884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:53.674944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.675381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.675902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.676627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.677098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.677538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.704808 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Cannot 'reboot' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a/action HTTP/1.1 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 28 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: {"reboot": {"type": "HARD"}} Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: exception: Cannot 'reboot' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e8cd99d3-7c7c-4f1e-8360-452d24e3e50a', 'body': {'reboot': {'type': 'HARD'}}} Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3539, in reboot Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 04:23:53.706815 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 409 to user: Cannot 'reboot' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-409de134-c64e-4e16-913d-006b3036ce4f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a/action" status: 409 len: 145 microversion: 2.1 time: 0.047079 Aug 24 04:23:53.711482 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3199/6669] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:23:53 2022] POST /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a/action => generated 145 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:23:53.722030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:23:53.726309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:53.733771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.734269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.734715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.735448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.736016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.736517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.777396 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Cannot 'rebuild' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a/action HTTP/1.1 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 65 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: exception: Cannot 'rebuild' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'e8cd99d3-7c7c-4f1e-8360-452d24e3e50a', 'body': {'rebuild': {'imageRef': '940ed0d3-700a-4ac5-a26b-97e9311e8ce3'}}} Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:23:53.779480 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 409 to user: Cannot 'rebuild' instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a while it is in vm_state rescued {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92f227ba-43c9-4050-94c3-67a6eca6e733 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "POST /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a/action" status: 409 len: 146 microversion: 2.1 time: 0.065421 Aug 24 04:23:53.784992 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3471/6670] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:23:53 2022] POST /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a/action => generated 146 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:23:53.790973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:53.791637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:53.798583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.799088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.799541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.800294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.800765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.801202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.832488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:23:53.923004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5a531e4-8a7c-4241-b5ac-7b5d3350cb9d tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 204 len: 0 microversion: 2.1 time: 0.135542 Aug 24 04:23:53.923858 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3200/6671] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:23:53 2022] DELETE /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:23:53.934209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:53.934755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:53.941197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.941684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.942129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:53.942824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:53.943283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:53.943736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:54.094027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:54.103694 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-00843366-f591-4ab1-b6f2-f3f107e3ec58 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1688 microversion: 2.1 time: 0.174419 Aug 24 04:23:54.104710 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3472/6672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:53 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:55.135521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:55.136544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:55.144708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:55.145222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:55.145680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:55.146419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:55.146892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:55.147340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:55.302653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:55.315442 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01bb99bc-b038-485c-9308-d8021be3084b tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1688 microversion: 2.1 time: 0.189082 Aug 24 04:23:55.316295 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3201/6673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:55 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:56.337735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:56.338342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:56.346291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:56.346796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:56.347221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:56.347958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:56.348413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:56.348848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:56.515643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:56.526947 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d25e84d9-f93d-49d9-9366-3c1dd49e7436 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1688 microversion: 2.1 time: 0.193313 Aug 24 04:23:56.527524 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3473/6674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:56 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:57.556738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:57.558162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:57.568563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:57.569325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:57.569957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:57.571074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:57.571652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:57.572273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:57.749283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:57.758092 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-78295fea-679f-46fe-b430-8027568acc68 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1688 microversion: 2.1 time: 0.207458 Aug 24 04:23:57.758684 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3202/6675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:57 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1688 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:58.781503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:58.782113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:58.789848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:58.790380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:58.790981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:58.791777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:58.792428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:58.793045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:58.863744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:23:58.879328 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b6d28dc-78f4-458c-87cc-4a5423a74370 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 200 len: 1620 microversion: 2.1 time: 0.101771 Aug 24 04:23:58.879961 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3474/6676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:58 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 1620 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:23:58.957887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3b6407d3-5ff2-401d-9099-9c159448b337 req-9547031b-7616-4b1f-8964-210242828862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46840e8c-528b-45ff-84cb-270ef6a0c65b", "name": "network-vif-deleted", "tag": "a4f35b49-2398-4308-a251-23130373d359"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:23:58.969762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b6407d3-5ff2-401d-9099-9c159448b337 req-9547031b-7616-4b1f-8964-210242828862 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:58.970559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b6407d3-5ff2-401d-9099-9c159448b337 req-9547031b-7616-4b1f-8964-210242828862 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:58.971058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3b6407d3-5ff2-401d-9099-9c159448b337 req-9547031b-7616-4b1f-8964-210242828862 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:58.989284 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3b6407d3-5ff2-401d-9099-9c159448b337 req-9547031b-7616-4b1f-8964-210242828862 service nova] Creating event network-vif-deleted:a4f35b49-2398-4308-a251-23130373d359 for instance 46840e8c-528b-45ff-84cb-270ef6a0c65b on n-h1-846470-15 Aug 24 04:23:58.996660 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3b6407d3-5ff2-401d-9099-9c159448b337 req-9547031b-7616-4b1f-8964-210242828862 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042174 Aug 24 04:23:58.997678 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3203/6677] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:23:59.902755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:59.903381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 46840e8c-528b-45ff-84cb-270ef6a0c65b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:23:59.911213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:59.914424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:59.914944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:59.915713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:23:59.916235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:23:59.916654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:23:59.932923 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Instance 46840e8c-528b-45ff-84cb-270ef6a0c65b could not be found. Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b HTTP/1.1 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 46840e8c-528b-45ff-84cb-270ef6a0c65b could not be found. Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '46840e8c-528b-45ff-84cb-270ef6a0c65b'} Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46840e8c-528b-45ff-84cb-270ef6a0c65b could not be found. Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46840e8c-528b-45ff-84cb-270ef6a0c65b could not be found. Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:59.934124 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46840e8c-528b-45ff-84cb-270ef6a0c65b could not be found. Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 404 to user: Instance 46840e8c-528b-45ff-84cb-270ef6a0c65b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63ad5436-6ef2-4933-8fe6-bcffc9afd825 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b" status: 404 len: 111 microversion: 2.1 time: 0.036983 Aug 24 04:23:59.939010 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3475/6678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:23:59 2022] GET /compute/v2.1/servers/46840e8c-528b-45ff-84cb-270ef6a0c65b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:23:59.945456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5c3f099-a2b1-4155-bd76-0d898c45ffd3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '.version_select at 0x7f1029db4c10>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:23:59.971882 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5c3f099-a2b1-4155-bd76-0d898c45ffd3 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-846754930" status: 202 len: 0 microversion: 2.1 time: 0.030581 Aug 24 04:23:59.973059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3204/6679] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 24 04:23:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-846754930 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:24:06.067296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:06.068471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:06.075935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:06.076435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:06.077601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:06.077888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:06.078379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:06.078807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:06.106170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:24:06.195430 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f8295d4-4bf4-4ef6-90f7-0bc329b94137 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 204 len: 0 microversion: 2.1 time: 0.131826 Aug 24 04:24:06.196517 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3476/6680] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:24:06 2022] DELETE /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:24:06.210949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:06.212272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:06.222675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:06.223395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:06.224169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:06.225127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:06.225733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:06.226259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:06.369624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:06.378242 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-21093a06-3d2a-426f-8072-e53b2b47c79f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1506 microversion: 2.1 time: 0.174954 Aug 24 04:24:06.378847 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3205/6681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:06 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:24:07.401131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:07.401728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:07.408651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:07.409141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:07.409577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:07.410275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:07.410733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:07.411159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:07.565293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:07.573463 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d73b3e5-6009-407e-8994-40167f758d95 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1506 microversion: 2.1 time: 0.176967 Aug 24 04:24:07.574017 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3477/6682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:07 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:24:08.597465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:08.598142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:08.606839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:08.607341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:08.607822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:08.608539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:08.609008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:08.609447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:08.842718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:08.851789 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d331cef5-1568-444d-b312-551cf6d14352 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 200 len: 1506 microversion: 2.1 time: 0.260076 Aug 24 04:24:08.852363 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3206/6683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:08 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:24:09.220166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2ca19ab4-8cb5-42bf-aa53-d7536296ef6d req-4ece5ddd-2d54-412e-9cf2-19594760805e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cd99d3-7c7c-4f1e-8360-452d24e3e50a", "name": "network-vif-deleted", "tag": "3872c731-e1cf-4353-a6c5-74bd5510f97e"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:24:09.234304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2ca19ab4-8cb5-42bf-aa53-d7536296ef6d req-4ece5ddd-2d54-412e-9cf2-19594760805e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:09.235176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2ca19ab4-8cb5-42bf-aa53-d7536296ef6d req-4ece5ddd-2d54-412e-9cf2-19594760805e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:09.235859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2ca19ab4-8cb5-42bf-aa53-d7536296ef6d req-4ece5ddd-2d54-412e-9cf2-19594760805e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:09.249322 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2ca19ab4-8cb5-42bf-aa53-d7536296ef6d req-4ece5ddd-2d54-412e-9cf2-19594760805e service nova] Creating event network-vif-deleted:3872c731-e1cf-4353-a6c5-74bd5510f97e for instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a on n-h2-846470-15 Aug 24 04:24:09.254852 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2ca19ab4-8cb5-42bf-aa53-d7536296ef6d req-4ece5ddd-2d54-412e-9cf2-19594760805e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038645 Aug 24 04:24:09.255965 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3478/6684] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:24:09.874545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:09.875113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: e8cd99d3-7c7c-4f1e-8360-452d24e3e50a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:09.881965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:09.882449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:09.882891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:09.883651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:09.884389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:09.884883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:09.899545 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a could not be found. Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a HTTP/1.1 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a could not be found. Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e8cd99d3-7c7c-4f1e-8360-452d24e3e50a'} Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a could not be found. Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a could not be found. Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:24:09.901737 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a could not be found. Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 404 to user: Instance e8cd99d3-7c7c-4f1e-8360-452d24e3e50a could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fc727c51-cf12-452c-af27-daa8043965f7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a" status: 404 len: 111 microversion: 2.1 time: 0.032862 Aug 24 04:24:09.906884 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3207/6685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:09 2022] GET /compute/v2.1/servers/e8cd99d3-7c7c-4f1e-8360-452d24e3e50a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:24:09.912498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:09.913077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:09.919819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:09.920299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:09.920734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:09.921420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:09.921871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:09.922288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:09.947834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:24:10.033927 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-36f93c27-e014-4c54-9132-503146808ca7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 204 len: 0 microversion: 2.1 time: 0.125244 Aug 24 04:24:10.035245 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3479/6686] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:24:09 2022] DELETE /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:24:10.043584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:10.044249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:10.050612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:10.051154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:10.051580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:10.052347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:10.052819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:10.053234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:10.194095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:10.202991 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-955107cf-ce65-4953-8487-6f9ecbe1d18f tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.163419 Aug 24 04:24:10.203570 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3208/6687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:10 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:24:11.231017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:11.232097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:11.239454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:11.239969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:11.240402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:11.241078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:11.241555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:11.241983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:11.398363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:11.406791 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5e330f7-382a-45b0-a786-26840e7db107 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.180090 Aug 24 04:24:11.407588 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3480/6688] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:11 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:24:12.435091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:12.435725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:12.444992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:12.445504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:12.446000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:12.446780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:12.447475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:12.448120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:12.607758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:12.616269 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11123c64-f96b-4f6d-971d-85988eacddd7 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.186616 Aug 24 04:24:12.616900 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3209/6689] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:12 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:24:13.638592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:13.639488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:13.647803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:13.648294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:13.648729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:13.649435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:13.649878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:13.650314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:13.655183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:13.800860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7e4965a6d45c083c84e714edee9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b565a749864bc6801910e6d70f3a37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:13.809496 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f68aa9b6-8b8e-4005-8ffe-7ba8a72809b1 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 200 len: 1520 microversion: 2.1 time: 0.174888 Aug 24 04:24:13.810122 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3481/6690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:13 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:24:14.131403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-859a7e7b-954c-42be-8808-a58698dd6f02 req-94077086-37de-42df-b21d-cc25bc4193b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb20b75-b852-4d45-8e50-7e43051e3493", "name": "network-vif-deleted", "tag": "5d0d9eb0-b914-4fac-bde0-6c29b2b4c267"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:24:14.147701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-859a7e7b-954c-42be-8808-a58698dd6f02 req-94077086-37de-42df-b21d-cc25bc4193b4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:14.148208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-859a7e7b-954c-42be-8808-a58698dd6f02 req-94077086-37de-42df-b21d-cc25bc4193b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:14.148703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-859a7e7b-954c-42be-8808-a58698dd6f02 req-94077086-37de-42df-b21d-cc25bc4193b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:14.162328 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-859a7e7b-954c-42be-8808-a58698dd6f02 req-94077086-37de-42df-b21d-cc25bc4193b4 service nova] Creating event network-vif-deleted:5d0d9eb0-b914-4fac-bde0-6c29b2b4c267 for instance 4fb20b75-b852-4d45-8e50-7e43051e3493 on n-h2-846470-15 Aug 24 04:24:14.167757 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-859a7e7b-954c-42be-8808-a58698dd6f02 req-94077086-37de-42df-b21d-cc25bc4193b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040359 Aug 24 04:24:14.168409 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3210/6691] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:24:14.833561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:14.834181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] [instance: 4fb20b75-b852-4d45-8e50-7e43051e3493] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:14.842348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:14.842858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:14.843303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:14.844059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:14.844585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:14.844973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:14.860862 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] HTTP exception thrown: Instance 4fb20b75-b852-4d45-8e50-7e43051e3493 could not be found. Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Request method failure captured: Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 HTTP/1.1 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaba_V2af1vip1IrAi4WyC_thMVNzijcE88NHewnqwKRSLpQynqh7szGhnaWldGHVsCnm_wYfpyUiJePA9ZTXiY0pxS6fS7RBi8vxFq7J6FQ4co9GXb9TPVPCpUFqUmAYqtQRl7r4twCOWGX4TbTXulyH7szMESLyyRcEL7C0eGMKh8 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80b565a749864bc6801910e6d70f3a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80b565a749864bc6801910e6d70f3a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 80b565a749864bc6801910e6d70f3a37 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-491233751 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 6bf7e4965a6d45c083c84e714edee9d7 Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-491233751-project Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 4fb20b75-b852-4d45-8e50-7e43051e3493 could not be found. Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '4fb20b75-b852-4d45-8e50-7e43051e3493'} Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb20b75-b852-4d45-8e50-7e43051e3493 could not be found. Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb20b75-b852-4d45-8e50-7e43051e3493 could not be found. Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:24:14.862643 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb20b75-b852-4d45-8e50-7e43051e3493 could not be found. Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] Returning 404 to user: Instance 4fb20b75-b852-4d45-8e50-7e43051e3493 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96d39bf2-e70a-4abf-a24c-ee2102403f85 tempest-ServerRescueNegativeTestJSON-491233751 tempest-ServerRescueNegativeTestJSON-491233751-project] 10.222.0.58 "GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493" status: 404 len: 111 microversion: 2.1 time: 0.035191 Aug 24 04:24:14.868374 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3482/6692] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:24:14 2022] GET /compute/v2.1/servers/4fb20b75-b852-4d45-8e50-7e43051e3493 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:24:19.330349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1334327897", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": "none"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:24:19.337831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:19.391489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:24:19.391962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:24:19.392459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:24:19.392888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:24:19.393334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:24:19.408005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:19.408520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:19.408971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:19.409722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:19.410200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:19.410645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:19.420947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:19.435016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Getting quotas for project 156144b88d1e46aab7b56654bc2c2ca8. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:24:19.440922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Getting quotas for user b06eabe30905459ebc9ed7f01fb44900 and project 156144b88d1e46aab7b56654bc2c2ca8. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:24:19.455018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:24:19.457834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:24:19.508268 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ae54519-5353-46f1-807b-4fd15355ea6c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.313076 Aug 24 04:24:19.508944 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3211/6693] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 24 04:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 04:24:19.520200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e59d8be6-c359-48bd-ba31-932dc854105c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:19.520771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e59d8be6-c359-48bd-ba31-932dc854105c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:19.523785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:19.578885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e59d8be6-c359-48bd-ba31-932dc854105c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:19.587841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e59d8be6-c359-48bd-ba31-932dc854105c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:19.589347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e59d8be6-c359-48bd-ba31-932dc854105c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:19.590483 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e59d8be6-c359-48bd-ba31-932dc854105c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1278 microversion: 2.57 time: 0.074323 Aug 24 04:24:19.591153 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3483/6694] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:19 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1278 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:20.615171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9e9d9c22-8bf1-40ff-a254-078aca604297 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:20.615987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9e9d9c22-8bf1-40ff-a254-078aca604297 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:20.677485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9e9d9c22-8bf1-40ff-a254-078aca604297 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:20.685831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9e9d9c22-8bf1-40ff-a254-078aca604297 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:20.687363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9e9d9c22-8bf1-40ff-a254-078aca604297 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:20.688590 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9e9d9c22-8bf1-40ff-a254-078aca604297 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1278 microversion: 2.57 time: 0.078429 Aug 24 04:24:20.689187 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3212/6695] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:20 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1278 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:21.712767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-021af4ba-29bf-4557-a1f1-f0c8ee4000cf tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:21.713325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-021af4ba-29bf-4557-a1f1-f0c8ee4000cf tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:21.782152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-021af4ba-29bf-4557-a1f1-f0c8ee4000cf tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:21.795570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-021af4ba-29bf-4557-a1f1-f0c8ee4000cf tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:21.803572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-021af4ba-29bf-4557-a1f1-f0c8ee4000cf tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:21.804835 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-021af4ba-29bf-4557-a1f1-f0c8ee4000cf tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1278 microversion: 2.57 time: 0.096174 Aug 24 04:24:21.805784 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3484/6696] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:21 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:22.829810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c11a0a89-727c-4634-a5de-6f4138fcd0ba tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:22.830472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c11a0a89-727c-4634-a5de-6f4138fcd0ba tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:22.893324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c11a0a89-727c-4634-a5de-6f4138fcd0ba tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:22.902529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c11a0a89-727c-4634-a5de-6f4138fcd0ba tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:22.904473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c11a0a89-727c-4634-a5de-6f4138fcd0ba tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:22.906152 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c11a0a89-727c-4634-a5de-6f4138fcd0ba tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1278 microversion: 2.57 time: 0.081085 Aug 24 04:24:22.906806 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3213/6697] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:22 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1278 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:23.931702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:23.932305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:23.945742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:23.946320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:23.946762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:23.947474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:23.947952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:23.948383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:24.019523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:24.028320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:24.029870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:24.032548 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8a6e4879-a2e2-4ca6-aee0-93f0fa4c7078 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1282 microversion: 2.57 time: 0.104552 Aug 24 04:24:24.032980 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3485/6698] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:23 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:25.056004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:25.056660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:25.068161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:25.075966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:25.079366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:25.080189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:25.080683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:25.081150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:25.149658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:25.158415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:25.159958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:25.161135 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ff5eb26-b393-4f45-8a8f-00841a261749 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1336 microversion: 2.57 time: 0.109613 Aug 24 04:24:25.161713 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3214/6699] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:25 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1336 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:26.186987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:26.188610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:26.197666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:26.198124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:26.198853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:26.200096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:26.200630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:26.201155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:26.271249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:26.283326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:26.284891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:26.286031 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b69b2e66-86b2-4cd8-91f3-0625c452d8af tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1336 microversion: 2.57 time: 0.103623 Aug 24 04:24:26.286608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3486/6700] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:26 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:27.317123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:27.317806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:27.325120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:27.325538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:27.325983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:27.327011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:27.327479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:27.327947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:27.400342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:27.409157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:27.410724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:27.411953 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-71c98c79-4c42-407b-b32d-11b6def8eb37 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1336 microversion: 2.57 time: 0.099080 Aug 24 04:24:27.412547 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3215/6701] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:27 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:28.437173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:28.437782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:28.445168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:28.445659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:28.446105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:28.447114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:28.447566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:28.448025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:28.517675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:28.530111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:28.531634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:28.532857 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5d7fc0f3-9c1c-49ce-8bee-3f508d4cc3ca tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1336 microversion: 2.57 time: 0.099769 Aug 24 04:24:28.533456 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3487/6702] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:28 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:29.562446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:29.563090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:29.565824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:29.572039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:29.572561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:29.573008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:29.573721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:29.574223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:29.574619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:29.646384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:29.655112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:29.657013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:29.658213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90ceff70-ec84-4281-a681-080731f94032 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1357 microversion: 2.57 time: 0.099892 Aug 24 04:24:29.658851 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3216/6703] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:29 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:29.686431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:24:29.689735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:29.697314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:29.697799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:29.698248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:29.698961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:29.699414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:29.699867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:29.797091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:24:29.797517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:24:29.798030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:24:29.798447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:24:29.798868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:24:29.863729 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [7066c2fc-b0e4-41c5-bb1b-0ca479a634e9] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:24:30.871798 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [7066c2fc-b0e4-41c5-bb1b-0ca479a634e9] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 53942. Aug 24 04:24:30.876056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:30.885140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:30.885632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:30.886074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:30.886791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:30.887256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:30.887885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:30.917421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-913a4f09-0668-4059-af95-9e28df82e0f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "POST /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b/action" status: 202 len: 1138 microversion: 2.57 time: 1.237683 Aug 24 04:24:30.929748 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3488/6704] 10.222.0.58 () {62 vars in 1320 bytes} [Wed Aug 24 04:24:29 2022] POST /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b/action => generated 1138 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 04:24:30.939460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:30.940519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:30.953109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:30.954365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:30.955154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:30.956577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:30.957488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:30.958278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:31.036597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:31.045025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:31.046564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:31.047969 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-672b6ef4-361c-44d4-bfc3-7f9733fe4019 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.113144 Aug 24 04:24:31.048388 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3217/6705] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:30 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:32.072224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:32.072842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:32.076885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:32.082144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:32.082634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:32.083068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:32.083788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:32.084242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:32.084665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:32.171655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:32.180881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:32.182412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:32.183635 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eea805e5-1958-4ea8-9686-87dc042e9a1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.115794 Aug 24 04:24:32.184309 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3489/6706] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:32 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:33.207144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:33.208051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:33.210824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=10 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:33.217489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:33.218093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:33.218608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:33.219442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:33.220034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:33.220414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:33.297602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:33.307622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:33.309217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:33.310518 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88da323b-68f9-45c0-beb0-ba94fa4cf60c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.107552 Aug 24 04:24:33.311173 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3218/6707] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:33 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:34.336152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:34.336739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:34.344048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:34.344536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:34.344974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:34.345694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:34.346149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:34.346582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:34.414302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:34.423761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:34.425277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:34.426490 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-30a876c0-499f-4261-b14b-383295106ce0 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.094621 Aug 24 04:24:34.427067 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3490/6708] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:34 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:35.455503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:35.456167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:35.463937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:35.464911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:35.464911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:35.465770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:35.466089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:35.466523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:35.545725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:35.555637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:35.557264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:35.558512 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-29cacce9-3125-49cc-8cf0-beeccf525020 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.107698 Aug 24 04:24:35.559096 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3219/6709] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:35 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:36.582149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:36.582793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:36.590745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:36.591250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:36.591696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:36.592450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:36.592912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:36.593324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:36.664593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:36.673900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:36.675426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:36.676665 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48b1a5a1-e3ce-4ce4-98b0-1297df4fc590 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.098695 Aug 24 04:24:36.677232 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3491/6710] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:36 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:37.701292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:37.702270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:37.710355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:37.710868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:37.711465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:37.712076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:37.712544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:37.712984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:37.782474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:37.791572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:37.793137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:37.794356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-42e451e3-79a3-40ac-8460-ce9a5f0c2bb9 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.097092 Aug 24 04:24:37.794937 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3220/6711] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:37 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:38.818723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:38.819408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:38.827027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:38.827515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:38.827995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:38.828702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:38.829157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:38.829581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:38.902540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:38.911543 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:38.913204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:38.914401 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a9c7fb7e-8366-4ed4-be3c-b323433250cd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.099980 Aug 24 04:24:38.914978 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3492/6712] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:38 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:39.938245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:39.938889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:39.947568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:39.948277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:39.948932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:39.950079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:39.950794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:39.951781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:40.020415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:40.029610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:40.031009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:40.032257 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1fa1b186-6e90-4a7e-808a-d19bea60d9f7 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.098180 Aug 24 04:24:40.032828 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3221/6713] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:39 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:41.056221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:41.056886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:41.065222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:41.065809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:41.066383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:41.067251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:41.067871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:41.068550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:41.147373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:41.156952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:41.158656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:41.159871 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a8b5125-ef51-46a0-be0e-618ceb43b8bd tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.107967 Aug 24 04:24:41.160454 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3493/6714] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:41 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:42.185560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:42.186207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:42.192800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:42.193308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:42.193753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:42.194467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:42.194930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:42.195369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:42.262889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:42.271465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:42.273018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:42.274334 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-308e1add-33fa-4ac9-9e9b-cc81520ed04c tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.094504 Aug 24 04:24:42.274907 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3222/6715] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:42 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:43.302666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:43.303298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:43.316956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:43.317633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:43.318305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:43.319389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:43.320158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:43.320826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:43.398053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:43.406981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:43.408507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:43.409676 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6c10cee-3c13-4a22-a45a-a445c4fe0d91 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.112476 Aug 24 04:24:43.410249 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3494/6716] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:43 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:44.433878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:44.434481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:44.442935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:44.443461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:44.443935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:44.444665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:44.445135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:44.445640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:44.519252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:44.529229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:44.530813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:44.532062 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-efb618cd-2213-4f4c-ac79-d9d21034bc7f tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.102558 Aug 24 04:24:44.532666 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3223/6717] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:44 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:45.556972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:45.557651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:45.564993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:45.565512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:45.565947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:45.566646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:45.567100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:45.567524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:45.570252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:45.641086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:45.649583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:45.651090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:45.652315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66aa0968-4d55-4703-9076-02811a86c8e3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.100278 Aug 24 04:24:45.652908 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3495/6718] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:45 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:46.677436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:46.678144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:46.685943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:46.686456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:46.686925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:46.687719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:46.688251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:46.688680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:46.763360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:46.772636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:46.774356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:46.775783 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ca72ef98-7874-47d2-ae60-7df3f315817a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.103476 Aug 24 04:24:46.776383 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3224/6719] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:46 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:47.801310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:47.801951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:47.809833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:47.810337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:47.810776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:47.811498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:47.811988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:47.812421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:48.027302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:48.040372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:48.042264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:48.043588 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2e1f8465-65f4-4a0b-be38-96913804fdad tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.246642 Aug 24 04:24:48.044233 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3496/6720] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:47 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:24:49.068955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:49.069738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:49.077213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:49.077697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:49.078738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:49.078858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:49.079311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:49.079782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:49.154889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:49.166011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:49.167549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:49.168822 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4cc4110c-ebd0-4997-889e-4198a25e46a2 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.104025 Aug 24 04:24:49.169402 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3225/6721] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:49 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:50.203106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:50.203742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:50.206729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=36 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:50.213047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:50.213538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:50.213976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:50.214683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:50.215171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:50.215571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:50.286894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:50.296089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:50.297654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:50.298914 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-315691fa-6a98-4b8d-9f36-c023604958fa tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.100552 Aug 24 04:24:50.299495 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3497/6722] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:50 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:51.324006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:51.324740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:51.328538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:51.335175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:51.336483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:51.337216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:51.338421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:51.339077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:51.339705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:51.344456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=74 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:51.414483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:51.424468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:51.426026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:51.427318 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db20dff8-0131-43c9-8d7e-de34fd493b17 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.107785 Aug 24 04:24:51.428002 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3226/6723] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:51 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:52.460471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:52.461123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:52.469426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:52.469975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:52.470370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:52.471327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:52.471546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:52.472038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:52.552593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:52.564994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:52.566861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:52.568597 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc18efc9-be2d-4157-bd47-37ab7f408d44 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.112429 Aug 24 04:24:52.569461 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3498/6724] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:52 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:53.610675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:53.611608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:53.622528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:53.623412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:53.624259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:53.625100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:53.625700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:53.626499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:53.706657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:53.717232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:53.718759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:53.719972 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4cca0e16-6f5d-4a33-adb8-fbdd047e3991 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.116096 Aug 24 04:24:53.720568 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3227/6725] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:53 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:54.744779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:54.745591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:54.753379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:54.753882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:54.754304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:54.755352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:54.755625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:54.756006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:54.835258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:54.845181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:54.846820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:54.848095 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0c299189-375e-4987-b14f-d4f8d2e6613a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.107619 Aug 24 04:24:54.848703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3499/6726] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:54 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:55.877685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:55.878717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:55.889232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:55.889740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:55.890190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:55.890909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:55.892235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:55.892235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:55.963004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:55.972120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:55.973614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:55.974862 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-301cbfe0-43b1-4a89-b4ae-fcb164bd762e tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.104992 Aug 24 04:24:55.975480 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3228/6727] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:55 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:56.998838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:56.999478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:57.008093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:57.008687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:57.009190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:57.009987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:57.010520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:57.011001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:57.084748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:57.095884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:57.097960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:57.099730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4ba39d64-e341-4e4a-b87b-efed5b01bad3 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.104654 Aug 24 04:24:57.100566 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3500/6728] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:56 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:58.124479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:58.125308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:58.132589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:58.133119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:58.133566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:58.134278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:58.134751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:58.135197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:58.211017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:58.222296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:58.223996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:58.225299 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-913a2955-d473-42d6-956e-59d7de12b06b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.104926 Aug 24 04:24:58.225957 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3229/6729] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:58 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:24:59.252700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:24:59.253305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:24:59.261635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:59.262393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:59.263028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:59.264350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:24:59.265047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:24:59.265677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:24:59.347448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:59.356163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:59.357779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:24:59.359027 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-808ab1ab-71a3-4edf-a80c-828e25ad3d95 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.112316 Aug 24 04:24:59.359779 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3501/6730] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:24:59 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:00.390001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:00.391371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:00.401226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:00.401776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:00.402217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:00.402956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:00.403455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:00.403951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:00.479233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:00.488935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:00.490466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:00.491694 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f7359c40-da68-4a2d-ae75-5567837f0f1a tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.106000 Aug 24 04:25:00.492387 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3230/6731] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:00 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:01.516643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:01.517284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:01.525230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:01.525727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:01.526163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:01.526869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:01.527329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:01.527782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:01.604795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:01.616513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:01.618038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:01.619271 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c68a868a-0a40-4bd3-8ee9-ef1b819e852b tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.107029 Aug 24 04:25:01.619890 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3502/6732] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:01 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:02.645144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:02.646659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:02.657319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:02.657987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:02.658456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:02.659326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:02.659985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:02.660473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:02.745426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:02.754768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:02.756329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:02.757569 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9b4f00d8-54a7-49ce-98a3-40e1931cbf98 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1366 microversion: 2.57 time: 0.116713 Aug 24 04:25:02.758126 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3231/6733] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:02 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:03.781352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:03.781994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:03.789442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:03.789921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:03.790357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:03.791057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:03.791510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:03.791967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:03.866300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:03.875354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:03.876958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:03.878141 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ba18029-03fd-4b1e-be72-1e7de3834791 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1372 microversion: 2.57 time: 0.100986 Aug 24 04:25:03.878742 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3503/6734] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:03 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:04.903992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:04.904662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:04.916638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:04.917158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:04.917628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:04.918428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:04.918969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:04.919471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:04.995028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:05.003971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:05.005501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:05.006737 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c8cc7629-a437-4b7d-a1f3-f3eb56e06581 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1372 microversion: 2.57 time: 0.108212 Aug 24 04:25:05.007324 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3232/6735] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:04 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:06.030811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:06.031576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:06.038853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:06.039341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:06.039823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:06.040532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:06.040992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:06.041458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:06.114456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:06.124714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:06.126227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:06.127458 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dca3d026-53b3-42b3-9fca-b5913965a108 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1372 microversion: 2.57 time: 0.101002 Aug 24 04:25:06.128061 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3504/6736] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:06 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:07.152151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:07.152918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:07.160250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:07.160847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:07.161296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:07.162003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:07.162566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:07.163107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:07.237313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:07.248641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:07.250688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:07.252592 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c9947ef-831e-4598-a50e-3c00e165e208 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1357 microversion: 2.57 time: 0.104568 Aug 24 04:25:07.253202 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3233/6737] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:07 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:07.283112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:07.283730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:07.291180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:07.291771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:07.292381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:07.293103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:07.293563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:07.293990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:07.320565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:25:07.409369 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90bbe4ca-632b-43bc-8b94-fdcc362dce43 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 204 len: 0 microversion: 2.57 time: 0.130184 Aug 24 04:25:07.410032 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3505/6738] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 24 04:25:07 2022] DELETE /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 04:25:07.419547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:07.420255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:07.426813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:07.427332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:07.427813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:07.428535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:07.428999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:07.429434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:07.501809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:07.510603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:07.512359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:07.513572 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26e06a52-1144-4b0e-ac5c-6e68e6dce871 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1363 microversion: 2.57 time: 0.098929 Aug 24 04:25:07.514141 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3234/6739] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:07 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1363 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:08.541789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:08.542538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:08.550273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:08.550774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:08.551210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:08.551960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:08.552417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:08.552844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:08.631210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:08.640664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:08.642179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:08.643341 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c9ae5b19-a62a-40a3-84d2-c9dfd2afd141 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1363 microversion: 2.57 time: 0.108165 Aug 24 04:25:08.643990 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3506/6740] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:08 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1363 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:09.670315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:09.671205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:09.681311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:09.681941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:09.682433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:09.683527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:09.684250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:09.684736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:09.721215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:09.721722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:09.722173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:09.722626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lazy-loading 'fault' on Instance uuid 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:25:09.776963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:09.786097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:09.787606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b06eabe30905459ebc9ed7f01fb44900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '156144b88d1e46aab7b56654bc2c2ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:09.788960 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 200 len: 1368 microversion: 2.57 time: 0.125165 Aug 24 04:25:09.789522 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3235/6741] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:09 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:25:10.815722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:10.816346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] [instance: 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:10.826547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:10.827042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:10.827475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:10.828199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:10.828661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:10.829149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:10.844076 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] HTTP exception thrown: Instance 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b could not be found. Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Request method failure captured: Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b HTTP/1.1 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBafzJ1hGsOmoBgfC30qmt8QsuhC3pY_V_RTHpLPBKyOi4oPrnpaLQviX-QL-XiBSm96rzyzKAhissg4wQYjlveOOos8BpLQ6MPvgFeIwebnRbSNT1bPdykPlpYMw0BUTG5eIuZdMPVDKxhoWsJ6HT2J2aAHw8j7nRmrhsSHHLONt20k Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Openstack-Nova-Api-Version: 2.57 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 156144b88d1e46aab7b56654bc2c2ca8 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerShowV257Test-866380273 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_156144b88d1e46aab7b56654bc2c2ca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/156144b88d1e46aab7b56654bc2c2ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/156144b88d1e46aab7b56654bc2c2ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/156144b88d1e46aab7b56654bc2c2ca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerShowV257Test-866380273 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 156144b88d1e46aab7b56654bc2c2ca8 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerShowV257Test-866380273 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerShowV257Test-866380273-project Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: b06eabe30905459ebc9ed7f01fb44900 Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerShowV257Test-866380273-project Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b could not be found. Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '7bec9aac-d9b1-4ea5-94e4-0f443f69d34b'} Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b could not be found. Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b could not be found. Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:10.845836 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b could not be found. Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Returning 404 to user: Instance 7bec9aac-d9b1-4ea5-94e4-0f443f69d34b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4672125-338a-4957-a4fc-e1a96f0fa8ea tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b" status: 404 len: 111 microversion: 2.57 time: 0.037263 Aug 24 04:25:10.851880 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3507/6742] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 24 04:25:10 2022] GET /compute/v2.1/servers/7bec9aac-d9b1-4ea5-94e4-0f443f69d34b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:25:12.322847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:12.323888 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15ef9456-f7a3-4120-bc88-a2aa53213f46 tempest-ServerShowV257Test-866380273 tempest-ServerShowV257Test-866380273-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001420 Aug 24 04:25:12.324249 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3236/6743] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 24 04:25:12 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 04:25:13.895392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2fb1dbc2-9e30-4601-98e8-2314dc4ce1c4 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Action: 'create', calling method: .version_select at 0x7f10341dc430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1824735532", "metadata": {"Type": "work"}}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2fb1dbc2-9e30-4601-98e8-2314dc4ce1c4 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Request method failure captured: Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 122 Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBagp01yKPuEn0irRGf8BcWVxtV0P6BthQvrwzZUbTAs9FX2c1qlPgC9f_XqxPaaug2TjBDIH9xzgqsOUeq8zM3NAaBQUxw_9D3n_EjBnXpu2HqZtPTApxejgqlR1wH5TuTtRvkGozZ_UucWPB9b2IXush006E3tGQOsVle0ioBT8inY Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cd6b369c24c543eea2e4707913f3eb45 Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1824735532", "metadata": {"Type": "work"}}} Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1824735532', 'metadata': {'Type': 'work'}}}} Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:25:13.899623 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2fb1dbc2-9e30-4601-98e8-2314dc4ce1c4 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2fb1dbc2-9e30-4601-98e8-2314dc4ce1c4 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.142524 Aug 24 04:25:13.905074 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3508/6744] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 24 04:25:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:25:13.914997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebdf5968-539a-45ce-b4e6-352a2508459c tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Action: 'create', calling method: .version_select at 0x7f1029da2d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-806289499", "metadata": {"Type": "work"}}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebdf5968-539a-45ce-b4e6-352a2508459c tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Request method failure captured: Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 119 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBagp01yKPuEn0irRGf8BcWVxtV0P6BthQvrwzZUbTAs9FX2c1qlPgC9f_XqxPaaug2TjBDIH9xzgqsOUeq8zM3NAaBQUxw_9D3n_EjBnXpu2HqZtPTApxejgqlR1wH5TuTtRvkGozZ_UucWPB9b2IXush006E3tGQOsVle0ioBT8inY Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cd6b369c24c543eea2e4707913f3eb45 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-806289499", "metadata": {"Type": "work"}}} Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-806289499', 'metadata': {'Type': 'work'}}}} Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi '0' Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:25:13.920299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebdf5968-539a-45ce-b4e6-352a2508459c tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ebdf5968-539a-45ce-b4e6-352a2508459c tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013260 Aug 24 04:25:13.925383 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3237/6745] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 24 04:25:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 04:25:13.933031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-82360a88-818f-43f3-a94d-e11ec5e0473d tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Action: 'create', calling method: .version_select at 0x7f1022f33820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1856421572", "metadata": {"Type": "work"}}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-82360a88-818f-43f3-a94d-e11ec5e0473d tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Request method failure captured: Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 119 Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBagp01yKPuEn0irRGf8BcWVxtV0P6BthQvrwzZUbTAs9FX2c1qlPgC9f_XqxPaaug2TjBDIH9xzgqsOUeq8zM3NAaBQUxw_9D3n_EjBnXpu2HqZtPTApxejgqlR1wH5TuTtRvkGozZ_UucWPB9b2IXush006E3tGQOsVle0ioBT8inY Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cd6b369c24c543eea2e4707913f3eb45 Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1856421572", "metadata": {"Type": "work"}}} Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1856421572', 'metadata': {'Type': 'work'}}}} Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi '' Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:25:13.937255 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-82360a88-818f-43f3-a94d-e11ec5e0473d tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-82360a88-818f-43f3-a94d-e11ec5e0473d tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010725 Aug 24 04:25:13.943632 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3509/6746] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 24 04:25:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:25:13.949439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93c61caf-834a-4ca0-8caf-cf65a2007bd1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Calling method '.version_select at 0x7f1029c71af0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:13.980014 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-93c61caf-834a-4ca0-8caf-cf65a2007bd1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] HTTP exception thrown: Volume tempest-invalid-111294613 could not be found. Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93c61caf-834a-4ca0-8caf-cf65a2007bd1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Request method failure captured: Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-111294613 HTTP/1.1 Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBagp01yKPuEn0irRGf8BcWVxtV0P6BthQvrwzZUbTAs9FX2c1qlPgC9f_XqxPaaug2TjBDIH9xzgqsOUeq8zM3NAaBQUxw_9D3n_EjBnXpu2HqZtPTApxejgqlR1wH5TuTtRvkGozZ_UucWPB9b2IXush006E3tGQOsVle0ioBT8inY Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cd6b369c24c543eea2e4707913f3eb45 Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: exception: Volume tempest-invalid-111294613 could not be found. Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'tempest-invalid-111294613'} Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-111294613 could not be found. (HTTP 404) (Request-ID: req-72e0155d-31bf-40e3-9a67-d435cfcd7532) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:25:13.991520 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-111294613 could not be found. Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-111294613 could not be found. Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-111294613 could not be found. Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-93c61caf-834a-4ca0-8caf-cf65a2007bd1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Returning 404 to user: Volume tempest-invalid-111294613 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-93c61caf-834a-4ca0-8caf-cf65a2007bd1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-111294613" status: 404 len: 98 microversion: 2.1 time: 0.048640 Aug 24 04:25:13.997448 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3238/6747] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 24 04:25:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-111294613 => generated 98 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:25:14.003045 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1bdc08d2-7db0-4ab5-86f5-7c3f3aaba917 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003895 Aug 24 04:25:14.003512 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3510/6748] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 24 04:25:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 04:25:14.011946 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7af3bb1c-c16c-44e8-9ca5-e67dbb02225d tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003788 Aug 24 04:25:14.012510 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3239/6749] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 24 04:25:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 04:25:14.021399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf3587fd-536e-407a-aa0f-ca74be162bc1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Calling method '.version_select at 0x7f1022e60790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:14.052115 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-bf3587fd-536e-407a-aa0f-ca74be162bc1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] HTTP exception thrown: Volume 732de963-b287-40f3-b787-9c475fd5aebe could not be found. Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf3587fd-536e-407a-aa0f-ca74be162bc1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Request method failure captured: Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/os-volumes/732de963-b287-40f3-b787-9c475fd5aebe HTTP/1.1 Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBagp01yKPuEn0irRGf8BcWVxtV0P6BthQvrwzZUbTAs9FX2c1qlPgC9f_XqxPaaug2TjBDIH9xzgqsOUeq8zM3NAaBQUxw_9D3n_EjBnXpu2HqZtPTApxejgqlR1wH5TuTtRvkGozZ_UucWPB9b2IXush006E3tGQOsVle0ioBT8inY Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: cd6b369c24c543eea2e4707913f3eb45 Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: method: Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: exception: Volume 732de963-b287-40f3-b787-9c475fd5aebe could not be found. Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '732de963-b287-40f3-b787-9c475fd5aebe'} Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 732de963-b287-40f3-b787-9c475fd5aebe could not be found. (HTTP 404) (Request-ID: req-44c735a0-30bf-434f-b2a4-a00579f479ab) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:25:14.055048 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 732de963-b287-40f3-b787-9c475fd5aebe could not be found. Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 732de963-b287-40f3-b787-9c475fd5aebe could not be found. Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 732de963-b287-40f3-b787-9c475fd5aebe could not be found. Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf3587fd-536e-407a-aa0f-ca74be162bc1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Returning 404 to user: Volume 732de963-b287-40f3-b787-9c475fd5aebe could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf3587fd-536e-407a-aa0f-ca74be162bc1 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/732de963-b287-40f3-b787-9c475fd5aebe" status: 404 len: 109 microversion: 2.1 time: 0.039090 Aug 24 04:25:14.061169 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3511/6750] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 24 04:25:14 2022] DELETE /compute/v2.1/os-volumes/732de963-b287-40f3-b787-9c475fd5aebe => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:25:14.069885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-091085a6-6a51-489b-b62f-d5e6042a6169 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Calling method '.version_select at 0x7f1029d4b550>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:14.102293 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-091085a6-6a51-489b-b62f-d5e6042a6169 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] HTTP exception thrown: Volume ba9d634c-2de0-47d2-94c0-501dbc3bd298 could not be found. Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-091085a6-6a51-489b-b62f-d5e6042a6169 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Request method failure captured: Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/os-volumes/ba9d634c-2de0-47d2-94c0-501dbc3bd298 HTTP/1.1 Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBagp01yKPuEn0irRGf8BcWVxtV0P6BthQvrwzZUbTAs9FX2c1qlPgC9f_XqxPaaug2TjBDIH9xzgqsOUeq8zM3NAaBQUxw_9D3n_EjBnXpu2HqZtPTApxejgqlR1wH5TuTtRvkGozZ_UucWPB9b2IXush006E3tGQOsVle0ioBT8inY Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd9ad8a62fe642358e71f841f7b3ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: dd9ad8a62fe642358e71f841f7b3ff3d Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-VolumesNegativeTest-634676933 Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: cd6b369c24c543eea2e4707913f3eb45 Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-VolumesNegativeTest-634676933-project Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: method: Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: exception: Volume ba9d634c-2de0-47d2-94c0-501dbc3bd298 could not be found. Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'ba9d634c-2de0-47d2-94c0-501dbc3bd298'} Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba9d634c-2de0-47d2-94c0-501dbc3bd298 could not be found. (HTTP 404) (Request-ID: req-f9381553-5aaa-4435-accc-a47f3a17e2db) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:25:14.105478 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba9d634c-2de0-47d2-94c0-501dbc3bd298 could not be found. Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba9d634c-2de0-47d2-94c0-501dbc3bd298 could not be found. Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba9d634c-2de0-47d2-94c0-501dbc3bd298 could not be found. Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-091085a6-6a51-489b-b62f-d5e6042a6169 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] Returning 404 to user: Volume ba9d634c-2de0-47d2-94c0-501dbc3bd298 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-091085a6-6a51-489b-b62f-d5e6042a6169 tempest-VolumesNegativeTest-634676933 tempest-VolumesNegativeTest-634676933-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ba9d634c-2de0-47d2-94c0-501dbc3bd298" status: 404 len: 109 microversion: 2.1 time: 0.041136 Aug 24 04:25:14.111390 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3240/6751] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 24 04:25:14 2022] GET /compute/v2.1/os-volumes/ba9d634c-2de0-47d2-94c0-501dbc3bd298 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:25:16.501843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:16.502413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:16.508707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:16.509193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:16.509621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:16.510362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:16.510834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:16.511238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:16.514017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:16.540387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:25:16.623748 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dbb6b483-9d45-4bf2-8ff6-58bb712a612f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 204 len: 0 microversion: 2.1 time: 0.383083 Aug 24 04:25:16.624952 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3512/6752] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:25:16 2022] DELETE /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:25:16.634795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:16.635414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:16.646672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:16.647183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:16.647636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:16.648579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:16.649321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:16.649742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:16.912071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:16.920567 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-40073181-17dd-49a2-b13b-4dd0a7ef799b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1578 microversion: 2.1 time: 0.291223 Aug 24 04:25:16.921134 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3241/6753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:16 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1578 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:17.942427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:17.943109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:17.949855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:17.950351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:17.950834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:17.952520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:17.953484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:17.953922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:18.144007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:18.152542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c9c42c04-664e-419a-a44b-9c14350b8d74 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1578 microversion: 2.1 time: 0.214408 Aug 24 04:25:18.154394 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3513/6754] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:17 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:25:19.174120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:19.174672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:19.181937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:19.182743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:19.183199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:19.183944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:19.184412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:19.187384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:19.602462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:19.611693 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7b5ae692-0b31-4384-9b87-993ef353bbc7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1510 microversion: 2.1 time: 0.441648 Aug 24 04:25:19.612865 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3242/6755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:19 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:19.691033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-03e5ff71-8703-4ed6-9365-73e5ae4a34be req-58406547-b589-4620-86ea-860f0d1767b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad81d7f-1a94-4b3f-b7ef-df7583b6e649", "name": "network-vif-deleted", "tag": "affa09d3-2d45-45a0-968a-8e6d521182bd"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:25:19.702685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-03e5ff71-8703-4ed6-9365-73e5ae4a34be req-58406547-b589-4620-86ea-860f0d1767b1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:19.703459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-03e5ff71-8703-4ed6-9365-73e5ae4a34be req-58406547-b589-4620-86ea-860f0d1767b1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:19.704116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-03e5ff71-8703-4ed6-9365-73e5ae4a34be req-58406547-b589-4620-86ea-860f0d1767b1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:19.728713 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-03e5ff71-8703-4ed6-9365-73e5ae4a34be req-58406547-b589-4620-86ea-860f0d1767b1 service nova] Creating event network-vif-deleted:affa09d3-2d45-45a0-968a-8e6d521182bd for instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 on n-h2-846470-15 Aug 24 04:25:19.735930 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-03e5ff71-8703-4ed6-9365-73e5ae4a34be req-58406547-b589-4620-86ea-860f0d1767b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049912 Aug 24 04:25:19.738632 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3514/6756] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:25:20.634108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:20.635048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:20.644249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:20.645169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:20.645983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:20.647357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:20.648720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:20.649433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:20.734177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:20.743321 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4bed984-babd-4726-afab-58ed00a81cd0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1225 microversion: 2.1 time: 0.113851 Aug 24 04:25:20.744016 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3243/6757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:20 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:21.768273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:21.769639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:21.772009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:21.777732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:21.778252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:21.778680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:21.779376 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:21.779911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:21.780370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:21.858858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:21.869188 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c56dd8c2-da61-47a4-b257-a6d01ac3552d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1225 microversion: 2.1 time: 0.105597 Aug 24 04:25:21.869785 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3515/6758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:21 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:22.891372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:22.892052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:22.894900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=28 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:22.905931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:22.906538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:22.906960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:22.909159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:22.909159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:22.909159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:22.924246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=80 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:23.010662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:23.019615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0e9ea15e-38e5-4ba1-8fdc-efaddf8e5d15 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1225 microversion: 2.1 time: 0.133042 Aug 24 04:25:23.021238 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3244/6759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:22 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:24.044305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:24.046358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:24.054152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:24.054756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:24.055491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:24.056478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:24.057004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:24.057502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:24.136574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:24.145484 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bae3f91-edbe-41ef-87a4-6282ed4247cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 200 len: 1225 microversion: 2.1 time: 0.106973 Aug 24 04:25:24.156352 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3516/6760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:24 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:25.166660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:25.167461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:25.174518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:25.175024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:25.175478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:25.176231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:25.176701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:25.177134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:25.191687 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 HTTP/1.1 Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'dad81d7f-1a94-4b3f-b7ef-df7583b6e649'} Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:25:25.193267 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3200a928-e565-4230-9ecf-e66c28ebe02f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 404 len: 111 microversion: 2.1 time: 0.032098 Aug 24 04:25:25.198741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3245/6761] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:25 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:25:25.328242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-668802446", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1371241705", "security_groups": [{"name": "tempest-secgroup-smoke-1748538127"}], "block_device_mapping_v2": [{"uuid": "187651b1-139f-4266-b669-f5e58453fa84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9935c908-0959-4c8b-be4e-161d3600b222"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:25:25.452684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] validate_networks() for [('9935c908-0959-4c8b-be4e-161d3600b222', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:25:26.057461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:25:26.057902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:25:26.058382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:25:26.058802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:25:26.059218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:25:26.069248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:26.069736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:26.070381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:26.071292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:26.072026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:26.072656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:26.095720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:25:26.102492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:25:26.171201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:25:26.173459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='187651b1-139f-4266-b669-f5e58453fa84',volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:25:26.312518 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-688139c8-5da3-48d9-9d46-dd69269eced7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.988832 Aug 24 04:25:26.313910 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3517/6762] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:25:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:25:26.324817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-366909e1-b4ef-49cc-b329-c2d2ab996cfb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:26.325428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-366909e1-b4ef-49cc-b329-c2d2ab996cfb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:26.402723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-366909e1-b4ef-49cc-b329-c2d2ab996cfb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:26.411502 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-366909e1-b4ef-49cc-b329-c2d2ab996cfb tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1094 microversion: 2.1 time: 0.090454 Aug 24 04:25:26.412090 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3246/6763] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:26 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:27.433191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:27.433913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:27.442029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:27.442841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:27.443657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:27.444617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:27.445123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:27.445550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:27.511721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:27.522036 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6300cf42-a803-4101-8694-c09d3c10c62c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1192 microversion: 2.1 time: 0.093586 Aug 24 04:25:27.522614 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3518/6764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:27 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:28.542984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:28.543773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:28.557132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:28.558970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:28.559714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:28.560932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:28.562759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:28.563633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:28.792938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:28.814479 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf3d6788-e9c9-4634-b0da-8514fba4d99c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1278 microversion: 2.1 time: 0.272055 Aug 24 04:25:28.815402 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3247/6765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:28 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:29.393966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b755a602-6a6d-4912-85d9-70151c7de965 req-56f850de-9ded-425e-b7fc-05bc5028ae55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407a322b-3cee-4440-a83d-ca2dfbb4c437", "tag": "a306f91e-838d-4d49-abb9-3272cd7fc484"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:25:29.410972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b755a602-6a6d-4912-85d9-70151c7de965 req-56f850de-9ded-425e-b7fc-05bc5028ae55 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:29.411452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b755a602-6a6d-4912-85d9-70151c7de965 req-56f850de-9ded-425e-b7fc-05bc5028ae55 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:29.412108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b755a602-6a6d-4912-85d9-70151c7de965 req-56f850de-9ded-425e-b7fc-05bc5028ae55 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:29.428169 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b755a602-6a6d-4912-85d9-70151c7de965 req-56f850de-9ded-425e-b7fc-05bc5028ae55 service nova] Creating event network-changed:a306f91e-838d-4d49-abb9-3272cd7fc484 for instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 on n-h2-846470-15 Aug 24 04:25:29.435080 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b755a602-6a6d-4912-85d9-70151c7de965 req-56f850de-9ded-425e-b7fc-05bc5028ae55 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044992 Aug 24 04:25:29.436582 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3519/6766] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:25:29.837040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:29.837667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:29.851271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:29.852140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:29.853325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:29.854896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:29.855445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:29.856204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:30.128900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:30.138052 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-df3ac335-3812-4adc-a94a-af3025968bc6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1278 microversion: 2.1 time: 0.305055 Aug 24 04:25:30.140228 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3248/6767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:29 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:31.161408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:31.162102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:31.168522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:31.169126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:31.169745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:31.170482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:31.170983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:31.171407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:31.348010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:31.356759 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af28dbee-d35b-41d1-bb3a-e50e46de42b8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1278 microversion: 2.1 time: 0.200698 Aug 24 04:25:31.357375 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3520/6768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:31 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:32.384384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:32.385736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:32.393512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:32.394079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:32.394546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:32.396088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:32.396615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:32.397231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:32.545484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:32.557079 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-36810f07-b8bb-460a-840e-172e31820349 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1278 microversion: 2.1 time: 0.177068 Aug 24 04:25:32.558050 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3249/6769] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:32 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:33.582255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:33.582889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:33.591097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:33.591643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:33.592112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:33.593087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:33.593672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:33.594088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:33.751540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:33.759411 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6d2623d7-164e-48ba-8b5f-2f569480afe8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.184180 Aug 24 04:25:33.760031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3521/6770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:33 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:34.781267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:34.781844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:34.789794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:34.790274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:34.790735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:34.791471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:34.791979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:34.792421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:34.931493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:34.940828 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-300ba923-d443-4238-b6e5-d969bdfd9eb6 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.164222 Aug 24 04:25:34.941453 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3250/6771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:34 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:35.963616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:35.964334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:35.975151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:35.976506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:35.976972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:35.977794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:35.978245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:35.978767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:36.087237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:36.111378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:36.141380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:36.158317 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c060f118-af9b-4183-a041-23480f16a4ab tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.198416 Aug 24 04:25:36.159063 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3522/6772] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:35 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:37.180965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:37.181682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:37.184589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:37.191413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:37.191927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:37.192378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:37.193075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:37.193556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:37.193990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:37.349992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:37.358607 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c0d2da6-73f1-435c-9b6c-90aeae67e0de tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.181567 Aug 24 04:25:37.359189 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3251/6773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:37 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:38.381928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:38.382857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:38.389758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:38.390286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:38.390735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:38.391772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:38.392239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:38.392670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:38.534857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:38.542697 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-01b4d99e-bd8c-4f5d-8ac8-755cacfe8d7e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.164963 Aug 24 04:25:38.543305 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3523/6774] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:38 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:39.564069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:39.564866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:39.573588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:39.573588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:39.573588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:39.574592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:39.575296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:39.575758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:39.721213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:39.732483 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e81173c9-71f7-4165-92fe-09d22ac9e6e7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.172132 Aug 24 04:25:39.733129 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3252/6775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:39 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:40.754462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:40.755041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:40.762701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:40.763202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:40.763636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:40.764617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:40.765074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:40.765501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:40.922084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:40.930504 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a49b663-4738-44b1-a640-b3be5fd8311b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.180250 Aug 24 04:25:40.932153 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3524/6776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:40 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:41.953595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:41.954239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:41.962288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:41.962769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:41.963257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:41.964014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:41.964498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:41.964938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:42.107285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:42.115571 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-999f0a98-5080-40f9-8fbb-4b753fe03dc3 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.166256 Aug 24 04:25:42.116198 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3253/6777] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:41 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:42.672133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Calling method '.version_select at 0x7f1021d1dee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:42.673281 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:25:42.673281 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:25:42.674611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:42.675198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:42.675824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:42.691044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:42.691781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:42.692253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:42.703155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:42.703633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:42.704093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:42.709991 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-82299a05-ea65-491d-87a0-3c518a31d2d3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472 tempest-PortsAdminExtendedAttrsIpV6TestJSON-648410472-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.177077 Aug 24 04:25:42.710498 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3525/6778] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 04:25:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:25:43.140369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:43.141093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:43.149843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:43.150420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:43.151034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:43.151819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:43.152369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:43.152809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:43.307443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:43.316322 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee405527-8746-4926-8bdc-a43a4c96361b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.182429 Aug 24 04:25:43.317143 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3254/6779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:43 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:44.340415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:44.340970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:44.348100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:44.348588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:44.349255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:44.350531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:44.350988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:44.351415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:44.511189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:44.519344 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca2c1715-139a-4e86-b493-d29486d1fa4d tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.182998 Aug 24 04:25:44.520042 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3526/6780] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:44 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:45.241798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-afd01d54-5d2a-4290-a208-e7b57eaa016c req-2fe5072a-0805-4183-a82b-29887a4e2912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407a322b-3cee-4440-a83d-ca2dfbb4c437", "name": "network-vif-plugged", "status": "completed", "tag": "a306f91e-838d-4d49-abb9-3272cd7fc484"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:25:45.260528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afd01d54-5d2a-4290-a208-e7b57eaa016c req-2fe5072a-0805-4183-a82b-29887a4e2912 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:45.263498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afd01d54-5d2a-4290-a208-e7b57eaa016c req-2fe5072a-0805-4183-a82b-29887a4e2912 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:45.263498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-afd01d54-5d2a-4290-a208-e7b57eaa016c req-2fe5072a-0805-4183-a82b-29887a4e2912 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:45.279627 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-afd01d54-5d2a-4290-a208-e7b57eaa016c req-2fe5072a-0805-4183-a82b-29887a4e2912 service nova] Creating event network-vif-plugged:a306f91e-838d-4d49-abb9-3272cd7fc484 for instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 on n-h2-846470-15 Aug 24 04:25:45.286139 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-afd01d54-5d2a-4290-a208-e7b57eaa016c req-2fe5072a-0805-4183-a82b-29887a4e2912 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047747 Aug 24 04:25:45.287107 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3255/6781] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:25:45.543517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:45.544477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:45.552585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:45.553075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:45.553509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:45.554210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:45.554659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:45.555081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:45.781203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:45.790300 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7328dd4-08aa-41f3-9bb0-fa38ad1224e2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.252803 Aug 24 04:25:45.790899 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3527/6782] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:45 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:25:46.813592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:46.814428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:46.822092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:46.822650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:46.823373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:46.824832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:46.825332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:46.825769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:47.053717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:47.062236 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d8aa632e-9ff8-4fb9-b6dc-ee65953037cd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1266 microversion: 2.1 time: 0.253796 Aug 24 04:25:47.062875 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3256/6783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:46 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:48.084849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:48.088231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:48.100570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:48.101012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:48.101451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:48.102147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:48.102598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:48.103230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:48.107882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:48.260157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:48.268736 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0073db65-9c53-4e3c-a056-63cbae2f639f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1453 microversion: 2.1 time: 0.188336 Aug 24 04:25:48.269403 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3528/6784] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:48 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:48.290132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:25:48.290716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:25:48.297577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:48.298100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:48.298550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:48.299377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:48.299744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:48.300185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:48.434115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:25:48.442300 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3fb2c2b0-170c-4955-87eb-426d7b72767f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1453 microversion: 2.1 time: 0.156697 Aug 24 04:25:48.443201 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3257/6785] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:25:48 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:25:50.584276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-027550d0-c04d-4920-bc45-e68613a26fc5 req-ba21456a-8d89-400b-828e-7b0e6cbcade6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407a322b-3cee-4440-a83d-ca2dfbb4c437", "tag": "a306f91e-838d-4d49-abb9-3272cd7fc484"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:25:50.596375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-027550d0-c04d-4920-bc45-e68613a26fc5 req-ba21456a-8d89-400b-828e-7b0e6cbcade6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:25:50.596861 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-027550d0-c04d-4920-bc45-e68613a26fc5 req-ba21456a-8d89-400b-828e-7b0e6cbcade6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:25:50.597295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-027550d0-c04d-4920-bc45-e68613a26fc5 req-ba21456a-8d89-400b-828e-7b0e6cbcade6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:25:50.610785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-027550d0-c04d-4920-bc45-e68613a26fc5 req-ba21456a-8d89-400b-828e-7b0e6cbcade6 service nova] Creating event network-changed:a306f91e-838d-4d49-abb9-3272cd7fc484 for instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 on n-h2-846470-15 Aug 24 04:25:50.616996 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-027550d0-c04d-4920-bc45-e68613a26fc5 req-ba21456a-8d89-400b-828e-7b0e6cbcade6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038419 Aug 24 04:25:50.617969 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3529/6786] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:26:56.771449 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:26:56.772405 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:26:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:27:30.146429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=29 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:30.147195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=69 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:30.152043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-552127188", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1371241705", "security_groups": [{"name": "tempest-secgroup-smoke-1748538127"}], "block_device_mapping_v2": [{"uuid": "2b8bebf6-7347-41ab-b41e-e9a60afc5caa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9935c908-0959-4c8b-be4e-161d3600b222"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:27:30.277568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] validate_networks() for [('9935c908-0959-4c8b-be4e-161d3600b222', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:27:30.686822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:27:30.687298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:27:30.687814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:27:30.688236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:27:30.688662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:27:30.698485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:30.698991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:30.699446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:30.700219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:30.701006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:30.701446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:30.718744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:27:30.724229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Getting quotas for user 146a0e603bde4818ad72ddcfc13181b8 and project 12da7c4cdd5543f89dbe102539afdeac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:27:30.789073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:27:30.791531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b8bebf6-7347-41ab-b41e-e9a60afc5caa',volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:27:30.945499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ff39df69-08b5-4d74-ba8a-046c1eca0d22 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.800891 Aug 24 04:27:30.946594 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3258/6787] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:27:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:27:30.956927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:30.957679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=7 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:30.965966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5918ca0-c396-428b-9d62-5fa4ca5f643b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:30.966841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5918ca0-c396-428b-9d62-5fa4ca5f643b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:31.026166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5918ca0-c396-428b-9d62-5fa4ca5f643b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:31.033474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5918ca0-c396-428b-9d62-5fa4ca5f643b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1094 microversion: 2.1 time: 0.079417 Aug 24 04:27:31.034107 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3530/6788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:30 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:27:32.056539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:32.057128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:32.063713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:32.074776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:32.076481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:32.077478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:32.079532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:32.080038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:32.310097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:32.318737 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2105d68b-ffa9-4476-b54b-b3a08dc1c235 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1192 microversion: 2.1 time: 0.267603 Aug 24 04:27:32.319447 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3259/6789] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:32 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1192 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:33.344803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:33.347128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:33.359779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:33.361078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:33.362348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:33.365546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:33.366487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:33.367224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:33.522286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:33.543552 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cdef23f6-c9d7-4f6e-97fd-02f149200d10 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1278 microversion: 2.1 time: 0.204868 Aug 24 04:27:33.545528 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3531/6790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:33 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:27:33.977611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-78419960-3a17-4cce-a3bb-ea2417adc53a req-002d4e63-f03a-4b55-a6ce-74ce0d63ef50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d410b0f6-9811-4ffb-a3d6-9a98b40e580c", "tag": "07c7fdb3-3855-4f79-9672-8e40fb0ad981"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:27:33.989712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-78419960-3a17-4cce-a3bb-ea2417adc53a req-002d4e63-f03a-4b55-a6ce-74ce0d63ef50 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:33.990220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-78419960-3a17-4cce-a3bb-ea2417adc53a req-002d4e63-f03a-4b55-a6ce-74ce0d63ef50 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:33.990669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-78419960-3a17-4cce-a3bb-ea2417adc53a req-002d4e63-f03a-4b55-a6ce-74ce0d63ef50 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:34.006352 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-78419960-3a17-4cce-a3bb-ea2417adc53a req-002d4e63-f03a-4b55-a6ce-74ce0d63ef50 service nova] Creating event network-changed:07c7fdb3-3855-4f79-9672-8e40fb0ad981 for instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c on n-h1-846470-15 Aug 24 04:27:34.014615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-78419960-3a17-4cce-a3bb-ea2417adc53a req-002d4e63-f03a-4b55-a6ce-74ce0d63ef50 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123030 Aug 24 04:27:34.015721 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3260/6791] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:27:34.565564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:34.567202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:34.574821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:34.575991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:34.576629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:34.577547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:34.578208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:34.578816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:34.766369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:34.779913 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0b9bcf5-3977-49a7-856b-f0b21d9f24bf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1278 microversion: 2.1 time: 0.218390 Aug 24 04:27:34.793388 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3532/6792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:34 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:35.806187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:35.807710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:35.814566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:35.815069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:35.815658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:35.816430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:35.816897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:35.817629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:35.967693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:35.976873 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f44dd187-e7be-4904-9a70-e2394335d266 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1278 microversion: 2.1 time: 0.176468 Aug 24 04:27:35.978746 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3261/6793] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:35 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:36.999316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:37.000820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:37.008216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:37.008712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:37.009405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:37.010100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:37.010718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:37.011149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:37.319207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:37.329290 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f563ebd4-0125-48cb-86c6-cbd734eb1df4 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1278 microversion: 2.1 time: 0.333809 Aug 24 04:27:37.340244 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3533/6794] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:36 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1278 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:38.356880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:38.357604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:38.365926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:38.366573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:38.367115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:38.368667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:38.369354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:38.369887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:38.723222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:38.731272 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffa5079a-19e6-4678-8854-0bd7b59e034a tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1266 microversion: 2.1 time: 0.379777 Aug 24 04:27:38.731947 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3262/6795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:38 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1266 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:39.755624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:39.756332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:39.764252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:39.764743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:39.765190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:39.765898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:39.766358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:39.766788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:39.911801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:39.922918 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce211eee-1fcf-49a6-8385-c7d00a483c80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1266 microversion: 2.1 time: 0.172338 Aug 24 04:27:39.923501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3534/6796] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:39 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:40.943856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:40.944492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:40.947804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:40.948165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:40.954527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:40.954968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:40.955424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:40.956188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:40.956701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:40.957116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:41.115764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:41.124480 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e39fbeff-f2c8-4b44-a1e5-b9da774a1029 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1266 microversion: 2.1 time: 0.184429 Aug 24 04:27:41.125302 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3263/6797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:40 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:42.148369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:42.149246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:42.152426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:42.158591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:42.159215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:42.159710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:42.160491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:42.160950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:42.161581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:42.322928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:42.331727 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eda3f89c-eaab-4042-bdfd-7beb8c66b3db tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1266 microversion: 2.1 time: 0.187652 Aug 24 04:27:42.332314 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3535/6798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:42 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:43.358869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:43.360020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:43.372495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:43.373048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:43.373673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:43.374503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:43.375161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:43.375625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:43.533212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:43.541312 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-afa29e60-22e5-473a-9242-75a4015af272 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1266 microversion: 2.1 time: 0.189843 Aug 24 04:27:43.541906 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3264/6799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:43 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:43.965033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46d2e6c3-8a49-4043-90ea-ef85df64b651 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'create', calling method: .version_select at 0x7f10343a00d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-175623948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKW6MdjQLNFm/pXSjsIshE1zfHx0O6ZMvi669re8sGa0VHLvkWl4Hb/DWlo5T4UZIxul7mafImO7GLC0QZWybK/o6EkqAa6sjKnAcf2muF9axqiGXoL1XAnzPtAJg7fgQ=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:27:43.982669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-46d2e6c3-8a49-4043-90ea-ef85df64b651 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for project 26d523eb1a564c7982ea864afdc701d8. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:27:43.988710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-46d2e6c3-8a49-4043-90ea-ef85df64b651 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for user d33ba6bcfb044286923c1c2c939b9097 and project 26d523eb1a564c7982ea864afdc701d8. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:27:44.005978 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46d2e6c3-8a49-4043-90ea-ef85df64b651 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:27:44.564824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:44.565447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:44.575831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:44.576491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:44.577130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:44.578167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:44.578791 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:44.579390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:44.735142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:44.744215 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-987cb79f-a711-41f1-adcd-84f75400fa5f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1266 microversion: 2.1 time: 0.185261 Aug 24 04:27:44.744798 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3265/6800] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:44 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:45.013987 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-46d2e6c3-8a49-4043-90ea-ef85df64b651 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56520. Aug 24 04:27:45.033006 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-46d2e6c3-8a49-4043-90ea-ef85df64b651 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.247333 Aug 24 04:27:45.033735 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3536/6801] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:27:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:27:45.209225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0e103128-d8bf-47ed-bfd9-b4899ec517b9 req-60736c58-1be8-465d-8d51-fb0ca003724d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d410b0f6-9811-4ffb-a3d6-9a98b40e580c", "name": "network-vif-plugged", "status": "completed", "tag": "07c7fdb3-3855-4f79-9672-8e40fb0ad981"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:27:45.223124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0e103128-d8bf-47ed-bfd9-b4899ec517b9 req-60736c58-1be8-465d-8d51-fb0ca003724d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:45.223574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0e103128-d8bf-47ed-bfd9-b4899ec517b9 req-60736c58-1be8-465d-8d51-fb0ca003724d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:45.224217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0e103128-d8bf-47ed-bfd9-b4899ec517b9 req-60736c58-1be8-465d-8d51-fb0ca003724d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:45.239934 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0e103128-d8bf-47ed-bfd9-b4899ec517b9 req-60736c58-1be8-465d-8d51-fb0ca003724d service nova] Creating event network-vif-plugged:07c7fdb3-3855-4f79-9672-8e40fb0ad981 for instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c on n-h1-846470-15 Aug 24 04:27:45.247194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0e103128-d8bf-47ed-bfd9-b4899ec517b9 req-60736c58-1be8-465d-8d51-fb0ca003724d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042772 Aug 24 04:27:45.248271 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3266/6802] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:27:45.765353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:45.765991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:45.772550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:45.773046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:45.773542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:45.774364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:45.774709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:45.775148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:45.922809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:45.930886 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ee4bbc05-5496-4179-8cfd-62ea6dd2ded0 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1266 microversion: 2.1 time: 0.169574 Aug 24 04:27:45.931475 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3537/6803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:45 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:46.954335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:46.955171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:46.963336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:46.964429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:46.965219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:46.966107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:46.966850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:46.967236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:47.129571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:47.137747 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19d6911c-8b83-4e86-ab55-20abb5758e2e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1266 microversion: 2.1 time: 0.189172 Aug 24 04:27:47.138343 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3267/6804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:46 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:48.162908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:48.164372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:48.173850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:48.173980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:48.174466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:48.175053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:48.175509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:48.176768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:48.331221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:48.340537 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c3064c3-4796-4684-aa22-1247d414795b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1453 microversion: 2.1 time: 0.183957 Aug 24 04:27:48.355777 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3538/6805] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:48 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:48.363315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:48.364570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:48.372235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:48.372753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:48.373213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:48.373939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:48.374503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:48.374881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:48.521963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:48.532158 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-869cd0f6-aa47-4ccc-8e57-4336d4bfc25c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1453 microversion: 2.1 time: 0.172797 Aug 24 04:27:48.533065 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3268/6806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:48 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:50.965820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ed6d2cb9-d620-48ad-bd7f-a0212bc0b3c5 req-e97ae790-30b1-458f-8543-9dcb4d2b8505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d410b0f6-9811-4ffb-a3d6-9a98b40e580c", "tag": "07c7fdb3-3855-4f79-9672-8e40fb0ad981"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:27:50.994612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ed6d2cb9-d620-48ad-bd7f-a0212bc0b3c5 req-e97ae790-30b1-458f-8543-9dcb4d2b8505 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:50.995898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ed6d2cb9-d620-48ad-bd7f-a0212bc0b3c5 req-e97ae790-30b1-458f-8543-9dcb4d2b8505 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:50.996541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ed6d2cb9-d620-48ad-bd7f-a0212bc0b3c5 req-e97ae790-30b1-458f-8543-9dcb4d2b8505 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:51.026693 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ed6d2cb9-d620-48ad-bd7f-a0212bc0b3c5 req-e97ae790-30b1-458f-8543-9dcb4d2b8505 service nova] Creating event network-changed:07c7fdb3-3855-4f79-9672-8e40fb0ad981 for instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c on n-h1-846470-15 Aug 24 04:27:51.033210 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ed6d2cb9-d620-48ad-bd7f-a0212bc0b3c5 req-e97ae790-30b1-458f-8543-9dcb4d2b8505 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071221 Aug 24 04:27:51.038056 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3539/6807] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:27:51.856661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-471247183", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "055ac1fb-06f9-4a62-bee1-2e0c4ee52811"}], "key_name": "tempest-TestNetworkAdvancedServerOps-175623948", "security_groups": [{"name": "tempest-secgroup-smoke-723992009"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:27:52.076380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] validate_networks() for [('055ac1fb-06f9-4a62-bee1-2e0c4ee52811', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:27:52.636495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:27:52.637027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:27:52.637533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:27:52.638088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:27:52.641029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:27:52.651980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:52.652478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:52.652923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:52.653721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:52.654186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:52.654620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:52.676633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for project 26d523eb1a564c7982ea864afdc701d8. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:27:52.683265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for user d33ba6bcfb044286923c1c2c939b9097 and project 26d523eb1a564c7982ea864afdc701d8. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:27:52.698147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:27:52.701063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:27:52.756294 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c18a6bf5-176f-411e-8235-2c33ddbb16c7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.908348 Aug 24 04:27:52.757277 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3269/6808] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:27:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:27:52.770192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0686c4e1-a14b-42bb-9fc9-c6e18b76d2cc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:52.771518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0686c4e1-a14b-42bb-9fc9-c6e18b76d2cc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:52.830662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0686c4e1-a14b-42bb-9fc9-c6e18b76d2cc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:52.839642 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0686c4e1-a14b-42bb-9fc9-c6e18b76d2cc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1265 microversion: 2.1 time: 0.074664 Aug 24 04:27:52.840268 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3540/6809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:52 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:27:53.861317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51aaf0ee-73db-4f6f-b5ef-e2191f06c00d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:53.861941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-51aaf0ee-73db-4f6f-b5ef-e2191f06c00d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:53.927707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-51aaf0ee-73db-4f6f-b5ef-e2191f06c00d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:53.936334 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-51aaf0ee-73db-4f6f-b5ef-e2191f06c00d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1265 microversion: 2.1 time: 0.079698 Aug 24 04:27:53.939752 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3270/6810] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:53 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:54.262146 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:27:54.262890 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:27:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:27:54.957594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-026b111d-6198-40db-b65b-95aab81da5aa tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:54.958408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-026b111d-6198-40db-b65b-95aab81da5aa tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:55.028049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-026b111d-6198-40db-b65b-95aab81da5aa tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:55.035443 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-026b111d-6198-40db-b65b-95aab81da5aa tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1265 microversion: 2.1 time: 0.081786 Aug 24 04:27:55.036062 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3541/6811] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:54 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:56.056041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:56.056815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:56.064590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:56.065387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:56.066028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:56.067108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:56.067914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:56.068534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:56.153115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:56.161491 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c3b49688-dd0c-43a9-aad4-3db40f6c995d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1323 microversion: 2.1 time: 0.109745 Aug 24 04:27:56.162078 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3271/6812] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:56 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:57.182993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:57.183633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:57.191602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:57.192126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:57.192592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:57.193249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:57.193698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:57.194115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:57.340012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:57.348724 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3bcd8221-41db-4626-9644-8424628c56f1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1390 microversion: 2.1 time: 0.170032 Aug 24 04:27:57.349387 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3542/6813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:57 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:57.626755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-738b0ad3-79db-4e81-ad64-8a4561f8a83b req-cc76d280-cf5a-412d-a3d0-b7b18b9e3072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084db2f0-ff03-4ea6-8749-c1091433f0f5", "tag": "6a95c467-8de8-4c6b-bf44-a5751a7fe35d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:27:57.637627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-738b0ad3-79db-4e81-ad64-8a4561f8a83b req-cc76d280-cf5a-412d-a3d0-b7b18b9e3072 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:57.638254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-738b0ad3-79db-4e81-ad64-8a4561f8a83b req-cc76d280-cf5a-412d-a3d0-b7b18b9e3072 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:57.638704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-738b0ad3-79db-4e81-ad64-8a4561f8a83b req-cc76d280-cf5a-412d-a3d0-b7b18b9e3072 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:57.650426 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-738b0ad3-79db-4e81-ad64-8a4561f8a83b req-cc76d280-cf5a-412d-a3d0-b7b18b9e3072 service nova] Creating event network-changed:6a95c467-8de8-4c6b-bf44-a5751a7fe35d for instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 on n-h2-846470-15 Aug 24 04:27:57.655949 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-738b0ad3-79db-4e81-ad64-8a4561f8a83b req-cc76d280-cf5a-412d-a3d0-b7b18b9e3072 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106382 Aug 24 04:27:57.656590 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3272/6814] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:27:58.372252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:58.372906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:58.379977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:58.380510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:58.381000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:58.381804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:58.382258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:58.382885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:58.527585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:58.536047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37d083ed-c0b3-46c3-9f4a-cf684bdc52c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1390 microversion: 2.1 time: 0.169465 Aug 24 04:27:58.536661 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3543/6815] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:58 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:27:59.559391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:27:59.560150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:27:59.567200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:59.567697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:59.568189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:59.568901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:27:59.569368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:27:59.569808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:27:59.719161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:27:59.728077 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de675cc2-bf21-4aeb-955b-6977834426ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1390 microversion: 2.1 time: 0.174257 Aug 24 04:27:59.728670 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3273/6816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:27:59 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:28:00.749091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:28:00.749731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:28:00.757095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:00.757761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:00.758200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:00.758899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:00.759344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:00.759798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:00.912801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:28:00.921411 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e972d899-a622-427b-89c1-257229c41e70 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1390 microversion: 2.1 time: 0.176255 Aug 24 04:28:00.921992 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3544/6817] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:28:00 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:28:01.942422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:28:01.943044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:28:01.946076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:01.952438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:01.952914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:01.953389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:01.954093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:01.954554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:01.954974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:01.960958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=71 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:02.118202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:28:02.126797 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15d13947-a063-405c-a343-f996136f63bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1390 microversion: 2.1 time: 0.188312 Aug 24 04:28:02.127440 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3274/6818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:28:01 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:28:03.150831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:28:03.151528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:28:03.155523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:03.164077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:03.164575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:03.165023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:03.165745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:03.166193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:03.166633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:03.169880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=63 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:03.308445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:28:03.321075 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4bab8702-d947-4535-a9ff-4ca997e2b99c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1390 microversion: 2.1 time: 0.175259 Aug 24 04:28:03.321837 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3545/6819] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:28:03 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:28:03.829930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:03.901982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e0f0012c-e8aa-44ff-828a-13bcb2e4f9c0 req-dec8fceb-36bf-48e5-866f-c76a28e95d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084db2f0-ff03-4ea6-8749-c1091433f0f5", "name": "network-vif-plugged", "status": "completed", "tag": "6a95c467-8de8-4c6b-bf44-a5751a7fe35d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:28:03.916246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e0f0012c-e8aa-44ff-828a-13bcb2e4f9c0 req-dec8fceb-36bf-48e5-866f-c76a28e95d7c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:03.916737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e0f0012c-e8aa-44ff-828a-13bcb2e4f9c0 req-dec8fceb-36bf-48e5-866f-c76a28e95d7c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:03.917172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e0f0012c-e8aa-44ff-828a-13bcb2e4f9c0 req-dec8fceb-36bf-48e5-866f-c76a28e95d7c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:03.932370 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e0f0012c-e8aa-44ff-828a-13bcb2e4f9c0 req-dec8fceb-36bf-48e5-866f-c76a28e95d7c service nova] Creating event network-vif-plugged:6a95c467-8de8-4c6b-bf44-a5751a7fe35d for instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 on n-h2-846470-15 Aug 24 04:28:03.938002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:03.941487 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e0f0012c-e8aa-44ff-828a-13bcb2e4f9c0 req-dec8fceb-36bf-48e5-866f-c76a28e95d7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115906 Aug 24 04:28:03.942308 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3275/6820] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:28:04.346535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:28:04.347189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:28:04.354320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:04.354817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:04.355248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:04.356008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:04.356472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:04.356900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:04.503187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:28:04.513466 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c579275e-b2d5-4547-a283-be29cf385a59 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1390 microversion: 2.1 time: 0.170954 Aug 24 04:28:04.514057 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3546/6821] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:28:04 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:28:05.535909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:28:05.536631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:28:05.543633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:05.544169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:05.544699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:05.545703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:05.546168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:05.546630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:05.693253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:28:05.702437 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-76dbf5fa-e036-4e22-93a7-e9c7706663b9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1563 microversion: 2.1 time: 0.172059 Aug 24 04:28:05.703106 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3276/6822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:28:05 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:28:05.723856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:28:05.724654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:28:05.726832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:05.733448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:05.733966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:05.734672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:05.736192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:05.736681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:05.737106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:05.882663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:28:05.891121 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-beb1f00d-3259-45b0-9bc5-7476c08acb62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1563 microversion: 2.1 time: 0.172095 Aug 24 04:28:05.891776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3547/6823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:28:05 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:28:07.983884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:28:07.984931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:28:07.993020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6a0f0b42-aca9-4a04-a3c8-2026d2cfb6e6 req-7fd1130d-5627-4242-8b7d-19e366613aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084db2f0-ff03-4ea6-8749-c1091433f0f5", "tag": "6a95c467-8de8-4c6b-bf44-a5751a7fe35d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:28:08.001015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:08.001568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:08.002022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:08.002753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:08.003224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:08.003687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:08.006367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a0f0b42-aca9-4a04-a3c8-2026d2cfb6e6 req-7fd1130d-5627-4242-8b7d-19e366613aae service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:08.006848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a0f0b42-aca9-4a04-a3c8-2026d2cfb6e6 req-7fd1130d-5627-4242-8b7d-19e366613aae service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:08.007361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a0f0b42-aca9-4a04-a3c8-2026d2cfb6e6 req-7fd1130d-5627-4242-8b7d-19e366613aae service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:08.025639 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6a0f0b42-aca9-4a04-a3c8-2026d2cfb6e6 req-7fd1130d-5627-4242-8b7d-19e366613aae service nova] Creating event network-changed:6a95c467-8de8-4c6b-bf44-a5751a7fe35d for instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 on n-h2-846470-15 Aug 24 04:28:08.032232 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6a0f0b42-aca9-4a04-a3c8-2026d2cfb6e6 req-7fd1130d-5627-4242-8b7d-19e366613aae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047457 Aug 24 04:28:08.033459 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3548/6824] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:28:08.508320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:28:08.519615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e85471b-a97f-4a17-bd75-1d42e4a13aad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1563 microversion: 2.1 time: 0.540344 Aug 24 04:28:08.520651 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3277/6825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:28:07 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1563 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:28:43.866714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=7 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:43.867469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=19 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:28:43.872611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:28:43.876073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:28:43.885639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:43.886293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:43.886883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:43.887903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:28:43.888563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:28:43.889185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:28:43.950261 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd82a5f8-130c-47ef-a72c-b343e9fd9952 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action" status: 200 len: 24568 microversion: 2.1 time: 0.086100 Aug 24 04:28:43.951141 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3549/6826] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:28:43 2022] POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action => generated 24568 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:29:14.402786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=7 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:14.403502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=19 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:14.409206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:14.410353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:14.417190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:14.417685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:14.418141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:14.418832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:14.419300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:14.419767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:14.681916 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-22effb43-e2a6-4bd0-a018-31d36b70d31b tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1834 microversion: 2.1 time: 0.282351 Aug 24 04:29:14.682861 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3278/6827] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:14 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1834 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:14.705031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:14.705818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:14.709094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:14.709759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:14.716140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:14.716625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:14.717067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:14.717768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:14.718222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:14.718649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:14.875083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:14.886932 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ceeb41e6-b024-4a71-8f9e-7ff8a4381303 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1681 microversion: 2.1 time: 0.185869 Aug 24 04:29:14.887714 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3550/6828] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:14 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:14.992972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:14.995291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:15.004854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:15.005357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:15.005807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:15.006521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:15.006993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:15.007436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:15.061843 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cfd06285-25a9-4928-b462-70a3c7a09355 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action" status: 200 len: 32634 microversion: 2.1 time: 0.073122 Aug 24 04:29:15.062467 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3279/6829] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:29:14 2022] POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action => generated 32634 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:29:15.223794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:15.224317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:15.233987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:15.234472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:15.234918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:15.235609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:15.236094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:15.236520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:15.407141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '92cf80c317d64ecda14f5c0fda5a2525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cafcb5c46745788bda643a4c9760c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:15.407803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] flavor_id is None. Assuming migration. {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 04:29:15.408345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:29:15.724337 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b9fab907-dc53-4af6-b4fa-966d55153cdd tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action" status: 202 len: 0 microversion: 2.1 time: 0.505018 Aug 24 04:29:15.725106 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3551/6830] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:29:15 2022] POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:29:15.734387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:15.735151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:15.743345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:15.743870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:15.744303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:15.745058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:15.745650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:15.746236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:15.893694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:15.902400 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e64306f6-e74b-4492-a5e5-38e8ab0db019 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1690 microversion: 2.1 time: 0.172246 Aug 24 04:29:15.902984 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3280/6831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:15 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:16.925677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:16.926357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:16.934064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:16.934561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:16.934997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:16.935699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:16.936900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:16.937434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:17.094704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:17.103534 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-70794677-9d20-4eb7-955e-b12c72f1eaa9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1690 microversion: 2.1 time: 0.183039 Aug 24 04:29:17.104157 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3552/6832] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:16 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:18.129992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:18.130630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:18.138989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:18.139502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:18.139991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:18.140710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:18.141187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:18.141636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:18.282657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:18.293594 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-034fdb77-0d85-4524-b4ba-ab7ae35820f3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.169102 Aug 24 04:29:18.294370 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3281/6833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:18 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:19.317533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:19.318178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:19.326024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:19.326437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:19.326869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:19.327562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:19.328050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:19.328469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:19.476810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:19.484873 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1b19daba-b7b1-4866-9b5c-d935361f1e29 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.171738 Aug 24 04:29:19.485456 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3553/6834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:19 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:20.509230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:20.509844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:20.517147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:20.517668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:20.518131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:20.518829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:20.519481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:20.520021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:20.794593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:20.803503 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-59787902-27bb-47e4-90d1-5ec93fe694af tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.299775 Aug 24 04:29:20.804127 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3282/6835] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:20 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:21.099167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:21.099707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:21.100190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6ba49406-be0b-4282-9e14-5162e32a0eea req-01d07a0d-a487-4f5e-b609-c3b01ca7fe2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d410b0f6-9811-4ffb-a3d6-9a98b40e580c", "tag": "07c7fdb3-3855-4f79-9672-8e40fb0ad981"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:21.106805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:21.107300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:21.107966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:21.108858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:21.109321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:21.109752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:21.110924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ba49406-be0b-4282-9e14-5162e32a0eea req-01d07a0d-a487-4f5e-b609-c3b01ca7fe2d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:21.111430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ba49406-be0b-4282-9e14-5162e32a0eea req-01d07a0d-a487-4f5e-b609-c3b01ca7fe2d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:21.111930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6ba49406-be0b-4282-9e14-5162e32a0eea req-01d07a0d-a487-4f5e-b609-c3b01ca7fe2d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:21.123932 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6ba49406-be0b-4282-9e14-5162e32a0eea req-01d07a0d-a487-4f5e-b609-c3b01ca7fe2d service nova] Creating event network-changed:07c7fdb3-3855-4f79-9672-8e40fb0ad981 for instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c on n-h1-846470-15 Aug 24 04:29:21.129875 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6ba49406-be0b-4282-9e14-5162e32a0eea req-01d07a0d-a487-4f5e-b609-c3b01ca7fe2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034259 Aug 24 04:29:21.130809 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3283/6836] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:29:21.144734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:29:21.234297 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0a9ecc9-8d78-4053-8897-bc04e93cdf95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 204 len: 0 microversion: 2.1 time: 0.141103 Aug 24 04:29:21.234999 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3554/6837] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:29:21 2022] DELETE /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:29:21.245733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:21.246871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:21.256421 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:21.257257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:21.258117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:21.259044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:21.259758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:21.261060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:21.435502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:21.444081 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5c392fa7-6242-48e0-953d-668b3645a845 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1577 microversion: 2.1 time: 0.203884 Aug 24 04:29:21.444633 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3284/6838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:21 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:21.825811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:21.826625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:21.834138 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:21.834695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:21.835233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:21.835974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:21.836432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:21.836866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:21.977325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:21.989391 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3136c4b-dd46-413c-8fc9-88c81773c93f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.167966 Aug 24 04:29:21.990017 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3555/6839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:21 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:22.466229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:22.467475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:22.474659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:22.475373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:22.475865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:22.476593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:22.477057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:22.477646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:22.680969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:22.689670 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94c8ccc7-db85-4d6d-84f7-080873c66961 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1577 microversion: 2.1 time: 0.227333 Aug 24 04:29:22.690338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3285/6840] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:22 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:23.013031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:23.013741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:23.027782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:23.027782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:23.027782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:23.027782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:23.027782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:23.027782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:23.195714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:23.205247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fb554599-eaa9-488f-ac08-a894afbecbc9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.195924 Aug 24 04:29:23.206082 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3556/6841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:23 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:23.713450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:23.713991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:23.721095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:23.721617 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:23.722080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:23.723021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:23.723463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:23.723936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:23.924659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:23.934028 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-38e3f778-3853-4d1f-a472-63a9b3cd0e95 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1459 microversion: 2.1 time: 0.224683 Aug 24 04:29:23.934633 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3286/6842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:23 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1459 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:24.076278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a1e3e9f3-e5c3-4364-96dc-b5a9dd329915 req-85bf8b8d-a58c-4557-a0d1-ca847cd2cfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d410b0f6-9811-4ffb-a3d6-9a98b40e580c", "name": "network-vif-deleted", "tag": "07c7fdb3-3855-4f79-9672-8e40fb0ad981"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:24.087497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a1e3e9f3-e5c3-4364-96dc-b5a9dd329915 req-85bf8b8d-a58c-4557-a0d1-ca847cd2cfed service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:24.088008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a1e3e9f3-e5c3-4364-96dc-b5a9dd329915 req-85bf8b8d-a58c-4557-a0d1-ca847cd2cfed service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:24.088442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a1e3e9f3-e5c3-4364-96dc-b5a9dd329915 req-85bf8b8d-a58c-4557-a0d1-ca847cd2cfed service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:24.100547 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a1e3e9f3-e5c3-4364-96dc-b5a9dd329915 req-85bf8b8d-a58c-4557-a0d1-ca847cd2cfed service nova] Creating event network-vif-deleted:07c7fdb3-3855-4f79-9672-8e40fb0ad981 for instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c on n-h1-846470-15 Aug 24 04:29:24.105580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a1e3e9f3-e5c3-4364-96dc-b5a9dd329915 req-85bf8b8d-a58c-4557-a0d1-ca847cd2cfed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Aug 24 04:29:24.106292 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3557/6843] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:29:24.228568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:24.229211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:24.236285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:24.236285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:24.237050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:24.237434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:24.238356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:24.238826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:24.422450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:24.432045 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eba25d68-b7cb-4ce0-8ca8-3bdb782efd72 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.207228 Aug 24 04:29:24.432820 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3287/6844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:24 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:24.957933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:24.958663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:24.965287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:24.965774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:24.966212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:24.966908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:24.967373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:24.967829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:25.041886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:25.052858 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a0feea8-9547-4f79-a083-4e684981b41b tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1225 microversion: 2.1 time: 0.099958 Aug 24 04:29:25.053623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3558/6845] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:24 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:25.455730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:25.456387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:25.464098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:25.464629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:25.465081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:25.465835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:25.466311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:25.466767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:25.620100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:25.628383 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9823df58-1add-4794-94e8-83be34e1aa7e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.176716 Aug 24 04:29:25.629243 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3288/6846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:25 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:26.076859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:26.077833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:26.085254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:26.085726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:26.086163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:26.086866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:26.087353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:26.087954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:26.155688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:26.166449 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f2c05e81-ecf4-479d-8ae2-dbbe5be806fd tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1225 microversion: 2.1 time: 0.093945 Aug 24 04:29:26.167571 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3559/6847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:26 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:26.651844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:26.652495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:26.663141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:26.664056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:26.664768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:26.665874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:26.666583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:26.667230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:26.825527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:26.833983 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-01b70ef7-658b-4af0-aa1e-46bcffbbc77e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.186560 Aug 24 04:29:26.834621 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3289/6848] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:26 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:27.189951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:27.190792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:27.198605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:27.199197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:27.199969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:27.200686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:27.201149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:27.201583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:27.272317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:27.281834 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dc9a3287-1ee2-4645-8505-1b963b113372 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1225 microversion: 2.1 time: 0.095802 Aug 24 04:29:27.282527 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3560/6849] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:27 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:27.856470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:27.857169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:27.865812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:27.866086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:27.866588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:27.867372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:27.867940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:27.868388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:28.027744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:28.036805 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-690238b6-2ea5-41cb-b097-37e3ea946ce5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.184526 Aug 24 04:29:28.037905 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3290/6850] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:27 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:28.303444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:28.304161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:28.312709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:28.313405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:28.314090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:28.315326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:28.316330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:28.316779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:28.385455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:28.394581 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0989d16a-f375-40aa-85b5-616920c7eed7 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 200 len: 1225 microversion: 2.1 time: 0.095072 Aug 24 04:29:28.395175 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3561/6851] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:28 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:29.061878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:29.071790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:29.078874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:29.079864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:29.080603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:29.082687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:29.083598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:29.084224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:29.233366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:29.246215 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0170518d-0452-458d-b54a-9ca3bbafab2b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1695 microversion: 2.1 time: 0.189894 Aug 24 04:29:29.247078 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3291/6852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:29 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:29.417089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:29.417704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: d410b0f6-9811-4ffb-a3d6-9a98b40e580c] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:29.425682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:29.426174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:29.426617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:29.427315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:29.427805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:29.428239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:29.442470 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c could not be found. Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c HTTP/1.1 Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c could not be found. Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd410b0f6-9811-4ffb-a3d6-9a98b40e580c'} Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c could not be found. Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c could not be found. Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:29:29.444214 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c could not be found. Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance d410b0f6-9811-4ffb-a3d6-9a98b40e580c could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6771b312-d09b-436f-b4d9-120be3a5b0cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c" status: 404 len: 111 microversion: 2.1 time: 0.032847 Aug 24 04:29:29.448012 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3562/6853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:29 2022] GET /compute/v2.1/servers/d410b0f6-9811-4ffb-a3d6-9a98b40e580c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:29:30.272288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:30.273769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:30.281621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:30.282138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:30.282991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:30.284111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:30.284794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:30.285387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:30.538584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:30.548516 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-635aac15-10b9-493a-9af0-5568993acb5e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1694 microversion: 2.1 time: 0.280431 Aug 24 04:29:30.549435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3292/6854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:30 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1694 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:30.900053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-75b2cbab-57eb-4a89-8b4c-6d302f7426ea req-37a6db49-0315-4936-a4cb-3ae81e82488a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084db2f0-ff03-4ea6-8749-c1091433f0f5", "name": "network-vif-unplugged", "status": "completed", "tag": "6a95c467-8de8-4c6b-bf44-a5751a7fe35d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:30.913291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-75b2cbab-57eb-4a89-8b4c-6d302f7426ea req-37a6db49-0315-4936-a4cb-3ae81e82488a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:30.913843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-75b2cbab-57eb-4a89-8b4c-6d302f7426ea req-37a6db49-0315-4936-a4cb-3ae81e82488a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:30.914343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-75b2cbab-57eb-4a89-8b4c-6d302f7426ea req-37a6db49-0315-4936-a4cb-3ae81e82488a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:30.927486 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-75b2cbab-57eb-4a89-8b4c-6d302f7426ea req-37a6db49-0315-4936-a4cb-3ae81e82488a service nova] Creating event network-vif-unplugged:6a95c467-8de8-4c6b-bf44-a5751a7fe35d for instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 on n-h1-846470-15 Aug 24 04:29:30.934775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-75b2cbab-57eb-4a89-8b4c-6d302f7426ea req-37a6db49-0315-4936-a4cb-3ae81e82488a service nova] Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:29:30.948058 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-75b2cbab-57eb-4a89-8b4c-6d302f7426ea req-37a6db49-0315-4936-a4cb-3ae81e82488a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053587 Aug 24 04:29:30.948915 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3563/6855] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:29:31.571368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:31.573122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:31.580720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:31.581591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:31.582053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:31.583006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:31.583672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:31.584125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:31.815053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:31.823610 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7bea8110-3c59-4a60-a97d-d62ea2484412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1694 microversion: 2.1 time: 0.256584 Aug 24 04:29:31.833386 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3293/6856] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:31 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1694 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:32.846224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:32.846924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:32.855487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:32.856141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:32.856583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:32.857643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:32.858075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:32.858499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:32.975656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-62504fb9-9e6c-4117-8871-eb419d237fd3 req-4f6784e4-2a8b-4584-9eca-9b52c5ab72f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084db2f0-ff03-4ea6-8749-c1091433f0f5", "tag": "6a95c467-8de8-4c6b-bf44-a5751a7fe35d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:32.989359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-62504fb9-9e6c-4117-8871-eb419d237fd3 req-4f6784e4-2a8b-4584-9eca-9b52c5ab72f9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:32.989901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-62504fb9-9e6c-4117-8871-eb419d237fd3 req-4f6784e4-2a8b-4584-9eca-9b52c5ab72f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:32.990586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-62504fb9-9e6c-4117-8871-eb419d237fd3 req-4f6784e4-2a8b-4584-9eca-9b52c5ab72f9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:33.008292 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-62504fb9-9e6c-4117-8871-eb419d237fd3 req-4f6784e4-2a8b-4584-9eca-9b52c5ab72f9 service nova] Creating event network-changed:6a95c467-8de8-4c6b-bf44-a5751a7fe35d for instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 on n-h1-846470-15 Aug 24 04:29:33.016158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-62504fb9-9e6c-4117-8871-eb419d237fd3 req-4f6784e4-2a8b-4584-9eca-9b52c5ab72f9 service nova] Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:29:33.020680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:33.025419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:33.033870 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e47ca1e-5344-4454-9c42-327d088f5931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1692 microversion: 2.1 time: 0.192042 Aug 24 04:29:33.034769 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-62504fb9-9e6c-4117-8871-eb419d237fd3 req-4f6784e4-2a8b-4584-9eca-9b52c5ab72f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063273 Aug 24 04:29:33.035165 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3564/6857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:32 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:33.036192 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3294/6858] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:29:34.056943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:34.057584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:34.065628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:34.066127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:34.066662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:34.067384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:34.067881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:34.068312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:34.230373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:34.239097 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f84f6368-9c20-45ba-8dcb-ce05e79c215a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1692 microversion: 2.1 time: 0.185850 Aug 24 04:29:34.239610 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3565/6859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:34 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:29:35.266905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:35.268642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:35.284759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:35.285904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:35.286632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:35.287658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:35.288416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:35.289227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:35.561925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:35.566027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=100 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:35.573024 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-682a7388-1803-4bd3-b770-d6ca134e2041 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1692 microversion: 2.1 time: 0.315119 Aug 24 04:29:35.590105 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3295/6860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:35 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1692 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:35.919867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:35.920879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:35.929921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:35.930756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:35.931177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:35.932230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:35.932988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:35.933472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:35.968180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:29:36.036417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cbd506ef-4278-4fdf-afb1-5d06c5ed5783 req-cc5bdc5c-5c14-4cff-b0ed-73cab2ccb9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407a322b-3cee-4440-a83d-ca2dfbb4c437", "tag": "a306f91e-838d-4d49-abb9-3272cd7fc484"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:36.048215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cbd506ef-4278-4fdf-afb1-5d06c5ed5783 req-cc5bdc5c-5c14-4cff-b0ed-73cab2ccb9c8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.049059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cbd506ef-4278-4fdf-afb1-5d06c5ed5783 req-cc5bdc5c-5c14-4cff-b0ed-73cab2ccb9c8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.049568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cbd506ef-4278-4fdf-afb1-5d06c5ed5783 req-cc5bdc5c-5c14-4cff-b0ed-73cab2ccb9c8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:36.073921 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cbd506ef-4278-4fdf-afb1-5d06c5ed5783 req-cc5bdc5c-5c14-4cff-b0ed-73cab2ccb9c8 service nova] Creating event network-changed:a306f91e-838d-4d49-abb9-3272cd7fc484 for instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 on n-h2-846470-15 Aug 24 04:29:36.083852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cbd506ef-4278-4fdf-afb1-5d06c5ed5783 req-cc5bdc5c-5c14-4cff-b0ed-73cab2ccb9c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114850 Aug 24 04:29:36.085045 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-477919a3-f0c7-46de-a162-d94efcdc8e58 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 204 len: 0 microversion: 2.1 time: 0.174284 Aug 24 04:29:36.086422 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3566/6861] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:29:35 2022] DELETE /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:29:36.092670 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3296/6862] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:29:36.103071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:36.104547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:36.111981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.112607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.113503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:36.114765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.115415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.115944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:36.275991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:36.284190 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dce4d016-901c-4091-98d4-0a949faa99fe tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1578 microversion: 2.1 time: 0.187740 Aug 24 04:29:36.285018 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3567/6863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:36 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:36.601982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:36.602742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:36.610333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.611054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.611524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:36.612305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.612794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.613327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:36.750559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:36.760292 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a8d7613e-4c27-4249-97d4-880a2d9435eb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1689 microversion: 2.1 time: 0.167186 Aug 24 04:29:36.760886 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3297/6864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:36 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:36.782049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:36.782527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:36.789583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.790086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.790519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:36.791226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.791691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.792151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:36.859884 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53c97de4-c1d3-459e-971d-332ddbe08200 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action" status: 204 len: 0 microversion: 2.1 time: 0.081528 Aug 24 04:29:36.860795 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3568/6865] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:29:36 2022] POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:29:36.869816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:36.870460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:36.880160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.880679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.881182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:36.881862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:36.882334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:36.882773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:37.026632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:37.035085 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd45c08b-96c8-4ef9-8535-5fcc1a22aeab tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1689 microversion: 2.1 time: 0.169418 Aug 24 04:29:37.035731 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3298/6866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:36 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:29:37.311368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:37.313069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:37.323895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:37.325110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:37.325736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:37.326894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:37.327545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:37.328223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:37.496951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:37.506008 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-558ed033-7f93-438a-a61a-17fe32924ad2 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1578 microversion: 2.1 time: 0.200727 Aug 24 04:29:37.511208 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3569/6867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:37 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1578 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:37.826406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-64f8fc82-09f5-4e63-adf1-6445243e2137 req-fb49363a-bfa5-4d4b-b4d7-39fed6ee6013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084db2f0-ff03-4ea6-8749-c1091433f0f5", "name": "network-vif-plugged", "status": "completed", "tag": "6a95c467-8de8-4c6b-bf44-a5751a7fe35d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:37.840194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-64f8fc82-09f5-4e63-adf1-6445243e2137 req-fb49363a-bfa5-4d4b-b4d7-39fed6ee6013 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:37.840816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-64f8fc82-09f5-4e63-adf1-6445243e2137 req-fb49363a-bfa5-4d4b-b4d7-39fed6ee6013 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:37.841341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-64f8fc82-09f5-4e63-adf1-6445243e2137 req-fb49363a-bfa5-4d4b-b4d7-39fed6ee6013 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:37.860281 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-64f8fc82-09f5-4e63-adf1-6445243e2137 req-fb49363a-bfa5-4d4b-b4d7-39fed6ee6013 service nova] Creating event network-vif-plugged:6a95c467-8de8-4c6b-bf44-a5751a7fe35d for instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 on n-h1-846470-15 Aug 24 04:29:37.870036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-64f8fc82-09f5-4e63-adf1-6445243e2137 req-fb49363a-bfa5-4d4b-b4d7-39fed6ee6013 service nova] Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:29:37.884021 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-64f8fc82-09f5-4e63-adf1-6445243e2137 req-fb49363a-bfa5-4d4b-b4d7-39fed6ee6013 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063114 Aug 24 04:29:37.885395 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3299/6868] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:29:38.057204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:38.057875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:38.070247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:38.071108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:38.071786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:38.073569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:38.074247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:38.075491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:38.310443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:38.322075 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-80fd6a19-a378-4a40-9630-c21bc4a21ebe tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1689 microversion: 2.1 time: 0.268823 Aug 24 04:29:38.323090 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3570/6869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:38 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1689 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:38.530104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:38.530793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:38.541303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-39d78c94-3129-4308-a3da-07240684afac req-65eae366-b38f-4986-999f-d52849d90d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407a322b-3cee-4440-a83d-ca2dfbb4c437", "name": "network-vif-deleted", "tag": "a306f91e-838d-4d49-abb9-3272cd7fc484"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:29:38.541440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:38.541933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:38.542405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:38.543202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:38.543701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:38.544200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:38.554737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39d78c94-3129-4308-a3da-07240684afac req-65eae366-b38f-4986-999f-d52849d90d8b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:38.555541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39d78c94-3129-4308-a3da-07240684afac req-65eae366-b38f-4986-999f-d52849d90d8b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:38.556047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39d78c94-3129-4308-a3da-07240684afac req-65eae366-b38f-4986-999f-d52849d90d8b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:38.570331 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-39d78c94-3129-4308-a3da-07240684afac req-65eae366-b38f-4986-999f-d52849d90d8b service nova] Creating event network-vif-deleted:a306f91e-838d-4d49-abb9-3272cd7fc484 for instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 on n-h2-846470-15 Aug 24 04:29:38.576449 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-39d78c94-3129-4308-a3da-07240684afac req-65eae366-b38f-4986-999f-d52849d90d8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040411 Aug 24 04:29:38.578011 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3571/6870] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:29:38.627438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:38.637415 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bde803c8-7c25-4164-976f-a0cb5c6390da tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1391 microversion: 2.1 time: 0.112299 Aug 24 04:29:38.638109 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3300/6871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:38 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1391 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:39.346855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:39.347906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:39.354734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:39.355249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:39.356603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:39.356603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:39.356993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:39.357305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:39.514955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:39.523653 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5c52c162-2281-4d39-afac-74b0b8c907b6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1681 microversion: 2.1 time: 0.181597 Aug 24 04:29:39.524305 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3572/6872] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:39 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:39.659034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:39.660352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:39.668028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:39.668547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:39.669001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:39.669736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:39.670200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:39.670665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:39.735634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:39.744401 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ff45f4e-fd27-42c7-b3f7-0ec682e7cc27 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1225 microversion: 2.1 time: 0.089342 Aug 24 04:29:39.745035 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3301/6873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:39 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:40.768818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:40.769511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:40.776910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:40.777430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:40.777842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:40.778544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:40.778998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:40.779427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:40.848040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:40.856735 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b9118f6f-d5cd-4051-af1b-0af6e23ff03c tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1225 microversion: 2.1 time: 0.094382 Aug 24 04:29:40.857321 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3573/6874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:40 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:41.880463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:41.881190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:41.889498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:41.890041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:41.890529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:41.891358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:41.892034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:41.892504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:41.967707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:41.976427 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-496ee5d6-44bf-4bee-85ef-9577de9cc7c8 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1225 microversion: 2.1 time: 0.101306 Aug 24 04:29:41.977015 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3302/6875] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:41 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:42.998241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:42.998977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:43.006428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:43.006930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:43.007363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:43.008123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:43.008584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:43.009020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:43.042753 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:43.043251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:43.043691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:43.044143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lazy-loading 'fault' on Instance uuid 407a322b-3cee-4440-a83d-ca2dfbb4c437 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:29:43.088598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a0e603bde4818ad72ddcfc13181b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c4cdd5543f89dbe102539afdeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:29:43.096564 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7594ce78-0a92-4bda-ab09-69f7785d744e tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 200 len: 1230 microversion: 2.1 time: 0.102350 Aug 24 04:29:43.097134 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3574/6876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:42 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:29:44.118224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:44.119117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: 407a322b-3cee-4440-a83d-ca2dfbb4c437] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:44.128645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:44.129176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:44.129641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:44.130367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:44.130848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:44.131323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:44.145457 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 could not be found. Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 HTTP/1.1 Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 could not be found. Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '407a322b-3cee-4440-a83d-ca2dfbb4c437'} Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 could not be found. Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 could not be found. Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:29:44.147171 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 could not be found. Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance 407a322b-3cee-4440-a83d-ca2dfbb4c437 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-610f73ef-9f1c-4b58-b02c-ef6373e6fd1f tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437" status: 404 len: 111 microversion: 2.1 time: 0.034504 Aug 24 04:29:44.150361 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3303/6877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:44 2022] GET /compute/v2.1/servers/407a322b-3cee-4440-a83d-ca2dfbb4c437 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:29:45.318728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:45.319357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:45.326718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:45.332504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:45.333005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:45.333440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:45.334206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:45.334662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:45.335091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:45.351204 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 HTTP/1.1 Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'dad81d7f-1a94-4b3f-b7ef-df7583b6e649'} Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:29:45.353056 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5caf8dc5-f324-457b-9355-faf7da3dae80 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 404 len: 111 microversion: 2.1 time: 0.040747 Aug 24 04:29:45.356298 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3575/6878] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:29:45 2022] DELETE /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:29:45.366827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:45.367454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] [instance: dad81d7f-1a94-4b3f-b7ef-df7583b6e649] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:29:45.370424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=53 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:45.376321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:45.376825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:45.377358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:45.378199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:29:45.378830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:29:45.379288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:29:45.394142 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] HTTP exception thrown: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Request method failure captured: Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 HTTP/1.1 Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBaaU5BQUsyRpeAPqddX6bGQnR4IqeIYvFz5pfus9Gkq7NkU2p3AzBNzi5KsX8VaeVfgwUMSBmfgo5m3_lYSivF3XGiHmkTi6rCf0PeTXnnnJiaX0ogZJOf1DCvxv06egsr1XQJSJKrhgJCzGu-tYmtssXBNMm8taW1ARmDJ2LDGlf-Q Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/12da7c4cdd5543f89dbe102539afdeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 12da7c4cdd5543f89dbe102539afdeac Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestVolumeBootPattern-236656250 Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 146a0e603bde4818ad72ddcfc13181b8 Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestVolumeBootPattern-236656250-project Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'dad81d7f-1a94-4b3f-b7ef-df7583b6e649'} Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:29:45.395980 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Returning 404 to user: Instance dad81d7f-1a94-4b3f-b7ef-df7583b6e649 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7f838b8c-92aa-4fba-a89b-73411b2c1a78 tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649" status: 404 len: 111 microversion: 2.1 time: 0.035232 Aug 24 04:29:45.399542 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3304/6879] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:29:45 2022] GET /compute/v2.1/servers/dad81d7f-1a94-4b3f-b7ef-df7583b6e649 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:29:48.846156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7443275-a3ce-4efe-b389-70a3e940e7cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] Calling method '.version_select at 0x7f10237061f0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:29:48.870699 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7443275-a3ce-4efe-b389-70a3e940e7cf tempest-TestVolumeBootPattern-236656250 tempest-TestVolumeBootPattern-236656250-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1371241705" status: 202 len: 0 microversion: 2.1 time: 0.028316 Aug 24 04:29:48.871597 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3576/6880] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 24 04:29:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1371241705 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:30:09.765626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:30:09.767898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:09.770031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:09.770689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=40 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:09.777473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:09.777983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:09.778446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:09.779171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:09.779699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:09.780157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:09.851549 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2d153e87-ba9a-4695-a914-0f340a373a7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action" status: 200 len: 24576 microversion: 2.1 time: 0.089671 Aug 24 04:30:09.852306 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3305/6881] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:30:09 2022] POST /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5/action => generated 24576 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:30:16.782149 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:30:16.783180 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:30:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:30:32.594812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:32.595696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:32.599612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:32.600422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:32.609612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:32.610099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:32.610725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:32.611471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:32.611959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:32.612383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:32.763927 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4a18599-74a2-4da2-8553-4d1fd4444cd3 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1834 microversion: 2.1 time: 0.170845 Aug 24 04:30:32.764505 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3577/6882] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:32 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1834 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:34.002042 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:34.002930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:34.003637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d74d275a-f21b-4369-bd99-8a5465005a46 req-eebb8929-a792-4386-8237-e296935bc78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084db2f0-ff03-4ea6-8749-c1091433f0f5", "tag": "6a95c467-8de8-4c6b-bf44-a5751a7fe35d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:30:34.010340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:34.011080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:34.018330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:34.018558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d74d275a-f21b-4369-bd99-8a5465005a46 req-eebb8929-a792-4386-8237-e296935bc78d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:34.018675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:34.018798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d74d275a-f21b-4369-bd99-8a5465005a46 req-eebb8929-a792-4386-8237-e296935bc78d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:34.018904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:34.019033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d74d275a-f21b-4369-bd99-8a5465005a46 req-eebb8929-a792-4386-8237-e296935bc78d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:34.019138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:34.019138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:34.019138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:34.030437 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d74d275a-f21b-4369-bd99-8a5465005a46 req-eebb8929-a792-4386-8237-e296935bc78d service nova] Creating event network-changed:6a95c467-8de8-4c6b-bf44-a5751a7fe35d for instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 on n-h1-846470-15 Aug 24 04:30:34.037176 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d74d275a-f21b-4369-bd99-8a5465005a46 req-eebb8929-a792-4386-8237-e296935bc78d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038564 Aug 24 04:30:34.038782 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3578/6883] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:30:34.049894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:30:34.161853 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-183a6995-2d97-4956-8db5-400aef6d085d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "DELETE /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 204 len: 0 microversion: 2.1 time: 0.165437 Aug 24 04:30:34.173363 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3306/6884] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:30:33 2022] DELETE /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:30:34.179074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:34.179644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:34.196209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:34.197108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:34.197691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:34.198749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:34.199871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:34.200747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:34.375380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:34.383574 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6ecf9436-7edf-44b1-b0b7-46b7f74a774d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1687 microversion: 2.1 time: 0.212216 Aug 24 04:30:34.384195 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3579/6885] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:34 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:30:35.409573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:35.410659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:35.421729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:35.421729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:35.422378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:35.423634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:35.424476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:35.425226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:35.616980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:35.630578 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3015d3b5-4289-4f68-b303-607f9b79f6ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1687 microversion: 2.1 time: 0.226770 Aug 24 04:30:35.631639 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3307/6886] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:35 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1687 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:36.448322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-55808b37-5f23-4dcc-bc04-6ca91272c188 req-b64f4dbf-cfbb-42ab-9542-0bc40797ecc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084db2f0-ff03-4ea6-8749-c1091433f0f5", "name": "network-vif-deleted", "tag": "6a95c467-8de8-4c6b-bf44-a5751a7fe35d"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:30:36.461496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-55808b37-5f23-4dcc-bc04-6ca91272c188 req-b64f4dbf-cfbb-42ab-9542-0bc40797ecc5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:36.461973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-55808b37-5f23-4dcc-bc04-6ca91272c188 req-b64f4dbf-cfbb-42ab-9542-0bc40797ecc5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:36.462407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-55808b37-5f23-4dcc-bc04-6ca91272c188 req-b64f4dbf-cfbb-42ab-9542-0bc40797ecc5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:36.474750 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-55808b37-5f23-4dcc-bc04-6ca91272c188 req-b64f4dbf-cfbb-42ab-9542-0bc40797ecc5 service nova] Creating event network-vif-deleted:6a95c467-8de8-4c6b-bf44-a5751a7fe35d for instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 on n-h1-846470-15 Aug 24 04:30:36.481319 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-55808b37-5f23-4dcc-bc04-6ca91272c188 req-b64f4dbf-cfbb-42ab-9542-0bc40797ecc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038578 Aug 24 04:30:36.482119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3580/6887] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:30:36.658811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:36.659429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:36.667614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:36.668549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:36.668633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:36.669351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:36.669848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:36.670292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:36.708814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:36.709301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:36.709926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:36.710539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lazy-loading 'fault' on Instance uuid 084db2f0-ff03-4ea6-8749-c1091433f0f5 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:30:36.757777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:36.766150 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7b9748ff-7fda-4d7c-8727-d9d2cfcd587b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 200 len: 1355 microversion: 2.1 time: 0.111435 Aug 24 04:30:36.766734 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3308/6888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:36 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 1355 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:37.789170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:37.789934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 084db2f0-ff03-4ea6-8749-c1091433f0f5] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:37.796512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:37.797009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:37.797427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:37.798130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:37.798875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:37.799310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:37.813877 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] HTTP exception thrown: Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 could not be found. Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Request method failure captured: Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 HTTP/1.1 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBai_d-HvT_nZhc9i3wSDIpIRoEXSDkKL04G1zdrYf21HHfmGVssO4J0m6LUD-KTU2mt5L61HdGjEmZW7CYfVAggBxx5ejT__a0ug1z9nlunnrgZibTaCnDKLtclWRZOiJsMt-EmjkLegjxqSiCideL03uLqmmxoeZCrtIa9-SXaEHwY Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 26d523eb1a564c7982ea864afdc701d8 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 26d523eb1a564c7982ea864afdc701d8 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestNetworkAdvancedServerOps-370832018-project Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: d33ba6bcfb044286923c1c2c939b9097 Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestNetworkAdvancedServerOps-370832018-project Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 could not be found. Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '084db2f0-ff03-4ea6-8749-c1091433f0f5'} Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 could not be found. Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 could not be found. Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:30:37.815645 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 could not be found. Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Returning 404 to user: Instance 084db2f0-ff03-4ea6-8749-c1091433f0f5 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-93617f24-7752-42eb-8d8d-37acbf52bf8a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5" status: 404 len: 111 microversion: 2.1 time: 0.033478 Aug 24 04:30:37.819740 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3581/6889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:37 2022] GET /compute/v2.1/servers/084db2f0-ff03-4ea6-8749-c1091433f0f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:30:41.296917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-adbc44ed-bfa3-4f02-8c40-a223e56d6f5d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '.version_select at 0x7f1029be48b0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:41.327711 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-adbc44ed-bfa3-4f02-8c40-a223e56d6f5d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-175623948" status: 202 len: 0 microversion: 2.1 time: 0.034639 Aug 24 04:30:41.328302 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3309/6890] 10.222.0.58 () {58 vars in 1281 bytes} [Wed Aug 24 04:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-175623948 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:30:41.359044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ea59b740-7d32-4d15-81b6-fe9e53c3006d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'create', calling method: .version_select at 0x7f10343a0160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-597471222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7iQXRQS0GW0rOR8cWo3uJlJKpl1ybwI0Ygel41MHmxs35Ny7rmVMmpHXgt2XK6+3Vsk4ADNWI75oNpeJ7QWAftFT1yBDVd5NiTHPVrOY36wMGPTHjfjcjIFXC+zz5X8g=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:30:41.379998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ea59b740-7d32-4d15-81b6-fe9e53c3006d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for project 26d523eb1a564c7982ea864afdc701d8. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:30:41.385566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ea59b740-7d32-4d15-81b6-fe9e53c3006d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for user d33ba6bcfb044286923c1c2c939b9097 and project 26d523eb1a564c7982ea864afdc701d8. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:30:41.414011 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ea59b740-7d32-4d15-81b6-fe9e53c3006d tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058976 Aug 24 04:30:41.414642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3582/6891] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:30:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:30:47.690842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:47.696949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1845976543", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "a29a7244-b27f-4e1d-9569-725a4a051d84"}], "key_name": "tempest-TestNetworkAdvancedServerOps-597471222", "security_groups": [{"name": "tempest-secgroup-smoke-955258862"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:30:47.841577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] validate_networks() for [('a29a7244-b27f-4e1d-9569-725a4a051d84', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:30:48.447141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:30:48.447728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:30:48.448253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:30:48.448691 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:30:48.449128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:30:48.465233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:48.465864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:48.466637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:48.467611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:48.468228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:48.468758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:48.496585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for project 26d523eb1a564c7982ea864afdc701d8. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:30:48.502595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for user d33ba6bcfb044286923c1c2c939b9097 and project 26d523eb1a564c7982ea864afdc701d8. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:30:48.518813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:30:48.521401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:30:48.580197 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e16a977f-3d04-4d91-b551-bc2c3b8710d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.890422 Aug 24 04:30:48.581727 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3310/6892] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:30:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:30:48.595564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37d35924-3202-46f9-a799-e4fa157df3c1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:48.596502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37d35924-3202-46f9-a799-e4fa157df3c1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:48.600946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=18 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:48.671316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-37d35924-3202-46f9-a799-e4fa157df3c1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:48.684452 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37d35924-3202-46f9-a799-e4fa157df3c1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1266 microversion: 2.1 time: 0.093336 Aug 24 04:30:48.686296 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3583/6893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:48 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:49.707647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:49.712688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:49.735086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:49.735868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:49.736477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:49.738048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:49.738697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:49.739437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:49.864718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:49.877543 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dbe945b3-473d-4f5f-90b1-b7881ac3404a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1318 microversion: 2.1 time: 0.174002 Aug 24 04:30:49.890877 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3311/6894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:49 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:50.915471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:50.917144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:50.927495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:50.928456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:50.928456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:50.929701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:50.930166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:50.930593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:51.085852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:51.093839 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-036bb1c6-7b83-4366-8b88-2de5952ce6b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1391 microversion: 2.1 time: 0.187644 Aug 24 04:30:51.094441 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3584/6895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:50 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:51.399484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-061b0e66-7843-4359-853f-0e4c10f8279c req-e8039517-cdcc-4cee-9a35-573428545c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:30:51.416175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-061b0e66-7843-4359-853f-0e4c10f8279c req-e8039517-cdcc-4cee-9a35-573428545c06 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:51.416657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-061b0e66-7843-4359-853f-0e4c10f8279c req-e8039517-cdcc-4cee-9a35-573428545c06 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:51.417116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-061b0e66-7843-4359-853f-0e4c10f8279c req-e8039517-cdcc-4cee-9a35-573428545c06 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:51.429531 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-061b0e66-7843-4359-853f-0e4c10f8279c req-e8039517-cdcc-4cee-9a35-573428545c06 service nova] Creating event network-changed:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h2-846470-15 Aug 24 04:30:51.434848 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-061b0e66-7843-4359-853f-0e4c10f8279c req-e8039517-cdcc-4cee-9a35-573428545c06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041934 Aug 24 04:30:51.435439 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3312/6896] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:30:52.116389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:52.117120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:52.124197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:52.124676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:52.125109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:52.125798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:52.126295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:52.126914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:52.288253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:52.299824 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86a29ef2-d21e-46c4-aede-b1fac17bf386 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1391 microversion: 2.1 time: 0.187730 Aug 24 04:30:52.300765 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3585/6897] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:52 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:53.323101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:53.323855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:53.331827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:53.332243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:53.332695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:53.333413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:53.333874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:53.334416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:53.483168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:53.491677 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d15b9b76-e17a-4b57-bce2-bb0fc245ad57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1391 microversion: 2.1 time: 0.173286 Aug 24 04:30:53.492265 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3313/6898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:53 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:54.513712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:54.514465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:54.525033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:54.525489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:54.526126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:54.526829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:54.527311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:54.527729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:54.683352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:54.691521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-34b8e0a0-9521-430f-bdd4-5aaa901cc685 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1391 microversion: 2.1 time: 0.182758 Aug 24 04:30:54.692155 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3586/6899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:54 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:55.713985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:55.714543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:55.721903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:55.722415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:55.722864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:55.723582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:55.724082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:55.724525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:55.877232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:55.885231 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a2655e5f-5927-4d50-854c-b9395e314959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1391 microversion: 2.1 time: 0.175459 Aug 24 04:30:55.885806 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3314/6900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:55 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:56.906427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:56.907022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:56.914501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:56.914991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:56.915412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:56.916132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:56.916560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:56.917063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:57.060690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:57.069251 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5cb191d-f7f4-4512-be15-1c05e78d9fbc tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1391 microversion: 2.1 time: 0.166709 Aug 24 04:30:57.070328 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3587/6901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:56 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:58.093160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:58.094203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:58.103830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:58.104349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:58.104798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:58.105527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:58.105992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:58.106434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:58.254979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:58.263439 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a66caca1-d69b-4755-b0e9-5149a0cf1501 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1391 microversion: 2.1 time: 0.176184 Aug 24 04:30:58.264191 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3315/6902] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:58 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:30:58.831088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:58.836632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5ccf5019-caaa-4cab-9e7c-d2187127bea5 req-d6c65bc5-3b05-4798-a274-d8139117c6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "name": "network-vif-plugged", "status": "completed", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:30:58.847339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5ccf5019-caaa-4cab-9e7c-d2187127bea5 req-d6c65bc5-3b05-4798-a274-d8139117c6b5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:58.847867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5ccf5019-caaa-4cab-9e7c-d2187127bea5 req-d6c65bc5-3b05-4798-a274-d8139117c6b5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:58.848299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5ccf5019-caaa-4cab-9e7c-d2187127bea5 req-d6c65bc5-3b05-4798-a274-d8139117c6b5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:58.860069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5ccf5019-caaa-4cab-9e7c-d2187127bea5 req-d6c65bc5-3b05-4798-a274-d8139117c6b5 service nova] Creating event network-vif-plugged:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h2-846470-15 Aug 24 04:30:58.865409 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5ccf5019-caaa-4cab-9e7c-d2187127bea5 req-d6c65bc5-3b05-4798-a274-d8139117c6b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035778 Aug 24 04:30:58.866158 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3588/6903] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:30:59.289487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:30:59.290420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:30:59.293509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:59.294498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:30:59.306501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:59.307010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:59.307459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:59.308217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:30:59.308688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:30:59.309129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:30:59.452918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:30:59.464218 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d3a4631-b25a-4b59-8607-b135122e61a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1391 microversion: 2.1 time: 0.180794 Aug 24 04:30:59.464967 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3316/6904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:30:59 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:31:00.490592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:31:00.491699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:31:00.498641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:00.499145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:00.499577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:00.500300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:00.500750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:00.501168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:00.665714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:31:00.673656 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e7754a2-4d8c-41fd-a3b2-1f56e76d5cd5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1561 microversion: 2.1 time: 0.188410 Aug 24 04:31:00.674255 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3589/6905] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:31:00 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:31:00.694396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:31:00.695057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:31:00.702827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:00.703339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:00.703843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:00.704566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:00.705046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:00.705496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:00.854087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:31:00.862190 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9890e86f-365b-4cd2-a67c-5079a3cb3c0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1561 microversion: 2.1 time: 0.171934 Aug 24 04:31:00.862782 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3317/6906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:31:00 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:31:02.808740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-19eddea1-bc91-4a90-a098-33ac652acb87 req-2a447c4d-2753-4879-88b1-14691b9c3e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:31:02.809884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:31:02.810510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:31:02.814412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:02.819693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:02.820345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:02.820531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-19eddea1-bc91-4a90-a098-33ac652acb87 req-2a447c4d-2753-4879-88b1-14691b9c3e01 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:02.820952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:02.821081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-19eddea1-bc91-4a90-a098-33ac652acb87 req-2a447c4d-2753-4879-88b1-14691b9c3e01 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:02.821433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-19eddea1-bc91-4a90-a098-33ac652acb87 req-2a447c4d-2753-4879-88b1-14691b9c3e01 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:02.821827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:02.822356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:02.822854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:02.833577 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-19eddea1-bc91-4a90-a098-33ac652acb87 req-2a447c4d-2753-4879-88b1-14691b9c3e01 service nova] Creating event network-changed:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h2-846470-15 Aug 24 04:31:02.839408 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-19eddea1-bc91-4a90-a098-33ac652acb87 req-2a447c4d-2753-4879-88b1-14691b9c3e01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034378 Aug 24 04:31:02.840282 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3318/6907] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:31:02.979830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:31:02.989543 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef556ea2-9c70-4346-8f22-f2dc9638462b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1561 microversion: 2.1 time: 0.187463 Aug 24 04:31:02.990249 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3590/6908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:31:02 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:31:36.362091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:36.362759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=42 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:36.368788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:31:36.371521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:31:36.379405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:36.379940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:36.380402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:36.381215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:31:36.381772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:31:36.382549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:31:36.442533 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f6b448b6-d4a5-46b3-aca3-062bb034f0ed tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action" status: 200 len: 24568 microversion: 2.1 time: 0.082594 Aug 24 04:31:36.443222 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3319/6909] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:31:36 2022] POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action => generated 24568 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:32:15.613198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:15.613968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=38 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:15.618159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:15.619260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:15.625727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:15.626208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:15.626638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:15.627412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:15.627805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:15.628210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:15.764033 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a8357c0-67b2-4c3f-83d2-dcf2d56cf591 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1832 microversion: 2.1 time: 0.152702 Aug 24 04:32:15.764630 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3591/6910] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:15 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1832 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:15.788436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:15.789264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:15.793530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:15.794545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:15.804017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:15.804738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:15.805382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:15.806467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:15.807261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:15.807724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:15.955407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:15.963787 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d913477-93f2-4a32-98ff-f55ac356a76c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1679 microversion: 2.1 time: 0.182234 Aug 24 04:32:15.964372 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3320/6911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:15 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:16.067190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:16.069438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:16.076247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:16.076738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:16.077175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:16.077867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:16.078321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:16.078743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:16.132148 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d07b7a94-4131-4361-bcc1-7d1753cb4641 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action" status: 200 len: 32641 microversion: 2.1 time: 0.068703 Aug 24 04:32:16.133116 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3592/6912] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:32:16 2022] POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action => generated 32641 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:32:16.301736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:16.302236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:16.308901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:16.309402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:16.309856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:16.310563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:16.311029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:16.311470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:16.359187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '92cf80c317d64ecda14f5c0fda5a2525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cafcb5c46745788bda643a4c9760c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:16.359852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] flavor_id is None. Assuming migration. {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 04:32:16.360305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:32:16.587526 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a8707a17-2b49-49fe-9fc5-16daf07cf430 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action" status: 202 len: 0 microversion: 2.1 time: 0.289696 Aug 24 04:32:16.589024 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3321/6913] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:32:16 2022] POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:32:16.597733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:16.598699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:16.606146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:16.606631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:16.607070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:16.607799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:16.608252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:16.608676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:16.779608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:16.787905 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-baf7c714-bb50-47fd-b7b8-4e0b0f29f4b3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1688 microversion: 2.1 time: 0.194532 Aug 24 04:32:16.788492 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3593/6914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:16 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:17.812899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:17.812899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:17.820936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:17.821502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:17.821993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:17.823513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:17.824380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:17.824868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:17.982293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:17.990588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9fad9e56-ca42-46d5-bec0-dc1d1179f6ac tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1688 microversion: 2.1 time: 0.183670 Aug 24 04:32:17.991165 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3322/6915] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:17 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:19.014890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:19.015494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:19.025043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:19.025720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:19.026383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:19.027172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:19.027624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:19.028081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:19.181356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:19.194132 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0cf83565-1de3-4acc-88dc-d7ca80a4c26f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.184897 Aug 24 04:32:19.195009 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3594/6916] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:19 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:20.217941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:20.218575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:20.226043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:20.226558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:20.227014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:20.227755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:20.228235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:20.228684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:20.385247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:20.393693 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4c7f84e0-9f74-4721-94b9-fb665ddefeb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.179781 Aug 24 04:32:20.394254 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3323/6917] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:20 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:21.418075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:21.418674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:21.425798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:21.426290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:21.426726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:21.427425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:21.427909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:21.428347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:21.579530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:21.590588 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-28837b5e-5fbd-4a25-a46f-32a717d17655 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.176347 Aug 24 04:32:21.591366 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3595/6918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:21 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:22.617785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:22.618513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:22.624984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:22.625500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:22.625955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:22.626712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:22.627327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:22.627824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:22.771757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:22.781506 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0bac0ff-d685-45e6-acc8-734da97d93a6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.168677 Aug 24 04:32:22.782057 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3324/6919] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:22 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:23.803335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:23.803939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:23.811426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:23.811943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:23.812383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:23.813078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:23.813529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:23.813959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:23.981739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:23.993975 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-065d1060-3923-4677-a112-d52598a99b38 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.194378 Aug 24 04:32:23.995388 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3596/6920] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:23 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:25.016190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:25.016774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:25.024824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:25.025336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:25.025797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:25.026611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:25.027083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:25.027511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:25.168454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:25.181420 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-feebd9e0-ffef-4ba5-a64d-f6d4e00e39ad tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.168895 Aug 24 04:32:25.182146 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3325/6921] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:25 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:26.208400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:26.209031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:26.216205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:26.216725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:26.217359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:26.218059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:26.218518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:26.218962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:26.366005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:26.374630 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0285f599-0973-4c2a-954c-f7572dd47135 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.170135 Aug 24 04:32:26.375214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3597/6922] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:26 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:27.396219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:27.396886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:27.404530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:27.405380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:27.406113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:27.407333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:27.408228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:27.408951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:27.557469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:27.565739 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b0207316-c5fc-4d9e-b286-90452f0bc68a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.173407 Aug 24 04:32:27.566221 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3326/6923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:27 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:28.589969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:28.591260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:28.600868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:28.601365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:28.601896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:28.602609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:28.603071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:28.603632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:28.765851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:28.775536 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-780a9ba1-0f54-44ed-abdf-e509700c1926 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.191740 Aug 24 04:32:28.776161 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3598/6924] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:28 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:29.797934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:29.798536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:29.808059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:29.808897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:29.809599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:29.810334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:29.810825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:29.811286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:29.957423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:29.969659 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b955a04-dc56-49b9-8a09-876b9545a287 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.175566 Aug 24 04:32:29.970446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3327/6925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:29 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:30.996248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:30.997403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:31.005179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:31.005652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:31.006120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:31.006835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:31.007291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:31.007780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:31.159318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:31.167875 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce4866e7-3a1e-4bd6-a7ec-7f5f14c23cd3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.175583 Aug 24 04:32:31.168474 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3599/6926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:30 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:32.195128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:32.195748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:32.204603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:32.205120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:32.205566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:32.206283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:32.206755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:32.207182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:32.380538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:32.392271 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-db16e040-56ce-4ef3-a663-92a309057eb8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.202697 Aug 24 04:32:32.392903 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3328/6927] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:32 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:33.414310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:33.414871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:33.424641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:33.425181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:33.425682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:33.426393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:33.426995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:33.427459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:33.587191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:33.601743 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29038c52-8ca8-4b1a-b401-7897c20135d8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.189540 Aug 24 04:32:33.601743 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3600/6928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:33 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:34.629870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:34.630511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:34.638401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:34.638903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:34.639356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:34.640088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:34.640553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:34.640990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:34.794204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:34.805192 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-44914a57-7429-4f3f-b44b-e1721630b15c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1693 microversion: 2.1 time: 0.179045 Aug 24 04:32:34.806030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3329/6929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:34 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:35.828475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:35.829091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:35.836329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:35.836821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:35.837255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:35.837957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:35.838406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:35.838827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:35.986536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:35.995283 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2f638f2a-1cb7-46f2-9b69-b2b917fd2ef8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1692 microversion: 2.1 time: 0.170887 Aug 24 04:32:35.995917 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3601/6930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:35 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:36.315169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e8b89cba-0e5a-4fd6-875f-ce9e3cd12f11 req-ac29a098-9779-4173-af7d-f3f9cfa9d5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "name": "network-vif-unplugged", "status": "completed", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:36.326923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e8b89cba-0e5a-4fd6-875f-ce9e3cd12f11 req-ac29a098-9779-4173-af7d-f3f9cfa9d5f0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:36.327427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e8b89cba-0e5a-4fd6-875f-ce9e3cd12f11 req-ac29a098-9779-4173-af7d-f3f9cfa9d5f0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:36.327942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e8b89cba-0e5a-4fd6-875f-ce9e3cd12f11 req-ac29a098-9779-4173-af7d-f3f9cfa9d5f0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:36.342086 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e8b89cba-0e5a-4fd6-875f-ce9e3cd12f11 req-ac29a098-9779-4173-af7d-f3f9cfa9d5f0 service nova] Creating event network-vif-unplugged:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h1-846470-15 Aug 24 04:32:36.348116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-e8b89cba-0e5a-4fd6-875f-ce9e3cd12f11 req-ac29a098-9779-4173-af7d-f3f9cfa9d5f0 service nova] Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:32:36.360477 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e8b89cba-0e5a-4fd6-875f-ce9e3cd12f11 req-ac29a098-9779-4173-af7d-f3f9cfa9d5f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049630 Aug 24 04:32:36.361197 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3330/6931] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:32:37.017810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:37.018362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:37.025360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:37.025855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:37.026534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:37.027834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:37.028927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:37.029397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:37.307899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:37.317765 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29047025-aff3-4414-b539-73babcf173e5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1692 microversion: 2.1 time: 0.303879 Aug 24 04:32:37.318169 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3602/6932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:37 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1692 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:38.342404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:38.343021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:38.350043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:38.350568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:38.350987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:38.351741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:38.352200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:38.352631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:38.409864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-cfa492a3-7f00-4230-b4d2-9355887bf475 req-24ef7824-38bf-4904-81e0-82bde89c399f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:38.420581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cfa492a3-7f00-4230-b4d2-9355887bf475 req-24ef7824-38bf-4904-81e0-82bde89c399f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:38.421065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cfa492a3-7f00-4230-b4d2-9355887bf475 req-24ef7824-38bf-4904-81e0-82bde89c399f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:38.421499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-cfa492a3-7f00-4230-b4d2-9355887bf475 req-24ef7824-38bf-4904-81e0-82bde89c399f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:38.433877 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-cfa492a3-7f00-4230-b4d2-9355887bf475 req-24ef7824-38bf-4904-81e0-82bde89c399f service nova] Creating event network-changed:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h1-846470-15 Aug 24 04:32:38.439894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-cfa492a3-7f00-4230-b4d2-9355887bf475 req-24ef7824-38bf-4904-81e0-82bde89c399f service nova] Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:32:38.452879 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-cfa492a3-7f00-4230-b4d2-9355887bf475 req-24ef7824-38bf-4904-81e0-82bde89c399f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046576 Aug 24 04:32:38.453782 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3603/6933] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:32:38.533614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:38.542035 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4f983dc2-b826-45d8-add7-87e7eb451556 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1690 microversion: 2.1 time: 0.205477 Aug 24 04:32:38.542590 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3331/6934] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:38 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1690 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:39.565866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:39.566565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:39.574418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:39.574924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:39.575360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:39.576090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:39.576551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:39.576945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:39.734026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:39.742257 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-13a666c6-b457-4247-8e6c-f220bd93d1b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1690 microversion: 2.1 time: 0.181492 Aug 24 04:32:39.742895 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3604/6935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:39 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:40.769774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:40.770408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:40.777080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:40.777801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:40.778111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:40.778837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:40.779320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:40.779816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:41.370055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:41.379338 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-13b21f47-8444-427d-b78d-210a326cf276 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1690 microversion: 2.1 time: 0.613692 Aug 24 04:32:41.380189 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3332/6936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:40 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1690 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:42.403444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:42.404022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:42.411743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:42.412258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:42.412719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:42.413467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:42.413946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:42.414370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:42.556830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:42.567579 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eef1e760-91fa-4178-942c-9c18d32dc22e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1687 microversion: 2.1 time: 0.168421 Aug 24 04:32:42.569149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-62ace064-57ab-47fd-aa54-fa9b42d239b9 req-a9c09d6a-ca83-44ba-aa02-22b3f5a3c445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "name": "network-vif-plugged", "status": "completed", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:42.576339 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3605/6937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:42 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:42.580725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-62ace064-57ab-47fd-aa54-fa9b42d239b9 req-a9c09d6a-ca83-44ba-aa02-22b3f5a3c445 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:42.581557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-62ace064-57ab-47fd-aa54-fa9b42d239b9 req-a9c09d6a-ca83-44ba-aa02-22b3f5a3c445 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:42.582191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-62ace064-57ab-47fd-aa54-fa9b42d239b9 req-a9c09d6a-ca83-44ba-aa02-22b3f5a3c445 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:42.591232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:42.591983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:42.596227 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-62ace064-57ab-47fd-aa54-fa9b42d239b9 req-a9c09d6a-ca83-44ba-aa02-22b3f5a3c445 service nova] Creating event network-vif-plugged:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h1-846470-15 Aug 24 04:32:42.598531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:42.599251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:42.599781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:42.600550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:42.601066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:42.601668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:42.602247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-62ace064-57ab-47fd-aa54-fa9b42d239b9 req-a9c09d6a-ca83-44ba-aa02-22b3f5a3c445 service nova] Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:32:42.615757 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-62ace064-57ab-47fd-aa54-fa9b42d239b9 req-a9c09d6a-ca83-44ba-aa02-22b3f5a3c445 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050896 Aug 24 04:32:42.616709 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3333/6938] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:32:42.692833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:42.725627 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8a1b1c8d-2e1d-4e5b-b736-15a4b6483697 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action" status: 202 len: 0 microversion: 2.1 time: 0.139150 Aug 24 04:32:42.726348 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3606/6939] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:32:42 2022] POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:32:42.739140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:42.740160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:42.749345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:42.749917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:42.750577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:42.751386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:42.751891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:42.752539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:42.992916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:43.001881 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5db6b8d3-ac18-4d88-93bb-7a624186b989 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1686 microversion: 2.1 time: 0.268871 Aug 24 04:32:43.002496 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3334/6940] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:42 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1686 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:44.085716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:44.086450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:44.093670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:44.094200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:44.094645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:44.095391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:44.095890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:44.096323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:44.247729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:44.259809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-187f9c76-7eed-4faa-ab29-538cb739094c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1686 microversion: 2.1 time: 0.237162 Aug 24 04:32:44.260673 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3607/6941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:44 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1686 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:45.284481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:45.285364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:45.293445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:45.294215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:45.294686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:45.295452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:45.295961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:45.296414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:45.319739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:45.438040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:45.450821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d1ea2067-faf6-4f16-b06f-8a9c52efa6b8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1686 microversion: 2.1 time: 0.170078 Aug 24 04:32:45.452230 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3335/6942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:45 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:46.313737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-43d7395f-36e1-4d86-a3bc-fff8f64e549b req-7addd5e3-47ce-4f99-bf05-3a938c02de52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "name": "network-vif-unplugged", "status": "completed", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:46.320973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=39 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:46.327128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-43d7395f-36e1-4d86-a3bc-fff8f64e549b req-7addd5e3-47ce-4f99-bf05-3a938c02de52 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:46.327620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-43d7395f-36e1-4d86-a3bc-fff8f64e549b req-7addd5e3-47ce-4f99-bf05-3a938c02de52 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:46.328084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-43d7395f-36e1-4d86-a3bc-fff8f64e549b req-7addd5e3-47ce-4f99-bf05-3a938c02de52 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:46.341301 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-43d7395f-36e1-4d86-a3bc-fff8f64e549b req-7addd5e3-47ce-4f99-bf05-3a938c02de52 service nova] Creating event network-vif-unplugged:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h2-846470-15 Aug 24 04:32:46.346978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-43d7395f-36e1-4d86-a3bc-fff8f64e549b req-7addd5e3-47ce-4f99-bf05-3a938c02de52 service nova] Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:32:46.358746 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-43d7395f-36e1-4d86-a3bc-fff8f64e549b req-7addd5e3-47ce-4f99-bf05-3a938c02de52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049458 Aug 24 04:32:46.359381 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3608/6943] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:32:46.479553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:46.480389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:46.483018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=35 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:46.489189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:46.489662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:46.490327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:46.491047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:46.491533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:46.492002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:46.677258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:46.704655 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8e2909f-35e7-40b5-88e3-1e1c0cfafb28 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1686 microversion: 2.1 time: 0.229315 Aug 24 04:32:46.705265 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3336/6944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:46 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1686 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:47.730428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:47.730987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:47.741310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:47.741870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:47.742454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:47.743478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:47.744111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:47.744671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:47.894295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:47.902717 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-15f44e6f-a02f-4a76-8fd3-c5437b24a5a9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1686 microversion: 2.1 time: 0.178427 Aug 24 04:32:47.904214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3609/6945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:47 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:48.396048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6fbe2b99-3206-48dc-8802-e24ccfba0abd req-93416f61-f87e-4d18-8198-4765af6244ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:48.408236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6fbe2b99-3206-48dc-8802-e24ccfba0abd req-93416f61-f87e-4d18-8198-4765af6244ab service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:48.408692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6fbe2b99-3206-48dc-8802-e24ccfba0abd req-93416f61-f87e-4d18-8198-4765af6244ab service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:48.409300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6fbe2b99-3206-48dc-8802-e24ccfba0abd req-93416f61-f87e-4d18-8198-4765af6244ab service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:48.422195 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6fbe2b99-3206-48dc-8802-e24ccfba0abd req-93416f61-f87e-4d18-8198-4765af6244ab service nova] Creating event network-changed:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h2-846470-15 Aug 24 04:32:48.428834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-6fbe2b99-3206-48dc-8802-e24ccfba0abd req-93416f61-f87e-4d18-8198-4765af6244ab service nova] Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:32:48.441586 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6fbe2b99-3206-48dc-8802-e24ccfba0abd req-93416f61-f87e-4d18-8198-4765af6244ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049289 Aug 24 04:32:48.442231 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3337/6946] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:32:48.925679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:48.926286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:48.933252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:48.933739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:48.934176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:48.934878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:48.935331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:48.935762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:49.091570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:49.099860 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60b943de-a491-4408-ba01-f66045a9d717 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1686 microversion: 2.1 time: 0.178154 Aug 24 04:32:49.100441 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3610/6947] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:48 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:50.123688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:50.124383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:50.131649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:50.132300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:50.132680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:50.133443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:50.133907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:50.134377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:50.366117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:50.375361 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2da4e968-c8b1-4dac-9f79-22618e912646 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1686 microversion: 2.1 time: 0.257127 Aug 24 04:32:50.388594 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3338/6948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:50 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1686 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:51.398248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:32:51.398797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:32:51.406347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:51.406798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:51.407265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:51.407992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:51.408446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:51.408866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:51.554485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:32:51.563646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe2e842f-b906-43ef-8ba9-58be5fbd08c2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1679 microversion: 2.1 time: 0.169532 Aug 24 04:32:51.564302 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3611/6949] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:32:51 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:32:53.202862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ceb78892-cd4e-4af9-b3dc-7d8c79f0aca2 req-9b16b2f5-7e29-4daa-ac35-cef7998a1cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "name": "network-vif-plugged", "status": "completed", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:32:53.213960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ceb78892-cd4e-4af9-b3dc-7d8c79f0aca2 req-9b16b2f5-7e29-4daa-ac35-cef7998a1cd4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:32:53.214425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ceb78892-cd4e-4af9-b3dc-7d8c79f0aca2 req-9b16b2f5-7e29-4daa-ac35-cef7998a1cd4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:32:53.215269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ceb78892-cd4e-4af9-b3dc-7d8c79f0aca2 req-9b16b2f5-7e29-4daa-ac35-cef7998a1cd4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:32:53.227511 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ceb78892-cd4e-4af9-b3dc-7d8c79f0aca2 req-9b16b2f5-7e29-4daa-ac35-cef7998a1cd4 service nova] Creating event network-vif-plugged:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h2-846470-15 Aug 24 04:32:53.233504 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ceb78892-cd4e-4af9-b3dc-7d8c79f0aca2 req-9b16b2f5-7e29-4daa-ac35-cef7998a1cd4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035056 Aug 24 04:32:53.233888 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3339/6950] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:32:54.250279 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:32:54.250940 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:33:23.846692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:33:23.849057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:33:23.851596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=7 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:23.852292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:23.860150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:23.860640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:23.861078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:23.861794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:23.862243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:23.862664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:23.920784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7c97469d-c43a-4ce6-a146-7c33f23249e9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action" status: 200 len: 62894 microversion: 2.1 time: 0.078119 Aug 24 04:33:23.921506 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3612/6951] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:33:23 2022] POST /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6/action => generated 62894 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:33:36.793958 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:33:36.794920 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:33:47.075897 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:33:47.076621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=7 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:47.078329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=20 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:47.202956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:33:47.203762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:33:47.210602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:47.211105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:47.211559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:47.212295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:47.212766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:47.213204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:47.348502 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-90830f1a-2e33-4f8d-8aa3-9de5ca119adb tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1832 microversion: 2.1 time: 0.274903 Aug 24 04:33:47.349076 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3340/6952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:33:47 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1832 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:48.266679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:33:48.272722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:33:48.275414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:48.276141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:48.285206 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57340. Aug 24 04:33:48.290164 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:48.290847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:48.291510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:48.292247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:48.292706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:48.293107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:48.319004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:33:48.335488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0ea5ef54-69bf-4c69-8a02-4d87226f1e2e req-ee475326-19e6-4db6-babf-be63d3fcae05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:33:48.345930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0ea5ef54-69bf-4c69-8a02-4d87226f1e2e req-ee475326-19e6-4db6-babf-be63d3fcae05 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:48.346466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0ea5ef54-69bf-4c69-8a02-4d87226f1e2e req-ee475326-19e6-4db6-babf-be63d3fcae05 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:48.347291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0ea5ef54-69bf-4c69-8a02-4d87226f1e2e req-ee475326-19e6-4db6-babf-be63d3fcae05 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:48.359927 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0ea5ef54-69bf-4c69-8a02-4d87226f1e2e req-ee475326-19e6-4db6-babf-be63d3fcae05 service nova] Creating event network-changed:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h2-846470-15 Aug 24 04:33:48.365533 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0ea5ef54-69bf-4c69-8a02-4d87226f1e2e req-ee475326-19e6-4db6-babf-be63d3fcae05 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097038 Aug 24 04:33:48.366215 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3341/6953] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:33:48.406006 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96fcf5ab-4a66-4216-bfa7-6824e7f684f7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "DELETE /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 204 len: 0 microversion: 2.1 time: 0.143085 Aug 24 04:33:48.407534 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3613/6954] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:33:48 2022] DELETE /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:48.417069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:33:48.418311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:33:48.426493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:48.427140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:48.427699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:48.428534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:48.429100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:48.429611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:48.567228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:33:48.575870 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b37d0a80-5dde-43b4-a5f0-93491dedaef6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1685 microversion: 2.1 time: 0.163516 Aug 24 04:33:48.576460 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3342/6955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:33:48 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:49.598535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:33:49.599230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:33:49.607366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:49.607881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:49.608320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:49.609015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:49.609468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:49.609892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:49.752212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:33:49.761069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ab76b856-f987-4384-97b1-8ccf2a78dcd2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1685 microversion: 2.1 time: 0.167161 Aug 24 04:33:49.761666 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3614/6956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:33:49 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:50.385580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-dc85499e-5f52-4691-8046-3588e8f621e1 req-235be461-7d2f-4187-92f2-1e28cc7f304e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bb1dc-4dda-415d-b1df-fab7e7dbd5e6", "name": "network-vif-deleted", "tag": "618e1964-2f7d-4ff4-baff-4e43faa40150"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:33:50.397603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dc85499e-5f52-4691-8046-3588e8f621e1 req-235be461-7d2f-4187-92f2-1e28cc7f304e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:50.398325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dc85499e-5f52-4691-8046-3588e8f621e1 req-235be461-7d2f-4187-92f2-1e28cc7f304e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:50.398783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dc85499e-5f52-4691-8046-3588e8f621e1 req-235be461-7d2f-4187-92f2-1e28cc7f304e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:50.414503 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-dc85499e-5f52-4691-8046-3588e8f621e1 req-235be461-7d2f-4187-92f2-1e28cc7f304e service nova] Creating event network-vif-deleted:618e1964-2f7d-4ff4-baff-4e43faa40150 for instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 on n-h2-846470-15 Aug 24 04:33:50.419963 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-dc85499e-5f52-4691-8046-3588e8f621e1 req-235be461-7d2f-4187-92f2-1e28cc7f304e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038002 Aug 24 04:33:50.420741 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3343/6957] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:33:50.782766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:33:50.783385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:33:50.790267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:50.790748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:50.792351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:50.793249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:50.793697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:50.794286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:50.828618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:50.829188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:50.829625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:50.830076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lazy-loading 'fault' on Instance uuid 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:33:50.873058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:33:50.881596 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f00f5d18-b1a1-445b-9d42-bb48d1bd3f98 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 200 len: 1356 microversion: 2.1 time: 0.102906 Aug 24 04:33:50.882612 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3615/6958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:33:50 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:51.906381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:33:51.907124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:33:51.914768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:51.915298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:51.915811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:51.916570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:33:51.917148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:33:51.917706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:33:51.932410 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] HTTP exception thrown: Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 could not be found. Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Request method failure captured: Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 HTTP/1.1 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBai_d-HvT_nZhc9i3wSDIpIRoEXSDkKL04G1zdrYf21HHfmGVssO4J0m6LUD-KTU2mt5L61HdGjEmZW7CYfVAggBxx5ejT__a0ug1z9nlunnrgZibTaCnDKLtclWRZOiJsMt-EmjkLegjxqSiCideL03uLqmmxoeZCrtIa9-SXaEHwY Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 26d523eb1a564c7982ea864afdc701d8 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 26d523eb1a564c7982ea864afdc701d8 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestNetworkAdvancedServerOps-370832018-project Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d33ba6bcfb044286923c1c2c939b9097 Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestNetworkAdvancedServerOps-370832018-project Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 could not be found. Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '698bb1dc-4dda-415d-b1df-fab7e7dbd5e6'} Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 could not be found. Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 could not be found. Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:33:51.934135 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 could not be found. Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Returning 404 to user: Instance 698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bab7092a-fa17-49d2-b604-997feb96da8f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6" status: 404 len: 111 microversion: 2.1 time: 0.034702 Aug 24 04:33:51.938244 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3344/6959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:33:51 2022] GET /compute/v2.1/servers/698bb1dc-4dda-415d-b1df-fab7e7dbd5e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:33:55.388738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e975556b-00da-4e39-a028-13599352478b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '.version_select at 0x7f1021aedf70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:33:55.418670 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e975556b-00da-4e39-a028-13599352478b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-597471222" status: 202 len: 0 microversion: 2.1 time: 0.033699 Aug 24 04:33:55.419266 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3616/6960] 10.222.0.58 () {58 vars in 1281 bytes} [Wed Aug 24 04:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-597471222 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:33:55.455335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3ec9143c-8af4-466b-8602-502648c707aa tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'create', calling method: .version_select at 0x7f1029e31040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1969070732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLO5X3Xn+C2C3M0ainOu+64OCxcuLIL8YqzFskXLI3g1ZopOZgwikB5RWg+Qs3fmFlT+JkaQ6U/8npvpe0n71hyZ2O+Ofo5KHkeOgMBRDTwWafow0YlQ78JFhBr8+U+FA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:33:55.472065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3ec9143c-8af4-466b-8602-502648c707aa tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for project 26d523eb1a564c7982ea864afdc701d8. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:33:55.478520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-3ec9143c-8af4-466b-8602-502648c707aa tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for user d33ba6bcfb044286923c1c2c939b9097 and project 26d523eb1a564c7982ea864afdc701d8. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:33:55.509635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3ec9143c-8af4-466b-8602-502648c707aa tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058085 Aug 24 04:33:55.510157 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3345/6961] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:33:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:34:01.214519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1430480475", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "4105381a-dc8f-424f-ae49-2fbd0ecc1f82"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1969070732", "security_groups": [{"name": "tempest-secgroup-smoke-226329616"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:34:01.227613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:01.341263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] validate_networks() for [('4105381a-dc8f-424f-ae49-2fbd0ecc1f82', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:34:01.804885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:34:01.805741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:34:01.806382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:34:01.806955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:34:01.807538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:34:01.820453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:01.821582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:01.822322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:01.823395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:01.824511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:01.828243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:01.857174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for project 26d523eb1a564c7982ea864afdc701d8. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:34:01.864318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for user d33ba6bcfb044286923c1c2c939b9097 and project 26d523eb1a564c7982ea864afdc701d8. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:34:01.877553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:34:01.880005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:34:01.934815 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [7066c2fc-b0e4-41c5-bb1b-0ca479a634e9] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:34:02.946643 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [7066c2fc-b0e4-41c5-bb1b-0ca479a634e9] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57422. Aug 24 04:34:02.951815 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-69a3ee8d-bd86-4161-ba42-04d235c1dc5c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.741106 Aug 24 04:34:02.958746 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3617/6962] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:34:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:34:02.962057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=18 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:02.967068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a2fde730-4d3f-4e4a-b7bc-9d88af3a2ad0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:02.968068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a2fde730-4d3f-4e4a-b7bc-9d88af3a2ad0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:03.043540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a2fde730-4d3f-4e4a-b7bc-9d88af3a2ad0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:03.051563 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a2fde730-4d3f-4e4a-b7bc-9d88af3a2ad0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1267 microversion: 2.1 time: 0.091372 Aug 24 04:34:03.060360 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3346/6963] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:02 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:04.078624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:04.080315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:04.087222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:04.087812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:04.088579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:04.089297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:04.089745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:04.090321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:04.195603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:04.208245 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2038b17a-22aa-4367-b5d1-40c46f5117cf tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1319 microversion: 2.1 time: 0.137581 Aug 24 04:34:04.222893 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3618/6964] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:04 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:05.230166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:05.230709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:05.238760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:05.239466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:05.240173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:05.240867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:05.241586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:05.242122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:05.377036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:05.385290 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8f2567ba-f6d2-4d4d-8e37-e4f3bba984db tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1392 microversion: 2.1 time: 0.159130 Aug 24 04:34:05.385987 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3347/6965] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:05 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:05.618113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-bb99c78e-a8b2-4c9e-81cf-62adf28f2977 req-6f6e59c9-f13e-4bb3-bdb8-bb82f33de0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5066fd11-13af-4c41-adc2-94aca87bb228", "tag": "ce3884cc-c15d-4145-989b-e8839c554745"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:34:05.631469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bb99c78e-a8b2-4c9e-81cf-62adf28f2977 req-6f6e59c9-f13e-4bb3-bdb8-bb82f33de0ac service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:05.632727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bb99c78e-a8b2-4c9e-81cf-62adf28f2977 req-6f6e59c9-f13e-4bb3-bdb8-bb82f33de0ac service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:05.633391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bb99c78e-a8b2-4c9e-81cf-62adf28f2977 req-6f6e59c9-f13e-4bb3-bdb8-bb82f33de0ac service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:05.649216 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bb99c78e-a8b2-4c9e-81cf-62adf28f2977 req-6f6e59c9-f13e-4bb3-bdb8-bb82f33de0ac service nova] Creating event network-changed:ce3884cc-c15d-4145-989b-e8839c554745 for instance 5066fd11-13af-4c41-adc2-94aca87bb228 on n-h2-846470-15 Aug 24 04:34:05.654989 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-bb99c78e-a8b2-4c9e-81cf-62adf28f2977 req-6f6e59c9-f13e-4bb3-bdb8-bb82f33de0ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041584 Aug 24 04:34:05.655941 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3619/6966] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:34:06.410826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:06.411833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:06.422506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:06.423282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:06.424053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:06.424974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:06.425446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:06.425884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:06.560174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:06.568295 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09944f8b-5ae6-4c7e-beef-6bc4a1d7b271 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1392 microversion: 2.1 time: 0.163483 Aug 24 04:34:06.568886 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3348/6967] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:06 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:07.594391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:07.595480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:07.603192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:07.603696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:07.604141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:07.604853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:07.605340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:07.605716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:07.748948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:07.761303 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b61dcf2a-72a6-453f-9904-72fac04a714b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1392 microversion: 2.1 time: 0.173692 Aug 24 04:34:07.762071 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3620/6968] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:07 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:08.785490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:08.786118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:08.793467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:08.793977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:08.794443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:08.795156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:08.795630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:08.796130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:08.936775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:08.945667 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74e1a50f-8e2e-4b43-aedb-e5e6b45bb2a5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1392 microversion: 2.1 time: 0.165605 Aug 24 04:34:08.946221 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3349/6969] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:08 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:09.966286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:09.966938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:09.974365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:09.974897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:09.975336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:09.976078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:09.976522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:09.976969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:10.111616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:10.119942 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-192f0e5a-8b02-4c23-b3d6-fc32b0b196ec tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1392 microversion: 2.1 time: 0.157590 Aug 24 04:34:10.120523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3621/6970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:09 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:11.142805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:11.143974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:11.153310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:11.153937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:11.154505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:11.155383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:11.156011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:11.156562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:11.293811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:11.305585 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b5e91ea4-b29c-4d79-b183-2349c50df2bb tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1392 microversion: 2.1 time: 0.167532 Aug 24 04:34:11.306295 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3350/6971] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:11 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:11.699140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b235ac0b-9451-4e16-b582-8146e52f7080 req-fbe098a4-31a7-47c9-827f-9c8829c0695d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5066fd11-13af-4c41-adc2-94aca87bb228", "name": "network-vif-plugged", "status": "completed", "tag": "ce3884cc-c15d-4145-989b-e8839c554745"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:34:11.708849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b235ac0b-9451-4e16-b582-8146e52f7080 req-fbe098a4-31a7-47c9-827f-9c8829c0695d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:11.709327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b235ac0b-9451-4e16-b582-8146e52f7080 req-fbe098a4-31a7-47c9-827f-9c8829c0695d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:11.709759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b235ac0b-9451-4e16-b582-8146e52f7080 req-fbe098a4-31a7-47c9-827f-9c8829c0695d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:11.722080 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b235ac0b-9451-4e16-b582-8146e52f7080 req-fbe098a4-31a7-47c9-827f-9c8829c0695d service nova] Creating event network-vif-plugged:ce3884cc-c15d-4145-989b-e8839c554745 for instance 5066fd11-13af-4c41-adc2-94aca87bb228 on n-h2-846470-15 Aug 24 04:34:11.728562 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b235ac0b-9451-4e16-b582-8146e52f7080 req-fbe098a4-31a7-47c9-827f-9c8829c0695d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090502 Aug 24 04:34:11.729318 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3622/6972] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:34:12.330344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:12.331194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:12.338685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:12.339192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:12.339642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:12.340382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:12.340850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:12.341291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:12.746641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:12.756688 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-385f1b55-eb69-4e96-bc3f-a41dea060e8e tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1392 microversion: 2.1 time: 0.430397 Aug 24 04:34:12.757288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3351/6973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:12 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1392 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:13.777017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:13.777940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:13.784701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:13.785585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:13.796846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:13.797450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:13.798070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:13.799100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:13.799866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:13.800296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:13.940546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:13.948616 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5c85a64-4b8d-4ddc-aa9d-e542931d9fd9 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1563 microversion: 2.1 time: 0.172958 Aug 24 04:34:13.949567 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3623/6974] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:13 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:13.973281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:13.974149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:13.977059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:13.985949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:13.986678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:13.987303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:13.988302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:13.988777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:13.989218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:14.138658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:14.146719 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-23c70994-ba7e-4d34-8fe4-d17fde37ee14 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1563 microversion: 2.1 time: 0.180056 Aug 24 04:34:14.147317 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3352/6975] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:13 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:15.797809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:34:15.798749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:15.799869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1aa035ca-a9cc-4fa5-94f0-6a44c723034d req-0fd4b4a1-b69b-4275-8286-a5594423b5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5066fd11-13af-4c41-adc2-94aca87bb228", "tag": "ce3884cc-c15d-4145-989b-e8839c554745"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:34:15.806534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:15.807906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:15.808505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:15.809377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:15.809838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:15.810261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:15.810762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1aa035ca-a9cc-4fa5-94f0-6a44c723034d req-0fd4b4a1-b69b-4275-8286-a5594423b5b3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:15.811330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1aa035ca-a9cc-4fa5-94f0-6a44c723034d req-0fd4b4a1-b69b-4275-8286-a5594423b5b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:15.811891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1aa035ca-a9cc-4fa5-94f0-6a44c723034d req-0fd4b4a1-b69b-4275-8286-a5594423b5b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:15.824669 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1aa035ca-a9cc-4fa5-94f0-6a44c723034d req-0fd4b4a1-b69b-4275-8286-a5594423b5b3 service nova] Creating event network-changed:ce3884cc-c15d-4145-989b-e8839c554745 for instance 5066fd11-13af-4c41-adc2-94aca87bb228 on n-h2-846470-15 Aug 24 04:34:15.830517 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1aa035ca-a9cc-4fa5-94f0-6a44c723034d req-0fd4b4a1-b69b-4275-8286-a5594423b5b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034425 Aug 24 04:34:15.831491 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3353/6976] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:34:16.044038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:34:16.052507 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b968384-c328-4c6b-b829-b02c9a2d5e50 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1563 microversion: 2.1 time: 0.258796 Aug 24 04:34:16.064714 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3624/6977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:34:15 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1563 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:44.360504 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:34:44.361169 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:34:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:34:49.397980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:49.398773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=38 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:49.405143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:34:49.408285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:34:49.416050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:49.416559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:49.417019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:49.417738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:34:49.418223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:34:49.418669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:34:49.469982 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89613c73-ad6b-4602-9e55-f9de77040877 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228/action" status: 200 len: 24562 microversion: 2.1 time: 0.075502 Aug 24 04:34:49.470989 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3354/6978] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:34:49 2022] POST /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228/action => generated 24562 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:35:19.696755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:19.698167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=36 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:19.704911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:19.705512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:19.713757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:19.714290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:19.714724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:19.715407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:19.715873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:19.716310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:19.875883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:19.886809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-66958cd7-e7c4-4f2c-a377-e0fbbfae7644 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1682 microversion: 2.1 time: 0.193495 Aug 24 04:35:19.887583 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3625/6979] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:19 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:19.994382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:19.996726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:19.999499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:20.000192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:20.007712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:20.008204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:20.008653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:20.009364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:20.009833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:20.010269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:20.075224 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-94aee8b8-6fe0-4344-8c11-6237626aeab3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228/action" status: 200 len: 32628 microversion: 2.1 time: 0.085007 Aug 24 04:35:20.075923 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3355/6980] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:35:19 2022] POST /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228/action => generated 32628 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:35:20.250115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:20.250833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:20.257784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:20.258277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:20.258874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:20.259635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:20.260631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:20.261083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:20.714243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f2eae356-35ab-45df-80e2-85e5d310fc78 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1835 microversion: 2.1 time: 0.467827 Aug 24 04:35:20.714835 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3626/6981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:20 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1835 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:20.743985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:20.746519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:20.754298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:20.754789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:20.755237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:20.755974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:20.756442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:20.756875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:20.784157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lazy-loading 'flavor' on Instance uuid 5066fd11-13af-4c41-adc2-94aca87bb228 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:35:20.796272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Going to try to live migrate instance to another host {{(pid=122535) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 04:35:22.286712 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d81db5c8-b320-465d-8183-35f17c13f2b1 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228/action" status: 202 len: 0 microversion: 2.1 time: 1.546680 Aug 24 04:35:22.287798 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3356/6982] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:35:20 2022] POST /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228/action => generated 0 bytes in 1549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:35:22.296791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:22.298392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:22.306943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:22.307591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:22.308127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:22.308901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:22.309457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:22.309918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:22.471338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:22.480112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a9cef84-5c81-454f-968f-3ca44b69520c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.187229 Aug 24 04:35:22.492773 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3627/6983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:22 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:23.504615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:23.505250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:23.507189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ae3a870d-e340-4ffe-a32a-952e6f923347 req-f7292ab9-f2b7-4bd6-9911-336b93858eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5066fd11-13af-4c41-adc2-94aca87bb228", "name": "network-vif-unplugged", "status": "completed", "tag": "ce3884cc-c15d-4145-989b-e8839c554745"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:23.513801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:23.514323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:23.519726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:23.519726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:23.520194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:23.520656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:23.520784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ae3a870d-e340-4ffe-a32a-952e6f923347 req-f7292ab9-f2b7-4bd6-9911-336b93858eb6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:23.521328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ae3a870d-e340-4ffe-a32a-952e6f923347 req-f7292ab9-f2b7-4bd6-9911-336b93858eb6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:23.521858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ae3a870d-e340-4ffe-a32a-952e6f923347 req-f7292ab9-f2b7-4bd6-9911-336b93858eb6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:23.535037 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ae3a870d-e340-4ffe-a32a-952e6f923347 req-f7292ab9-f2b7-4bd6-9911-336b93858eb6 service nova] Creating event network-vif-unplugged:ce3884cc-c15d-4145-989b-e8839c554745 for instance 5066fd11-13af-4c41-adc2-94aca87bb228 on n-h2-846470-15 Aug 24 04:35:23.543136 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ae3a870d-e340-4ffe-a32a-952e6f923347 req-f7292ab9-f2b7-4bd6-9911-336b93858eb6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040494 Aug 24 04:35:23.545330 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3628/6984] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:35:23.779648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:23.788145 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e95d6d68-b9c4-49c9-87c2-95e01db096c3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.288559 Aug 24 04:35:23.788703 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3357/6985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:23 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:24.814652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:24.815339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:24.822195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:24.822683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:24.823117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:24.824155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:24.824594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:24.825040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:24.990465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:24.998393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d00b692d-8e46-4e7d-a72d-0f75bdb363a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.191460 Aug 24 04:35:24.998997 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3629/6986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:24 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:25.595435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a5e99c49-a842-4fd3-9be7-c80e277c68d6 req-ff3b76e4-13fe-43fa-b51a-07940f1e0b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5066fd11-13af-4c41-adc2-94aca87bb228", "tag": "ce3884cc-c15d-4145-989b-e8839c554745"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:25.606971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a5e99c49-a842-4fd3-9be7-c80e277c68d6 req-ff3b76e4-13fe-43fa-b51a-07940f1e0b9f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:25.607474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a5e99c49-a842-4fd3-9be7-c80e277c68d6 req-ff3b76e4-13fe-43fa-b51a-07940f1e0b9f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:25.607976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a5e99c49-a842-4fd3-9be7-c80e277c68d6 req-ff3b76e4-13fe-43fa-b51a-07940f1e0b9f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:25.620019 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a5e99c49-a842-4fd3-9be7-c80e277c68d6 req-ff3b76e4-13fe-43fa-b51a-07940f1e0b9f service nova] Creating event network-changed:ce3884cc-c15d-4145-989b-e8839c554745 for instance 5066fd11-13af-4c41-adc2-94aca87bb228 on n-h2-846470-15 Aug 24 04:35:25.627481 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a5e99c49-a842-4fd3-9be7-c80e277c68d6 req-ff3b76e4-13fe-43fa-b51a-07940f1e0b9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037505 Aug 24 04:35:25.628545 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3358/6987] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:35:26.020593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:26.021187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:26.028292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:26.028784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:26.029221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:26.029917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:26.030374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:26.030798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:26.249816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:26.259233 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2be2c647-1b8f-498b-9fd0-7ff2f2e73d0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.243433 Aug 24 04:35:26.259855 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3630/6988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:26 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:27.286243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:27.286959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:27.293620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:27.294188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:27.294648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:27.295357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:27.295860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:27.296302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:27.455932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:27.464297 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b0facc6f-6c7f-4eae-921a-817b01aeff69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.183367 Aug 24 04:35:27.464854 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3359/6989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:27 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:28.489921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:28.490985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:28.501959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:28.502453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:28.502953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:28.503704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:28.504231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:28.504662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:28.656338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:28.665040 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1dd2082-366c-4cf1-82ff-75158a0eec36 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.181736 Aug 24 04:35:28.665635 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3631/6990] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:28 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:29.690218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:29.691358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:29.703146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:29.704427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:29.704649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:29.705365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:29.705836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:29.706283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:29.853139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:29.862184 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-13ab1b23-9442-4fa6-b8d8-d83b6d722931 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.178874 Aug 24 04:35:29.862772 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3360/6991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:29 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:30.885308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:30.885992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:30.894915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:30.895399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:30.895867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:30.896557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:30.897010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:30.897429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:31.043043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:31.052737 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8d3917e-5115-44a1-b92d-2bb0e455ec0c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.171860 Aug 24 04:35:31.053320 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3632/6992] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:30 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:32.078969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:32.079727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:32.090226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:32.090982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:32.091655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:32.092817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:32.093562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:32.094431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:32.234663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:32.243231 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ddd5add6-5e5d-456e-859c-2395d8de7430 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.169813 Aug 24 04:35:32.243883 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3361/6993] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:32 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:33.265105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:33.265740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:33.273679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:33.274165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:33.274607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:33.275311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:33.275780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:33.276199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:33.415607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:33.424138 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92de7907-4cc7-409d-b7f3-8644f89bef3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1692 microversion: 2.1 time: 0.162874 Aug 24 04:35:33.424706 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3633/6994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:33 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:34.445794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:34.446408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:34.453869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:34.454636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:34.455094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:34.455850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:34.456321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:34.456784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:34.606497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:34.618693 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-46d680ee-59d7-48a0-8782-e02440504190 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1682 microversion: 2.1 time: 0.176610 Aug 24 04:35:34.619556 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3362/6995] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:34 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:34.639700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:34.640283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:34.648002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:34.648618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:34.649042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:34.649764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:34.650391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:34.650840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:34.789104 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c716dbbf-0c20-403f-895f-7c351dcec920 tempest-TestNetworkAdvancedServerOps-1477349548 tempest-TestNetworkAdvancedServerOps-1477349548-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1835 microversion: 2.1 time: 0.153213 Aug 24 04:35:34.789768 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3634/6996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:34 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1835 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:34.810632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:34.811291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:34.819387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:34.819930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:34.820382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:34.821087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:34.821560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:34.821996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:34.976780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:34.987845 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-177bd58d-77e4-42f1-b5bf-5fa5ed1e2f57 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1682 microversion: 2.1 time: 0.181113 Aug 24 04:35:34.988401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3363/6997] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:34 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:35:35.082962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:35.085193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:35.091271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:35.091791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:35.092224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:35.092908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:35.093391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:35.093837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:35.155345 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e6e9fc7-ef46-4ed6-a398-37329e349c23 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228/action" status: 200 len: 38618 microversion: 2.1 time: 0.076334 Aug 24 04:35:35.156054 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3635/6998] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:35:35 2022] POST /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228/action => generated 38618 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:35:36.171874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:36.172464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:36.184461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:36.185236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:36.185778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:36.186572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:36.187107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:36.187608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:36.218054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:35:36.240860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-39f76f4e-8523-42b2-abf7-0a02478cb46e req-f2160af6-6320-4919-aede-83f9d17f7560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5066fd11-13af-4c41-adc2-94aca87bb228", "tag": "ce3884cc-c15d-4145-989b-e8839c554745"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:36.252369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39f76f4e-8523-42b2-abf7-0a02478cb46e req-f2160af6-6320-4919-aede-83f9d17f7560 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:36.252839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39f76f4e-8523-42b2-abf7-0a02478cb46e req-f2160af6-6320-4919-aede-83f9d17f7560 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:36.253275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-39f76f4e-8523-42b2-abf7-0a02478cb46e req-f2160af6-6320-4919-aede-83f9d17f7560 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:36.264739 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-39f76f4e-8523-42b2-abf7-0a02478cb46e req-f2160af6-6320-4919-aede-83f9d17f7560 service nova] Creating event network-changed:ce3884cc-c15d-4145-989b-e8839c554745 for instance 5066fd11-13af-4c41-adc2-94aca87bb228 on n-h1-846470-15 Aug 24 04:35:36.272460 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-39f76f4e-8523-42b2-abf7-0a02478cb46e req-f2160af6-6320-4919-aede-83f9d17f7560 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100495 Aug 24 04:35:36.273524 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3636/6999] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:35:36.311761 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3cb5d2c3-37a0-478b-b3e1-f98b2f7a4972 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 204 len: 0 microversion: 2.1 time: 0.142782 Aug 24 04:35:36.315859 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3364/7000] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:35:36 2022] DELETE /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:36.332441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:36.333712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:36.340486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:36.341079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:36.341582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:36.342346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:36.343023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:36.343652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:36.483475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:36.492037 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f08a164e-8eb7-4c7d-b886-e6c4acb6137a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1688 microversion: 2.1 time: 0.168730 Aug 24 04:35:36.492584 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3637/7001] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:36 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:37.515138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:37.515941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:37.523466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:37.524030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:37.524483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:37.525220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:37.525703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:37.526161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:37.768889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:37.777984 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ad09ea41-519b-4094-a8cf-ecf7ade9dec6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 200 len: 1569 microversion: 2.1 time: 0.266993 Aug 24 04:35:37.778884 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3365/7002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:37 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:37.781464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b83b43bb-727b-4736-8268-4085a9ff9d2b req-405eb16f-a246-4f11-a16d-e13a16ba6ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5066fd11-13af-4c41-adc2-94aca87bb228", "name": "network-vif-deleted", "tag": "ce3884cc-c15d-4145-989b-e8839c554745"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:37.793004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b83b43bb-727b-4736-8268-4085a9ff9d2b req-405eb16f-a246-4f11-a16d-e13a16ba6ce1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:37.793484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b83b43bb-727b-4736-8268-4085a9ff9d2b req-405eb16f-a246-4f11-a16d-e13a16ba6ce1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:37.793916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b83b43bb-727b-4736-8268-4085a9ff9d2b req-405eb16f-a246-4f11-a16d-e13a16ba6ce1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:37.806822 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b83b43bb-727b-4736-8268-4085a9ff9d2b req-405eb16f-a246-4f11-a16d-e13a16ba6ce1 service nova] Creating event network-vif-deleted:ce3884cc-c15d-4145-989b-e8839c554745 for instance 5066fd11-13af-4c41-adc2-94aca87bb228 on n-h1-846470-15 Aug 24 04:35:37.812555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b83b43bb-727b-4736-8268-4085a9ff9d2b req-405eb16f-a246-4f11-a16d-e13a16ba6ce1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034688 Aug 24 04:35:37.813282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3638/7003] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:35:38.802479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:38.803377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 5066fd11-13af-4c41-adc2-94aca87bb228] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:38.814074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:38.814578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:38.815031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:38.815767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:38.816239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:38.816683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:38.831571 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] HTTP exception thrown: Instance 5066fd11-13af-4c41-adc2-94aca87bb228 could not be found. Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Request method failure captured: Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 HTTP/1.1 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBai_d-HvT_nZhc9i3wSDIpIRoEXSDkKL04G1zdrYf21HHfmGVssO4J0m6LUD-KTU2mt5L61HdGjEmZW7CYfVAggBxx5ejT__a0ug1z9nlunnrgZibTaCnDKLtclWRZOiJsMt-EmjkLegjxqSiCideL03uLqmmxoeZCrtIa9-SXaEHwY Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 26d523eb1a564c7982ea864afdc701d8 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 26d523eb1a564c7982ea864afdc701d8 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestNetworkAdvancedServerOps-370832018-project Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d33ba6bcfb044286923c1c2c939b9097 Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestNetworkAdvancedServerOps-370832018-project Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 5066fd11-13af-4c41-adc2-94aca87bb228 could not be found. Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '5066fd11-13af-4c41-adc2-94aca87bb228'} Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5066fd11-13af-4c41-adc2-94aca87bb228 could not be found. Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5066fd11-13af-4c41-adc2-94aca87bb228 could not be found. Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:35:38.833416 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5066fd11-13af-4c41-adc2-94aca87bb228 could not be found. Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Returning 404 to user: Instance 5066fd11-13af-4c41-adc2-94aca87bb228 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-36d7d854-bbb3-438a-9f50-6b404ccb1866 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228" status: 404 len: 111 microversion: 2.1 time: 0.038845 Aug 24 04:35:38.838062 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3366/7004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:38 2022] GET /compute/v2.1/servers/5066fd11-13af-4c41-adc2-94aca87bb228 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:35:42.407999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c52ad371-2826-447a-9cbd-42bf93a0ce43 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '.version_select at 0x7f1021ae1dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:42.433455 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c52ad371-2826-447a-9cbd-42bf93a0ce43 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1969070732" status: 202 len: 0 microversion: 2.1 time: 0.030243 Aug 24 04:35:42.433963 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3639/7005] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 24 04:35:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1969070732 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:35:42.468754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-060ed3f6-568f-4622-8163-2e711b3a8d7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'create', calling method: .version_select at 0x7f1029f3a280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2031912651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKumAe7NQbxCFvmRR0wNeV/bnEBvUub6hoAGVT8EAf58ti1JxqTqGT9PqrO33rykjlrSXtJ7p84RKZ4Cru9sSEd4a6hLP71zDesmSzP4xXQ52nCwCgu1bnKnDkGClt5aEQ=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:42.487700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-060ed3f6-568f-4622-8163-2e711b3a8d7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for project 26d523eb1a564c7982ea864afdc701d8. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:35:42.494150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-060ed3f6-568f-4622-8163-2e711b3a8d7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for user d33ba6bcfb044286923c1c2c939b9097 and project 26d523eb1a564c7982ea864afdc701d8. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:35:42.520699 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-060ed3f6-568f-4622-8163-2e711b3a8d7a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057259 Aug 24 04:35:42.521387 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3367/7006] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:35:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:35:48.202380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=70 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.207374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1677456575", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "4f4c2f7e-e5a8-4662-aed6-d82995b1bb8f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2031912651", "security_groups": [{"name": "tempest-secgroup-smoke-1908818846"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:48.343354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] validate_networks() for [('4f4c2f7e-e5a8-4662-aed6-d82995b1bb8f', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:35:49.139077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:35:49.139497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:35:49.140002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:35:49.140408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:35:49.140981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:35:49.150261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:49.150743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:49.151188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:49.151943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:49.152393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:49.152827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:49.170595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for project 26d523eb1a564c7982ea864afdc701d8. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:35:49.176108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Getting quotas for user d33ba6bcfb044286923c1c2c939b9097 and project 26d523eb1a564c7982ea864afdc701d8. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:35:49.190561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:35:49.192988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:35:49.242893 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b9b7836c-ffaa-4c74-b8d5-ceb9d98e50ef tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.042135 Aug 24 04:35:49.243606 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3640/7007] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:35:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:35:49.252942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.258358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aa477b7e-2039-47bd-977e-09022b72b412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:49.259020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aa477b7e-2039-47bd-977e-09022b72b412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:49.346479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aa477b7e-2039-47bd-977e-09022b72b412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:49.353999 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aa477b7e-2039-47bd-977e-09022b72b412 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1267 microversion: 2.1 time: 0.102984 Aug 24 04:35:49.354906 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3368/7008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:49 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:50.377775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:50.378491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:50.380844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.387491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:50.388002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:50.394575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:50.395343 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:50.395851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:50.396290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:50.493110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:50.503303 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c056af19-086a-4bad-ab79-24d2a836a8f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1327 microversion: 2.1 time: 0.131028 Aug 24 04:35:50.504080 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3641/7009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:50 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1327 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:51.525571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:51.526174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:51.528956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:51.535894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:51.536401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:51.536860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:51.537581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:51.538048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:51.538488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:51.686509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:51.698993 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e9d613fa-17f0-460e-af4d-f19e0f19d401 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1393 microversion: 2.1 time: 0.177060 Aug 24 04:35:51.700200 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3369/7010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:51 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:35:51.811399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1787a9da-b5d5-4033-a0a3-e764dfad6d1a req-c39c12cc-6e15-4810-a42f-a4c65be961f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0624b23b-7fdb-4283-b857-e86f868f8623", "tag": "9b49884e-ccc4-49a9-9b45-a6444784725f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:51.825135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1787a9da-b5d5-4033-a0a3-e764dfad6d1a req-c39c12cc-6e15-4810-a42f-a4c65be961f3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:51.825642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1787a9da-b5d5-4033-a0a3-e764dfad6d1a req-c39c12cc-6e15-4810-a42f-a4c65be961f3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:51.826067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1787a9da-b5d5-4033-a0a3-e764dfad6d1a req-c39c12cc-6e15-4810-a42f-a4c65be961f3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:51.842171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1787a9da-b5d5-4033-a0a3-e764dfad6d1a req-c39c12cc-6e15-4810-a42f-a4c65be961f3 service nova] Creating event network-changed:9b49884e-ccc4-49a9-9b45-a6444784725f for instance 0624b23b-7fdb-4283-b857-e86f868f8623 on n-h2-846470-15 Aug 24 04:35:51.848850 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1787a9da-b5d5-4033-a0a3-e764dfad6d1a req-c39c12cc-6e15-4810-a42f-a4c65be961f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041621 Aug 24 04:35:51.850859 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3642/7011] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:35:52.724658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:52.725219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:52.735362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:52.735909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:52.736369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:52.737103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:52.737625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:52.738075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:52.882190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:52.893638 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-03ae1296-57bc-4263-92dd-cddd07899032 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1393 microversion: 2.1 time: 0.175512 Aug 24 04:35:52.894227 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3370/7012] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:52 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:53.920629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:53.921790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:53.932633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:53.933296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:53.934024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:53.935179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:53.936013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:53.936764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:54.075844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:54.084201 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ee2fc730-44ec-4a3d-a92a-684ba58d8932 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1393 microversion: 2.1 time: 0.172004 Aug 24 04:35:54.084867 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3643/7013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:53 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:55.105971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:55.106526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:55.114029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:55.114541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:55.114998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:55.115745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:55.116224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:55.116675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:55.274712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:55.283055 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2c8218a0-4c29-4d5d-b886-832af3ca7a15 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1393 microversion: 2.1 time: 0.181192 Aug 24 04:35:55.283635 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3371/7014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:55 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:56.304007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:56.304617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:56.311998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:56.313108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:56.313573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:56.314284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:56.314716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:56.315146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:56.457748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:56.465785 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cba4cb70-ca5d-4c9d-af14-4a7524b20df7 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1393 microversion: 2.1 time: 0.165737 Aug 24 04:35:56.466316 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3644/7015] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:56 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:57.487243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:57.487821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:57.495065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:57.495575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:57.496072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:57.496793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:57.497253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:57.497736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:57.632015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:57.640019 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d3365f2-a36f-47ad-ba8a-02d99e910751 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1393 microversion: 2.1 time: 0.157074 Aug 24 04:35:57.640822 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3372/7016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:57 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:58.211549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d339b8b7-e9ba-42b4-a4aa-2ad90a0a4766 req-59d2ae98-8e9e-48e1-86ed-2855e0e535b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0624b23b-7fdb-4283-b857-e86f868f8623", "name": "network-vif-plugged", "status": "completed", "tag": "9b49884e-ccc4-49a9-9b45-a6444784725f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:35:58.224624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d339b8b7-e9ba-42b4-a4aa-2ad90a0a4766 req-59d2ae98-8e9e-48e1-86ed-2855e0e535b4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:58.225114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d339b8b7-e9ba-42b4-a4aa-2ad90a0a4766 req-59d2ae98-8e9e-48e1-86ed-2855e0e535b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:58.225550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d339b8b7-e9ba-42b4-a4aa-2ad90a0a4766 req-59d2ae98-8e9e-48e1-86ed-2855e0e535b4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:58.237406 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d339b8b7-e9ba-42b4-a4aa-2ad90a0a4766 req-59d2ae98-8e9e-48e1-86ed-2855e0e535b4 service nova] Creating event network-vif-plugged:9b49884e-ccc4-49a9-9b45-a6444784725f for instance 0624b23b-7fdb-4283-b857-e86f868f8623 on n-h2-846470-15 Aug 24 04:35:58.242656 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d339b8b7-e9ba-42b4-a4aa-2ad90a0a4766 req-59d2ae98-8e9e-48e1-86ed-2855e0e535b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034946 Aug 24 04:35:58.243263 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3645/7017] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:35:58.662005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:58.662690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:58.670220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:58.670727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:58.671177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:58.672230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:58.672829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:58.673273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:58.828707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:35:58.837049 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e1521e23-c66d-4548-96c3-d7b1fcaf3b9c tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1393 microversion: 2.1 time: 0.179119 Aug 24 04:35:58.837672 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3373/7018] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:58 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:59.860498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:35:59.861513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:35:59.864016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.864926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.875002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:59.875484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:59.875948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:35:59.876691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:35:59.877152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:35:59.877581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:36:00.022283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:36:00.030279 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05985c4a-c796-4686-9dc0-edff1106eb69 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1565 microversion: 2.1 time: 0.175615 Aug 24 04:36:00.030854 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3646/7019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:35:59 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:00.050735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:36:00.051375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:36:00.053315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.059588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:36:00.060140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:36:00.060565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:36:00.061318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:36:00.061835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:36:00.062488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:36:00.204064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:36:00.212903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e9553310-d578-4cd1-b4e1-0bae26ab14e6 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1565 microversion: 2.1 time: 0.166217 Aug 24 04:36:00.213530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3374/7020] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:36:00 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:01.870130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:36:01.875726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-31053e36-f416-4615-abe8-e4d21dc7730d req-cd29e45e-b20f-40a6-a67e-d598689e2719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0624b23b-7fdb-4283-b857-e86f868f8623", "tag": "9b49884e-ccc4-49a9-9b45-a6444784725f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:36:01.882615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:36:01.889925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-31053e36-f416-4615-abe8-e4d21dc7730d req-cd29e45e-b20f-40a6-a67e-d598689e2719 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:36:01.890661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:36:01.890776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-31053e36-f416-4615-abe8-e4d21dc7730d req-cd29e45e-b20f-40a6-a67e-d598689e2719 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:36:01.891153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:36:01.891373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-31053e36-f416-4615-abe8-e4d21dc7730d req-cd29e45e-b20f-40a6-a67e-d598689e2719 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:36:01.891578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:36:01.892373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:36:01.892830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:36:01.893481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:36:01.904730 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-31053e36-f416-4615-abe8-e4d21dc7730d req-cd29e45e-b20f-40a6-a67e-d598689e2719 service nova] Creating event network-changed:9b49884e-ccc4-49a9-9b45-a6444784725f for instance 0624b23b-7fdb-4283-b857-e86f868f8623 on n-h2-846470-15 Aug 24 04:36:01.911845 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-31053e36-f416-4615-abe8-e4d21dc7730d req-cd29e45e-b20f-40a6-a67e-d598689e2719 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039830 Aug 24 04:36:01.912457 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3375/7021] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:36:02.115801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:36:02.126569 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e8b69f56-77fd-4a9d-9524-efff33fd652a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1565 microversion: 2.1 time: 0.260306 Aug 24 04:36:02.128014 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3647/7022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:36:01 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1565 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:35.530018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=13 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:35.530908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=38 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:35.535160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:36:35.537632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:36:35.544940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:36:35.545442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:36:35.545954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:36:35.546656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:36:35.547154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:36:35.547590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:36:35.601933 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98075d94-3ea4-4629-ab12-8f1498680ea5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623/action" status: 200 len: 24567 microversion: 2.1 time: 0.073900 Aug 24 04:36:35.602680 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3376/7023] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:36:35 2022] POST /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:06.069368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=13 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:06.070538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=36 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:06.078640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:37:06.083729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:06.093855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:06.094366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:06.094798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:06.095498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:06.095984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:06.096403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:06.181776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:37:06.182212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:37:06.182676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:37:06.183061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:37:06.183466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:37:06.256135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:06.261911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:06.262394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:06.262826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:06.263515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:06.264074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:06.264694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:06.292692 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dda95543-2758-4c36-8e9f-285a20ee56f5 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623/action" status: 202 len: 1138 microversion: 2.1 time: 0.226688 Aug 24 04:37:06.293336 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3648/7024] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:37:06 2022] POST /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623/action => generated 1138 bytes in 228 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 04:37:06.312059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:06.312810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:06.315568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:06.316261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:06.322720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:06.323164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:06.323960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:06.324673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:06.325146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:06.325590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:06.473171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:06.484367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b2bb2079-66d5-4167-8ec4-52bd5857b349 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.177353 Aug 24 04:37:06.484942 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3377/7025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:06 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:07.508809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:07.509435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:07.518083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:07.518584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:07.519016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:07.519904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:07.520536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:07.521328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:07.666160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:07.675884 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e80cb158-3ff9-472c-afa9-126d2c201191 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.171284 Aug 24 04:37:07.676495 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3649/7026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:07 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:08.701984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:08.702620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:08.709921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:08.710423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:08.710878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:08.711588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:08.712094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:08.712522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:08.859518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:08.872416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-15346c97-821b-4fa1-bd4e-ed3b20a14378 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.177065 Aug 24 04:37:08.873296 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3378/7027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:08 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:09.896125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:09.896884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:09.905563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:09.906057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:09.906577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:09.907396 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:09.907986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:09.908523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:10.055839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:10.066182 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c2e99102-09c1-4ace-bfd5-b31beb6169c8 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.174782 Aug 24 04:37:10.067007 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3650/7028] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:09 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:11.090162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:11.090873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:11.098570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:11.099054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:11.099500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:11.100246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:11.100752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:11.101188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:11.246033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:11.255257 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6e458990-5a63-44ae-81ec-3faed09192a3 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.169731 Aug 24 04:37:11.256184 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3379/7029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:11 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:12.277601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:12.278182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:12.285327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:12.285813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:12.286252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:12.286941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:12.287397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:12.287864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:12.436181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:12.447876 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7e9ae2e1-6b8a-4187-9a09-82e8b36b37a2 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.173959 Aug 24 04:37:12.448885 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3651/7030] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:12 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:13.472256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:13.472916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:13.481079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:13.481671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:13.482202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:13.483681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:13.484214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:13.484750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:13.629614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:13.637944 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef66c354-d1e3-467e-a77a-365b7061af0f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.170868 Aug 24 04:37:13.638535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3380/7031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:13 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:14.659757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:14.660447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:14.668871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:14.669435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:14.670111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:14.670797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:14.671253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:14.671704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:14.818800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:14.828242 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-79d10761-f0d1-4e43-ae0d-5704a40af08b tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.172690 Aug 24 04:37:14.829564 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3652/7032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:14 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:15.854886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:15.856033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:15.868140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:15.868980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:15.869734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:15.870914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:15.871731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:15.872507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:16.008632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:16.016825 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-11f722db-3c3f-4697-b2fd-99a5cf4b63d0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.168516 Aug 24 04:37:16.017404 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3381/7033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:15 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:17.040556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:17.041190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:17.050726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:17.051325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:17.051940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:17.052774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:17.053358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:17.053872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:17.203217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:17.215517 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-94d473c6-416b-4bd0-88d6-6d78164f8f3a tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.179752 Aug 24 04:37:17.216473 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3653/7034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:17 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:18.244831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:18.245463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:18.252864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:18.253370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:18.253821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:18.254526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:18.254997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:18.255438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:18.390995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:18.399553 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b33a2917-e2ee-4c27-84b6-a82f0e4b39ff tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1693 microversion: 2.1 time: 0.158814 Aug 24 04:37:18.400173 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3382/7035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:18 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:19.425451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:19.426422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:19.437243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:19.437731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:19.438169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:19.438897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:19.439353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:19.439807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:19.575369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:19.583384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cfe29ef3-dfed-4981-9144-445375275959 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1699 microversion: 2.1 time: 0.164811 Aug 24 04:37:19.584012 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3654/7036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:19 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1699 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:20.605977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:20.606841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:20.616338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:20.616998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:20.617594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:20.618682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:20.619350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:20.620020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:20.771765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:20.782825 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a913e65-87da-4699-9caf-45f9586740b0 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1699 microversion: 2.1 time: 0.181363 Aug 24 04:37:20.783425 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3383/7037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:20 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1699 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:21.808908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:21.809774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:21.817688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:21.818171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:21.818608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:21.819336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:21.819813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:21.820231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:21.971572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:21.983803 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df66198e-c6f8-4b3d-852d-f34db6286e62 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1699 microversion: 2.1 time: 0.181466 Aug 24 04:37:21.984424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3655/7038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:21 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1699 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:23.012629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:37:23.013265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:23.023307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:23.024033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:23.024850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:23.026159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:23.027024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:23.027625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:23.034939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-daf57b40-13d5-4565-9314-88e838e2f980 req-ec2dc15c-b966-442c-8410-2e83233f5d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0624b23b-7fdb-4283-b857-e86f868f8623", "name": "network-vif-unplugged", "status": "completed", "tag": "9b49884e-ccc4-49a9-9b45-a6444784725f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:37:23.057077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-daf57b40-13d5-4565-9314-88e838e2f980 req-ec2dc15c-b966-442c-8410-2e83233f5d84 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:23.058784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-daf57b40-13d5-4565-9314-88e838e2f980 req-ec2dc15c-b966-442c-8410-2e83233f5d84 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:23.060920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-daf57b40-13d5-4565-9314-88e838e2f980 req-ec2dc15c-b966-442c-8410-2e83233f5d84 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:23.092413 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-daf57b40-13d5-4565-9314-88e838e2f980 req-ec2dc15c-b966-442c-8410-2e83233f5d84 service nova] Creating event network-vif-unplugged:9b49884e-ccc4-49a9-9b45-a6444784725f for instance 0624b23b-7fdb-4283-b857-e86f868f8623 on n-h2-846470-15 Aug 24 04:37:23.101492 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-daf57b40-13d5-4565-9314-88e838e2f980 req-ec2dc15c-b966-442c-8410-2e83233f5d84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075285 Aug 24 04:37:23.102771 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3656/7039] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:37:23.222069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:37:23.230318 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a685047-9446-49b4-8ed3-1085ab0639b1 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1684 microversion: 2.1 time: 0.221616 Aug 24 04:37:23.230897 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3384/7040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:37:23 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1684 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:25.123650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c06a0130-f9c5-456d-9804-84a820d7cbcb req-941d501f-b136-493a-81eb-a6b7bc9699df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0624b23b-7fdb-4283-b857-e86f868f8623", "name": "network-vif-plugged", "status": "completed", "tag": "9b49884e-ccc4-49a9-9b45-a6444784725f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:37:25.133711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c06a0130-f9c5-456d-9804-84a820d7cbcb req-941d501f-b136-493a-81eb-a6b7bc9699df service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:25.134183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c06a0130-f9c5-456d-9804-84a820d7cbcb req-941d501f-b136-493a-81eb-a6b7bc9699df service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:25.134609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c06a0130-f9c5-456d-9804-84a820d7cbcb req-941d501f-b136-493a-81eb-a6b7bc9699df service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:25.147004 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c06a0130-f9c5-456d-9804-84a820d7cbcb req-941d501f-b136-493a-81eb-a6b7bc9699df service nova] Creating event network-vif-plugged:9b49884e-ccc4-49a9-9b45-a6444784725f for instance 0624b23b-7fdb-4283-b857-e86f868f8623 on n-h2-846470-15 Aug 24 04:37:25.152037 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c06a0130-f9c5-456d-9804-84a820d7cbcb req-941d501f-b136-493a-81eb-a6b7bc9699df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033950 Aug 24 04:37:25.152650 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3657/7041] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:37:54.262081 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:37:54.263272 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:37:59.531486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=16 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:59.532412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=48 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:59.616111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:37:59.619719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:37:59.628913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:59.629574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:59.630222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:59.631338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:37:59.632044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:37:59.632645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:37:59.686011 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9f4962e0-89ab-4101-a0ed-4859f8117541 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "POST /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623/action" status: 200 len: 24575 microversion: 2.1 time: 0.162447 Aug 24 04:37:59.686916 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3385/7042] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:37:59 2022] POST /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623/action => generated 24575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:38:04.370997 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:38:04.372178 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:38:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:38:30.966265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=24 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:30.967404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:30.970310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f874b1a3-bf08-4497-95e4-a2f88265ffbc req-5b2716ec-41de-4706-b134-9ee743d7a00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0624b23b-7fdb-4283-b857-e86f868f8623", "tag": "9b49884e-ccc4-49a9-9b45-a6444784725f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:38:30.973027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:30.973818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:30.976029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:30.976665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:30.983368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:30.983952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f874b1a3-bf08-4497-95e4-a2f88265ffbc req-5b2716ec-41de-4706-b134-9ee743d7a00f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:30.984125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:30.984458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f874b1a3-bf08-4497-95e4-a2f88265ffbc req-5b2716ec-41de-4706-b134-9ee743d7a00f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:30.984749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:30.984905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f874b1a3-bf08-4497-95e4-a2f88265ffbc req-5b2716ec-41de-4706-b134-9ee743d7a00f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:30.985574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:30.986085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:30.986569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:30.998015 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f874b1a3-bf08-4497-95e4-a2f88265ffbc req-5b2716ec-41de-4706-b134-9ee743d7a00f service nova] Creating event network-changed:9b49884e-ccc4-49a9-9b45-a6444784725f for instance 0624b23b-7fdb-4283-b857-e86f868f8623 on n-h2-846470-15 Aug 24 04:38:31.004259 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f874b1a3-bf08-4497-95e4-a2f88265ffbc req-5b2716ec-41de-4706-b134-9ee743d7a00f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039392 Aug 24 04:38:31.005920 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3386/7043] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:38:31.017870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:38:31.115141 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-519e0e55-1fcb-404e-88ec-63d5c7fdca32 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 204 len: 0 microversion: 2.1 time: 0.152225 Aug 24 04:38:31.116485 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3658/7044] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:38:30 2022] DELETE /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:38:31.125132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:31.125849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:31.132747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:31.132938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:31.133357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:31.134078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:31.134558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:31.135001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:31.343634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:31.352031 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e15dfc71-f0b4-47c9-a15d-953890252e21 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1690 microversion: 2.1 time: 0.231662 Aug 24 04:38:31.352610 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3387/7045] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:31 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1690 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:32.374506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:32.375219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:32.382559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:32.383055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:32.383496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:32.384232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:32.384714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:32.385148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:32.646902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:32.655339 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9ea9383-63a3-4809-b137-f4edf7b2fb02 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1690 microversion: 2.1 time: 0.285342 Aug 24 04:38:32.655950 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3659/7046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:32 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1690 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:33.330253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-83e100c2-75bb-4b5e-aa22-ffdf358c8a35 req-5ca72872-f012-4907-a622-0a103bb32ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0624b23b-7fdb-4283-b857-e86f868f8623", "name": "network-vif-deleted", "tag": "9b49884e-ccc4-49a9-9b45-a6444784725f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:38:33.343759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-83e100c2-75bb-4b5e-aa22-ffdf358c8a35 req-5ca72872-f012-4907-a622-0a103bb32ea6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:33.344245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-83e100c2-75bb-4b5e-aa22-ffdf358c8a35 req-5ca72872-f012-4907-a622-0a103bb32ea6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:33.344690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-83e100c2-75bb-4b5e-aa22-ffdf358c8a35 req-5ca72872-f012-4907-a622-0a103bb32ea6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:33.358444 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-83e100c2-75bb-4b5e-aa22-ffdf358c8a35 req-5ca72872-f012-4907-a622-0a103bb32ea6 service nova] Creating event network-vif-deleted:9b49884e-ccc4-49a9-9b45-a6444784725f for instance 0624b23b-7fdb-4283-b857-e86f868f8623 on n-h2-846470-15 Aug 24 04:38:33.364720 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-83e100c2-75bb-4b5e-aa22-ffdf358c8a35 req-5ca72872-f012-4907-a622-0a103bb32ea6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040112 Aug 24 04:38:33.365328 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3388/7047] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:38:33.677243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:33.677877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:33.685252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:33.686011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:33.686452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:33.687227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:33.687693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:33.688167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:33.723402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:33.723932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:33.724429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:33.724892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lazy-loading 'fault' on Instance uuid 0624b23b-7fdb-4283-b857-e86f868f8623 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:38:33.771094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33ba6bcfb044286923c1c2c939b9097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d523eb1a564c7982ea864afdc701d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:33.778814 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2375cb99-e3bb-44c5-83fe-7366611ec765 tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 200 len: 1357 microversion: 2.1 time: 0.105611 Aug 24 04:38:33.779478 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3660/7048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:33 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:34.807495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:34.808740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] [instance: 0624b23b-7fdb-4283-b857-e86f868f8623] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:34.819951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:34.820781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:34.821578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:34.822737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:34.823948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:34.824788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:34.839702 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] HTTP exception thrown: Instance 0624b23b-7fdb-4283-b857-e86f868f8623 could not be found. Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Request method failure captured: Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 HTTP/1.1 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBai_d-HvT_nZhc9i3wSDIpIRoEXSDkKL04G1zdrYf21HHfmGVssO4J0m6LUD-KTU2mt5L61HdGjEmZW7CYfVAggBxx5ejT__a0ug1z9nlunnrgZibTaCnDKLtclWRZOiJsMt-EmjkLegjxqSiCideL03uLqmmxoeZCrtIa9-SXaEHwY Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 26d523eb1a564c7982ea864afdc701d8 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26d523eb1a564c7982ea864afdc701d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 26d523eb1a564c7982ea864afdc701d8 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-370832018 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestNetworkAdvancedServerOps-370832018-project Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: d33ba6bcfb044286923c1c2c939b9097 Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestNetworkAdvancedServerOps-370832018-project Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 0624b23b-7fdb-4283-b857-e86f868f8623 could not be found. Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '0624b23b-7fdb-4283-b857-e86f868f8623'} Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0624b23b-7fdb-4283-b857-e86f868f8623 could not be found. Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0624b23b-7fdb-4283-b857-e86f868f8623 could not be found. Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:38:34.841366 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0624b23b-7fdb-4283-b857-e86f868f8623 could not be found. Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Returning 404 to user: Instance 0624b23b-7fdb-4283-b857-e86f868f8623 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-68311633-9b37-4056-9942-0e9aa57a637f tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623" status: 404 len: 111 microversion: 2.1 time: 0.044154 Aug 24 04:38:34.845552 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3389/7049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:34 2022] GET /compute/v2.1/servers/0624b23b-7fdb-4283-b857-e86f868f8623 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:38:36.807626 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:38:36.808327 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:38:37.895255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07988a72-5d67-4804-b4bc-c5093d1f28ba tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] Calling method '.version_select at 0x7f1021bed670>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:37.925212 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07988a72-5d67-4804-b4bc-c5093d1f28ba tempest-TestNetworkAdvancedServerOps-370832018 tempest-TestNetworkAdvancedServerOps-370832018-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2031912651" status: 202 len: 0 microversion: 2.1 time: 0.034146 Aug 24 04:38:37.929178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3661/7050] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 24 04:38:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2031912651 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:38:50.507881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:50.508706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=12 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:50.618749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2069596609", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:38:50.673111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] validate_networks() for None {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:38:51.228575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:38:51.229048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:38:51.229540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:38:51.229967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:38:51.230371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:38:51.240385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:51.240890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:51.241351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:51.242095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:51.242570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:51.243016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:51.260777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Getting quotas for project a3be1237ceba48c9b9191289a0eb9ab5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:38:51.266658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Getting quotas for user c9963fcc1cb3427588d16110341b7d3b and project a3be1237ceba48c9b9191289a0eb9ab5. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:38:51.280097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:38:51.282425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:38:51.332706 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1434a394-2556-436c-b21c-9a5e4bfdfc93 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829643 Aug 24 04:38:51.333277 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3390/7051] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:38:51.343890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:51.344633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:51.349090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b69793b7-e7fb-4827-a3a3-799c37b05bcc tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:51.350078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b69793b7-e7fb-4827-a3a3-799c37b05bcc tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:51.414034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b69793b7-e7fb-4827-a3a3-799c37b05bcc tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:51.421789 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b69793b7-e7fb-4827-a3a3-799c37b05bcc tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1222 microversion: 2.1 time: 0.079713 Aug 24 04:38:51.422373 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3662/7052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:51 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:52.444295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:52.444854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:52.451585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:52.452115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:52.452902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:52.453273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:52.453743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:52.454183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:52.523506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:52.533308 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06c17bdc-d1c5-4c81-9414-98c99294792d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1274 microversion: 2.1 time: 0.094017 Aug 24 04:38:52.533876 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3391/7053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:52 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:53.558946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:53.559587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:53.570087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:53.570552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:53.570992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:53.571820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:53.572284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:53.572721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:53.641517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:53.649757 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df14ba57-d2fc-49c0-b6ad-8df3957ce249 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1280 microversion: 2.1 time: 0.096660 Aug 24 04:38:53.650563 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3663/7054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:53 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:54.500168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-342158a3-7055-4e9f-8422-b44747234816 req-8431c789-554f-4b97-980b-b3b82b917896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f584d2e-cbe4-4608-92cc-848c85d75915", "tag": "618fbc38-f2d0-4aa7-9221-fa86af3ae18f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:38:54.513884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-342158a3-7055-4e9f-8422-b44747234816 req-8431c789-554f-4b97-980b-b3b82b917896 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:54.514650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-342158a3-7055-4e9f-8422-b44747234816 req-8431c789-554f-4b97-980b-b3b82b917896 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:54.515103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-342158a3-7055-4e9f-8422-b44747234816 req-8431c789-554f-4b97-980b-b3b82b917896 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:54.527948 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-342158a3-7055-4e9f-8422-b44747234816 req-8431c789-554f-4b97-980b-b3b82b917896 service nova] Creating event network-changed:618fbc38-f2d0-4aa7-9221-fa86af3ae18f for instance 1f584d2e-cbe4-4608-92cc-848c85d75915 on n-h2-846470-15 Aug 24 04:38:54.533273 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-342158a3-7055-4e9f-8422-b44747234816 req-8431c789-554f-4b97-980b-b3b82b917896 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038724 Aug 24 04:38:54.533946 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3392/7055] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:38:54.671730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:54.672368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:54.682893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:54.683394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:54.684054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:54.685083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:54.685510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:54.685929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:54.925415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:54.934263 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7b3c213-dfd0-4ac8-ade7-190c0a98da24 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1322 microversion: 2.1 time: 0.267555 Aug 24 04:38:54.934938 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3664/7056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:54 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:55.958995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:55.959871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:55.968155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:55.968597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:55.969050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:55.969765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:55.970242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:55.970685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:56.125629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:56.133981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b0a08863-9dfe-4819-8114-ed80e284484e tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1322 microversion: 2.1 time: 0.181098 Aug 24 04:38:56.134547 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3393/7057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:55 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:57.161764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:57.162398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:57.170763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:57.171252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:57.171711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:57.172419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:57.172872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:57.173325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:57.403580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:57.411758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-80cf6939-7951-45db-b29b-478bcbb1b64d tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1322 microversion: 2.1 time: 0.253913 Aug 24 04:38:57.412351 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3665/7058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:57 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:58.436725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:58.437262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:58.444578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:58.445078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:58.445531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:58.446240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:58.446712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:58.447150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:58.586943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:58.598372 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-658c78b5-0ca5-4616-a3fe-fbf02c61c395 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1322 microversion: 2.1 time: 0.167345 Aug 24 04:38:58.599208 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3394/7059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:58 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:38:59.626730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:38:59.627392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:38:59.637683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:59.638774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:59.639187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:59.639959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:38:59.640421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:38:59.640850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:38:59.783492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:38:59.791514 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fe903be0-49a4-4a30-ad60-61fff0350407 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1322 microversion: 2.1 time: 0.171991 Aug 24 04:38:59.792118 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3666/7060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:38:59 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:00.814480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:00.815073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:00.823278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:00.824115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:00.824565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:00.825256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:00.825978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:00.826413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:00.974403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:00.984412 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-71be62a7-5ebd-4086-9774-25160524e1a0 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1322 microversion: 2.1 time: 0.173939 Aug 24 04:39:00.984999 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3395/7061] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:00 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:01.315614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ad7c6d71-d04f-4a12-89c5-81cbf62098df req-3fec625f-ccb5-4f1e-b411-e260f2922f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f584d2e-cbe4-4608-92cc-848c85d75915", "name": "network-vif-plugged", "status": "completed", "tag": "618fbc38-f2d0-4aa7-9221-fa86af3ae18f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:01.326483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad7c6d71-d04f-4a12-89c5-81cbf62098df req-3fec625f-ccb5-4f1e-b411-e260f2922f36 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:01.327002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad7c6d71-d04f-4a12-89c5-81cbf62098df req-3fec625f-ccb5-4f1e-b411-e260f2922f36 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:01.327432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad7c6d71-d04f-4a12-89c5-81cbf62098df req-3fec625f-ccb5-4f1e-b411-e260f2922f36 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:01.339277 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ad7c6d71-d04f-4a12-89c5-81cbf62098df req-3fec625f-ccb5-4f1e-b411-e260f2922f36 service nova] Creating event network-vif-plugged:618fbc38-f2d0-4aa7-9221-fa86af3ae18f for instance 1f584d2e-cbe4-4608-92cc-848c85d75915 on n-h2-846470-15 Aug 24 04:39:01.344573 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ad7c6d71-d04f-4a12-89c5-81cbf62098df req-3fec625f-ccb5-4f1e-b411-e260f2922f36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 Aug 24 04:39:01.345222 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3667/7062] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:02.017015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:02.017832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:02.021321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:02.022202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:02.031725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:02.032269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:02.032731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:02.033449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:02.033929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:02.034364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:02.167721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:02.176416 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-23abcc74-19a6-47f9-a05c-8730c5f2e6f1 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1322 microversion: 2.1 time: 0.166366 Aug 24 04:39:02.176999 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3396/7063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:02 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:03.197383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:03.204166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:03.204859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:03.211746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:03.212249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:03.212681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:03.213370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:03.213816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:03.214234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:03.350779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:03.359512 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7378ba52-072c-400f-aad2-0708e6ce2f7b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1472 microversion: 2.1 time: 0.163993 Aug 24 04:39:03.360099 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3668/7064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:03 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:03.439391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d9ac8bc2-af63-472d-a99e-a0495f58bd2a tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Calling method '.version_select at 0x7f1029e311f0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:03.509407 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d9ac8bc2-af63-472d-a99e-a0495f58bd2a tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/2e678ec753b7452fbeb58ac03b2ebecd" status: 200 len: 371 microversion: 2.1 time: 0.129963 Aug 24 04:39:03.510023 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3397/7065] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 04:39:03 2022] GET /compute/v2.1/os-quota-sets/2e678ec753b7452fbeb58ac03b2ebecd => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:03.521666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dc2ae125-afcb-4ddf-a1db-1dbbff0a990d tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1642604723", "id": 1114310924, "os-flavor-access:is_public": "True"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:03.524572 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:39:03.524572 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:39:03.542563 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dc2ae125-afcb-4ddf-a1db-1dbbff0a990d tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.024541 Aug 24 04:39:03.543344 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3669/7066] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:39:03 2022] POST /compute/v2.1/flavors => generated 438 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:03.555838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1114310924"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:03.558078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:03.565182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:03.565773 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:03.566297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:03.567081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:03.567619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:03.568163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:03.723905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '01ca2b50711247bdb1688a4d04f81f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e678ec753b7452fbeb58ac03b2ebecd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:03.733302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1642604723 {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:39:03.744033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:03.744738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:03.745267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:03.746241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:03.746881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:03.747458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:03.769566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Getting quotas for project a3be1237ceba48c9b9191289a0eb9ab5. Resources: {'cores', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:39:03.774878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Getting quotas for user c9963fcc1cb3427588d16110341b7d3b and project a3be1237ceba48c9b9191289a0eb9ab5. Resources: {'cores', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:39:03.788539 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.api [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] ram quota exceeded for 2e678ec753b7452fbeb58ac03b2ebecd, tried to resize instance. Aug 24 04:39:03.789103 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Request method failure captured: Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915/action HTTP/1.1 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 39 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBataAmir47Qf-7Cyv8Y_oEgjM4KQ8JJA2B2mOcdCvfgWXTWr9Ozv_vwfhnQMOg9WIwD4CfgULdNk08k_-R1GuM72vKl-GeZI5vG2uDQUbs56XdjmBvq-vNkGGdPZs6t-fyqjK4Tp6-tuZJxLu-q97QceBs6jdF_gVes3IB-pl0zHpr8 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 2e678ec753b7452fbeb58ac03b2ebecd Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-879284767 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Role: admin,member,reader Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: admin,member,reader Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e678ec753b7452fbeb58ac03b2ebecd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e678ec753b7452fbeb58ac03b2ebecd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e678ec753b7452fbeb58ac03b2ebecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e678ec753b7452fbeb58ac03b2ebecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersAdminNegativeTestJSON-879284767 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 2e678ec753b7452fbeb58ac03b2ebecd Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-879284767 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersAdminNegativeTestJSON-879284767-project-admin Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 01ca2b50711247bdb1688a4d04f81f49 Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersAdminNegativeTestJSON-879284767-project-admin Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: {"resize": {"flavorRef": "1114310924"}} Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '1f584d2e-cbe4-4608-92cc-848c85d75915', 'body': {'resize': {'flavorRef': '1114310924'}}} Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:39:03.791244 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7f69e6cc-5456-4bc5-baf5-2c160f8d4ed0 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915/action" status: 403 len: 118 microversion: 2.1 time: 0.241220 Aug 24 04:39:03.795192 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3398/7067] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:39:03 2022] POST /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915/action => generated 118 bytes in 243 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:39:03.801938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-02361c3a-8375-4d57-aef9-12728987465b tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:03.802711 n-d-846470-15 devstack@n-api.service[122536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:39:03.802711 n-d-846470-15 devstack@n-api.service[122536]: warnings.warn(msg) Aug 24 04:39:03.820751 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-02361c3a-8375-4d57-aef9-12728987465b tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1114310924" status: 202 len: 0 microversion: 2.1 time: 0.022333 Aug 24 04:39:03.821316 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3670/7068] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 04:39:03 2022] DELETE /compute/v2.1/flavors/1114310924 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:39:03.829948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1730bc74-9cd4-4f82-8bbc-c71e133a1087 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:03.851302 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1730bc74-9cd4-4f82-8bbc-c71e133a1087 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025036 Aug 24 04:39:03.851904 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3399/7069] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 04:39:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:03.871816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48871725-10c3-44be-9c62-2fa4b3606401 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Calling method '.version_select at 0x7f1021aec790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:03.943063 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48871725-10c3-44be-9c62-2fa4b3606401 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/2e678ec753b7452fbeb58ac03b2ebecd" status: 200 len: 371 microversion: 2.1 time: 0.074940 Aug 24 04:39:03.943636 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3671/7070] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 24 04:39:03 2022] GET /compute/v2.1/os-quota-sets/2e678ec753b7452fbeb58ac03b2ebecd => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:03.955927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9591145f-affe-4544-999f-24a985bd4718 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-237263170", "id": 1613588995, "os-flavor-access:is_public": "True"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:03.958967 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:39:03.958967 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 04:39:03.976241 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9591145f-affe-4544-999f-24a985bd4718 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024250 Aug 24 04:39:03.976854 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3400/7071] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:39:03 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:03.988799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1613588995"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:03.991093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:03.997502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:03.998220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:03.998689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:03.999387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:03.999863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:04.000286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:04.097178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '01ca2b50711247bdb1688a4d04f81f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e678ec753b7452fbeb58ac03b2ebecd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:04.103903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-237263170 {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:39:04.111178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:04.111651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:04.112110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:04.113101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:04.113551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:04.113969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:04.134009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Getting quotas for project a3be1237ceba48c9b9191289a0eb9ab5. Resources: {'cores', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:39:04.139045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Getting quotas for user c9963fcc1cb3427588d16110341b7d3b and project a3be1237ceba48c9b9191289a0eb9ab5. Resources: {'cores', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:39:04.150947 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.compute.api [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] cores quota exceeded for 2e678ec753b7452fbeb58ac03b2ebecd, tried to resize instance. Aug 24 04:39:04.151480 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Request method failure captured: Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915/action HTTP/1.1 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 39 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBataAmir47Qf-7Cyv8Y_oEgjM4KQ8JJA2B2mOcdCvfgWXTWr9Ozv_vwfhnQMOg9WIwD4CfgULdNk08k_-R1GuM72vKl-GeZI5vG2uDQUbs56XdjmBvq-vNkGGdPZs6t-fyqjK4Tp6-tuZJxLu-q97QceBs6jdF_gVes3IB-pl0zHpr8 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 2e678ec753b7452fbeb58ac03b2ebecd Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-879284767 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Role: admin,member,reader Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: admin,member,reader Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e678ec753b7452fbeb58ac03b2ebecd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e678ec753b7452fbeb58ac03b2ebecd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e678ec753b7452fbeb58ac03b2ebecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e678ec753b7452fbeb58ac03b2ebecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAdminNegativeTestJSON-879284767 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 2e678ec753b7452fbeb58ac03b2ebecd Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-879284767 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAdminNegativeTestJSON-879284767-project-admin Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 01ca2b50711247bdb1688a4d04f81f49 Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAdminNegativeTestJSON-879284767-project-admin Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: {"resize": {"flavorRef": "1613588995"}} Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1f584d2e-cbe4-4608-92cc-848c85d75915', 'body': {'resize': {'flavorRef': '1613588995'}}} Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:39:04.153864 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ddae5015-8a99-4e6a-ad74-76ae473ddc40 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915/action" status: 403 len: 113 microversion: 2.1 time: 0.170358 Aug 24 04:39:04.157719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3672/7072] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:39:03 2022] POST /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915/action => generated 113 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:39:04.164494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04b6b147-e4a4-4ab6-81a5-93283ece05d8 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:04.165256 n-d-846470-15 devstack@n-api.service[122535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:39:04.165256 n-d-846470-15 devstack@n-api.service[122535]: warnings.warn(msg) Aug 24 04:39:04.185462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04b6b147-e4a4-4ab6-81a5-93283ece05d8 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1613588995" status: 202 len: 0 microversion: 2.1 time: 0.024451 Aug 24 04:39:04.186065 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3401/7073] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 24 04:39:04 2022] DELETE /compute/v2.1/flavors/1613588995 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:39:04.194192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14e403bd-3ef9-4ae6-9eef-c8589f2477c7 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:04.215567 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14e403bd-3ef9-4ae6-9eef-c8589f2477c7 tempest-ServersAdminNegativeTestJSON-879284767 tempest-ServersAdminNegativeTestJSON-879284767-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025064 Aug 24 04:39:04.216975 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3673/7074] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 24 04:39:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:39:04.237667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:04.238298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:04.244869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:04.245372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:04.245826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:04.246533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:04.247004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:04.247636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:04.273425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:39:04.369942 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d1618d83-1e9c-4b79-bff7-796586d4dcc6 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 204 len: 0 microversion: 2.1 time: 0.136551 Aug 24 04:39:04.370780 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3402/7075] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:39:04 2022] DELETE /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:04.379335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:04.380020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:04.386240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:04.386723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:04.387166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:04.387925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:04.388609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:04.389037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:04.535139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:04.547267 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f01de7aa-600d-44fc-9d8b-e58644ab8b8a tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1478 microversion: 2.1 time: 0.171595 Aug 24 04:39:04.548178 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3674/7076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:04 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:05.578373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:05.579536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:05.590612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:05.591302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:05.591954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:05.593055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:05.593757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:05.594401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:05.735579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:05.747772 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8738103c-5518-4f55-b88b-f2a934ff9f72 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1478 microversion: 2.1 time: 0.176962 Aug 24 04:39:05.748364 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3403/7077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:05 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1478 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:06.271938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f4ba128f-3dfd-4a8b-aa21-38c97a87ef21 req-0e30d466-0fad-4ed9-a329-d68f39bcdc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f584d2e-cbe4-4608-92cc-848c85d75915", "name": "network-vif-deleted", "tag": "618fbc38-f2d0-4aa7-9221-fa86af3ae18f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:06.283023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f4ba128f-3dfd-4a8b-aa21-38c97a87ef21 req-0e30d466-0fad-4ed9-a329-d68f39bcdc88 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:06.283515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f4ba128f-3dfd-4a8b-aa21-38c97a87ef21 req-0e30d466-0fad-4ed9-a329-d68f39bcdc88 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:06.283980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f4ba128f-3dfd-4a8b-aa21-38c97a87ef21 req-0e30d466-0fad-4ed9-a329-d68f39bcdc88 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:06.296079 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f4ba128f-3dfd-4a8b-aa21-38c97a87ef21 req-0e30d466-0fad-4ed9-a329-d68f39bcdc88 service nova] Creating event network-vif-deleted:618fbc38-f2d0-4aa7-9221-fa86af3ae18f for instance 1f584d2e-cbe4-4608-92cc-848c85d75915 on n-h2-846470-15 Aug 24 04:39:06.302137 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f4ba128f-3dfd-4a8b-aa21-38c97a87ef21 req-0e30d466-0fad-4ed9-a329-d68f39bcdc88 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034046 Aug 24 04:39:06.302812 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3675/7078] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:06.769158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:06.769785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:06.777382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:06.777904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:06.778362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:06.779399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:06.779963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:06.780408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:06.817800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:06.818269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:06.818727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:06.819251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lazy-loading 'fault' on Instance uuid 1f584d2e-cbe4-4608-92cc-848c85d75915 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:39:06.865680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9963fcc1cb3427588d16110341b7d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3be1237ceba48c9b9191289a0eb9ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:06.876053 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-df5fcff1-2ec9-4d0c-93c2-dc4bba2f562b tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 200 len: 1312 microversion: 2.1 time: 0.110763 Aug 24 04:39:06.876922 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3404/7079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:06 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:07.904059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:07.904944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] [instance: 1f584d2e-cbe4-4608-92cc-848c85d75915] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:07.915588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:07.916461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:07.917132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:07.918269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:07.918963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:07.919582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:07.933057 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] HTTP exception thrown: Instance 1f584d2e-cbe4-4608-92cc-848c85d75915 could not be found. Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Request method failure captured: Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 HTTP/1.1 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBatZXRLTH0RkNnqO5HQ02-zBimTCDnLCJS_TwI-kixbVQXGXIANgNPTWYqs9CtqZ87en-8Xl9SX_-a-iNL7NspAvvNWcrwpUrwBySM_pEZwR1tP3U1l0myYiSCnwdqDBA-_5PpNNdZRbYLMxhLUD2DnEDhjFZDo0e5tY2GNB1f_8B-Q Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: a3be1237ceba48c9b9191289a0eb9ab5 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-231544223 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a3be1237ceba48c9b9191289a0eb9ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a3be1237ceba48c9b9191289a0eb9ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a3be1237ceba48c9b9191289a0eb9ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a3be1237ceba48c9b9191289a0eb9ab5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersAdminNegativeTestJSON-231544223 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: a3be1237ceba48c9b9191289a0eb9ab5 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-231544223 Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersAdminNegativeTestJSON-231544223-project Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c9963fcc1cb3427588d16110341b7d3b Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersAdminNegativeTestJSON-231544223-project Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 1f584d2e-cbe4-4608-92cc-848c85d75915 could not be found. Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '1f584d2e-cbe4-4608-92cc-848c85d75915'} Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f584d2e-cbe4-4608-92cc-848c85d75915 could not be found. Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f584d2e-cbe4-4608-92cc-848c85d75915 could not be found. Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:07.934756 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f584d2e-cbe4-4608-92cc-848c85d75915 could not be found. Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] Returning 404 to user: Instance 1f584d2e-cbe4-4608-92cc-848c85d75915 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d9b8be54-a0b6-49ad-8d77-2946724a6d86 tempest-ServersAdminNegativeTestJSON-231544223 tempest-ServersAdminNegativeTestJSON-231544223-project] 10.222.0.58 "GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915" status: 404 len: 111 microversion: 2.1 time: 0.041044 Aug 24 04:39:07.938954 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3676/7080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:07 2022] GET /compute/v2.1/servers/1f584d2e-cbe4-4608-92cc-848c85d75915 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:39:13.939737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:13.941141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:14.068092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1795053672", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "06c3fb26-7f82-4c07-89d4-6e315d6ec201"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:14.124017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] validate_networks() for [('06c3fb26-7f82-4c07-89d4-6e315d6ec201', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:39:14.534632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:39:14.535071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:39:14.535558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:39:14.536008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:39:14.536435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:39:14.545832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:14.546331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:14.546780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:14.547540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:14.548150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:14.548589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:14.566851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Getting quotas for project 9f90ac1a555f44c1b2aa0fc727ab8413. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:39:14.572255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Getting quotas for user 90619480b4154bb28874bb8fabb25d45 and project 9f90ac1a555f44c1b2aa0fc727ab8413. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:39:14.585772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:39:14.588159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:39:14.637198 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f088934-1409-4a75-bd9b-c7a0f21d527f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706310 Aug 24 04:39:14.638045 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3405/7081] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:39:14.649431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-309258b6-c662-441d-8a9a-ba514caee46a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:14.650860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-309258b6-c662-441d-8a9a-ba514caee46a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:14.654377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:14.655076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:14.726144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-309258b6-c662-441d-8a9a-ba514caee46a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:14.734790 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-309258b6-c662-441d-8a9a-ba514caee46a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1215 microversion: 2.1 time: 0.089219 Aug 24 04:39:14.735447 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3677/7082] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:14 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:15.757879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:15.759122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:15.782154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:15.782973 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:15.785064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:15.786107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:15.786741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:15.787343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:15.878075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:15.889434 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e086f3ed-b6cf-4159-a28f-914adb71d8a2 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1285 microversion: 2.1 time: 0.136045 Aug 24 04:39:15.891194 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3406/7083] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:15 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:16.910759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:16.912163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:16.921361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:16.922183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:16.922833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:16.923783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:16.924457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:16.925200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:17.187693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:17.196701 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ee5bf23-d84d-4326-a249-2cf03d95f21f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1315 microversion: 2.1 time: 0.289734 Aug 24 04:39:17.197564 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3678/7084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:16 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:17.517080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-8dae62eb-9bd3-4db2-9c70-072cdfe9ec76 req-e6682dad-adb2-42a0-8822-bb5d177ff6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a8a350-9364-4840-8d3c-49f3c310b624", "tag": "1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:17.528169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8dae62eb-9bd3-4db2-9c70-072cdfe9ec76 req-e6682dad-adb2-42a0-8822-bb5d177ff6bc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:17.528673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8dae62eb-9bd3-4db2-9c70-072cdfe9ec76 req-e6682dad-adb2-42a0-8822-bb5d177ff6bc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:17.529122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-8dae62eb-9bd3-4db2-9c70-072cdfe9ec76 req-e6682dad-adb2-42a0-8822-bb5d177ff6bc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:17.541338 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-8dae62eb-9bd3-4db2-9c70-072cdfe9ec76 req-e6682dad-adb2-42a0-8822-bb5d177ff6bc service nova] Creating event network-changed:1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4 for instance 01a8a350-9364-4840-8d3c-49f3c310b624 on n-h2-846470-15 Aug 24 04:39:17.546426 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-8dae62eb-9bd3-4db2-9c70-072cdfe9ec76 req-e6682dad-adb2-42a0-8822-bb5d177ff6bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033748 Aug 24 04:39:17.547039 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3407/7085] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:18.219958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:18.220482 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:18.227871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:18.228366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:18.228794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:18.229502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:18.229967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:18.230380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:18.369813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:18.378397 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4c395f7c-aee7-4861-b36b-6c1e2b2a8efe tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1315 microversion: 2.1 time: 0.162714 Aug 24 04:39:18.378976 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3679/7086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:18 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:19.404798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:19.405505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:19.412438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:19.412947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:19.413407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:19.414101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:19.414574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:19.415017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:19.548226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:19.556481 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b172351f-d23f-4511-872a-d4cd4e845f6a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1315 microversion: 2.1 time: 0.159805 Aug 24 04:39:19.557036 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3408/7087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:19 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:20.579555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:20.580226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:20.586912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:20.587397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:20.587874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:20.588556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:20.589009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:20.589429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:20.729336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:20.737816 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cd4ebb2b-128e-4167-90da-949cd7afc0a3 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1315 microversion: 2.1 time: 0.163123 Aug 24 04:39:20.738395 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3680/7088] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:20 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:21.758671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:21.759301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:21.762194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:21.768147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:21.768710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:21.769101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:21.769859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:21.770350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:21.770784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:21.774694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:21.915549 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:21.923584 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c3eab6d-3402-4cb6-b5dd-97fcf424a09f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1315 microversion: 2.1 time: 0.168928 Aug 24 04:39:21.924191 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3409/7089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:21 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:22.945043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:22.945608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:22.948353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:22.955284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:22.955830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:22.956282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:22.956989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:22.957439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:22.957856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:22.962245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=74 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:23.107384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:23.115477 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b2e54c74-a283-459f-a970-745763e2bd5e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1315 microversion: 2.1 time: 0.174504 Aug 24 04:39:23.116090 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3681/7090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:22 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:23.530538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-4f3a921d-8945-46d6-85ee-17333e9ac62f req-d6349129-7870-483d-b203-1504b846c41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a8a350-9364-4840-8d3c-49f3c310b624", "name": "network-vif-plugged", "status": "completed", "tag": "1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:23.540854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4f3a921d-8945-46d6-85ee-17333e9ac62f req-d6349129-7870-483d-b203-1504b846c41b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:23.541323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4f3a921d-8945-46d6-85ee-17333e9ac62f req-d6349129-7870-483d-b203-1504b846c41b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:23.542018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-4f3a921d-8945-46d6-85ee-17333e9ac62f req-d6349129-7870-483d-b203-1504b846c41b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:23.554682 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-4f3a921d-8945-46d6-85ee-17333e9ac62f req-d6349129-7870-483d-b203-1504b846c41b service nova] Creating event network-vif-plugged:1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4 for instance 01a8a350-9364-4840-8d3c-49f3c310b624 on n-h2-846470-15 Aug 24 04:39:23.560008 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-4f3a921d-8945-46d6-85ee-17333e9ac62f req-d6349129-7870-483d-b203-1504b846c41b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128687 Aug 24 04:39:23.561310 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3410/7091] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:24.138342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:24.139173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:24.146688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:24.147167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:24.147601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:24.148321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:24.148771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:24.149192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:24.295900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:24.303814 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-851d2820-6379-4dfb-9758-70f9a17a360f tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1315 microversion: 2.1 time: 0.169654 Aug 24 04:39:24.304404 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3682/7092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:24 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:25.324444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:25.325244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:25.330022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:25.330666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:25.337762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:25.338259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:25.338709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:25.339416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:25.339919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:25.340356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:25.505396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:25.514829 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fa876ab2-e29b-418e-82bb-ad83dcb165fd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1502 microversion: 2.1 time: 0.192334 Aug 24 04:39:25.515520 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3411/7093] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:25 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:25.535712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:25.537953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:25.539922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:25.546589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:25.547071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:25.547500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:25.548208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:25.548653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:25.549076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:25.578197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:25.584733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Old instance type m1.heat2, new instance type m1.heat {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:39:25.591702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:39:25.592135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:39:25.592603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:39:25.593008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:39:25.593411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:39:25.673046 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2c7232d4-d09e-4239-9cfc-723db1bdf2df tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "POST /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624/action" status: 202 len: 0 microversion: 2.1 time: 0.141321 Aug 24 04:39:25.673683 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3683/7094] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:39:25 2022] POST /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:39:25.682043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:25.683294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:25.689476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:25.690037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:25.690690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:25.691415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:25.692371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:25.692371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:25.833032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:25.841022 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-005e1ed7-6526-47f4-91d1-4b984108892c tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1511 microversion: 2.1 time: 0.162897 Aug 24 04:39:25.841528 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3412/7095] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:25 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:26.863291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:26.864584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:26.870981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:26.871471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:26.871941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:26.872723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:26.873179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:26.873605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:27.010128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:27.018234 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8fbb284e-2cd0-429d-bae2-9858af2ab518 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1511 microversion: 2.1 time: 0.159998 Aug 24 04:39:27.018792 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3684/7096] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:26 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:28.040150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:28.040777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:28.048025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:28.048569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:28.049029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:28.049705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:28.050179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:28.050618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:28.187934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:28.200121 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a3ea5a20-1d42-4e57-aca4-4ba23be8772d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1511 microversion: 2.1 time: 0.163575 Aug 24 04:39:28.200825 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3413/7097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:28 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:29.222113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:29.222730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:29.230693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:29.231246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:29.232306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:29.233026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:29.233489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:29.233964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:29.384992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:29.393410 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c7c8724-6ff7-4ead-87f7-fce88673a634 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.175635 Aug 24 04:39:29.393992 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3685/7098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:29 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:30.418872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:30.419930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:30.427515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:30.428046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:30.428495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:30.429199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:30.429664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:30.430101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:30.589444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:30.598343 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d077b13-779f-4dbb-bb46-9d41d211a437 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.185719 Aug 24 04:39:30.598957 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3414/7099] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:30 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:31.624197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:31.625159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:31.637032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:31.637866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:31.638873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:31.639592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:31.640074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:31.640506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:31.785658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:31.793673 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c781e31f-4fe3-4c33-acef-bf63ba6e1416 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.176076 Aug 24 04:39:31.794274 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3686/7100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:31 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:32.827350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:32.828359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:32.840405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:32.841247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:32.842122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:32.842961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:32.843444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:32.843921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:32.989757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:32.998076 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24bd0794-de36-4141-823e-511a8d695bfb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.178107 Aug 24 04:39:32.999346 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3415/7101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:32 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:34.024619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:34.025638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:34.037496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:34.038255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:34.038940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:34.040060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:34.040770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:34.041427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:34.185067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:34.194071 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90166779-d565-4e03-9799-b3c185ed49c9 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.175571 Aug 24 04:39:34.194650 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3687/7102] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:34 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:35.221261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:35.221926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:35.229665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:35.230173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:35.230639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:35.231354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:35.231872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:35.232316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:35.389545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:35.398032 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de91fed4-8053-4418-99a7-ff0fa99be284 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.182597 Aug 24 04:39:35.398614 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3416/7103] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:35 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:36.424287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:36.425259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:36.436449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:36.437136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:36.437627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:36.438284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:36.438741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:36.439177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:36.580831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:36.589252 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df868184-dad4-462a-bb2d-b3c3a5ac255e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.171930 Aug 24 04:39:36.589828 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3688/7104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:36 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:37.611141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:37.611799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:37.619115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:37.619627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:37.620109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:37.620826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:37.621301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:37.621743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:37.768810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:37.778776 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a4a2720-cba9-41db-8f96-078c9b686ccf tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.171813 Aug 24 04:39:37.779412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3417/7105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:37 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:38.806057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:38.806885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:38.815256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:38.815771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:38.816202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:38.816899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:38.817353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:38.817777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:38.957003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:38.964900 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-134cbd29-0483-4dc7-bce9-57e85238d804 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.165627 Aug 24 04:39:38.965450 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3689/7106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:38 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:39.992181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:39.992744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:40.003695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:40.004516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:40.005151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:40.005988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:40.006648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:40.007190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:40.146135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:40.154099 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45237466-6930-4dae-9075-48b391a9f784 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.168784 Aug 24 04:39:40.154697 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3418/7107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:39 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:41.186055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:41.186619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:41.194480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:41.194966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:41.195404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:41.196101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:41.196548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:41.196967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:41.347378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:41.355579 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a15733bd-1f7f-4068-a173-c8a17652bbfc tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.175657 Aug 24 04:39:41.356202 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3690/7108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:41 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:42.379159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:42.379768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:42.388542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:42.389835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:42.390545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:42.391437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:42.392346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:42.392997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:42.568302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:42.582774 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0bbae487-3d65-432e-b759-45f343a05bee tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.208493 Aug 24 04:39:42.583635 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3419/7109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:42 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:43.609503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:43.610125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:43.617370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:43.617863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:43.618300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:43.618999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:43.619450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:43.619913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:43.785806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:43.793763 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6f8e0296-a0fa-4db7-8da0-b26e1b533fab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.190145 Aug 24 04:39:43.794337 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3691/7110] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:43 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:44.815203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:44.815871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:44.823134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:44.823985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:44.824436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:44.825149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:44.825618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:44.826064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:44.957361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:44.965561 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-85de2e1b-ed42-49f7-98b6-525a32093b96 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.154759 Aug 24 04:39:44.966279 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3420/7111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:44 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:45.992195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:45.993389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:46.005050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:46.005837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:46.006570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:46.007750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:46.008499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:46.009196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:46.166350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:46.175506 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b09ec6b2-2812-464b-9d05-6812f42c9afd tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.189777 Aug 24 04:39:46.176175 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3692/7112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:45 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:47.204154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:47.204753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:47.211931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:47.212457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:47.212905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:47.213606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:47.214080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:47.214521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:47.360006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:47.370544 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-82cf453f-414d-48bf-8ff0-4a508fdf467d tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.172399 Aug 24 04:39:47.371214 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3421/7113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:47 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:48.396989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:48.397704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:48.406170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:48.406639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:48.407102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:48.407836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:48.408295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:48.408723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:48.559345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:48.568586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0ba57da4-5720-47ee-ba74-bfc63a7fa8a7 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.178657 Aug 24 04:39:48.569164 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3693/7114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:48 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:49.603499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:49.604570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:49.612674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:49.613226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:49.613688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:49.614450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:49.614978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:49.615456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:49.766229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:49.774465 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dcb06409-3dab-4db0-a092-94765c1c49ba tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.176934 Aug 24 04:39:49.774974 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3422/7115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:49 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:50.796283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:50.796890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:50.804189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:50.804668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:50.805102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:50.805785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:50.806234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:50.806650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:51.224497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:51.232321 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7fa428c4-a100-4b70-ac91-9cb6ce391a7a tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.440101 Aug 24 04:39:51.233093 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3694/7116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:50 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:52.264670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:52.265331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:52.268169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=28 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.273568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:52.274073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:52.274511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:52.275223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:52.275701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:52.276165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:52.278931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=80 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.418363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:52.429197 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de3ec0d2-39d1-4c9e-851b-3d6a7671c341 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.168963 Aug 24 04:39:52.430358 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3423/7117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:52 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:53.458024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:53.458678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:53.461014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=32 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.467913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:53.468610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:53.469075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:53.470425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:53.471100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:53.471920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:53.475098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.620633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:53.632336 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14249cfc-96ec-48c4-8a1a-93a32fc6afa5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.181727 Aug 24 04:39:53.633103 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3695/7118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:53 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:54.657992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:54.658597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:54.666089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:54.666597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:54.667052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:54.667815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:54.668291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:54.668738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:54.818161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:54.827219 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cdbc3ffa-26ee-4347-8e2f-08b942511fd5 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1516 microversion: 2.1 time: 0.174286 Aug 24 04:39:54.827838 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3424/7119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:54 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:55.577655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-09b41b92-c20a-437f-9aca-6d601ce53b29 req-2a0043ed-3ba9-41c6-a119-196d4e958816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a8a350-9364-4840-8d3c-49f3c310b624", "name": "network-vif-unplugged", "status": "completed", "tag": "1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:55.587198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-09b41b92-c20a-437f-9aca-6d601ce53b29 req-2a0043ed-3ba9-41c6-a119-196d4e958816 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:55.587759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-09b41b92-c20a-437f-9aca-6d601ce53b29 req-2a0043ed-3ba9-41c6-a119-196d4e958816 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:55.588126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-09b41b92-c20a-437f-9aca-6d601ce53b29 req-2a0043ed-3ba9-41c6-a119-196d4e958816 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:55.599948 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-09b41b92-c20a-437f-9aca-6d601ce53b29 req-2a0043ed-3ba9-41c6-a119-196d4e958816 service nova] Creating event network-vif-unplugged:1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4 for instance 01a8a350-9364-4840-8d3c-49f3c310b624 on n-h1-846470-15 Aug 24 04:39:55.605805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-09b41b92-c20a-437f-9aca-6d601ce53b29 req-2a0043ed-3ba9-41c6-a119-196d4e958816 service nova] Instance 01a8a350-9364-4840-8d3c-49f3c310b624 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:39:55.616789 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-09b41b92-c20a-437f-9aca-6d601ce53b29 req-2a0043ed-3ba9-41c6-a119-196d4e958816 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111489 Aug 24 04:39:55.617378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3696/7120] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:55.848452 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:55.849077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:55.856312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:55.856829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:55.857359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:55.858266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:55.858953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:55.859398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:56.079179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:56.088124 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c19dd88-53e2-43ec-aebd-8da004b73e9e tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1515 microversion: 2.1 time: 0.243637 Aug 24 04:39:56.088726 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3425/7121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:55 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:57.112628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:57.113315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:57.120016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:57.120496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:57.120928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:57.121614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:57.122075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:57.122495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:57.264935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:57.273393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-39096dff-8ec3-4ef3-b333-7ad6488533b8 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1513 microversion: 2.1 time: 0.166363 Aug 24 04:39:57.273944 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3697/7122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:57 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:57.649031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9651da5f-127e-493a-8b44-392aef6b76c5 req-8c946d45-9f31-4147-a337-da02e08f2035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a8a350-9364-4840-8d3c-49f3c310b624", "tag": "1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:39:57.662841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9651da5f-127e-493a-8b44-392aef6b76c5 req-8c946d45-9f31-4147-a337-da02e08f2035 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:57.663340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9651da5f-127e-493a-8b44-392aef6b76c5 req-8c946d45-9f31-4147-a337-da02e08f2035 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:57.663828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9651da5f-127e-493a-8b44-392aef6b76c5 req-8c946d45-9f31-4147-a337-da02e08f2035 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:57.676634 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9651da5f-127e-493a-8b44-392aef6b76c5 req-8c946d45-9f31-4147-a337-da02e08f2035 service nova] Creating event network-changed:1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4 for instance 01a8a350-9364-4840-8d3c-49f3c310b624 on n-h1-846470-15 Aug 24 04:39:57.682941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-9651da5f-127e-493a-8b44-392aef6b76c5 req-8c946d45-9f31-4147-a337-da02e08f2035 service nova] Instance 01a8a350-9364-4840-8d3c-49f3c310b624 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:39:57.695537 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9651da5f-127e-493a-8b44-392aef6b76c5 req-8c946d45-9f31-4147-a337-da02e08f2035 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053848 Aug 24 04:39:57.696606 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3426/7123] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:39:58.298822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:58.299811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:58.310767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:58.311356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:58.311830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:58.312671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:58.313128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:58.313582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:58.462194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:58.473300 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c04c0412-3f1b-4b34-aca3-522d980be102 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1513 microversion: 2.1 time: 0.180958 Aug 24 04:39:58.473889 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3698/7124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:58 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:59.496047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:39:59.496759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:39:59.503703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:59.504238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:59.504690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:59.505409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:39:59.506470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:39:59.506936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:39:59.735640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:39:59.745568 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea06b409-8676-4023-ad3e-5256784a3513 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1513 microversion: 2.1 time: 0.254772 Aug 24 04:39:59.746573 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3427/7125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:39:59 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:00.767565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:00.768217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:00.775201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:00.775722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:00.776196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:00.776928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:00.777388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:00.777815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:00.919878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:00.928209 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-519c8ce5-7644-4d5e-9b1b-c27e774805ce tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1510 microversion: 2.1 time: 0.165403 Aug 24 04:40:00.928828 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3699/7126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:00 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:00.949117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:00.949664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:00.957336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:00.957843 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:00.958297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:00.959009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:00.959480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:00.959946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:00.986880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:40:01.049417 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.compute.api [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Found an unconfirmed migration during delete, id: 16, status: finished Aug 24 04:40:02.487581 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f59c1d91-e810-45b7-a50d-9757858c5658 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "DELETE /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 204 len: 0 microversion: 2.1 time: 1.542489 Aug 24 04:40:02.488582 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3428/7127] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:40:00 2022] DELETE /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 0 bytes in 1544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:02.496132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-27895f8a-e9b6-43c8-8550-f1f5cfa5f902 req-e3e9ab27-b842-4bd9-920c-26374293a811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a8a350-9364-4840-8d3c-49f3c310b624", "name": "network-vif-plugged", "status": "completed", "tag": "1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:40:02.497407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:02.498764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:02.506925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:02.507451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:02.508189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:02.508858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:02.509346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:02.509776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:02.514692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-27895f8a-e9b6-43c8-8550-f1f5cfa5f902 req-e3e9ab27-b842-4bd9-920c-26374293a811 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:02.515176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-27895f8a-e9b6-43c8-8550-f1f5cfa5f902 req-e3e9ab27-b842-4bd9-920c-26374293a811 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:02.515601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-27895f8a-e9b6-43c8-8550-f1f5cfa5f902 req-e3e9ab27-b842-4bd9-920c-26374293a811 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:02.528893 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-27895f8a-e9b6-43c8-8550-f1f5cfa5f902 req-e3e9ab27-b842-4bd9-920c-26374293a811 service nova] Creating event network-vif-plugged:1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4 for instance 01a8a350-9364-4840-8d3c-49f3c310b624 on n-h1-846470-15 Aug 24 04:40:02.534791 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-27895f8a-e9b6-43c8-8550-f1f5cfa5f902 req-e3e9ab27-b842-4bd9-920c-26374293a811 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046503 Aug 24 04:40:02.535395 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3700/7128] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:40:02.644982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:02.656158 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07e8103b-8af6-453c-9eab-73a4f6f08e7b tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1502 microversion: 2.1 time: 0.163190 Aug 24 04:40:02.656745 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3429/7129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:02 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:03.688008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:03.688693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:03.695446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:03.695963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:03.696424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:03.697123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:03.697588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:03.698012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:03.860084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90619480b4154bb28874bb8fabb25d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f90ac1a555f44c1b2aa0fc727ab8413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:03.868069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac44fdfd-e19b-472d-8163-b81d5203e2ab tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 200 len: 1502 microversion: 2.1 time: 0.186023 Aug 24 04:40:03.868667 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3701/7130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:03 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:04.588425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-3baab3f5-cf77-4ae7-bd95-8f73ed067968 req-c775c1ef-25ce-4eb0-ac4b-d8360f510655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a8a350-9364-4840-8d3c-49f3c310b624", "name": "network-vif-deleted", "tag": "1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:40:04.602893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3baab3f5-cf77-4ae7-bd95-8f73ed067968 req-c775c1ef-25ce-4eb0-ac4b-d8360f510655 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:04.603295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3baab3f5-cf77-4ae7-bd95-8f73ed067968 req-c775c1ef-25ce-4eb0-ac4b-d8360f510655 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:04.603775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-3baab3f5-cf77-4ae7-bd95-8f73ed067968 req-c775c1ef-25ce-4eb0-ac4b-d8360f510655 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:04.616200 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-3baab3f5-cf77-4ae7-bd95-8f73ed067968 req-c775c1ef-25ce-4eb0-ac4b-d8360f510655 service nova] Creating event network-vif-deleted:1e47029f-32a0-4e6a-8d4a-c3b3df16e7a4 for instance 01a8a350-9364-4840-8d3c-49f3c310b624 on n-h1-846470-15 Aug 24 04:40:04.621555 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-3baab3f5-cf77-4ae7-bd95-8f73ed067968 req-c775c1ef-25ce-4eb0-ac4b-d8360f510655 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036873 Aug 24 04:40:04.622650 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3430/7131] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:40:04.891176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:04.891754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:04.898356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:04.898839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:04.899269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:04.899998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:04.900454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:04.900876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:04.914342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] HTTP exception thrown: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Request method failure captured: Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 HTTP/1.1 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBatx2_CsUCGbqxT7SIaX53LupOTAOwsDE35ZbbH_iNnZ40y_cPBm_nfqUZPqqH5xQN4jsTR2It2WQPK_dANJu1CIkyOfDBDzHPr33dj7PgiXdZFU8qpD-Pc0PLNH-LYUT6vCHtbJJq316a1p0uWs97cMtIlGEGOVHQxK5bSOXobNW_0 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9f90ac1a555f44c1b2aa0fc727ab8413 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9f90ac1a555f44c1b2aa0fc727ab8413 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-179382558-project Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 90619480b4154bb28874bb8fabb25d45 Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-179382558-project Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '01a8a350-9364-4840-8d3c-49f3c310b624'} Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:40:04.916087 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Returning 404 to user: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-95048c55-0416-4cec-8a91-a900d4199ceb tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 404 len: 111 microversion: 2.1 time: 0.031577 Aug 24 04:40:04.920038 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3702/7132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:04 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:40:04.934265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:04.934911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:04.942067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:04.942578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:04.943037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:04.943785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:04.944263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:04.944715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:04.961774 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] HTTP exception thrown: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Request method failure captured: Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 HTTP/1.1 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBatx2_CsUCGbqxT7SIaX53LupOTAOwsDE35ZbbH_iNnZ40y_cPBm_nfqUZPqqH5xQN4jsTR2It2WQPK_dANJu1CIkyOfDBDzHPr33dj7PgiXdZFU8qpD-Pc0PLNH-LYUT6vCHtbJJq316a1p0uWs97cMtIlGEGOVHQxK5bSOXobNW_0 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9f90ac1a555f44c1b2aa0fc727ab8413 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9f90ac1a555f44c1b2aa0fc727ab8413 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-DeleteServersTestJSON-179382558-project Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 90619480b4154bb28874bb8fabb25d45 Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-DeleteServersTestJSON-179382558-project Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '01a8a350-9364-4840-8d3c-49f3c310b624'} Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:40:04.963458 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Returning 404 to user: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-939612db-2d2c-4fe8-a912-b4370de22318 tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "DELETE /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 404 len: 111 microversion: 2.1 time: 0.035097 Aug 24 04:40:04.968199 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3431/7133] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:40:04 2022] DELETE /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:40:04.974321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:04.974925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] [instance: 01a8a350-9364-4840-8d3c-49f3c310b624] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:04.981516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:04.982037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:04.982492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:04.983191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:04.984035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:04.984514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:05.000115 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] HTTP exception thrown: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Request method failure captured: Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 HTTP/1.1 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBatx2_CsUCGbqxT7SIaX53LupOTAOwsDE35ZbbH_iNnZ40y_cPBm_nfqUZPqqH5xQN4jsTR2It2WQPK_dANJu1CIkyOfDBDzHPr33dj7PgiXdZFU8qpD-Pc0PLNH-LYUT6vCHtbJJq316a1p0uWs97cMtIlGEGOVHQxK5bSOXobNW_0 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9f90ac1a555f44c1b2aa0fc727ab8413 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9f90ac1a555f44c1b2aa0fc727ab8413"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9f90ac1a555f44c1b2aa0fc727ab8413 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-DeleteServersTestJSON-179382558 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-DeleteServersTestJSON-179382558-project Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 90619480b4154bb28874bb8fabb25d45 Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-DeleteServersTestJSON-179382558-project Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '01a8a350-9364-4840-8d3c-49f3c310b624'} Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:40:05.001695 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] Returning 404 to user: Instance 01a8a350-9364-4840-8d3c-49f3c310b624 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c31526a2-6c43-4c90-9e55-1b70a3a064ae tempest-DeleteServersTestJSON-179382558 tempest-DeleteServersTestJSON-179382558-project] 10.222.0.58 "GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624" status: 404 len: 111 microversion: 2.1 time: 0.032757 Aug 24 04:40:05.005608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3703/7134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:04 2022] GET /compute/v2.1/servers/01a8a350-9364-4840-8d3c-49f3c310b624 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:40:13.929630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1629219186", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "e3ebb231-4694-4f6a-a448-ee519cbd1d3b"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:40:13.986632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] validate_networks() for [('e3ebb231-4694-4f6a-a448-ee519cbd1d3b', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:40:14.368436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:40:14.368873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:40:14.370529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:40:14.371105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:40:14.371558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:40:14.385083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:14.385795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:14.386456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:14.387638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:14.388444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:14.389313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:14.406074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Getting quotas for project 1f48576354da4788b3d6573065b8c92b. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:40:14.411415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Getting quotas for user daa686206116464f84fd49ad5c9a21e3 and project 1f48576354da4788b3d6573065b8c92b. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:40:14.425208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:40:14.427576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:40:14.479339 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8a9b025c-41ea-4e68-b6a3-f2e65ccf4744 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674087 Aug 24 04:40:14.480221 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3432/7135] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:40:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:40:14.492077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e4c92030-fcba-4479-b0eb-4713ca97ea0c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:14.492719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e4c92030-fcba-4479-b0eb-4713ca97ea0c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:14.569911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e4c92030-fcba-4479-b0eb-4713ca97ea0c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:14.579489 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e4c92030-fcba-4479-b0eb-4713ca97ea0c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1218 microversion: 2.1 time: 0.091451 Aug 24 04:40:14.580116 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3704/7136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:14 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:15.603517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:15.604132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:15.613455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:15.614559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:15.615644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:15.616625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:15.617277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:15.617902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:15.734398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:15.745161 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4b8524a-fd23-4cc2-ba4c-004d71835773 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1278 microversion: 2.1 time: 0.146446 Aug 24 04:40:15.745816 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3433/7137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:15 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:16.769578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:16.770197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:16.772497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=39 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:16.779942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:16.780443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:16.780895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:16.781648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:16.782107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:16.782536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:16.921943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:16.930730 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92d40c33-2e00-4710-8c62-d8df2a846437 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.164948 Aug 24 04:40:16.931552 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3705/7138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:16 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:17.045764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9c5c92b6-2251-425a-b919-10a1f72aebca req-5183a0e1-6791-4df7-968f-4c5ca2989240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ecb26e-7f95-498e-8274-003c8eab46f3", "tag": "a2ed3dbd-468d-4050-9b99-3e280d076863"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:40:17.056855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9c5c92b6-2251-425a-b919-10a1f72aebca req-5183a0e1-6791-4df7-968f-4c5ca2989240 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:17.057362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9c5c92b6-2251-425a-b919-10a1f72aebca req-5183a0e1-6791-4df7-968f-4c5ca2989240 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:17.057804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9c5c92b6-2251-425a-b919-10a1f72aebca req-5183a0e1-6791-4df7-968f-4c5ca2989240 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:17.075747 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9c5c92b6-2251-425a-b919-10a1f72aebca req-5183a0e1-6791-4df7-968f-4c5ca2989240 service nova] Creating event network-changed:a2ed3dbd-468d-4050-9b99-3e280d076863 for instance 14ecb26e-7f95-498e-8274-003c8eab46f3 on n-h1-846470-15 Aug 24 04:40:17.081563 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9c5c92b6-2251-425a-b919-10a1f72aebca req-5183a0e1-6791-4df7-968f-4c5ca2989240 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039915 Aug 24 04:40:17.082802 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3434/7139] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:40:17.953357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:17.953947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:17.961144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:17.961633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:17.962076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:17.962773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:17.963223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:17.963651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:18.105478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:18.114097 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32e12344-56a9-4727-8331-d1d5caf860d4 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.164707 Aug 24 04:40:18.114683 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3706/7140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:17 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:19.142272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:19.143442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:19.154654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:19.155446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:19.156181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:19.157722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:19.158209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:19.158654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:19.306136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:19.314137 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f578036f-db88-4587-bd95-18d2bd758d9b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.181523 Aug 24 04:40:19.314715 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3435/7141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:19 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:20.339356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:20.340374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:20.351973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:20.352808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:20.353488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:20.354637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:20.355397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:20.356108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:20.490568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:20.499120 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-52f2f192-85e6-45a1-8f53-a44c85c301dd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.166297 Aug 24 04:40:20.499711 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3707/7142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:20 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:21.522612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:21.523313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:21.532255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:21.532771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:21.533236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:21.533966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:21.534446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:21.534893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:21.672414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:21.680718 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a752f4c-1ee8-4d1a-9e25-2b9cd2f56e70 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.163528 Aug 24 04:40:21.681257 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3436/7143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:21 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:22.702196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:22.702795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:22.710499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:22.710972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:22.711427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:22.712140 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:22.712598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:22.713024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:22.862074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:22.870136 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7e8fccd-cbb0-4dfa-9b96-446ccb609817 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.172217 Aug 24 04:40:22.870724 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3708/7144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:22 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:23.891989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:23.892553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:23.895340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:23.901064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:23.901588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:23.902015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:23.902726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:23.903228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:23.903689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:23.907707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:24.058367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:24.068076 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0f89ca8a-9b11-48da-abf0-4ba5c064c5af tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.180146 Aug 24 04:40:24.068873 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3437/7145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:23 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:24.606525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-932ed970-bbb4-4dab-acc9-c76a0e87507c req-49a3cab0-70f0-4929-b721-80386d00abf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ecb26e-7f95-498e-8274-003c8eab46f3", "name": "network-vif-plugged", "status": "completed", "tag": "a2ed3dbd-468d-4050-9b99-3e280d076863"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:40:24.612333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:24.612964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=30 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:24.620257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-932ed970-bbb4-4dab-acc9-c76a0e87507c req-49a3cab0-70f0-4929-b721-80386d00abf9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:24.620718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-932ed970-bbb4-4dab-acc9-c76a0e87507c req-49a3cab0-70f0-4929-b721-80386d00abf9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:24.621314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-932ed970-bbb4-4dab-acc9-c76a0e87507c req-49a3cab0-70f0-4929-b721-80386d00abf9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:24.632542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-932ed970-bbb4-4dab-acc9-c76a0e87507c req-49a3cab0-70f0-4929-b721-80386d00abf9 service nova] Creating event network-vif-plugged:a2ed3dbd-468d-4050-9b99-3e280d076863 for instance 14ecb26e-7f95-498e-8274-003c8eab46f3 on n-h1-846470-15 Aug 24 04:40:24.637832 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-932ed970-bbb4-4dab-acc9-c76a0e87507c req-49a3cab0-70f0-4929-b721-80386d00abf9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035079 Aug 24 04:40:24.638405 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3709/7146] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:40:25.094517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:25.095149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:25.097067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:25.097708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:25.104559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:25.105065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:25.105520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:25.106211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:25.106680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:25.107140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:25.260349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:25.268540 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1bfd22ec-ec78-4ec6-9fed-1eb7f9ffb24c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.180472 Aug 24 04:40:25.269125 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3438/7147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:25 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:26.292374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:26.293087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:26.299986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:26.300475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:26.300908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:26.301643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:26.302096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:26.302519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:26.446567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:26.455857 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05fd778f-4ca3-45c7-bc23-94bd185ff73a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1318 microversion: 2.1 time: 0.168549 Aug 24 04:40:26.456496 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3710/7148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:26 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:27.477516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:27.478079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:27.485531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:27.486032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:27.486493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:27.487192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:27.487684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:27.488159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:27.649923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:27.657900 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba892a2b-9ca2-4af3-b0c4-582a3b7ecfc8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1507 microversion: 2.1 time: 0.184426 Aug 24 04:40:27.658494 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3439/7149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:27 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:27.679374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:27.680016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:27.687378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:27.688100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:27.688832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:27.689525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:27.690270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:27.690270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:27.838269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:27.846929 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-35c5c577-c2b3-40d3-9a32-4e4f887de1cb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1507 microversion: 2.1 time: 0.171509 Aug 24 04:40:27.847504 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3711/7150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:27 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:27.872697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:40:27.875151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:27.881661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:27.882167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:27.882619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:27.883331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:27.883838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:27.884284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:27.962354 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b2897bf-b9c6-4487-8b3a-899e667a0cc6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "PUT /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1079 microversion: 2.1 time: 0.093275 Aug 24 04:40:27.963266 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3440/7151] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 24 04:40:27 2022] PUT /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1079 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:27.984491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:27.985270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:27.991921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:27.992467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:27.992947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:27.993717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:27.994229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:27.994711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:28.138978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:28.151027 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d78089ba-aac4-43f2-a791-787351364988 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1505 microversion: 2.1 time: 0.172910 Aug 24 04:40:28.151813 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3712/7152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:27 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:28.173078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:28.173744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:28.180278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:28.180781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:28.181236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:28.181948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:28.182424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:28.182872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:28.329553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:28.337634 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8f805689-1b84-4d0a-a00e-650880b7b618 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1505 microversion: 2.1 time: 0.168643 Aug 24 04:40:28.338220 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3441/7153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:28 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:28.360976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:40:28.363420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:28.370245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:28.370903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:28.371492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:28.372317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:28.372826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:28.373315 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:28.406159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:28.413137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:40:28.420430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:40:28.420913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:40:28.421417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:40:28.421905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:40:28.422370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:40:28.498639 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-002ece5d-b95f-425a-b877-bf085912102e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "POST /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3/action" status: 202 len: 0 microversion: 2.1 time: 0.142015 Aug 24 04:40:28.499300 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3713/7154] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:40:28 2022] POST /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:40:28.508241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:28.508836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:28.517256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:28.517848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:28.518299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:28.519023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:28.519493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:28.520011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:28.651369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:28.659363 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ffcb020d-750c-494d-99a1-3223218615cc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1516 microversion: 2.1 time: 0.154940 Aug 24 04:40:28.659950 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3442/7155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:28 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:29.685103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:29.685910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:29.695185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:29.695690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:29.696135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:29.696819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:29.697270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:29.697693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:29.845259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:29.853619 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ea8bf768-b6ce-44dd-9433-282b1db5535c tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1516 microversion: 2.1 time: 0.175285 Aug 24 04:40:29.854203 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3714/7156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:29 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:30.876371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:30.877114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:30.885851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:30.886448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:30.886985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:30.887867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:30.888430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:30.888958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:31.049385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:31.057564 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f4b28da-79d6-4afc-a177-e47d1d1a1333 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.186126 Aug 24 04:40:31.058137 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3443/7157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:30 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:32.080276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:32.081204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:32.091747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:32.092480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:32.093103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:32.094060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:32.094520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:32.094953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:32.248752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:32.261077 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-83e721fe-d871-4831-a604-3b18037907df tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.185440 Aug 24 04:40:32.261946 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3715/7158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:32 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:33.286222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:33.286892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:33.294834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:33.295361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:33.295879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:33.296628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:33.297303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:33.297835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:33.450766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:33.462745 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-92d313fe-5742-4e42-be64-3e30e1078792 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.180680 Aug 24 04:40:33.463476 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3444/7159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:33 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:34.487602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:34.488196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:34.494978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:34.495465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:34.495933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:34.496629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:34.497083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:34.497508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:34.645915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:34.654467 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-587d95cc-14ec-4843-8f49-6963723fb64b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.172152 Aug 24 04:40:34.655295 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3716/7160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:34 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:35.682903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:35.683851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:35.691417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:35.691970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:35.692418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:35.693135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:35.693610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:35.694054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:35.838444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:35.846527 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dcd9e3e6-a5f7-4d39-b09d-2955dafe9406 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.167672 Aug 24 04:40:35.847146 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3445/7161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:35 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:36.869925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:36.870678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:36.879227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:36.879891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:36.880449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:36.881326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:36.881903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:36.882452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:37.020706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:37.028922 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-54bf4fb2-abd7-4a7a-92f1-3ce4d531505f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.164237 Aug 24 04:40:37.029501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3717/7162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:36 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:38.049979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:38.050640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:38.058301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:38.058832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:38.059312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:38.060054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:38.060837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:38.061312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:38.208884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:38.218499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c0905f4c-1076-4d63-8169-b86f691a0304 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.172620 Aug 24 04:40:38.219122 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3446/7163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:38 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:39.242591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:39.243607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:39.254877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:39.255609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:39.256212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:39.257151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:39.257776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:39.258366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:39.390768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:39.398646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-656a2db6-b89f-4914-ad64-cca62b7f9761 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.161434 Aug 24 04:40:39.399222 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3718/7164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:39 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:40.422944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:40.423761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:40.434675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:40.435572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:40.436312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:40.438175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:40.438175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:40.438362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:40.578688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:40.586531 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fcf2e91f-0f62-4b23-831e-a91dab73e664 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.169656 Aug 24 04:40:40.587131 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3447/7165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:40 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:41.612451 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:41.613495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:41.624973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:41.625582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:41.626049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:41.626746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:41.627205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:41.627612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:41.783454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:41.794025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-08ad0726-516b-45ce-b293-582e6d674e31 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.188065 Aug 24 04:40:41.794698 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3719/7166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:41 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:42.827329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:42.828785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:42.835906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:42.836417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:42.836873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:42.837594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:42.838065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:42.838515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:42.999131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:43.011820 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3108f603-c063-4d5e-afd4-99bcc2373a24 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.192244 Aug 24 04:40:43.012640 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3448/7167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:42 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:44.035065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:44.035618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:44.043649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:44.044371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:44.044894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:44.045686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:44.046136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:44.046708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:44.189463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:44.193089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:44.199709 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-73447451-087a-4ea1-b8f1-a763578777da tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.168868 Aug 24 04:40:44.200318 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3720/7168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:44 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:45.225168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:45.226209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:45.236931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:45.237435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:45.237886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:45.238595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:45.239065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:45.239505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:45.401234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:45.410808 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a6df0189-b3d0-41e8-a928-71761a0904cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.192336 Aug 24 04:40:45.411388 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3449/7169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:45 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:46.435305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:46.436013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:46.444443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:46.444946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:46.445368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:46.446070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:46.446523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:46.446956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:46.586923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:46.595456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bab772bc-a7fd-4e02-9dcf-c35b44967e7e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.165634 Aug 24 04:40:46.596106 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3721/7170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:46 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:47.626131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:47.626750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:47.634229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:47.634734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:47.635186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:47.635939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:47.636407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:47.636851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:47.780636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:47.789166 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-64f31c0d-436a-493c-abe6-4bf3a6bb10a8 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.169188 Aug 24 04:40:47.789746 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3450/7171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:47 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:48.812150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:48.813622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:48.821722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:48.822292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:48.822808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:48.823987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:48.824523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:48.825026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:48.977462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:48.988462 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7af6ff46-427a-4caa-9007-740bc92343fd tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.180962 Aug 24 04:40:48.989061 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3722/7172] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:48 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:50.017788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:50.018838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:50.030580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:50.031740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:50.032134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:50.032852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:50.033323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:50.033763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:50.191834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:50.203745 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-712e39de-e3e6-4310-9f43-eec0ce513271 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.193382 Aug 24 04:40:50.204353 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3451/7173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:50 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:51.229226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:51.230251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:51.239311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:51.239848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:51.240295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:51.240997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:51.241464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:51.241898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:51.396149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:51.407383 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-69c80578-69b3-4628-bbba-b80348bab14a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.184873 Aug 24 04:40:51.408045 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3723/7174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:51 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:52.428829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:52.429480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:52.436541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:52.437053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:52.437987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:52.438270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:52.438747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:52.439192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:52.605368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:52.613997 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4c90fe38-87f7-4046-af90-637875ff318e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.189199 Aug 24 04:40:52.614578 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3452/7175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:52 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:53.637332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:53.638084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:53.647792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:53.648440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:53.649015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:53.649938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:53.650707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:53.651183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:53.813134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:53.821580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de5ccf20-0ed6-4334-9ac2-1c3a76515ec5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.189483 Aug 24 04:40:53.822192 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3724/7176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:53 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:54.845606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:54.846365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:54.849712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=32 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:54.857501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:54.858122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:54.858713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:54.859610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:54.860136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:54.860552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:54.863333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:55.011642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:55.020303 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-78fb4d0e-6acb-4e44-9727-66108eec388f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.179639 Aug 24 04:40:55.021184 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3453/7177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:54 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:56.044703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:56.045393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:56.049170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=36 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:56.056641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:56.057293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:56.057876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:56.058802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:56.059395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:56.060002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:56.197722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:56.206795 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0525acf-bc98-4600-bbe1-3c2134b2aef0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.167779 Aug 24 04:40:56.207421 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3725/7178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:56 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:57.232317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:57.233111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:57.240813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:57.241318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:57.241748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:57.242492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:57.242969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:57.243418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:57.418967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:57.430852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7544ccd7-2079-4281-8a7c-2eb5cae7b857 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1521 microversion: 2.1 time: 0.204325 Aug 24 04:40:57.431623 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3454/7179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:57 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:58.131544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e84bcad7-2be6-411b-a2a7-2f954da05413 req-654b154d-a695-46ca-8681-3a6382e8d0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ecb26e-7f95-498e-8274-003c8eab46f3", "name": "network-vif-unplugged", "status": "completed", "tag": "a2ed3dbd-468d-4050-9b99-3e280d076863"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:40:58.142515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e84bcad7-2be6-411b-a2a7-2f954da05413 req-654b154d-a695-46ca-8681-3a6382e8d0d4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:58.143330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e84bcad7-2be6-411b-a2a7-2f954da05413 req-654b154d-a695-46ca-8681-3a6382e8d0d4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:58.143966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e84bcad7-2be6-411b-a2a7-2f954da05413 req-654b154d-a695-46ca-8681-3a6382e8d0d4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:58.157592 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e84bcad7-2be6-411b-a2a7-2f954da05413 req-654b154d-a695-46ca-8681-3a6382e8d0d4 service nova] Creating event network-vif-unplugged:a2ed3dbd-468d-4050-9b99-3e280d076863 for instance 14ecb26e-7f95-498e-8274-003c8eab46f3 on n-h2-846470-15 Aug 24 04:40:58.163583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-e84bcad7-2be6-411b-a2a7-2f954da05413 req-654b154d-a695-46ca-8681-3a6382e8d0d4 service nova] Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:40:58.175537 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e84bcad7-2be6-411b-a2a7-2f954da05413 req-654b154d-a695-46ca-8681-3a6382e8d0d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117052 Aug 24 04:40:58.176229 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3726/7180] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:40:58.453092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:58.453939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:58.461082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:58.461571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:58.462014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:58.462719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:58.463186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:58.463623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:58.602887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:58.611462 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc61754a-1df7-4350-b1e1-458a8901b331 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1520 microversion: 2.1 time: 0.162857 Aug 24 04:40:58.612089 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3455/7181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:58 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:59.634419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:40:59.635120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:40:59.641825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:59.642308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:59.642740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:59.643428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:40:59.643917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:40:59.644340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:40:59.782619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:40:59.791055 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9f0c109d-e692-44cd-9ce0-a5a4adb7b53a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1518 microversion: 2.1 time: 0.161840 Aug 24 04:40:59.791698 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3727/7182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:40:59 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:00.191756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-dfc702aa-8a91-4bc4-9c5f-bd929996f7e0 req-b5e336b0-b814-4e7f-967a-6ad0d079ab5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ecb26e-7f95-498e-8274-003c8eab46f3", "tag": "a2ed3dbd-468d-4050-9b99-3e280d076863"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:00.203376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dfc702aa-8a91-4bc4-9c5f-bd929996f7e0 req-b5e336b0-b814-4e7f-967a-6ad0d079ab5d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:00.203900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dfc702aa-8a91-4bc4-9c5f-bd929996f7e0 req-b5e336b0-b814-4e7f-967a-6ad0d079ab5d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:00.204352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-dfc702aa-8a91-4bc4-9c5f-bd929996f7e0 req-b5e336b0-b814-4e7f-967a-6ad0d079ab5d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:00.216875 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-dfc702aa-8a91-4bc4-9c5f-bd929996f7e0 req-b5e336b0-b814-4e7f-967a-6ad0d079ab5d service nova] Creating event network-changed:a2ed3dbd-468d-4050-9b99-3e280d076863 for instance 14ecb26e-7f95-498e-8274-003c8eab46f3 on n-h2-846470-15 Aug 24 04:41:00.222827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-dfc702aa-8a91-4bc4-9c5f-bd929996f7e0 req-b5e336b0-b814-4e7f-967a-6ad0d079ab5d service nova] Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:41:00.236279 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-dfc702aa-8a91-4bc4-9c5f-bd929996f7e0 req-b5e336b0-b814-4e7f-967a-6ad0d079ab5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048303 Aug 24 04:41:00.236861 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3456/7183] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:00.815251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:00.815913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:00.826306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:00.826978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:00.827539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:00.828740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:00.829236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:00.829625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:00.972255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:00.984346 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5541853-5f61-42ee-8bd9-9c3cb7b209bb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1518 microversion: 2.1 time: 0.175603 Aug 24 04:41:00.984908 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3728/7184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:00 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:02.020750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:02.021916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:02.033169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:02.034068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:02.034562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:02.035291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:02.035804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:02.036254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:02.186541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:02.195285 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-049ff94a-59af-4fd7-bef5-2513fcd5f3fe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1515 microversion: 2.1 time: 0.183505 Aug 24 04:41:02.195980 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3457/7185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:02 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:02.216898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:02.217513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:02.225323 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:02.225809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:02.226242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:02.226955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:02.227406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:02.227873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:02.300014 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f825567a-413e-49e8-b2ad-207aea004e77 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "POST /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3/action" status: 204 len: 0 microversion: 2.1 time: 0.086867 Aug 24 04:41:02.300883 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3729/7186] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:41:02 2022] POST /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:41:02.309724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:02.310361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:02.318148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:02.318675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:02.319129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:02.319949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:02.320412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:02.321055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:02.533812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:02.542591 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eb7f050c-4f64-4cdc-ab6c-7ea495403570 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1515 microversion: 2.1 time: 0.236881 Aug 24 04:41:02.543179 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3458/7187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:02 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:03.566825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:03.567600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:03.575328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:03.575869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:03.576307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:03.577010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:03.577487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:03.578700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:03.720134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:03.731159 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-279fdebb-966f-4e09-80a6-e2f28156ec01 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1515 microversion: 2.1 time: 0.170524 Aug 24 04:41:03.732063 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3730/7188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:03 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:03.819340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-99b365a7-0ebc-4b71-b390-30e684ba687b req-7216d987-5f90-4ecb-88ba-a28b0884a078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ecb26e-7f95-498e-8274-003c8eab46f3", "name": "network-vif-plugged", "status": "completed", "tag": "a2ed3dbd-468d-4050-9b99-3e280d076863"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:03.833370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99b365a7-0ebc-4b71-b390-30e684ba687b req-7216d987-5f90-4ecb-88ba-a28b0884a078 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:03.833889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99b365a7-0ebc-4b71-b390-30e684ba687b req-7216d987-5f90-4ecb-88ba-a28b0884a078 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:03.834342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99b365a7-0ebc-4b71-b390-30e684ba687b req-7216d987-5f90-4ecb-88ba-a28b0884a078 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:03.849110 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-99b365a7-0ebc-4b71-b390-30e684ba687b req-7216d987-5f90-4ecb-88ba-a28b0884a078 service nova] Creating event network-vif-plugged:a2ed3dbd-468d-4050-9b99-3e280d076863 for instance 14ecb26e-7f95-498e-8274-003c8eab46f3 on n-h2-846470-15 Aug 24 04:41:03.854576 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-99b365a7-0ebc-4b71-b390-30e684ba687b req-7216d987-5f90-4ecb-88ba-a28b0884a078 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039017 Aug 24 04:41:03.855488 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3459/7189] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:04.756921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:04.757914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:04.767809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:04.768301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:04.768742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:04.769452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:04.769909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:04.770331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:04.905500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:04.913671 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3738c325-c4cd-49aa-853f-5cf8c3778ba3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1507 microversion: 2.1 time: 0.163745 Aug 24 04:41:04.914259 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3731/7190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:04 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:04.938787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:04.939528 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:04.946268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:04.946782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:04.947265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:04.947993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:04.948798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:04.949250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:05.095338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:05.103749 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f25d4672-8e43-4dbc-b7c4-6dc2c3d07bf0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1507 microversion: 2.1 time: 0.172485 Aug 24 04:41:05.104334 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3460/7191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:04 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:05.128004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2b86aaba-f810-4d3d-948d-afa23995d5fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Action: 'create', calling method: .version_select at 0x7f1021aede50>, body: {"keypair": {"name": "tempest-keypair-1068733026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZBXYkBphfk1wKit+gpCB7ZsFy1ZKqsL2uD0PYu5GHG/nePLbuxRuomcX39802cDSKxd0TfznZkU9sh7EJzvd8okDKW9RqVCZo5XPrb83CAX+++/4Tlt0cXN0A6VQwYw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:05.150709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-2b86aaba-f810-4d3d-948d-afa23995d5fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Getting quotas for project 1f48576354da4788b3d6573065b8c92b. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:41:05.157154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-2b86aaba-f810-4d3d-948d-afa23995d5fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Getting quotas for user daa686206116464f84fd49ad5c9a21e3 and project 1f48576354da4788b3d6573065b8c92b. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:41:05.172817 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b86aaba-f810-4d3d-948d-afa23995d5fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:41:06.183011 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b86aaba-f810-4d3d-948d-afa23995d5fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58462. Aug 24 04:41:06.206442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2b86aaba-f810-4d3d-948d-afa23995d5fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.082955 Aug 24 04:41:06.206960 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3732/7192] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:41:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:07.472153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:07.472790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:07.480291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:07.480801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:07.481262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:07.481995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:07.482483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:07.482927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:07.618674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:07.630614 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2f3cf8a-77ae-4d25-9d14-58119b3f7116 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 200 len: 1507 microversion: 2.1 time: 0.162519 Aug 24 04:41:07.631412 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3461/7193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:07 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:07.653444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:07.653994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:07.660306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:07.660787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:07.661221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:07.661905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:07.662355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:07.662762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:07.687179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:41:07.770842 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a32a3979-e573-4baf-a0a2-94d37836b820 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "DELETE /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 204 len: 0 microversion: 2.1 time: 0.122792 Aug 24 04:41:07.771497 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3733/7194] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:41:07 2022] DELETE /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:41:07.828324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1254524646", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "e3ebb231-4694-4f6a-a448-ee519cbd1d3b"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:07.882825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] validate_networks() for [('e3ebb231-4694-4f6a-a448-ee519cbd1d3b', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:41:08.281363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:41:08.281816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:41:08.282351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:41:08.282746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:41:08.283172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:41:08.292933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:08.293456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:08.293928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:08.294644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:08.295129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:08.295564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:08.313598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Getting quotas for project 1f48576354da4788b3d6573065b8c92b. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:41:08.319273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Getting quotas for user daa686206116464f84fd49ad5c9a21e3 and project 1f48576354da4788b3d6573065b8c92b. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:41:08.333287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:41:08.335605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:41:08.382595 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a756b10b-4f4c-48c5-b911-5ee1c5344e81 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558187 Aug 24 04:41:08.383367 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3462/7195] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:41:08.396657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9226fc78-4139-426d-a09c-bc5fd1d73d4a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:08.397328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9226fc78-4139-426d-a09c-bc5fd1d73d4a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:08.453086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9226fc78-4139-426d-a09c-bc5fd1d73d4a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:08.460521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9226fc78-4139-426d-a09c-bc5fd1d73d4a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1218 microversion: 2.1 time: 0.068291 Aug 24 04:41:08.471720 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3734/7196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:08 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:09.482291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:09.483178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:09.491704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:09.492231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:09.492688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:09.494782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:09.495367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:09.495853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:09.566902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:09.575845 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-60a3e62f-d3d4-41fd-a7d9-7c1388aaf24f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1270 microversion: 2.1 time: 0.098340 Aug 24 04:41:09.576850 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3463/7197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:09 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:09.808995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7839bccc-ae76-4e65-ad06-09ac4d8c3ba4 req-f8de2cf8-f7e5-406a-89a2-1df5d50845e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ecb26e-7f95-498e-8274-003c8eab46f3", "name": "network-vif-deleted", "tag": "a2ed3dbd-468d-4050-9b99-3e280d076863"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:09.823130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7839bccc-ae76-4e65-ad06-09ac4d8c3ba4 req-f8de2cf8-f7e5-406a-89a2-1df5d50845e9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:09.823954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7839bccc-ae76-4e65-ad06-09ac4d8c3ba4 req-f8de2cf8-f7e5-406a-89a2-1df5d50845e9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:09.824573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7839bccc-ae76-4e65-ad06-09ac4d8c3ba4 req-f8de2cf8-f7e5-406a-89a2-1df5d50845e9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:09.837473 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7839bccc-ae76-4e65-ad06-09ac4d8c3ba4 req-f8de2cf8-f7e5-406a-89a2-1df5d50845e9 service nova] Creating event network-vif-deleted:a2ed3dbd-468d-4050-9b99-3e280d076863 for instance 14ecb26e-7f95-498e-8274-003c8eab46f3 on n-h2-846470-15 Aug 24 04:41:09.842595 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7839bccc-ae76-4e65-ad06-09ac4d8c3ba4 req-f8de2cf8-f7e5-406a-89a2-1df5d50845e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037599 Aug 24 04:41:09.843861 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3735/7198] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:10.597934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:10.599426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:10.607902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:10.608426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:10.609101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:10.610002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:10.610483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:10.610937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:10.818305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:10.826971 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-569131c1-61e7-4ce2-a9d7-51e98a0255cf tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1318 microversion: 2.1 time: 0.233394 Aug 24 04:41:10.827555 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3464/7199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:10 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:11.076606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-2d2a1226-b9d0-4def-891b-a0d52bd7b645 req-2938e36c-e599-456f-b171-0b4ef4399386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d70ac51-2131-4778-a709-e13c812d769d", "tag": "014ce252-741d-4fda-8d76-5b94064eb090"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:11.091799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2d2a1226-b9d0-4def-891b-a0d52bd7b645 req-2938e36c-e599-456f-b171-0b4ef4399386 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:11.092279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2d2a1226-b9d0-4def-891b-a0d52bd7b645 req-2938e36c-e599-456f-b171-0b4ef4399386 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:11.092705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-2d2a1226-b9d0-4def-891b-a0d52bd7b645 req-2938e36c-e599-456f-b171-0b4ef4399386 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:11.105842 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-2d2a1226-b9d0-4def-891b-a0d52bd7b645 req-2938e36c-e599-456f-b171-0b4ef4399386 service nova] Creating event network-changed:014ce252-741d-4fda-8d76-5b94064eb090 for instance 5d70ac51-2131-4778-a709-e13c812d769d on n-h2-846470-15 Aug 24 04:41:11.110912 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-2d2a1226-b9d0-4def-891b-a0d52bd7b645 req-2938e36c-e599-456f-b171-0b4ef4399386 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041162 Aug 24 04:41:11.111523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3736/7200] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:11.848619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:11.849281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:11.858176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:11.858700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:11.859162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:11.860018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:11.860887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:11.861533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:11.999409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:12.011316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d38d0ad3-fb4d-4822-b5ab-56f775763eac tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1318 microversion: 2.1 time: 0.166294 Aug 24 04:41:12.012100 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3465/7201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:11 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:13.037283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:13.038044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:13.045843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:13.046331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:13.046770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:13.047470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:13.047939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:13.048390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:13.189300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:13.199321 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb849134-c1a2-411b-a359-882d0159b793 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1318 microversion: 2.1 time: 0.167467 Aug 24 04:41:13.199984 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3737/7202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:13 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:14.222674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:14.223390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:14.233991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:14.235265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:14.235744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:14.236736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:14.237433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:14.238053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:14.383066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:14.391189 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8e21cb1-e4c6-4779-8bd3-8da2733a1fe3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1318 microversion: 2.1 time: 0.173344 Aug 24 04:41:14.391800 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3466/7203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:14 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:15.412890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:15.413501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:15.420897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:15.421390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:15.421832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:15.422535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:15.422995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:15.423434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:15.439882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:15.578415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:15.590604 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5a17040d-259e-4684-a62e-389ac6dd584e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1318 microversion: 2.1 time: 0.181453 Aug 24 04:41:15.591423 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3738/7204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:15 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:15.871339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bb68e327-5947-40bf-a82e-7e193451303c req-e43e2d51-f7c8-47e2-a940-49f734d0ba95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d70ac51-2131-4778-a709-e13c812d769d", "name": "network-vif-plugged", "status": "completed", "tag": "014ce252-741d-4fda-8d76-5b94064eb090"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:15.883783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bb68e327-5947-40bf-a82e-7e193451303c req-e43e2d51-f7c8-47e2-a940-49f734d0ba95 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:15.884698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bb68e327-5947-40bf-a82e-7e193451303c req-e43e2d51-f7c8-47e2-a940-49f734d0ba95 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:15.885146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bb68e327-5947-40bf-a82e-7e193451303c req-e43e2d51-f7c8-47e2-a940-49f734d0ba95 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:15.899172 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bb68e327-5947-40bf-a82e-7e193451303c req-e43e2d51-f7c8-47e2-a940-49f734d0ba95 service nova] Creating event network-vif-plugged:014ce252-741d-4fda-8d76-5b94064eb090 for instance 5d70ac51-2131-4778-a709-e13c812d769d on n-h2-846470-15 Aug 24 04:41:15.904359 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bb68e327-5947-40bf-a82e-7e193451303c req-e43e2d51-f7c8-47e2-a940-49f734d0ba95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037195 Aug 24 04:41:15.904975 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3467/7205] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:16.615127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:16.615770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:16.625169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:16.625908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:16.626572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:16.627798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:16.628516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:16.629153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:16.775088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:16.785739 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b12b04cb-5696-414e-90e9-43294aaee7ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1318 microversion: 2.1 time: 0.175912 Aug 24 04:41:16.786294 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3739/7206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:16 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:17.810438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:17.811523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:17.820413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:17.820917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:17.821379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:17.822091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:17.822562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:17.823008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:17.962612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:17.975593 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d6d2703b-7d00-488a-8409-e3784ddef5e3 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1507 microversion: 2.1 time: 0.171503 Aug 24 04:41:17.976454 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3468/7207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:17 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:17.999566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:18.000173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:18.007517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:18.008026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:18.008457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:18.009207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:18.009655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:18.010076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:18.147593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:18.155524 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6046206-c8cc-4d70-bd91-05c96efbfe87 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1507 microversion: 2.1 time: 0.159892 Aug 24 04:41:18.156123 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3740/7208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:17 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:41:18.176593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:18.179030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:18.185827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:18.186337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:18.186792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:18.187507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:18.188021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:18.188469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:18.218363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:18.224634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:41:18.231644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:41:18.232121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:41:18.232615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:41:18.233046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:41:18.233508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:41:18.306074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:18.307633 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4d8a7e04-7af6-4724-b69a-401b044605d1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "POST /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d/action" status: 202 len: 0 microversion: 2.1 time: 0.135285 Aug 24 04:41:18.308536 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3469/7209] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:41:18 2022] POST /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:41:18.318103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:18.318952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:18.326502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:18.327020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:18.327507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:18.328354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:18.328926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:18.329512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:18.457341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:18.491536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:18.499680 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c0d6bd44-a519-4d2b-b6e7-9d236077ce12 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1514 microversion: 2.1 time: 0.186211 Aug 24 04:41:18.500287 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3741/7210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:18 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:19.519024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:19.524295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:19.524968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:19.535809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:19.536301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:19.536767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:19.537477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:19.537946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:19.538384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:20.056903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:20.059138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:20.067043 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d4ddc1b0-39ba-4db4-bf46-16ee8c4eb6aa tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1514 microversion: 2.1 time: 0.548840 Aug 24 04:41:20.067636 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3470/7211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:19 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1514 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:21.089378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:21.090019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:21.097509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:21.097999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:21.098430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:21.099125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:21.099585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:21.100041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:21.237538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:21.245462 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f9ac0895-4b76-4fae-acd5-1f2d4ff2795d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.160041 Aug 24 04:41:21.246036 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3742/7212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:21 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:22.269914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:22.270694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:22.280782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:22.281470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:22.282091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:22.283126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:22.283920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:22.284358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:22.421539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:22.430418 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eca0d3d0-4d0e-451b-bbf3-b4621fb42953 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.166707 Aug 24 04:41:22.431060 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3471/7213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:22 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:23.453613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:23.454362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:23.461707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:23.462177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:23.462636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:23.463601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:23.464095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:23.464515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:23.608636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:23.619828 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d580dc65-ee01-4992-aaea-518cb105045f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.171082 Aug 24 04:41:23.620383 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3743/7214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:23 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:24.646287 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:24.646888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:24.654332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:24.654842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:24.655305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:24.656065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:24.656575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:24.657021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:24.813297 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:24.826510 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45eca014-1b10-4073-ada5-f66091c3ca3d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.185188 Aug 24 04:41:24.827355 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3472/7215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:24 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:25.849833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:25.850439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:25.857804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:25.858289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:25.858724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:25.859414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:25.859906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:25.860333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:25.997063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:26.005955 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4681ebb0-f428-4a2e-96b6-23ea5e71b4e5 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.160335 Aug 24 04:41:26.006536 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3744/7216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:25 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:27.033460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:27.034518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:27.037518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:27.046350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:27.047191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:27.048016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:27.049219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:27.049797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:27.050248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:27.185266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:27.194100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-32bb78ea-8458-4288-b147-06251a80f8a6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.168806 Aug 24 04:41:27.195374 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3473/7217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:27 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:28.220882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:28.221525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:28.224305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.229710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:28.230218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:28.230657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:28.231345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:28.231832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:28.232265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:28.368286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:28.378859 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5d84674-a0b4-4743-8017-201e06dfddfe tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.164703 Aug 24 04:41:28.379453 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3745/7218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:28 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:29.399860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:29.400514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:29.408354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:29.408841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:29.409310 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:29.410016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:29.410489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:29.410921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:29.554993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:29.563569 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d21d25df-c6c4-48d4-8dbe-f9ec2105ebfb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.167723 Aug 24 04:41:29.564232 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3474/7219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:29 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:30.587766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:30.588447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:30.597081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:30.597655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:30.598177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:30.598997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:30.599541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:30.600078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:30.744775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:30.753843 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-483b1254-d029-48ea-8dc7-8d8c799fa882 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.170803 Aug 24 04:41:30.754429 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3746/7220] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:30 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:31.779552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:31.780621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:31.792516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:31.793401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:31.794101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:31.795526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:31.796327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:31.797063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:31.942383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:31.956312 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cbf42803-b2b4-4b06-bd3d-46815a7071f6 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.182849 Aug 24 04:41:31.956865 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3475/7221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:31 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:32.982084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:32.983366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:32.996769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:32.997580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:32.998572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:33.000027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:33.001016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:33.001745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:33.146696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:33.155230 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d0b62428-8be5-4dd7-b2e8-79bd1a7ccf3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.179767 Aug 24 04:41:33.155814 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3747/7222] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:32 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:34.179552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:34.180324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:34.188785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:34.189372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:34.190010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:34.190848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:34.191380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:34.191927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:34.345864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:34.360627 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0ea46e7-5a4d-4f0f-9cd5-4c496474f95d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.186238 Aug 24 04:41:34.361402 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3476/7223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:34 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:35.383707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:35.384353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:35.391427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:35.391952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:35.392404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:35.393109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:35.393566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:35.393997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:35.542478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:35.550976 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f7263427-4593-40ae-abcd-b097d6093536 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.171311 Aug 24 04:41:35.551567 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3748/7224] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:35 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:36.576888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:36.578020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:36.587198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:36.587696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:36.588189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:36.588922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:36.589394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:36.589841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:36.737929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:36.746081 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2b14c29-043d-438e-850c-adb6703b2d10 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.176270 Aug 24 04:41:36.746668 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3477/7225] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:36 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:37.769635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:37.770237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:37.777367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:37.777850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:37.778284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:37.779202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:37.779686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:37.780129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:37.933267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:37.941867 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-79200f87-f059-4bf4-b08f-b0f4888de7b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.176911 Aug 24 04:41:37.942447 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3749/7226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:37 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:38.968598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:38.969692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:38.977837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:38.978347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:38.978809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:38.979530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:38.980114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:38.980572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:39.114124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:39.122194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d209c808-a5f5-4afe-9d64-cef53cb6f373 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.160274 Aug 24 04:41:39.122788 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3478/7227] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:38 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:40.144359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:40.144973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:40.152312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:40.152798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:40.153236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:40.153928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:40.154381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:40.154809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:40.295385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:40.303595 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-38d6c4ea-f0c6-478c-a873-71a86463915d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.163717 Aug 24 04:41:40.304211 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3750/7228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:40 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:41.329667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:41.330816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:41.342705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:41.343425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:41.344263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:41.345431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:41.346205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:41.346759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:41.486850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:41.495391 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cafd5753-d010-4eb6-b1c5-4762904886c7 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.172661 Aug 24 04:41:41.496019 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3479/7229] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:41 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:42.518372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:42.518974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:42.527115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:42.527604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:42.528081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:42.528791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:42.529248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:42.529684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:42.670896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:42.684359 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2acb58d2-8f9a-40cc-9e69-2d9f93c1a386 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.169859 Aug 24 04:41:42.685207 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3751/7230] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:42 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:43.713230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:43.714245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:43.724275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:43.724775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:43.725229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:43.725944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:43.726416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:43.726854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:43.865279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:43.876813 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f11b4e0b-f9ff-4f06-b3d6-4c7dbd76503d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.169966 Aug 24 04:41:43.877788 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3480/7231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:43 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:44.907326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:44.908031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:44.916346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:44.917515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:44.917515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:44.918024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:44.918476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:44.918928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:45.074767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:45.082969 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef846b61-224c-43ea-8eaf-6c3d29ed6258 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.182993 Aug 24 04:41:45.083553 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3752/7232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:44 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:46.104574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:46.105296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:46.112789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:46.113300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:46.113754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:46.114484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:46.114950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:46.115393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:46.264076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:46.272454 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e6f717e-c50f-49df-be4e-05069037d491 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1519 microversion: 2.1 time: 0.171980 Aug 24 04:41:46.273034 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3481/7233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:46 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:47.293908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:47.294524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:47.301875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:47.302370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:47.302891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:47.303598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:47.304087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:47.304514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:47.308596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=88 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:47.451817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:47.460471 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a31048f-03cf-488c-b150-638eb2a15250 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1518 microversion: 2.1 time: 0.170460 Aug 24 04:41:47.461265 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3753/7234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:47 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:47.822786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d0f86cd6-7d3c-4787-afec-d880808dea7f req-f5bdb879-f8ba-40a6-970b-6c333d7c2da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d70ac51-2131-4778-a709-e13c812d769d", "name": "network-vif-unplugged", "status": "completed", "tag": "014ce252-741d-4fda-8d76-5b94064eb090"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:47.836006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d0f86cd6-7d3c-4787-afec-d880808dea7f req-f5bdb879-f8ba-40a6-970b-6c333d7c2da5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:47.836515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d0f86cd6-7d3c-4787-afec-d880808dea7f req-f5bdb879-f8ba-40a6-970b-6c333d7c2da5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:47.836967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d0f86cd6-7d3c-4787-afec-d880808dea7f req-f5bdb879-f8ba-40a6-970b-6c333d7c2da5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:47.852438 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d0f86cd6-7d3c-4787-afec-d880808dea7f req-f5bdb879-f8ba-40a6-970b-6c333d7c2da5 service nova] Creating event network-vif-unplugged:014ce252-741d-4fda-8d76-5b94064eb090 for instance 5d70ac51-2131-4778-a709-e13c812d769d on n-h1-846470-15 Aug 24 04:41:47.858616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-d0f86cd6-7d3c-4787-afec-d880808dea7f req-f5bdb879-f8ba-40a6-970b-6c333d7c2da5 service nova] Instance 5d70ac51-2131-4778-a709-e13c812d769d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:41:47.870387 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d0f86cd6-7d3c-4787-afec-d880808dea7f req-f5bdb879-f8ba-40a6-970b-6c333d7c2da5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051630 Aug 24 04:41:47.871009 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3482/7235] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:48.482808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:48.483349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:48.490859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:48.491465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:48.492035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:48.492832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:48.493512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:48.494207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:48.639118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:48.647968 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-37f5b2ea-8586-437a-96ec-39b771090f60 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1518 microversion: 2.1 time: 0.169131 Aug 24 04:41:48.648540 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3754/7236] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:48 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:49.674499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:49.675211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:49.685858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:49.686585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:49.687279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:49.688438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:49.689147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:49.689905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:49.845492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:49.853545 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9c5628b9-cb1d-480a-927a-d2c6649da54e tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1516 microversion: 2.1 time: 0.185887 Aug 24 04:41:49.854152 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3483/7237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:49 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:49.891577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a5ae5e37-db4b-4f9e-9719-9e97107135bd req-e197b0aa-5e19-442c-8dcc-e2d32ab18296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d70ac51-2131-4778-a709-e13c812d769d", "tag": "014ce252-741d-4fda-8d76-5b94064eb090"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:49.902033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5ae5e37-db4b-4f9e-9719-9e97107135bd req-e197b0aa-5e19-442c-8dcc-e2d32ab18296 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:49.902550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5ae5e37-db4b-4f9e-9719-9e97107135bd req-e197b0aa-5e19-442c-8dcc-e2d32ab18296 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:49.902985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a5ae5e37-db4b-4f9e-9719-9e97107135bd req-e197b0aa-5e19-442c-8dcc-e2d32ab18296 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:49.914953 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a5ae5e37-db4b-4f9e-9719-9e97107135bd req-e197b0aa-5e19-442c-8dcc-e2d32ab18296 service nova] Creating event network-changed:014ce252-741d-4fda-8d76-5b94064eb090 for instance 5d70ac51-2131-4778-a709-e13c812d769d on n-h1-846470-15 Aug 24 04:41:49.920528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-a5ae5e37-db4b-4f9e-9719-9e97107135bd req-e197b0aa-5e19-442c-8dcc-e2d32ab18296 service nova] Instance 5d70ac51-2131-4778-a709-e13c812d769d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:41:49.931901 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a5ae5e37-db4b-4f9e-9719-9e97107135bd req-e197b0aa-5e19-442c-8dcc-e2d32ab18296 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044138 Aug 24 04:41:49.932429 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3755/7238] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:50.879468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:50.880110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:50.887587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:50.888130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:50.888589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:50.889307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:50.889784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:50.890230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:51.036824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:51.045432 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-14cb5979-5679-4b8c-9085-9a640ee21388 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1516 microversion: 2.1 time: 0.172169 Aug 24 04:41:51.046026 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3484/7239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:50 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:52.071613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:52.072213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:52.081522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:52.082008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:52.082446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:52.083190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:52.083618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:52.084082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:52.234378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:52.243226 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d93fbe58-f0d1-4dca-b7d9-fcd708a45a8f tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1513 microversion: 2.1 time: 0.179067 Aug 24 04:41:52.243859 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3756/7240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:52 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:52.275847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:52.276401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:52.285250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:52.285903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:52.286526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:52.287577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:52.288189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:52.288661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:52.306982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=86 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:52.359913 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81f0d56b-96cc-4476-88b2-105390f3b55d tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "POST /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d/action" status: 204 len: 0 microversion: 2.1 time: 0.091762 Aug 24 04:41:52.360565 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3485/7241] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:41:52 2022] POST /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:41:52.370251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:52.370900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:52.379623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:52.382202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:52.382650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:52.383369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:52.383880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:52.384307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:52.525609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:52.533883 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9bc7a6bb-6996-4a8f-b871-6ca428084504 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1513 microversion: 2.1 time: 0.167852 Aug 24 04:41:52.534483 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3757/7242] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:52 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:53.556424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:53.557127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:53.564194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:53.564689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:53.565358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:53.566066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:53.566668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:53.566972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:53.709711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:53.719536 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-277a97f3-7e7e-43b7-a8a9-a57d36eb58ed tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1513 microversion: 2.1 time: 0.167418 Aug 24 04:41:53.720156 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3486/7243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:53 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:54.743077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:54.743655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:54.751064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:54.751729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:54.752144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:54.753031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:54.753497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:54.753930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:54.895978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:54.904669 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1a5e0fed-c3b8-4e18-bab3-aaa1e4080d23 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1505 microversion: 2.1 time: 0.165555 Aug 24 04:41:54.905336 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3758/7244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:54 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:54.926306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:54.927244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:54.934430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:54.934953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:54.935433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:54.936184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:54.936664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:54.937165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:54.954511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a00fb7fd-8b02-4cb8-b503-1475cdd56ff0 req-196e6127-9e9b-41ed-837f-5754a49da0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d70ac51-2131-4778-a709-e13c812d769d", "name": "network-vif-plugged", "status": "completed", "tag": "014ce252-741d-4fda-8d76-5b94064eb090"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:54.966552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a00fb7fd-8b02-4cb8-b503-1475cdd56ff0 req-196e6127-9e9b-41ed-837f-5754a49da0ea service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:54.967097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a00fb7fd-8b02-4cb8-b503-1475cdd56ff0 req-196e6127-9e9b-41ed-837f-5754a49da0ea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:54.967598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a00fb7fd-8b02-4cb8-b503-1475cdd56ff0 req-196e6127-9e9b-41ed-837f-5754a49da0ea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:54.981126 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a00fb7fd-8b02-4cb8-b503-1475cdd56ff0 req-196e6127-9e9b-41ed-837f-5754a49da0ea service nova] Creating event network-vif-plugged:014ce252-741d-4fda-8d76-5b94064eb090 for instance 5d70ac51-2131-4778-a709-e13c812d769d on n-h1-846470-15 Aug 24 04:41:54.986860 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a00fb7fd-8b02-4cb8-b503-1475cdd56ff0 req-196e6127-9e9b-41ed-837f-5754a49da0ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036083 Aug 24 04:41:54.989942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3759/7245] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:41:55.086834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:55.095627 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c71a2138-97d6-4ff4-a745-16e2f378c4b1 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1505 microversion: 2.1 time: 0.173553 Aug 24 04:41:55.096556 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3487/7246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:54 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:55.116418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:55.117116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:55.123374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:55.123886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:55.124325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:55.125005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:55.125455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:55.125879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:55.262765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:55.271127 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f066b281-6b91-4125-8749-f65d9cfbb9dc tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1505 microversion: 2.1 time: 0.159105 Aug 24 04:41:55.271717 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3760/7247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:55 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:55.291689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:55.292213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:55.298706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:55.299210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:55.299698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:55.300410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:55.300884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:55.301330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:55.330162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:41:55.417417 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b81bae93-dc23-44c9-99c5-32e53b9d8034 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 204 len: 0 microversion: 2.1 time: 0.129293 Aug 24 04:41:55.418036 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3488/7248] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:41:55 2022] DELETE /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:41:55.434608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:55.435099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:55.441725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:55.442209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:55.442645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:55.443346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:55.443839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:55.444267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:55.470811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:41:55.521692 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.compute.api [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Instance is already in deleting state, ignoring this request Aug 24 04:41:55.522441 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c3e6c612-7352-4301-8c8f-ec210492a32a tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 204 len: 0 microversion: 2.1 time: 0.091827 Aug 24 04:41:55.523014 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3761/7249] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:41:55 2022] DELETE /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:41:55.533140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:55.534107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:55.540447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:55.540942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:55.541383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:55.542079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:55.542541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:55.542972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:55.682804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:55.691405 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3d793ffe-12ac-4a3e-8541-df8778bce0fb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1511 microversion: 2.1 time: 0.162578 Aug 24 04:41:55.692002 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3489/7250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:55 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:56.722047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:56.722665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:56.730042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:56.730533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:56.730979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:56.731703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:56.732185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:56.732616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:56.821634 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:41:56.822294 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:41:56.883716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:56.894749 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-867e801d-daa6-4fa8-8be4-4adb57fd3eeb tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1511 microversion: 2.1 time: 0.179298 Aug 24 04:41:56.895327 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3762/7251] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:56 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:57.544775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2736c56f-8833-4035-ab9d-a447b67d7445 req-6dabd6ed-21cb-4d73-93e7-f540dec94db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d70ac51-2131-4778-a709-e13c812d769d", "name": "network-vif-deleted", "tag": "014ce252-741d-4fda-8d76-5b94064eb090"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:41:57.554194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:57.556900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2736c56f-8833-4035-ab9d-a447b67d7445 req-6dabd6ed-21cb-4d73-93e7-f540dec94db9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:57.557396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2736c56f-8833-4035-ab9d-a447b67d7445 req-6dabd6ed-21cb-4d73-93e7-f540dec94db9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:57.557847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2736c56f-8833-4035-ab9d-a447b67d7445 req-6dabd6ed-21cb-4d73-93e7-f540dec94db9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:57.570291 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2736c56f-8833-4035-ab9d-a447b67d7445 req-6dabd6ed-21cb-4d73-93e7-f540dec94db9 service nova] Creating event network-vif-deleted:014ce252-741d-4fda-8d76-5b94064eb090 for instance 5d70ac51-2131-4778-a709-e13c812d769d on n-h1-846470-15 Aug 24 04:41:57.581216 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2736c56f-8833-4035-ab9d-a447b67d7445 req-6dabd6ed-21cb-4d73-93e7-f540dec94db9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039715 Aug 24 04:41:57.582336 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3490/7252] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:41:57.918781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:57.919656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:57.928485 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:57.928981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:57.929428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:57.930133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:57.930604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:57.931039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:57.963085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:57.963563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:57.964041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:57.964497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lazy-loading 'fault' on Instance uuid 5d70ac51-2131-4778-a709-e13c812d769d {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:41:58.008023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa686206116464f84fd49ad5c9a21e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f48576354da4788b3d6573065b8c92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:41:58.016074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-623e2c0a-2aea-4fbe-bd7c-fc1b86fafb05 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 200 len: 1306 microversion: 2.1 time: 0.102937 Aug 24 04:41:58.016652 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3763/7253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:57 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:41:59.040324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:59.040878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 5d70ac51-2131-4778-a709-e13c812d769d] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:59.048513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:59.049226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:59.049839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:59.050759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:59.051440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:59.052167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:59.069654 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] HTTP exception thrown: Instance 5d70ac51-2131-4778-a709-e13c812d769d could not be found. Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Request method failure captured: Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d HTTP/1.1 Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBautDp5bk83qW6xtGtvmssFWGXwxM32pOusq7SOQZxEZV1qJHb7_oMJiUYcxLamtNsK4Gcgn1xkbQlECTnCFsfvoirObjRok9uWOyh_BKEuLVdMgn7JZCPlLlNRbjAIUEe1kzBrDfNMM-YsL9uf80rp4CsEf7oi28pOqNVW9j4rwJeQ Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1f48576354da4788b3d6573065b8c92b Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1f48576354da4788b3d6573065b8c92b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1f48576354da4788b3d6573065b8c92b Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerDiskConfigTestJSON-1157580018-project Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: daa686206116464f84fd49ad5c9a21e3 Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerDiskConfigTestJSON-1157580018-project Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 5d70ac51-2131-4778-a709-e13c812d769d could not be found. Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '5d70ac51-2131-4778-a709-e13c812d769d'} Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d70ac51-2131-4778-a709-e13c812d769d could not be found. Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d70ac51-2131-4778-a709-e13c812d769d could not be found. Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:41:59.071344 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d70ac51-2131-4778-a709-e13c812d769d could not be found. Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Returning 404 to user: Instance 5d70ac51-2131-4778-a709-e13c812d769d could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a99b7e0-f668-4f08-aa29-ae38d033ed35 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d" status: 404 len: 111 microversion: 2.1 time: 0.037928 Aug 24 04:41:59.075748 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3491/7254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:59 2022] GET /compute/v2.1/servers/5d70ac51-2131-4778-a709-e13c812d769d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:41:59.082234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4e346bc-6807-491a-9892-243876ec3774 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '.version_select at 0x7f1023628790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:59.090614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=40 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:59.107221 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4e346bc-6807-491a-9892-243876ec3774 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068733026" status: 202 len: 0 microversion: 2.1 time: 0.029008 Aug 24 04:41:59.107838 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3764/7255] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 04:41:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068733026 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:41:59.753336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:59.753868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:59.760122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:59.760622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:59.761070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:59.761771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:59.762243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:59.762676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:59.776594 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] HTTP exception thrown: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Request method failure captured: Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 HTTP/1.1 Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBautDp5bk83qW6xtGtvmssFWGXwxM32pOusq7SOQZxEZV1qJHb7_oMJiUYcxLamtNsK4Gcgn1xkbQlECTnCFsfvoirObjRok9uWOyh_BKEuLVdMgn7JZCPlLlNRbjAIUEe1kzBrDfNMM-YsL9uf80rp4CsEf7oi28pOqNVW9j4rwJeQ Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 1f48576354da4788b3d6573065b8c92b Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1f48576354da4788b3d6573065b8c92b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 1f48576354da4788b3d6573065b8c92b Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerDiskConfigTestJSON-1157580018-project Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: daa686206116464f84fd49ad5c9a21e3 Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerDiskConfigTestJSON-1157580018-project Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '14ecb26e-7f95-498e-8274-003c8eab46f3'} Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:41:59.778216 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Returning 404 to user: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e35ff45e-1331-4658-a3fb-95fbd9e7e4c0 tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "DELETE /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 404 len: 111 microversion: 2.1 time: 0.032501 Aug 24 04:41:59.782259 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3492/7256] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:41:59 2022] DELETE /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:41:59.788641 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:41:59.789253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] [instance: 14ecb26e-7f95-498e-8274-003c8eab46f3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:41:59.796277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:59.796758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:59.797193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:59.797881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:41:59.798334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:41:59.798758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:41:59.812769 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] HTTP exception thrown: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Request method failure captured: Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 HTTP/1.1 Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBautDp5bk83qW6xtGtvmssFWGXwxM32pOusq7SOQZxEZV1qJHb7_oMJiUYcxLamtNsK4Gcgn1xkbQlECTnCFsfvoirObjRok9uWOyh_BKEuLVdMgn7JZCPlLlNRbjAIUEe1kzBrDfNMM-YsL9uf80rp4CsEf7oi28pOqNVW9j4rwJeQ Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 1f48576354da4788b3d6573065b8c92b Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1f48576354da4788b3d6573065b8c92b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f48576354da4788b3d6573065b8c92b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 1f48576354da4788b3d6573065b8c92b Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1157580018 Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerDiskConfigTestJSON-1157580018-project Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: daa686206116464f84fd49ad5c9a21e3 Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerDiskConfigTestJSON-1157580018-project Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '14ecb26e-7f95-498e-8274-003c8eab46f3'} Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:41:59.814448 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] Returning 404 to user: Instance 14ecb26e-7f95-498e-8274-003c8eab46f3 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2df64609-de9b-4d41-959e-cfe0a13e1d3b tempest-ServerDiskConfigTestJSON-1157580018 tempest-ServerDiskConfigTestJSON-1157580018-project] 10.222.0.58 "GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3" status: 404 len: 111 microversion: 2.1 time: 0.031734 Aug 24 04:41:59.818878 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3765/7257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:41:59 2022] GET /compute/v2.1/servers/14ecb26e-7f95-498e-8274-003c8eab46f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:42:08.642616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-77d599cf-1562-4791-a6e7-5db2eb23dc1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'create', calling method: .version_select at 0x7f102ad08c10>, body: {"keypair": {"name": "tempest-keypair-1213395054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBXjgM4UrE1zAmR30QXoutUUglAyDrgHX9FFN0NvCw2yBoCCD3vsuRMJUGCcEi9EO6k+BHVFK/eMnHMibDoiZf14ZapYKVrmzYYNlCx6JT0J3pzROOooJHBAoMCpOAWlg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:08.661871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-77d599cf-1562-4791-a6e7-5db2eb23dc1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for project 406d494d9545497db446811a4b13adac. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:42:08.667714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-77d599cf-1562-4791-a6e7-5db2eb23dc1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for user c7e86d3ac0e74a8886f56c8b32e63333 and project 406d494d9545497db446811a4b13adac. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:42:08.699187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-77d599cf-1562-4791-a6e7-5db2eb23dc1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176495 Aug 24 04:42:08.700046 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3493/7258] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:42:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:10.066528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:10.068365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:10.074481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1165515555", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97984039-df0d-403d-a9d4-47ad3c354114"}], "security_groups": [{"name": "tempest-securitygroup--1150372431"}], "key_name": "tempest-keypair-1213395054", "user_data": "}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:10.185688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] validate_networks() for [('97984039-df0d-403d-a9d4-47ad3c354114', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:42:10.636233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:42:10.636662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:42:10.637254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:42:10.637775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:42:10.638570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:42:10.651431 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:10.652460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:10.652460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:10.653131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:10.653605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:10.654040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:10.673406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:42:10.679862 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for user c7e86d3ac0e74a8886f56c8b32e63333 and project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:42:10.693153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:42:10.695496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:42:10.744580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0a89036d-3699-4b00-8185-6935209b535f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.679755 Aug 24 04:42:10.745238 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3766/7259] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:42:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 04:42:10.755050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:10.762615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ee94c30b-4efb-452c-afab-a480f2c5ba1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:10.763328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ee94c30b-4efb-452c-afab-a480f2c5ba1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:10.829157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ee94c30b-4efb-452c-afab-a480f2c5ba1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:10.837079 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ee94c30b-4efb-452c-afab-a480f2c5ba1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1239 microversion: 2.1 time: 0.084557 Aug 24 04:42:10.851183 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3494/7260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:10 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:11.858210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:11.859590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:11.908882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:11.909922 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:11.910573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:11.911705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:11.912333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:11.912914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:12.018261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:12.028310 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b33b65d7-c715-4df5-8e39-aa0f4ca13614 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1299 microversion: 2.1 time: 0.174547 Aug 24 04:42:12.030646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3767/7261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:11 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:13.052145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:13.053505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:13.065450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:13.066020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:13.066495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:13.067267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:13.067769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:13.068224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:13.275161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:13.283831 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8f22f814-c780-411a-92d9-87b2ee98dfc3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1365 microversion: 2.1 time: 0.235516 Aug 24 04:42:13.289639 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3495/7262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:13 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:13.782476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e565955b-098e-4c5a-8e0f-378d16c04de2 req-7d8d8407-a1ba-4a1a-ac7f-1bb433093baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d2b6e5-13ad-45e7-827f-67eb65b866a2", "tag": "30851567-2d48-47df-96f4-749fdb6dfab7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:13.798763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e565955b-098e-4c5a-8e0f-378d16c04de2 req-7d8d8407-a1ba-4a1a-ac7f-1bb433093baa service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:13.800166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e565955b-098e-4c5a-8e0f-378d16c04de2 req-7d8d8407-a1ba-4a1a-ac7f-1bb433093baa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:13.800691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e565955b-098e-4c5a-8e0f-378d16c04de2 req-7d8d8407-a1ba-4a1a-ac7f-1bb433093baa service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:13.815646 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e565955b-098e-4c5a-8e0f-378d16c04de2 req-7d8d8407-a1ba-4a1a-ac7f-1bb433093baa service nova] Creating event network-changed:30851567-2d48-47df-96f4-749fdb6dfab7 for instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 on n-h1-846470-15 Aug 24 04:42:13.823048 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e565955b-098e-4c5a-8e0f-378d16c04de2 req-7d8d8407-a1ba-4a1a-ac7f-1bb433093baa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045927 Aug 24 04:42:13.824261 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3768/7263] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:14.305380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:14.305934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:14.313218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:14.313717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:14.314167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:14.314872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:14.315314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:14.315798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:14.454171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:14.462760 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cd3c3926-1b23-49ef-a499-f18c59479fdb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1365 microversion: 2.1 time: 0.161481 Aug 24 04:42:14.463343 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3496/7264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:14 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:15.491403 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:15.492421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:15.503476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:15.503999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:15.504443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:15.505145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:15.505607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:15.506038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:15.645495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:15.653358 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8758c9b6-2386-4f0b-870a-a075a9932365 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1365 microversion: 2.1 time: 0.171541 Aug 24 04:42:15.653942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3769/7265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:15 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:16.674753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:16.675420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:16.682898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:16.683419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:16.684038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:16.684760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:16.685238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:16.685685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:16.900177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:16.909371 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e981cf8-5c90-4e31-af7b-7cc0e3880935 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1365 microversion: 2.1 time: 0.238614 Aug 24 04:42:16.910059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3497/7266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:16 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:17.934961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:17.935799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:17.947549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:17.948717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:17.949513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:17.950674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:17.951433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:17.952228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:18.102565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:18.110492 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a3ff8b2b-5dd1-4c48-8889-499132bf3485 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1365 microversion: 2.1 time: 0.182418 Aug 24 04:42:18.111115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3770/7267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:17 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:19.137334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:19.137939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:19.145398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:19.145909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:19.146359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:19.147076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:19.147548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:19.148029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:19.295689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:19.304004 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f5aaf902-1a07-492b-88ef-dd7b187a1802 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1365 microversion: 2.1 time: 0.170928 Aug 24 04:42:19.304588 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3498/7268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:19 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:20.329745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:20.331222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:20.338664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:20.339151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:20.339592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:20.340325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:20.340784 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:20.341211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:20.485288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:20.493699 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b689d324-3e23-43d7-a6d8-e9a9e86d6398 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1365 microversion: 2.1 time: 0.170790 Aug 24 04:42:20.494275 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3771/7269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:20 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:21.079251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f00d6175-af62-447f-a206-01f4f8b26603 req-81d66db6-da7f-4fad-b148-b3a7ea5e601f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d2b6e5-13ad-45e7-827f-67eb65b866a2", "name": "network-vif-plugged", "status": "completed", "tag": "30851567-2d48-47df-96f4-749fdb6dfab7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:21.085482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:21.092063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f00d6175-af62-447f-a206-01f4f8b26603 req-81d66db6-da7f-4fad-b148-b3a7ea5e601f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:21.092565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f00d6175-af62-447f-a206-01f4f8b26603 req-81d66db6-da7f-4fad-b148-b3a7ea5e601f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:21.093017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f00d6175-af62-447f-a206-01f4f8b26603 req-81d66db6-da7f-4fad-b148-b3a7ea5e601f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:21.105482 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f00d6175-af62-447f-a206-01f4f8b26603 req-81d66db6-da7f-4fad-b148-b3a7ea5e601f service nova] Creating event network-vif-plugged:30851567-2d48-47df-96f4-749fdb6dfab7 for instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 on n-h1-846470-15 Aug 24 04:42:21.110635 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f00d6175-af62-447f-a206-01f4f8b26603 req-81d66db6-da7f-4fad-b148-b3a7ea5e601f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035201 Aug 24 04:42:21.111620 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3499/7270] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:21.515491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:21.516337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:21.518974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:21.519773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:21.529268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:21.529994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:21.530668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:21.531427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:21.531844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:21.532579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:21.670302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:21.678871 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c5129be-cd3a-4537-b48e-8bb2284bc080 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1365 microversion: 2.1 time: 0.168109 Aug 24 04:42:21.679438 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3772/7271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:21 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:22.703751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:22.704552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:22.712206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:22.712696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:22.713387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:22.714312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:22.714924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:22.715442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:22.856264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:42:22.865954 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-abd52c47-8100-408b-a62f-3ab60585bf70 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1552 microversion: 2.1 time: 0.169331 Aug 24 04:42:22.866641 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3500/7272] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:42:22 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:42:22.887607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:42:22.888206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:42:22.896015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:22.896510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:22.896948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:22.897762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:22.898250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:22.898680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:22.979339 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ea618f51-ad7e-4e2e-9da9-b2fcb5459a0d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095708 Aug 24 04:42:22.979973 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3773/7273] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:42:22 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:42:24.326269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e7ce4640-3d35-43b5-9856-611c7f3f9a86 req-5641134f-4672-46ee-a0e2-09feea1e53b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d2b6e5-13ad-45e7-827f-67eb65b866a2", "tag": "30851567-2d48-47df-96f4-749fdb6dfab7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:42:24.336808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7ce4640-3d35-43b5-9856-611c7f3f9a86 req-5641134f-4672-46ee-a0e2-09feea1e53b9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:42:24.337309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7ce4640-3d35-43b5-9856-611c7f3f9a86 req-5641134f-4672-46ee-a0e2-09feea1e53b9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:42:24.337765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7ce4640-3d35-43b5-9856-611c7f3f9a86 req-5641134f-4672-46ee-a0e2-09feea1e53b9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:42:24.349251 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e7ce4640-3d35-43b5-9856-611c7f3f9a86 req-5641134f-4672-46ee-a0e2-09feea1e53b9 service nova] Creating event network-changed:30851567-2d48-47df-96f4-749fdb6dfab7 for instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 on n-h1-846470-15 Aug 24 04:42:24.354291 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e7ce4640-3d35-43b5-9856-611c7f3f9a86 req-5641134f-4672-46ee-a0e2-09feea1e53b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032230 Aug 24 04:42:24.354907 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3501/7274] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:43:39.586277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.587030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=38 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.591755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:39.592367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:39.599634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:39.600152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:39.600594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:39.601291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:39.601745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:39.602170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:39.792469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:39.800786 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b63b581a-5b52-4987-8081-ed2423366f1d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1670 microversion: 2.1 time: 0.217525 Aug 24 04:43:39.801366 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3774/7275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:39 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:39.820141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.820898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=34 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.825789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:39.826509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:39.834521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:39.835026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:39.835485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:39.836223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:39.836749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:39.837146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:40.023922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:40.032455 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3356884f-4e16-47eb-8b6f-9a327922f950 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1670 microversion: 2.1 time: 0.215212 Aug 24 04:43:40.033036 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3502/7276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:39 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1670 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:40.052755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:40.053346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:40.059695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:40.060238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:40.060686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:40.061390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:40.061855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:40.062289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:40.202283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:40.212528 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ccde82a-18b4-45ee-856c-96d4fb5dfa80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1670 microversion: 2.1 time: 0.163848 Aug 24 04:43:40.213110 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3775/7277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:40 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:40.234407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:43:40.236789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:40.243511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:40.244041 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:40.244489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:40.245291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:40.245758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:40.246190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:40.274905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:40.281250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:43:40.290090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:43:40.290516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:43:40.290998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:43:40.291408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:43:40.291951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:43:40.360764 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-02a82eef-0930-4112-92db-26ff40c59be1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2/action" status: 202 len: 0 microversion: 2.1 time: 0.131420 Aug 24 04:43:40.361526 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3503/7278] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:43:40 2022] POST /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:43:40.371550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:40.372268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:40.379816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:40.380558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:40.381143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:40.382370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:40.383175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:40.384006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:40.541729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:40.550026 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07a98148-b8d0-4602-8bd4-82181dba492a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1679 microversion: 2.1 time: 0.183903 Aug 24 04:43:40.550601 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3776/7279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:40 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:43:41.573175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:41.574046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:41.584669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:41.585218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:41.585692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:41.586401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:41.586875 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:41.587314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:41.804047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:41.813282 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bca7a672-9ab4-46e5-8e8c-9dc0f05d9c9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1679 microversion: 2.1 time: 0.245791 Aug 24 04:43:41.814104 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3504/7280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:41 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:42.841652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:42.842605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:42.852754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:42.853239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:42.853675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:42.854371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:42.854829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:42.855255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:43.003597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:43.015722 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6d0e2581-f4bf-49e7-81dc-49b87f178358 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.180787 Aug 24 04:43:43.016522 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3777/7281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:42 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:44.045306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:44.046285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:44.057418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:44.057926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:44.058375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:44.059081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:44.059548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:44.060018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:44.201273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:44.214389 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04eb22b2-1b2e-40cd-90e3-41b2ab2c9bab tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.176984 Aug 24 04:43:44.215278 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3505/7282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:44 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:45.244617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:45.245982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:45.258506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:45.259168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:45.259763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:45.260724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:45.261365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:45.261943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:45.416344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:45.428233 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f073b87c-adcc-4be6-ac06-eb01e26327d2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.190149 Aug 24 04:43:45.428949 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3778/7283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:45 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:46.450744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:46.451358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:46.458978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:46.460123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:46.460580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:46.461288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:46.461766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:46.462210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:46.599244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:46.607588 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0075bece-58f8-4a1b-91f2-d60c8fbdb289 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.161236 Aug 24 04:43:46.608210 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3506/7284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:46 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:47.640264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:47.641233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:47.650697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:47.651185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:47.651621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:47.652346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:47.652802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:47.653229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:47.809005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:47.817568 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a09eb520-a6b2-4b0c-82c0-d55c2bb7c838 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.184016 Aug 24 04:43:47.818186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3779/7285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:47 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:48.840954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:48.841569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:48.852526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:48.853038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:48.853497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:48.854209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:48.854682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:48.855122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:49.008916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:49.022127 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5c2b046-79fc-4fa5-8342-5a419f260884 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.185586 Aug 24 04:43:49.022736 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3507/7286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:48 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:50.048413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:50.049430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:50.058257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:50.058742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:50.059179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:50.059907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:50.060363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:50.060792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:50.205775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:50.218919 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d7160c2c-c05d-40ea-83c8-723891d59f59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.176803 Aug 24 04:43:50.219833 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3780/7287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:50 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:51.245174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:51.246014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:51.255949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:51.256640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:51.257263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:51.258205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:51.258839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:51.259417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:51.401593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:51.415077 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-408aa34b-216b-4a1e-945c-974bbefbc965 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.175283 Aug 24 04:43:51.415891 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3508/7288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:51 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:52.444465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:52.445095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:52.452683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:52.453170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:52.453615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:52.454303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:52.454760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:52.455187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:52.595012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:52.603358 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e8d0ab2-5786-4b97-b858-1873bf0ba65a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.164801 Aug 24 04:43:52.603973 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3781/7289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:52 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:53.628903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:53.629868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:53.641437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:53.642225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:53.642911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:53.644062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:53.644783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:53.645438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:53.800396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:53.810100 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fcc77edf-c913-44ef-8055-cf34564760a1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1684 microversion: 2.1 time: 0.187844 Aug 24 04:43:53.810690 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3509/7290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:53 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:43:54.832447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:54.833033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:54.840492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:54.840993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:54.841441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:54.842149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:54.842617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:54.843045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:54.949206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e7ddc397-879f-4722-9fb7-a90bc1d00c39 req-4dce3267-88fc-4a5a-9df5-1c2274512f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d2b6e5-13ad-45e7-827f-67eb65b866a2", "name": "network-vif-unplugged", "status": "completed", "tag": "30851567-2d48-47df-96f4-749fdb6dfab7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:43:54.961109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7ddc397-879f-4722-9fb7-a90bc1d00c39 req-4dce3267-88fc-4a5a-9df5-1c2274512f4a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:54.961705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7ddc397-879f-4722-9fb7-a90bc1d00c39 req-4dce3267-88fc-4a5a-9df5-1c2274512f4a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:54.962215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e7ddc397-879f-4722-9fb7-a90bc1d00c39 req-4dce3267-88fc-4a5a-9df5-1c2274512f4a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:54.977927 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e7ddc397-879f-4722-9fb7-a90bc1d00c39 req-4dce3267-88fc-4a5a-9df5-1c2274512f4a service nova] Creating event network-vif-unplugged:30851567-2d48-47df-96f4-749fdb6dfab7 for instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 on n-h2-846470-15 Aug 24 04:43:54.980890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:54.983717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-e7ddc397-879f-4722-9fb7-a90bc1d00c39 req-4dce3267-88fc-4a5a-9df5-1c2274512f4a service nova] Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:43:54.989470 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0bb45f8d-d447-46cd-b4f3-04a3de69acd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1683 microversion: 2.1 time: 0.161033 Aug 24 04:43:54.990229 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3782/7291] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:54 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:55.006279 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e7ddc397-879f-4722-9fb7-a90bc1d00c39 req-4dce3267-88fc-4a5a-9df5-1c2274512f4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062445 Aug 24 04:43:55.007005 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3510/7292] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:43:56.011697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:56.012368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:56.020584 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:56.021236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:56.021709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:56.022416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:56.022871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:56.023295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:56.162134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:56.170241 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-852a76a7-02d4-4e81-ab4c-bd18c6258283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1683 microversion: 2.1 time: 0.162581 Aug 24 04:43:56.171012 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3783/7293] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:56 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:57.042871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-11f189f8-04fe-4bc0-970d-a2acacc0b3cf req-d22890dd-8398-4dd4-9826-c0db82d64353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d2b6e5-13ad-45e7-827f-67eb65b866a2", "tag": "30851567-2d48-47df-96f4-749fdb6dfab7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:43:57.053362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-11f189f8-04fe-4bc0-970d-a2acacc0b3cf req-d22890dd-8398-4dd4-9826-c0db82d64353 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:57.053836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-11f189f8-04fe-4bc0-970d-a2acacc0b3cf req-d22890dd-8398-4dd4-9826-c0db82d64353 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:57.054295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-11f189f8-04fe-4bc0-970d-a2acacc0b3cf req-d22890dd-8398-4dd4-9826-c0db82d64353 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:57.066427 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-11f189f8-04fe-4bc0-970d-a2acacc0b3cf req-d22890dd-8398-4dd4-9826-c0db82d64353 service nova] Creating event network-changed:30851567-2d48-47df-96f4-749fdb6dfab7 for instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 on n-h2-846470-15 Aug 24 04:43:57.073294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-11f189f8-04fe-4bc0-970d-a2acacc0b3cf req-d22890dd-8398-4dd4-9826-c0db82d64353 service nova] Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:43:57.088950 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-11f189f8-04fe-4bc0-970d-a2acacc0b3cf req-d22890dd-8398-4dd4-9826-c0db82d64353 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051505 Aug 24 04:43:57.089811 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3511/7294] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:43:57.192855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:57.193589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:57.200972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:57.201455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:57.201912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:57.202602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:57.203054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:57.203454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:57.340347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:57.348399 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c466ad77-b3f4-4a28-beb7-d0478d62fe22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1681 microversion: 2.1 time: 0.159509 Aug 24 04:43:57.348982 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3784/7295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:57 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:58.378868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:58.380104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:58.387210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:58.387708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:58.388199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:58.388925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:58.389401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:58.389844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:58.526022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:58.533998 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cb43fdb1-438b-4d2c-80b7-07b855e2e18f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1681 microversion: 2.1 time: 0.166376 Aug 24 04:43:58.534559 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3512/7296] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:58 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:59.557051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:59.557646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:59.564950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:59.565436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:59.565889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:59.566594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:59.567038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:59.567464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:59.714538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:43:59.726139 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23bcb61a-23ca-4ec2-9209-60bd6e16d276 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1678 microversion: 2.1 time: 0.173618 Aug 24 04:43:59.726717 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3785/7297] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:59 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:43:59.758157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:43:59.758710 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:59.766192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:59.766704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:59.767216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:59.767943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:59.768422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:59.768867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:59.835945 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4f02c5bb-7329-4d29-bb88-0d53becb41da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2/action" status: 204 len: 0 microversion: 2.1 time: 0.083662 Aug 24 04:43:59.837357 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3513/7298] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:43:59 2022] POST /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:43:59.845283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:43:59.845933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:43:59.852377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:59.852945 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:59.853398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:59.854338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:43:59.854827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:43:59.855231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:43:59.998366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:00.007403 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a6dfb4cf-ca90-449d-9104-5ae75e09bbc0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1678 microversion: 2.1 time: 0.166103 Aug 24 04:44:00.008018 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3786/7299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:43:59 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:00.775744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2b3bf0ec-a11d-4596-b3ec-8033eb27753e req-f5b6ad63-1881-4a5f-ac72-45068f6294bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d2b6e5-13ad-45e7-827f-67eb65b866a2", "name": "network-vif-plugged", "status": "completed", "tag": "30851567-2d48-47df-96f4-749fdb6dfab7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:44:00.785766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b3bf0ec-a11d-4596-b3ec-8033eb27753e req-f5b6ad63-1881-4a5f-ac72-45068f6294bf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:00.786259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b3bf0ec-a11d-4596-b3ec-8033eb27753e req-f5b6ad63-1881-4a5f-ac72-45068f6294bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:00.786808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b3bf0ec-a11d-4596-b3ec-8033eb27753e req-f5b6ad63-1881-4a5f-ac72-45068f6294bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:00.799130 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2b3bf0ec-a11d-4596-b3ec-8033eb27753e req-f5b6ad63-1881-4a5f-ac72-45068f6294bf service nova] Creating event network-vif-plugged:30851567-2d48-47df-96f4-749fdb6dfab7 for instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 on n-h2-846470-15 Aug 24 04:44:00.806607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-2b3bf0ec-a11d-4596-b3ec-8033eb27753e req-f5b6ad63-1881-4a5f-ac72-45068f6294bf service nova] Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:44:00.817507 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2b3bf0ec-a11d-4596-b3ec-8033eb27753e req-f5b6ad63-1881-4a5f-ac72-45068f6294bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046944 Aug 24 04:44:00.818286 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3514/7300] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:44:01.029453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:01.030033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:01.037650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:01.038146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:01.038582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:01.039287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:01.039848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:01.040275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:01.180232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:01.188069 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2491e3be-20ef-45a6-8b1a-466b476d25d3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1678 microversion: 2.1 time: 0.162707 Aug 24 04:44:01.188633 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3787/7301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:01 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:02.212184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:02.212751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:02.219224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.219757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.220219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.220927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.221401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.221844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.375268 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:02.383951 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-969b0c69-1ff0-47b5-88a6-c3805f14d7cc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1670 microversion: 2.1 time: 0.177516 Aug 24 04:44:02.384528 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3515/7302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:02 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:02.410869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:02.411628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:02.423077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.423856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.424477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.425580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.426239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.426857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.573210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:02.581689 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f7ae8024-0ce2-4086-b169-608f3e315bb3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1670 microversion: 2.1 time: 0.179860 Aug 24 04:44:02.582317 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3788/7303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:02 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:02.603867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:02.604534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:02.610729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.611231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.611697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.612439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.612915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.613358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.768021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:02.779882 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7327e842-dfa1-4dc5-901c-80e480490d20 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1670 microversion: 2.1 time: 0.179641 Aug 24 04:44:02.780666 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3516/7304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:02 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:02.803177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:02.803859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:02.811931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.812414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.812848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.813578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.814013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.814437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.843700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:44:02.870865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=100 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:02.929930 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-20fb7791-c3f6-44cf-8874-d7ab805f84bf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 204 len: 0 microversion: 2.1 time: 0.130600 Aug 24 04:44:02.930802 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3789/7305] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:44:02 2022] DELETE /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:44:02.939550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:02.940232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:02.946541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.947043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.947732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.948812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:02.949240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:02.949675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:02.953858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:03.093334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:03.102039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4cc49a19-f06a-424c-a84a-fd770f128e55 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1676 microversion: 2.1 time: 0.166392 Aug 24 04:44:03.102603 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3517/7306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:02 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:04.125095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:04.126002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:04.133732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:04.134229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:04.134676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:04.135390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:04.135903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:04.136339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:04.287408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:04.295597 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0b914d59-1f3e-4623-99ca-e4ff298c836c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1676 microversion: 2.1 time: 0.175329 Aug 24 04:44:04.296739 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3790/7307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:04 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:05.180934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-484ae57d-c854-4bd3-89f5-78e731b4dd14 req-97bea941-7c8e-441a-91d0-8f1c5da616cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d2b6e5-13ad-45e7-827f-67eb65b866a2", "name": "network-vif-deleted", "tag": "30851567-2d48-47df-96f4-749fdb6dfab7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:44:05.196656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-484ae57d-c854-4bd3-89f5-78e731b4dd14 req-97bea941-7c8e-441a-91d0-8f1c5da616cf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:05.197169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-484ae57d-c854-4bd3-89f5-78e731b4dd14 req-97bea941-7c8e-441a-91d0-8f1c5da616cf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:05.197775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-484ae57d-c854-4bd3-89f5-78e731b4dd14 req-97bea941-7c8e-441a-91d0-8f1c5da616cf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:05.211232 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-484ae57d-c854-4bd3-89f5-78e731b4dd14 req-97bea941-7c8e-441a-91d0-8f1c5da616cf service nova] Creating event network-vif-deleted:30851567-2d48-47df-96f4-749fdb6dfab7 for instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 on n-h2-846470-15 Aug 24 04:44:05.217960 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-484ae57d-c854-4bd3-89f5-78e731b4dd14 req-97bea941-7c8e-441a-91d0-8f1c5da616cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050200 Aug 24 04:44:05.218280 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3518/7308] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:44:05.319454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:05.320910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:05.328766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:05.329351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:05.329860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:05.330645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:05.331197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:05.331694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:05.370572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:05.371598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:05.372286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:05.374382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lazy-loading 'fault' on Instance uuid 61d2b6e5-13ad-45e7-827f-67eb65b866a2 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:44:05.434411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:05.446121 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1deb1109-30cf-4bd6-aa8e-191a4d32c922 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 200 len: 1329 microversion: 2.1 time: 0.132642 Aug 24 04:44:05.446707 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3791/7309] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:05 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 1329 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:06.472257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:06.472867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:06.481330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:06.481936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:06.482388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:06.483417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:06.484051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:06.484512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:06.498795 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 HTTP/1.1 Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '61d2b6e5-13ad-45e7-827f-67eb65b866a2'} Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:44:06.500521 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea009e7c-40c3-4fa8-a1ce-9b71ccd29283 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 404 len: 111 microversion: 2.1 time: 0.036660 Aug 24 04:44:06.504674 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3519/7310] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:06 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:44:06.517251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:06.517997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:06.524340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:06.524837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:06.525272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:06.525965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:06.526420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:06.526845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:06.540735 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 HTTP/1.1 Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '61d2b6e5-13ad-45e7-827f-67eb65b866a2'} Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:44:06.542458 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c87f057c-577f-445c-8103-62cea0219693 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 404 len: 111 microversion: 2.1 time: 0.031590 Aug 24 04:44:06.547034 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3792/7311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:06 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:44:06.594721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1550792078", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "97984039-df0d-403d-a9d4-47ad3c354114"}], "security_groups": [{"name": "tempest-securitygroup--1150372431"}], "key_name": "tempest-keypair-1213395054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:44:06.718092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] validate_networks() for [('97984039-df0d-403d-a9d4-47ad3c354114', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:44:07.157020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:44:07.157456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:44:07.157953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:44:07.158409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:44:07.158851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:44:07.170033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:07.171291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:07.171808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:07.172576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:07.173059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:07.173700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:07.191382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:44:07.196873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for user c7e86d3ac0e74a8886f56c8b32e63333 and project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:44:07.210048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:44:07.212492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:44:07.260006 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0958b400-90c9-4892-b057-a5528da61946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.669195 Aug 24 04:44:07.260897 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3520/7312] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:44:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:44:07.274154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-660499b5-0864-48e4-9124-7917ee182e72 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:07.275145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-660499b5-0864-48e4-9124-7917ee182e72 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:07.328182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-660499b5-0864-48e4-9124-7917ee182e72 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:07.336437 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-660499b5-0864-48e4-9124-7917ee182e72 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1239 microversion: 2.1 time: 0.068315 Aug 24 04:44:07.337018 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3793/7313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:07 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:08.359502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:08.360281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:08.368759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:08.369300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:08.369796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:08.370744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:08.371483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:08.371985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:08.450685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:08.460293 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e9ac75ef-9751-4f04-b8b5-64dc158b00dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1299 microversion: 2.1 time: 0.106824 Aug 24 04:44:08.460864 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3521/7314] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:08 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:09.482656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:09.483893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:09.492011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:09.492493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:09.492923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:09.493614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:09.494066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:09.494492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:09.628825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:09.637153 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-456c9af1-96e0-450e-afd2-d3c538b88d80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1365 microversion: 2.1 time: 0.158489 Aug 24 04:44:09.637721 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3794/7315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:09 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:09.838888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a2427235-56ab-40a7-9039-a93adda8a4c4 req-5cd16460-9895-498d-bf4a-9488226dc1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86d31dd-200a-4b74-a511-00e59467bb1b", "tag": "285139f6-6bb9-4054-8b60-19d3537ca788"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:44:09.845498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:09.852475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a2427235-56ab-40a7-9039-a93adda8a4c4 req-5cd16460-9895-498d-bf4a-9488226dc1d2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:09.853094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a2427235-56ab-40a7-9039-a93adda8a4c4 req-5cd16460-9895-498d-bf4a-9488226dc1d2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:09.854000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a2427235-56ab-40a7-9039-a93adda8a4c4 req-5cd16460-9895-498d-bf4a-9488226dc1d2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:09.866850 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a2427235-56ab-40a7-9039-a93adda8a4c4 req-5cd16460-9895-498d-bf4a-9488226dc1d2 service nova] Creating event network-changed:285139f6-6bb9-4054-8b60-19d3537ca788 for instance d86d31dd-200a-4b74-a511-00e59467bb1b on n-h1-846470-15 Aug 24 04:44:09.871964 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a2427235-56ab-40a7-9039-a93adda8a4c4 req-5cd16460-9895-498d-bf4a-9488226dc1d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036677 Aug 24 04:44:09.872579 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3522/7316] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:44:10.659911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:10.660521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:10.663657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:10.669145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:10.669632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:10.670070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:10.670762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:10.671218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:10.671643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:10.813197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:10.821665 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-62a0ffa8-1883-415c-8479-0a3d2d2bd0d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1365 microversion: 2.1 time: 0.165737 Aug 24 04:44:10.822238 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3795/7317] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:10 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:11.848996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:11.850205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:11.861241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:11.862106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:11.862806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:11.864017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:11.864963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:11.865406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:12.002129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:12.011139 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-eff5280c-8cf6-4c65-b160-6bd06adb671b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1365 microversion: 2.1 time: 0.170678 Aug 24 04:44:12.011748 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3523/7318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:11 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:13.033523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:13.034144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:13.041698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:13.042193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:13.042633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:13.043344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:13.043841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:13.044281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:13.188848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:13.197619 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-106be014-5ef2-46b1-bbf1-e3a9393d1d30 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1365 microversion: 2.1 time: 0.168049 Aug 24 04:44:13.198207 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3796/7319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:13 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:14.222500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:14.223384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:14.230941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:14.231444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:14.231922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:14.232626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:14.233091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:14.233531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:14.372788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:14.382063 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8c2076de-0dc5-479a-9ea4-6385b1057bc1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1365 microversion: 2.1 time: 0.166121 Aug 24 04:44:14.382672 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3524/7320] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:14 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:15.405013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:15.405694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:15.413065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:15.413552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:15.413989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:15.414684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:15.415135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:15.415567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:15.564552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:15.572979 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3b3702ba-5d7c-4041-bba1-12598068d050 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1365 microversion: 2.1 time: 0.172056 Aug 24 04:44:15.573888 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3797/7321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:15 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:15.624005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-07b3e584-e989-4d87-a4d4-f55e5d48cef5 req-cfa4a59e-de1c-481a-8e22-72b653b4bb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86d31dd-200a-4b74-a511-00e59467bb1b", "name": "network-vif-plugged", "status": "completed", "tag": "285139f6-6bb9-4054-8b60-19d3537ca788"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:44:15.635030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-07b3e584-e989-4d87-a4d4-f55e5d48cef5 req-cfa4a59e-de1c-481a-8e22-72b653b4bb6d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:15.635510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-07b3e584-e989-4d87-a4d4-f55e5d48cef5 req-cfa4a59e-de1c-481a-8e22-72b653b4bb6d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:15.635979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-07b3e584-e989-4d87-a4d4-f55e5d48cef5 req-cfa4a59e-de1c-481a-8e22-72b653b4bb6d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:15.647852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-07b3e584-e989-4d87-a4d4-f55e5d48cef5 req-cfa4a59e-de1c-481a-8e22-72b653b4bb6d service nova] Creating event network-vif-plugged:285139f6-6bb9-4054-8b60-19d3537ca788 for instance d86d31dd-200a-4b74-a511-00e59467bb1b on n-h1-846470-15 Aug 24 04:44:15.653099 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-07b3e584-e989-4d87-a4d4-f55e5d48cef5 req-cfa4a59e-de1c-481a-8e22-72b653b4bb6d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 Aug 24 04:44:15.653695 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3525/7322] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:44:16.595742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:16.596592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:16.603946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:16.604434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:16.604870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:16.605571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:16.606018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:16.606439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:16.743934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:16.755193 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b73c2659-7311-4a86-98e3-a183fe3d3187 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1365 microversion: 2.1 time: 0.163504 Aug 24 04:44:16.755844 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3798/7323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:16 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:17.778430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:17.779814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:17.786295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:17.787579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:17.799308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:17.800195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:17.800980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:17.802257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:17.802942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:17.803401 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:17.941516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:44:17.953115 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b22a94d4-82ed-4549-b38f-ec3fda88d8d8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1553 microversion: 2.1 time: 0.177905 Aug 24 04:44:17.953727 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3526/7324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:44:17 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:44:17.974880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:44:17.975429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:44:17.977266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:17.984574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:17.985065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:17.985514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:17.986214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:17.986676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:17.987108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:18.074302 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-45833dc0-dde8-46e7-8906-0b128c0c6353 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103532 Aug 24 04:44:18.074954 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3799/7325] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:44:17 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:44:19.081767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-35e7cb75-0bd8-490c-981b-904ed063222a req-7bf5c707-cd2c-4435-9f83-56138cabd2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86d31dd-200a-4b74-a511-00e59467bb1b", "tag": "285139f6-6bb9-4054-8b60-19d3537ca788"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:44:19.092602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-35e7cb75-0bd8-490c-981b-904ed063222a req-7bf5c707-cd2c-4435-9f83-56138cabd2c0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:44:19.093081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-35e7cb75-0bd8-490c-981b-904ed063222a req-7bf5c707-cd2c-4435-9f83-56138cabd2c0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:44:19.093762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-35e7cb75-0bd8-490c-981b-904ed063222a req-7bf5c707-cd2c-4435-9f83-56138cabd2c0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:44:19.106007 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-35e7cb75-0bd8-490c-981b-904ed063222a req-7bf5c707-cd2c-4435-9f83-56138cabd2c0 service nova] Creating event network-changed:285139f6-6bb9-4054-8b60-19d3537ca788 for instance d86d31dd-200a-4b74-a511-00e59467bb1b on n-h1-846470-15 Aug 24 04:44:19.111009 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-35e7cb75-0bd8-490c-981b-904ed063222a req-7bf5c707-cd2c-4435-9f83-56138cabd2c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033197 Aug 24 04:44:19.111602 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3527/7326] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:44:34.274588 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:44:34.275387 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:44:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:45:16.834020 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:45:16.834765 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:45:31.329229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=9 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:31.330367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:31.337825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eee07dc1-bb1a-462f-b1d0-118ed7c4d8d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:45:31.349643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee07dc1-bb1a-462f-b1d0-118ed7c4d8d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:31.350125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee07dc1-bb1a-462f-b1d0-118ed7c4d8d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:31.350555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eee07dc1-bb1a-462f-b1d0-118ed7c4d8d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:31.374349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eee07dc1-bb1a-462f-b1d0-118ed7c4d8d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Going to try to stop instance {{(pid=122536) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 04:45:31.426338 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eee07dc1-bb1a-462f-b1d0-118ed7c4d8d6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/action" status: 202 len: 0 microversion: 2.1 time: 0.100816 Aug 24 04:45:31.427330 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3800/7327] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:45:31 2022] POST /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:45:31.434586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=11 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:31.435343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=41 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:31.439958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:31.440655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:31.447922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:31.448740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:31.449195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:31.449915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:31.450408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:31.450844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:31.604481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:31.612765 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-294a724c-711b-4157-ad8a-4305a301e0fc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.180816 Aug 24 04:45:31.613338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3528/7328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:31 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:32.642542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:32.643245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:32.650463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:32.650971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:32.651411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:32.652183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:32.652638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:32.653071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:32.800318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:32.813230 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb0b0ffc-15fe-4cd7-a73e-18a5f68aaed8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.175593 Aug 24 04:45:32.814167 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3801/7329] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:32 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:33.839121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:33.839856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:33.848276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:33.849233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:33.849901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:33.850737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:33.851289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:33.851870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:33.991044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:33.999248 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-836b274a-22e5-46f5-b4b6-b8b0c8a76c2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.164838 Aug 24 04:45:33.999844 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3529/7330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:33 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:35.025588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:35.026585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:35.037373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:35.037868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:35.038310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:35.039015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:35.039477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:35.039957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:35.182181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:35.190542 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d79c39ae-18d0-44d9-b580-58af255e206a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.171849 Aug 24 04:45:35.191119 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3802/7331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:35 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:36.214223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:36.214797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:36.222890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:36.223611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:36.224181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:36.224965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:36.225489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:36.225981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:36.364110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:36.372617 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-afe5ed6d-4b8f-44e5-9958-170baf848db9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.163130 Aug 24 04:45:36.373195 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3530/7332] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:36 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:37.397372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:37.397964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:37.405188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:37.405685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:37.406116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:37.406814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:37.407269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:37.407691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:37.561232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:37.572537 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-61403cfb-f2d6-49b5-9d25-e21c527b1a80 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.180874 Aug 24 04:45:37.573366 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3803/7333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:37 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:38.600220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:38.600860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:38.610941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:38.611864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:38.612683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:38.613993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:38.614874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:38.615736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:38.763253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:38.771470 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e0430713-e86a-40f9-921c-5d435be3b432 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.176540 Aug 24 04:45:38.772083 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3531/7334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:38 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:39.797380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:39.798392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:39.806986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:39.807479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:39.807955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:39.808664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:39.809120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:39.809629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:39.942375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:39.950711 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3b630202-dd34-4dca-9501-ab8192a0abed tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.159883 Aug 24 04:45:39.951287 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3804/7335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:39 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:40.976080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:40.976788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:40.985368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:40.985962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:40.986492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:40.987326 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:40.987955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:40.988450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:41.142707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:41.152335 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9f77b121-26c3-4fa5-a015-c7caa5e5a1bc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.182032 Aug 24 04:45:41.152930 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3532/7336] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:40 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:42.183560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:42.184277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:42.192979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:42.193551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:42.194096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:42.194885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:42.195419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:42.195955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:42.333017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:42.345037 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-44026dfa-f2c6-42f3-9f37-df1bf25673da tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1658 microversion: 2.1 time: 0.166043 Aug 24 04:45:42.345804 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3805/7337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:42 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1658 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:42.367279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:45:42.369605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:42.377015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:42.377527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:42.377985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:42.378696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:42.379164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:42.379605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:42.412407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:42.419103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Old instance type m1.heat2, new instance type m1.heat {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:45:42.426249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:45:42.426768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:45:42.427218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:45:42.427634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:45:42.428090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:45:42.498991 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1687e41c-321d-4a00-b209-f57621cd7dce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/action" status: 202 len: 0 microversion: 2.1 time: 0.135798 Aug 24 04:45:42.499894 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3533/7338] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:45:42 2022] POST /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:45:42.508868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:42.509481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:42.515718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:42.516214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:42.516677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:42.517418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:42.517874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:42.518300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:42.685692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:42.694690 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-efb0e68a-dd5e-42d1-8a37-593e60cd2602 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.190481 Aug 24 04:45:42.695302 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3806/7339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:42 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:43.716831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:43.717450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:43.724697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:43.725196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:43.725644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:43.726339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:43.726805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:43.727242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:43.874529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:43.884533 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c25d21de-f710-4066-a250-51c424420b06 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1681 microversion: 2.1 time: 0.171833 Aug 24 04:45:43.885091 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3534/7340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:43 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:44.911650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:44.912607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:44.924559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:44.925423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:44.926215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:44.927319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:44.927809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:44.928256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:45.064760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:45.074203 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ee7dea27-a30c-4167-aefa-6c871418dc84 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1686 microversion: 2.1 time: 0.169399 Aug 24 04:45:45.074997 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3807/7341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:44 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:46.102378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:46.103002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:46.110645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:46.111153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:46.111600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:46.112343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:46.112809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:46.113248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:46.269607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:46.282743 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4d8d139-e357-428b-a90d-db9eb66c056e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1686 microversion: 2.1 time: 0.186323 Aug 24 04:45:46.283617 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3535/7342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:46 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:47.305396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:47.306277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:47.314905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:47.315410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:47.315826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-58159b20-134e-4107-b462-7e4676c6622c req-91c072c9-3c12-4b9d-a881-8c0fe92bd4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86d31dd-200a-4b74-a511-00e59467bb1b", "name": "network-vif-unplugged", "status": "completed", "tag": "285139f6-6bb9-4054-8b60-19d3537ca788"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:45:47.316282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:47.316597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:47.317062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:47.317491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:47.327193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-58159b20-134e-4107-b462-7e4676c6622c req-91c072c9-3c12-4b9d-a881-8c0fe92bd4ea service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:47.328055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-58159b20-134e-4107-b462-7e4676c6622c req-91c072c9-3c12-4b9d-a881-8c0fe92bd4ea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:47.328581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-58159b20-134e-4107-b462-7e4676c6622c req-91c072c9-3c12-4b9d-a881-8c0fe92bd4ea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:47.341568 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-58159b20-134e-4107-b462-7e4676c6622c req-91c072c9-3c12-4b9d-a881-8c0fe92bd4ea service nova] Creating event network-vif-unplugged:285139f6-6bb9-4054-8b60-19d3537ca788 for instance d86d31dd-200a-4b74-a511-00e59467bb1b on n-h2-846470-15 Aug 24 04:45:47.347519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-58159b20-134e-4107-b462-7e4676c6622c req-91c072c9-3c12-4b9d-a881-8c0fe92bd4ea service nova] Instance d86d31dd-200a-4b74-a511-00e59467bb1b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:45:47.361866 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-58159b20-134e-4107-b462-7e4676c6622c req-91c072c9-3c12-4b9d-a881-8c0fe92bd4ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116697 Aug 24 04:45:47.362500 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3808/7343] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:45:47.564348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:47.573362 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4395f4d9-0e4e-4afc-9e13-5cec7bb3f005 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1685 microversion: 2.1 time: 0.272801 Aug 24 04:45:47.574288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3536/7344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:47 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1685 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:48.599562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:48.600279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:48.607003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:48.607492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:48.607967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:48.608666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:48.609125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:48.609549 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:48.754893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:48.763556 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1be111f3-605f-42ac-8606-c7b8564a3304 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1683 microversion: 2.1 time: 0.170271 Aug 24 04:45:48.764241 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3809/7345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:48 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:49.385212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1d1167b6-de73-4b00-955f-24ffceeabb01 req-257e2662-29e4-497b-8af8-eb8456d4cdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86d31dd-200a-4b74-a511-00e59467bb1b", "tag": "285139f6-6bb9-4054-8b60-19d3537ca788"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:45:49.395914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d1167b6-de73-4b00-955f-24ffceeabb01 req-257e2662-29e4-497b-8af8-eb8456d4cdf4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:49.396405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d1167b6-de73-4b00-955f-24ffceeabb01 req-257e2662-29e4-497b-8af8-eb8456d4cdf4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:49.396859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1d1167b6-de73-4b00-955f-24ffceeabb01 req-257e2662-29e4-497b-8af8-eb8456d4cdf4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:49.409532 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1d1167b6-de73-4b00-955f-24ffceeabb01 req-257e2662-29e4-497b-8af8-eb8456d4cdf4 service nova] Creating event network-changed:285139f6-6bb9-4054-8b60-19d3537ca788 for instance d86d31dd-200a-4b74-a511-00e59467bb1b on n-h2-846470-15 Aug 24 04:45:49.415698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-1d1167b6-de73-4b00-955f-24ffceeabb01 req-257e2662-29e4-497b-8af8-eb8456d4cdf4 service nova] Instance d86d31dd-200a-4b74-a511-00e59467bb1b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:45:49.427590 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1d1167b6-de73-4b00-955f-24ffceeabb01 req-257e2662-29e4-497b-8af8-eb8456d4cdf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048141 Aug 24 04:45:49.428217 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3537/7346] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:45:49.787263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:49.788005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:49.795336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:49.795863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:49.796295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:49.797011 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:49.797469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:49.797895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:49.945050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:49.953758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-990a8297-023b-41ca-a1d9-b28462345946 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1683 microversion: 2.1 time: 0.171459 Aug 24 04:45:49.954424 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3810/7347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:49 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:50.976729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:50.978416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:50.985022 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:50.985632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:50.986029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:50.986807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:50.987519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:50.988001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:51.207311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:51.216201 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e22fc9b-6283-4044-94f3-1ecb9dcc356a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1679 microversion: 2.1 time: 0.245316 Aug 24 04:45:51.217095 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3538/7348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:50 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:51.239286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:45:51.240081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:51.247110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:51.247600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:51.248125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:51.248850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:51.249302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:51.249724 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:51.318658 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-99590285-2405-4cd3-a6db-38cb77430094 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/action" status: 204 len: 0 microversion: 2.1 time: 0.082983 Aug 24 04:45:51.319599 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3811/7349] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:45:51 2022] POST /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:45:51.330553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:51.331470 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:51.338778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:51.339521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:51.340341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:51.341620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:51.342281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:51.342972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:51.938546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:51.946666 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0a55707a-2e62-483e-8044-c6baeaee4e59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1679 microversion: 2.1 time: 0.621430 Aug 24 04:45:51.947225 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3539/7350] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:51 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1679 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:52.971842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:52.972830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:52.980663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:52.981372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:52.981893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:52.982690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:52.983204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:52.983710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:53.143438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:53.155018 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-674d0335-047e-495b-a5e3-78a2862d9e22 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1679 microversion: 2.1 time: 0.187583 Aug 24 04:45:53.169215 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3812/7351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:52 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:53.380357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-38f794c3-3d4e-4cf3-bfb7-ab886618bf32 req-53dc800c-e0f9-4f14-a457-a60ede4db655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86d31dd-200a-4b74-a511-00e59467bb1b", "name": "network-vif-plugged", "status": "completed", "tag": "285139f6-6bb9-4054-8b60-19d3537ca788"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:45:53.391244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-38f794c3-3d4e-4cf3-bfb7-ab886618bf32 req-53dc800c-e0f9-4f14-a457-a60ede4db655 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:53.391877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-38f794c3-3d4e-4cf3-bfb7-ab886618bf32 req-53dc800c-e0f9-4f14-a457-a60ede4db655 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:53.392391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-38f794c3-3d4e-4cf3-bfb7-ab886618bf32 req-53dc800c-e0f9-4f14-a457-a60ede4db655 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:53.406769 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-38f794c3-3d4e-4cf3-bfb7-ab886618bf32 req-53dc800c-e0f9-4f14-a457-a60ede4db655 service nova] Creating event network-vif-plugged:285139f6-6bb9-4054-8b60-19d3537ca788 for instance d86d31dd-200a-4b74-a511-00e59467bb1b on n-h2-846470-15 Aug 24 04:45:53.411694 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-38f794c3-3d4e-4cf3-bfb7-ab886618bf32 req-53dc800c-e0f9-4f14-a457-a60ede4db655 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097966 Aug 24 04:45:53.412801 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3540/7352] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:45:54.179148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:54.179846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:54.187334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:54.187845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:54.188281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:54.188971 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:54.189401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:54.189848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:54.337406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:54.345388 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-40b42987-55d0-4b7f-9e4f-41ab3a2f2623 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1658 microversion: 2.1 time: 0.171504 Aug 24 04:45:54.345959 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3813/7353] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:54 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1658 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:54.366976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:54.367695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:54.375229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:54.375765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:54.376217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:54.376923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:54.377388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:54.377826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:54.516028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:54.527976 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4632e79b-71ad-415d-a57b-63623f127888 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1658 microversion: 2.1 time: 0.165258 Aug 24 04:45:54.528730 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3541/7354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:54 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1658 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:54.551067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2dd1e7e-1699-4031-a54b-81c2812fc6c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:45:54.557365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2dd1e7e-1699-4031-a54b-81c2812fc6c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:54.557877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2dd1e7e-1699-4031-a54b-81c2812fc6c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:54.558317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2dd1e7e-1699-4031-a54b-81c2812fc6c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:54.590089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a2dd1e7e-1699-4031-a54b-81c2812fc6c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Going to try to start instance {{(pid=122536) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 04:45:54.594786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:54.639482 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2dd1e7e-1699-4031-a54b-81c2812fc6c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/action" status: 202 len: 0 microversion: 2.1 time: 0.092366 Aug 24 04:45:54.640127 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3814/7355] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:45:54 2022] POST /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:45:54.648795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:54.649547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:54.655906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:54.656472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:54.656935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:54.657771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:54.658245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:54.658679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:54.853739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:54.862367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d3c2fd36-19e0-4720-aae6-8dfe0a8cfd59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1667 microversion: 2.1 time: 0.217551 Aug 24 04:45:54.862922 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3542/7356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:54 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1667 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:55.886438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:55.887447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:55.893705 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:55.894184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:55.894616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:55.895358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:55.896108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:55.896300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:56.047751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:56.060682 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ade75330-44a1-4515-b281-701cfc355a38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1671 microversion: 2.1 time: 0.179301 Aug 24 04:45:56.061466 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3815/7357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:55 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:56.084418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:56.084950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:56.095324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:56.095945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:56.096539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:56.097330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:56.097822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:56.098628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:56.124854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:45:56.139971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:56.221942 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-76c4b546-c960-431a-aee0-061ab9d5c5de tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 204 len: 0 microversion: 2.1 time: 0.143309 Aug 24 04:45:56.222668 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3543/7358] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:45:56 2022] DELETE /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:45:56.231271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:56.231923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:56.238406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:56.238933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:56.239422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:56.240194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:56.240660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:56.241095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:56.381293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:56.389538 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-57430a5c-02e2-4949-9911-c58dbc6f4b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1677 microversion: 2.1 time: 0.162221 Aug 24 04:45:56.390200 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3816/7359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:56 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:57.414261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:57.414880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:57.422517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:57.423034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:57.423519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:57.424276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:57.424748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:57.425192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:57.577451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:57.586181 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05ad88fc-a010-4b75-9571-f95483bdd6eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1677 microversion: 2.1 time: 0.177075 Aug 24 04:45:57.586777 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3544/7360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:57 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:58.514690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-a65dfbd8-0343-4573-b0d2-c3365d5fd856 req-11a8c530-0ccb-41a5-b427-641cdee019f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86d31dd-200a-4b74-a511-00e59467bb1b", "name": "network-vif-deleted", "tag": "285139f6-6bb9-4054-8b60-19d3537ca788"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:45:58.528027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a65dfbd8-0343-4573-b0d2-c3365d5fd856 req-11a8c530-0ccb-41a5-b427-641cdee019f7 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:58.528512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a65dfbd8-0343-4573-b0d2-c3365d5fd856 req-11a8c530-0ccb-41a5-b427-641cdee019f7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:58.529137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-a65dfbd8-0343-4573-b0d2-c3365d5fd856 req-11a8c530-0ccb-41a5-b427-641cdee019f7 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:58.543442 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-a65dfbd8-0343-4573-b0d2-c3365d5fd856 req-11a8c530-0ccb-41a5-b427-641cdee019f7 service nova] Creating event network-vif-deleted:285139f6-6bb9-4054-8b60-19d3537ca788 for instance d86d31dd-200a-4b74-a511-00e59467bb1b on n-h2-846470-15 Aug 24 04:45:58.549072 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-a65dfbd8-0343-4573-b0d2-c3365d5fd856 req-11a8c530-0ccb-41a5-b427-641cdee019f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038895 Aug 24 04:45:58.549681 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3817/7361] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:45:58.612735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:58.613728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:58.621304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:58.621821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:58.622279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:58.623006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:58.623486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:58.623962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:58.666685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:58.667203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:58.667655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:58.668159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lazy-loading 'fault' on Instance uuid d86d31dd-200a-4b74-a511-00e59467bb1b {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:45:58.719376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:45:58.729105 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b87b047-f1d6-4220-a190-6b7c040660c2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 200 len: 1329 microversion: 2.1 time: 0.120230 Aug 24 04:45:58.729756 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3545/7362] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:58 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 1329 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:45:59.756807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:59.757504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:59.764644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:59.765128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:59.765562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:59.766253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:59.766716 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:59.767187 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:59.782262 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b HTTP/1.1 Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd86d31dd-200a-4b74-a511-00e59467bb1b'} Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:45:59.784009 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86cd9c42-3694-46cf-897f-5ede82a3dc9c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 404 len: 111 microversion: 2.1 time: 0.036468 Aug 24 04:45:59.789301 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3818/7363] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:59 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:45:59.811989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:59.813078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:45:59.822607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:59.823119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:59.823925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:59.824675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:59.825151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:59.825597 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:59.839518 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b HTTP/1.1 Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd86d31dd-200a-4b74-a511-00e59467bb1b'} Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:45:59.841230 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-077b15df-9cee-483b-9cb5-02644a3b62e9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 404 len: 111 microversion: 2.1 time: 0.037330 Aug 24 04:45:59.845180 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3546/7364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:45:59 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:45:59.893201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1394154401", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "97984039-df0d-403d-a9d4-47ad3c354114"}], "security_groups": [{"name": "tempest-securitygroup--1150372431"}], "key_name": "tempest-keypair-1213395054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:46:00.013644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] validate_networks() for [('97984039-df0d-403d-a9d4-47ad3c354114', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:46:00.420937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:46:00.421367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:46:00.421810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:46:00.422215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:46:00.422653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:46:00.432982 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:00.433501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:00.433929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:00.434650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:00.435101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:00.435520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:00.455163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:46:00.461039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for user c7e86d3ac0e74a8886f56c8b32e63333 and project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:46:00.475268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:46:00.477666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:46:00.528447 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e873192a-7a8f-44d9-8e8e-07087290de38 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638757 Aug 24 04:46:00.529117 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3819/7365] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:45:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:46:00.540782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46b86800-4ea1-4a07-8270-a0ec2278b89a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:00.541412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-46b86800-4ea1-4a07-8270-a0ec2278b89a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:00.597987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-46b86800-4ea1-4a07-8270-a0ec2278b89a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:00.606062 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-46b86800-4ea1-4a07-8270-a0ec2278b89a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1239 microversion: 2.1 time: 0.069670 Aug 24 04:46:00.606622 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3547/7366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:00 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:01.628466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:01.629120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:01.632124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:01.639211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:01.639707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:01.640158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:01.640865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:01.641314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:01.641738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:01.715143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:01.722997 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8f0d0087-3b47-452c-bdf6-1800e21f8308 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1299 microversion: 2.1 time: 0.098884 Aug 24 04:46:01.723933 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3820/7367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:01 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:02.749152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:02.749926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:02.752888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:02.759926 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:02.760449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:02.760911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:02.761642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:02.762125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:02.762574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:03.004803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:03.012995 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-469ca286-3170-42c6-9cae-cfd7410e0dad tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1365 microversion: 2.1 time: 0.267797 Aug 24 04:46:03.027703 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3548/7368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:02 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:03.173797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-32bcc9f5-24a8-4b14-8c66-cd620823160b req-04eb089a-7f58-45ad-be53-9be13f5b52d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:46:03.185112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-32bcc9f5-24a8-4b14-8c66-cd620823160b req-04eb089a-7f58-45ad-be53-9be13f5b52d8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:03.185586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-32bcc9f5-24a8-4b14-8c66-cd620823160b req-04eb089a-7f58-45ad-be53-9be13f5b52d8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:03.186018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-32bcc9f5-24a8-4b14-8c66-cd620823160b req-04eb089a-7f58-45ad-be53-9be13f5b52d8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:03.197851 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-32bcc9f5-24a8-4b14-8c66-cd620823160b req-04eb089a-7f58-45ad-be53-9be13f5b52d8 service nova] Creating event network-changed:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h1-846470-15 Aug 24 04:46:03.203493 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-32bcc9f5-24a8-4b14-8c66-cd620823160b req-04eb089a-7f58-45ad-be53-9be13f5b52d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034205 Aug 24 04:46:03.204137 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3821/7369] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:46:04.034925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:04.035540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:04.043763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:04.044298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:04.044746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:04.045467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:04.045938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:04.046374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:04.352627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:04.361441 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d3f1a26-f0cc-42a9-b3c3-f1bbbe6b6fcd tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1365 microversion: 2.1 time: 0.330531 Aug 24 04:46:04.362112 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3549/7370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:04 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:05.388484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:05.389646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:05.398476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:05.399033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:05.399538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:05.400389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:05.400891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:05.401358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:05.545910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:05.558771 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dcf9b321-93a7-4ee6-8c55-2b529e854426 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1365 microversion: 2.1 time: 0.177461 Aug 24 04:46:05.559536 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3822/7371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:05 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:06.588800 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:06.590125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:06.601689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:06.602199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:06.602653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:06.603374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:06.603892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:06.604330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:06.748892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:06.757272 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d0f18415-1e10-4a51-920d-8f5707b55f10 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1365 microversion: 2.1 time: 0.175698 Aug 24 04:46:06.757851 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3550/7372] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:06 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:07.786513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:07.787402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:07.795395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:07.795912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:07.796347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:07.797030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:07.797483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:07.797987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:07.930867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:07.939151 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a935e14-dab5-49dc-b76d-749700e83bae tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1365 microversion: 2.1 time: 0.162680 Aug 24 04:46:07.939718 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3823/7373] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:07 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:08.962393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:08.962989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:08.971232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:08.971859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:08.972353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:08.973144 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:08.973652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:08.974138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:09.115701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:09.123859 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a8ff4880-5b92-4fd1-a130-8317145dda3c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1365 microversion: 2.1 time: 0.166580 Aug 24 04:46:09.124677 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3551/7374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:08 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:10.155120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:10.156098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:10.165601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:10.166086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:10.166529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:10.167228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:10.167692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:10.168128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:10.314043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:10.322189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f175984b-91d4-4eb2-9fc6-cc3a9caadaa2 req-18e31733-8365-4526-86ea-b7dec914a360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "name": "network-vif-plugged", "status": "completed", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:46:10.323244 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ba15ed87-a593-4d86-a682-4d4c1e231061 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1365 microversion: 2.1 time: 0.174130 Aug 24 04:46:10.324192 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3824/7375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:10 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:10.333531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f175984b-91d4-4eb2-9fc6-cc3a9caadaa2 req-18e31733-8365-4526-86ea-b7dec914a360 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:10.334508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f175984b-91d4-4eb2-9fc6-cc3a9caadaa2 req-18e31733-8365-4526-86ea-b7dec914a360 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:10.334959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f175984b-91d4-4eb2-9fc6-cc3a9caadaa2 req-18e31733-8365-4526-86ea-b7dec914a360 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:10.348410 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f175984b-91d4-4eb2-9fc6-cc3a9caadaa2 req-18e31733-8365-4526-86ea-b7dec914a360 service nova] Creating event network-vif-plugged:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h1-846470-15 Aug 24 04:46:10.353903 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f175984b-91d4-4eb2-9fc6-cc3a9caadaa2 req-18e31733-8365-4526-86ea-b7dec914a360 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035856 Aug 24 04:46:10.354525 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3552/7376] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:46:11.347622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:11.348224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:11.350729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:11.351271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:11.359849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:11.360377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:11.360864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:11.361635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:11.362142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:11.362627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:11.503387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:11.518366 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0cb9e6d2-427e-4915-b629-932b36a4da3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1365 microversion: 2.1 time: 0.175162 Aug 24 04:46:11.518977 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3825/7377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:11 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:12.538151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:12.543208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:12.543964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:12.550885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:12.551397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:12.551906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:12.552624 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:12.553099 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:12.553572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:12.697662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:46:12.706054 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a09a40a1-21c7-496b-93f7-7e97df6291d0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1553 microversion: 2.1 time: 0.169171 Aug 24 04:46:12.706617 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3553/7378] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:46:12 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:46:12.734767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:46:12.735316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:46:12.742959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:12.743446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:12.743912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:12.744600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:12.745049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:12.745473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:12.833415 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dab240df-7412-43ad-b9d4-7681378f6519 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102182 Aug 24 04:46:12.834367 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3826/7379] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:46:12 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:46:14.191272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-95bbb767-dc55-49d6-a2b0-26423cd53ddc req-497afbac-02d4-4202-8aaf-d4b990a7f8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:46:14.202293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-95bbb767-dc55-49d6-a2b0-26423cd53ddc req-497afbac-02d4-4202-8aaf-d4b990a7f8b1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:46:14.202892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-95bbb767-dc55-49d6-a2b0-26423cd53ddc req-497afbac-02d4-4202-8aaf-d4b990a7f8b1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:46:14.203399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-95bbb767-dc55-49d6-a2b0-26423cd53ddc req-497afbac-02d4-4202-8aaf-d4b990a7f8b1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:46:14.216297 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-95bbb767-dc55-49d6-a2b0-26423cd53ddc req-497afbac-02d4-4202-8aaf-d4b990a7f8b1 service nova] Creating event network-changed:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h1-846470-15 Aug 24 04:46:14.221910 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-95bbb767-dc55-49d6-a2b0-26423cd53ddc req-497afbac-02d4-4202-8aaf-d4b990a7f8b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091329 Aug 24 04:46:14.222651 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3554/7380] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:27.190829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=13 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:27.191709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:27.258976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:27.261398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:27.267883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:27.268375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:27.268815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:27.269524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:27.269983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:27.270415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:27.304083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:27.315303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Old instance type m1.heat2, new instance type m1.heat {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:47:27.326445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:47:27.326999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:47:27.327729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:47:27.328473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:47:27.329109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:47:27.401146 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6babc254-9091-4c38-8a6e-98edc749225f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.214365 Aug 24 04:47:27.405544 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3827/7381] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:47:27 2022] POST /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:47:27.412008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=13 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:27.413951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:27.419282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:27.420045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:27.429257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:27.430040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:27.430437 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:27.431466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:27.432507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:27.432877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:27.583728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:27.592267 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0d3194a3-28f0-4f30-8bdf-0467ec406666 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1680 microversion: 2.1 time: 0.183766 Aug 24 04:47:27.592843 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3555/7382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:27 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:28.617337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:28.617967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:28.625437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:28.625925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:28.626380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:28.627113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:28.627575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:28.628035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:28.774381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:28.784396 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0574313e-23ab-46ef-8bff-7de7775e1d16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1680 microversion: 2.1 time: 0.172295 Aug 24 04:47:28.785163 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3828/7383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:28 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:29.812023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:29.812828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:29.821826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:29.822354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:29.822831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:29.823558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:29.824036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:29.824803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:29.973371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:29.981809 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5eea6959-0c36-48ae-94fc-0f319da4a47c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.173734 Aug 24 04:47:29.982411 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3556/7384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:29 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:31.005292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:31.005985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:31.013614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:31.014099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:31.014529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:31.015228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:31.015946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:31.016484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:31.157364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:31.165812 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6cc67839-0ee6-4566-ba5b-ac9e24054205 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.164628 Aug 24 04:47:31.166410 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3829/7385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:30 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:32.188436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:32.189058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:32.197148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:32.197674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:32.198272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:32.199408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:32.200561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:32.201278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:32.349263 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:32.363082 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8208d458-8c80-45e1-b2fe-3e445b992176 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.178631 Aug 24 04:47:32.363901 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3557/7386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:32 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:33.391516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:33.392445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:33.399931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:33.400630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:33.400900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:33.401635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:33.402103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:33.402544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:33.555108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:33.563857 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-17ea8840-272b-4394-bf1e-d7e5c4a62b59 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.176969 Aug 24 04:47:33.564482 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3830/7387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:33 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:47:34.587008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:34.587687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:34.596879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:34.597413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:34.597887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:34.598640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:34.599136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:34.599600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:34.765110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:34.776706 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9ae24469-bea9-45f1-b36f-12933f328142 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.193945 Aug 24 04:47:34.777375 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3558/7388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:34 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:35.805027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:35.805648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:35.812591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:35.813073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:35.813503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:35.814324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:35.815039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:35.815539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:35.953091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:35.961809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8c654be6-52ff-4f8c-a7c9-652028f18b68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.161702 Aug 24 04:47:35.962359 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3831/7389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:35 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:36.985112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:36.985950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:36.995488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:36.996272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:36.996749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:36.997780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:36.998405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:36.998848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:37.151449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:37.160744 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-df4aadbb-9eee-4509-a402-d797c00c772a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.180969 Aug 24 04:47:37.161327 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3559/7390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:36 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:38.184547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:38.185191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:38.192618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:38.193155 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:38.193687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:38.194391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:38.194981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:38.195607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:38.355483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:38.364130 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b304e15f-09f6-49c9-a7d9-bd6a3404ba16 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.183890 Aug 24 04:47:38.364711 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3832/7391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:38 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:39.388424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:39.389211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:39.398701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:39.399273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:39.399851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:39.400654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:39.401150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:39.401618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:39.545842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:39.554865 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e513e487-f6d8-42e7-9e13-b12ef572382a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.172735 Aug 24 04:47:39.555492 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3560/7392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:39 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:40.578137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:40.578726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:40.586731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:40.587231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:40.587702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:40.588443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:40.589582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:40.589582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:40.748755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:40.757605 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6b6c6daf-6876-43c9-9cbd-ef2ed359e85a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.183800 Aug 24 04:47:40.758194 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3833/7393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:40 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:41.780281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:41.780891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:41.788506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:41.788982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:41.789930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:41.790999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:41.791475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:41.791943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:41.942932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:41.951345 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c39502a8-6545-43f8-bd31-7ee604eaf7a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.175331 Aug 24 04:47:41.951956 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3561/7394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:41 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:42.976826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:42.977684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:42.986903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:42.987654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:42.988220 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:42.989267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:42.990430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:42.990941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:43.156104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:43.165109 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c58d4b15-be29-42cf-abbf-91295647ab68 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.194110 Aug 24 04:47:43.165696 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3834/7395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:42 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:44.190983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:44.191603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:44.199506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:44.200447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:44.200895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:44.201607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:44.202073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:44.202506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:44.362838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:44.370933 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2d072884-84b5-4bd8-bf79-b14dad0fa74a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.184677 Aug 24 04:47:44.371511 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3562/7396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:44 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:45.393646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:45.394205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:45.401858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:45.402378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:45.402851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:45.403581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:45.404087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:45.404538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:45.568889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:45.577723 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e737eec9-21b6-4ae3-a210-3a785bb22f34 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.188110 Aug 24 04:47:45.578341 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3835/7397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:45 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:47:46.604579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:46.605836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:46.616506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:46.617103 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:46.617649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:46.618500 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:46.619061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:46.619574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:46.814055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:46.822986 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e27b7f2a-9b2c-4e82-b2eb-d2ea41e8d99e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1685 microversion: 2.1 time: 0.226027 Aug 24 04:47:46.824205 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3563/7398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:46 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1685 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:47.233347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-871ae1bf-db38-4b41-a914-a555c637be8f req-5038d0fd-4bba-4719-ac1f-6b16a4dd8ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "name": "network-vif-unplugged", "status": "completed", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:47.245099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-871ae1bf-db38-4b41-a914-a555c637be8f req-5038d0fd-4bba-4719-ac1f-6b16a4dd8ee3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:47.245528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-871ae1bf-db38-4b41-a914-a555c637be8f req-5038d0fd-4bba-4719-ac1f-6b16a4dd8ee3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:47.245978 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-871ae1bf-db38-4b41-a914-a555c637be8f req-5038d0fd-4bba-4719-ac1f-6b16a4dd8ee3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:47.259047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-871ae1bf-db38-4b41-a914-a555c637be8f req-5038d0fd-4bba-4719-ac1f-6b16a4dd8ee3 service nova] Creating event network-vif-unplugged:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h2-846470-15 Aug 24 04:47:47.265009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-871ae1bf-db38-4b41-a914-a555c637be8f req-5038d0fd-4bba-4719-ac1f-6b16a4dd8ee3 service nova] Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:47:47.277837 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-871ae1bf-db38-4b41-a914-a555c637be8f req-5038d0fd-4bba-4719-ac1f-6b16a4dd8ee3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048239 Aug 24 04:47:47.278384 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3836/7399] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:47.851324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:47.852364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:47.860027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:47.860545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:47.860990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:47.861774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:47.862501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:47.862951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:48.052927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:48.062531 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7e00ed86-7e34-44bd-997a-a375acb2af47 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1684 microversion: 2.1 time: 0.217350 Aug 24 04:47:48.063653 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3564/7400] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:47 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1684 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:49.087517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:49.088247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:49.094733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:49.095243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:49.095658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:49.096384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:49.096900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:49.097262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:49.249763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:49.259498 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af2954f1-e1c4-4916-83c2-7b858689e50f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1682 microversion: 2.1 time: 0.177260 Aug 24 04:47:49.260102 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3837/7401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:49 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:49.298211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-880af8b1-4c93-4e17-ad2a-207637a47263 req-d9adcf27-c988-4dfd-b943-acb6daf4a1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:49.313731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-880af8b1-4c93-4e17-ad2a-207637a47263 req-d9adcf27-c988-4dfd-b943-acb6daf4a1ea service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:49.314226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-880af8b1-4c93-4e17-ad2a-207637a47263 req-d9adcf27-c988-4dfd-b943-acb6daf4a1ea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:49.314685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-880af8b1-4c93-4e17-ad2a-207637a47263 req-d9adcf27-c988-4dfd-b943-acb6daf4a1ea service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:49.329573 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-880af8b1-4c93-4e17-ad2a-207637a47263 req-d9adcf27-c988-4dfd-b943-acb6daf4a1ea service nova] Creating event network-changed:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h2-846470-15 Aug 24 04:47:49.336404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-880af8b1-4c93-4e17-ad2a-207637a47263 req-d9adcf27-c988-4dfd-b943-acb6daf4a1ea service nova] Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:47:49.348135 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-880af8b1-4c93-4e17-ad2a-207637a47263 req-d9adcf27-c988-4dfd-b943-acb6daf4a1ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056222 Aug 24 04:47:49.348936 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3565/7402] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:50.281320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:50.281979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:50.290078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:50.290568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:50.291006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:50.291775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:50.292337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:50.292809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:50.437958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:50.454633 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e4d0c642-a349-4f80-a112-ec812018ca11 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1682 microversion: 2.1 time: 0.177331 Aug 24 04:47:50.455204 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3838/7403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:50 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:51.482370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:51.483111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:51.490379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:51.490942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:51.491706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:51.492192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:51.492638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:51.493080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:51.656643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:51.667066 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d19b2351-6f85-49ce-a951-20f96e980ffa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1682 microversion: 2.1 time: 0.194179 Aug 24 04:47:51.667659 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3566/7404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:51 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:52.690710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:52.691299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:52.698826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:52.699321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:52.700260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:52.701294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:52.701998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:52.702618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:52.852955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:52.861447 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0dfdd77-36fa-4ebd-b673-e94a700a9c6b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1679 microversion: 2.1 time: 0.174709 Aug 24 04:47:52.862036 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3839/7405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:52 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:52.884395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:52.885007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:52.894780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:52.895280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:52.895763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:52.896507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:52.896980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:52.897574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:52.941793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:52.942629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:52.943085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:52.943855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:52.944328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:52.944777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:52.966282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:47:52.971950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for user c7e86d3ac0e74a8886f56c8b32e63333 and project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:47:53.097991 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b2ec3e3-e145-47a2-9289-e99017186429 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.217335 Aug 24 04:47:53.102611 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3567/7406] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:47:52 2022] POST /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:47:53.112519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:53.113633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:53.121637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:53.122580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:53.123278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:53.124689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:53.125248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:53.125771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:53.305826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:53.317395 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3cbed550-d1bb-485f-9809-b0bf3505fdfa tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1678 microversion: 2.1 time: 0.212286 Aug 24 04:47:53.317994 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3840/7407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:53 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:53.906085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2ee3d032-f29e-453f-96f4-a15cc19f07ad req-2c7cc9ab-45ff-4e13-afa3-19a6c22cdbbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "name": "network-vif-plugged", "status": "completed", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:53.919161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2ee3d032-f29e-453f-96f4-a15cc19f07ad req-2c7cc9ab-45ff-4e13-afa3-19a6c22cdbbc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:53.920497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2ee3d032-f29e-453f-96f4-a15cc19f07ad req-2c7cc9ab-45ff-4e13-afa3-19a6c22cdbbc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:53.921116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2ee3d032-f29e-453f-96f4-a15cc19f07ad req-2c7cc9ab-45ff-4e13-afa3-19a6c22cdbbc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:53.945584 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2ee3d032-f29e-453f-96f4-a15cc19f07ad req-2c7cc9ab-45ff-4e13-afa3-19a6c22cdbbc service nova] Creating event network-vif-plugged:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h2-846470-15 Aug 24 04:47:53.952594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-2ee3d032-f29e-453f-96f4-a15cc19f07ad req-2c7cc9ab-45ff-4e13-afa3-19a6c22cdbbc service nova] Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:47:53.975413 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2ee3d032-f29e-453f-96f4-a15cc19f07ad req-2c7cc9ab-45ff-4e13-afa3-19a6c22cdbbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074433 Aug 24 04:47:53.976199 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3568/7408] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:54.285323 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:47:54.286259 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:47:54.339382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:54.340079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:54.350476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:54.351227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:54.351961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:54.353165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:54.353939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:54.354616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:54.510681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:54.519281 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-460253ca-d104-401e-9396-8160c4654db1 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1678 microversion: 2.1 time: 0.183877 Aug 24 04:47:54.519884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3841/7409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:54 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:55.543759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:55.544488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:55.551198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:55.552272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:55.552578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:55.553816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:55.554322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:55.554763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:55.559914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:55.775462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:55.790108 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f6a28eac-d1b9-474b-bcdb-2a3882116d96 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1678 microversion: 2.1 time: 0.252723 Aug 24 04:47:55.797816 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3569/7410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:55 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1678 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:56.817277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:56.818371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:56.826781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:56.827275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:56.827732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:56.828457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:56.828911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:56.829347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:56.851192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:56.996166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:57.004694 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-431958ef-4d4a-42b0-a127-c631c2c6affe tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1678 microversion: 2.1 time: 0.194280 Aug 24 04:47:57.005764 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3842/7411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:56 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:57.285161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-548fce40-bae8-485d-aa07-d73a7fb04b54 req-c8ae0adc-21de-49a4-b603-df82939da403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "name": "network-vif-unplugged", "status": "completed", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:57.297282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-548fce40-bae8-485d-aa07-d73a7fb04b54 req-c8ae0adc-21de-49a4-b603-df82939da403 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:57.297783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-548fce40-bae8-485d-aa07-d73a7fb04b54 req-c8ae0adc-21de-49a4-b603-df82939da403 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:57.298602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-548fce40-bae8-485d-aa07-d73a7fb04b54 req-c8ae0adc-21de-49a4-b603-df82939da403 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:57.313530 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-548fce40-bae8-485d-aa07-d73a7fb04b54 req-c8ae0adc-21de-49a4-b603-df82939da403 service nova] Creating event network-vif-unplugged:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h1-846470-15 Aug 24 04:47:57.320572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-548fce40-bae8-485d-aa07-d73a7fb04b54 req-c8ae0adc-21de-49a4-b603-df82939da403 service nova] Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:47:57.334422 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-548fce40-bae8-485d-aa07-d73a7fb04b54 req-c8ae0adc-21de-49a4-b603-df82939da403 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052091 Aug 24 04:47:57.335415 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3570/7412] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:47:58.028517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:58.029149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:58.033032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=37 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:58.040954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:58.041498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:58.041953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:58.042789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:58.043218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:58.043654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:58.205319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:58.213731 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0640acee-cd7f-43fe-9779-2d5a0bd9c51e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1678 microversion: 2.1 time: 0.189234 Aug 24 04:47:58.214329 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3843/7413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:58 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:59.237828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:59.238650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:47:59.241073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:59.247378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:59.247900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:59.248361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:59.249413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:59.249901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:59.250702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:59.383269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-1021489c-a6fe-49b4-9590-710847f6e100 req-a9a4d73c-268b-4cd9-aafb-0d7e245ed113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:59.393362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1021489c-a6fe-49b4-9590-710847f6e100 req-a9a4d73c-268b-4cd9-aafb-0d7e245ed113 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:47:59.393843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1021489c-a6fe-49b4-9590-710847f6e100 req-a9a4d73c-268b-4cd9-aafb-0d7e245ed113 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:47:59.394266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-1021489c-a6fe-49b4-9590-710847f6e100 req-a9a4d73c-268b-4cd9-aafb-0d7e245ed113 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:47:59.405816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:47:59.409113 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-1021489c-a6fe-49b4-9590-710847f6e100 req-a9a4d73c-268b-4cd9-aafb-0d7e245ed113 service nova] Creating event network-changed:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h1-846470-15 Aug 24 04:47:59.414606 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-99f9508d-e8d6-49ee-a7d8-fdc5cfa4398d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1678 microversion: 2.1 time: 0.181936 Aug 24 04:47:59.415215 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3571/7414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:47:59 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:59.417911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-1021489c-a6fe-49b4-9590-710847f6e100 req-a9a4d73c-268b-4cd9-aafb-0d7e245ed113 service nova] Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:47:59.430392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-1021489c-a6fe-49b4-9590-710847f6e100 req-a9a4d73c-268b-4cd9-aafb-0d7e245ed113 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052858 Aug 24 04:47:59.431007 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3844/7415] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:00.437309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:00.437977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:00.446066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:00.446572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:00.447045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:00.447793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:00.448235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:00.448671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:00.599536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:00.608844 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a51c8e5-00bc-4d2a-8530-c879c7dd41ee tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1678 microversion: 2.1 time: 0.175434 Aug 24 04:48:00.609454 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3572/7416] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:00 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:01.632517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:01.633262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:01.640135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:01.640647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:01.641088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:01.641816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:01.642291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:01.642721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:01.790057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:01.798520 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ca829409-f9d6-41ae-805d-a45a952394df tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1671 microversion: 2.1 time: 0.171618 Aug 24 04:48:01.799092 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3845/7417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:01 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:01.820348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:01.820976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:01.829032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:01.829705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:01.830143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:01.830868 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:01.831338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:01.831807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:01.976923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:01.985556 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2f058c7-09d7-49f6-b3a4-aaa9cc408f28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1671 microversion: 2.1 time: 0.169684 Aug 24 04:48:01.986134 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3573/7418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:01 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:02.007676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:02.008359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:02.014768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:02.015262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:02.015697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:02.016466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:02.016925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:02.017328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:02.177737 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:02.188493 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5404795b-8a0c-4dcd-8bc3-29fc18ae6d2e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1671 microversion: 2.1 time: 0.185426 Aug 24 04:48:02.189429 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3846/7419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:02 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:02.216731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:02.217280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:02.225655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:02.226174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:02.226631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:02.227358 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:02.227873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:02.228318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:02.258641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:48:02.363887 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-18e7355d-fa77-4249-ad80-9f1a37593983 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 204 len: 0 microversion: 2.1 time: 0.150894 Aug 24 04:48:02.364345 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3574/7420] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:48:02 2022] DELETE /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:48:02.373775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:02.374427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:02.381701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:02.382207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:02.382839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:02.383583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:02.384087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:02.384521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:02.542483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:02.553434 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29698594-0907-4a78-8b64-a826df964a58 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1677 microversion: 2.1 time: 0.184202 Aug 24 04:48:02.554038 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3847/7421] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:02 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:02.909994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-74da7d4b-6b62-4d33-a427-be665b7cfe90 req-2cf348ac-a5f8-40ac-8c79-539081afe4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "name": "network-vif-plugged", "status": "completed", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:02.921228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-74da7d4b-6b62-4d33-a427-be665b7cfe90 req-2cf348ac-a5f8-40ac-8c79-539081afe4a4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:02.921736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-74da7d4b-6b62-4d33-a427-be665b7cfe90 req-2cf348ac-a5f8-40ac-8c79-539081afe4a4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:02.922212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-74da7d4b-6b62-4d33-a427-be665b7cfe90 req-2cf348ac-a5f8-40ac-8c79-539081afe4a4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:02.934239 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-74da7d4b-6b62-4d33-a427-be665b7cfe90 req-2cf348ac-a5f8-40ac-8c79-539081afe4a4 service nova] Creating event network-vif-plugged:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h1-846470-15 Aug 24 04:48:02.939195 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-74da7d4b-6b62-4d33-a427-be665b7cfe90 req-2cf348ac-a5f8-40ac-8c79-539081afe4a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Aug 24 04:48:02.939843 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3575/7422] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:03.578464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:03.579093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:03.586564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:03.587117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:03.587620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:03.588334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:03.588824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:03.589254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:03.732948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:03.742296 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1221832a-2968-43ef-b056-ec04de608225 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1677 microversion: 2.1 time: 0.168116 Aug 24 04:48:03.742941 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3848/7423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:03 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:04.389944 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:48:04.390544 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:48:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:48:04.763643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:04.775236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:04.776170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:04.783739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:04.784753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:04.785195 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:04.787117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:04.787606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:04.788087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:04.879552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:04.888804 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-50bbef47-dff3-4694-8e20-4b17d5b63bdf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 200 len: 1609 microversion: 2.1 time: 0.126617 Aug 24 04:48:04.889486 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3576/7424] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:04 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 1609 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:05.094088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-952d6c6e-0c77-493f-b6d2-82778f7182ed req-fdb4a3b6-1d70-4046-a37f-36e4d17d7e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f71cdb-a8ac-46bf-aedc-d65e417c3fdf", "name": "network-vif-deleted", "tag": "f94ebc9c-3d02-46b4-b485-490b125bb7c0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:05.105310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-952d6c6e-0c77-493f-b6d2-82778f7182ed req-fdb4a3b6-1d70-4046-a37f-36e4d17d7e9e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:05.105808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-952d6c6e-0c77-493f-b6d2-82778f7182ed req-fdb4a3b6-1d70-4046-a37f-36e4d17d7e9e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:05.106251 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-952d6c6e-0c77-493f-b6d2-82778f7182ed req-fdb4a3b6-1d70-4046-a37f-36e4d17d7e9e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:05.119202 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-952d6c6e-0c77-493f-b6d2-82778f7182ed req-fdb4a3b6-1d70-4046-a37f-36e4d17d7e9e service nova] Creating event network-vif-deleted:f94ebc9c-3d02-46b4-b485-490b125bb7c0 for instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf on n-h1-846470-15 Aug 24 04:48:05.135697 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-952d6c6e-0c77-493f-b6d2-82778f7182ed req-fdb4a3b6-1d70-4046-a37f-36e4d17d7e9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045246 Aug 24 04:48:05.140359 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3849/7425] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:05.910784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:05.911932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:05.918852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:05.919359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:05.920443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:05.920443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:05.921114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:05.921581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:05.937381 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf HTTP/1.1 Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '58f71cdb-a8ac-46bf-aedc-d65e417c3fdf'} Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:48:05.939091 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:48:05.943952 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f951bfa2-a184-404c-b0b4-10bfb761fb9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 404 len: 111 microversion: 2.1 time: 0.033893 Aug 24 04:48:05.945139 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3577/7426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:05 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:48:05.960004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:05.960744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:05.968319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:05.968821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:05.969256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:05.969972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:05.970411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:05.971044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:05.987174 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf HTTP/1.1 Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '58f71cdb-a8ac-46bf-aedc-d65e417c3fdf'} Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:48:05.989148 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:48:05.993828 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-46b4c846-b8ae-4d8e-b82f-dd704122050f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 404 len: 111 microversion: 2.1 time: 0.036493 Aug 24 04:48:06.001011 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3850/7427] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:05 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:48:06.059145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1978066191", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "97984039-df0d-403d-a9d4-47ad3c354114"}], "security_groups": [{"name": "tempest-securitygroup--1150372431"}], "key_name": "tempest-keypair-1213395054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:06.182416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] validate_networks() for [('97984039-df0d-403d-a9d4-47ad3c354114', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:48:06.631502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:48:06.632003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:48:06.632498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:48:06.632924 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:48:06.633352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:48:06.643088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:06.643594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:06.644080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:06.644829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:06.645749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:06.646202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:06.664689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:48:06.670323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for user c7e86d3ac0e74a8886f56c8b32e63333 and project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:48:06.685216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:48:06.687625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:48:06.740232 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2e99ab4c-c700-48cc-bd10-c9a74d639896 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.684851 Aug 24 04:48:06.741023 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3578/7428] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:48:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:48:06.753819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a91b932-142c-4c47-a70f-93c9384b7ba6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:06.754489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a91b932-142c-4c47-a70f-93c9384b7ba6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:06.829719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a91b932-142c-4c47-a70f-93c9384b7ba6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:06.838492 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a91b932-142c-4c47-a70f-93c9384b7ba6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1239 microversion: 2.1 time: 0.090577 Aug 24 04:48:06.839627 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3851/7429] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:06 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:07.862427 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:07.862995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:07.871618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:07.872170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:07.872630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:07.873398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:07.873854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:07.874303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:07.962419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:07.971689 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a839e235-56c4-4451-8d8c-f4cef920fa3f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1291 microversion: 2.1 time: 0.114344 Aug 24 04:48:07.972647 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3579/7430] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:07 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1291 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:08.995008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:08.995720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:09.003282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:09.003805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:09.004234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:09.006037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:09.006655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:09.007240 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:09.169629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:09.181794 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97376a96-f296-4349-9e47-3478f7fc06dc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1365 microversion: 2.1 time: 0.191137 Aug 24 04:48:09.182411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3852/7431] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:08 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:09.725119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-02dbf0ea-f6f5-45ae-8a07-0f7b02a2405f req-7b6b42d4-e330-4e2a-b700-b55a353b50f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:09.739055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-02dbf0ea-f6f5-45ae-8a07-0f7b02a2405f req-7b6b42d4-e330-4e2a-b700-b55a353b50f1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:09.739858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-02dbf0ea-f6f5-45ae-8a07-0f7b02a2405f req-7b6b42d4-e330-4e2a-b700-b55a353b50f1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:09.740518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-02dbf0ea-f6f5-45ae-8a07-0f7b02a2405f req-7b6b42d4-e330-4e2a-b700-b55a353b50f1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:09.755960 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-02dbf0ea-f6f5-45ae-8a07-0f7b02a2405f req-7b6b42d4-e330-4e2a-b700-b55a353b50f1 service nova] Creating event network-changed:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h2-846470-15 Aug 24 04:48:09.761539 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-02dbf0ea-f6f5-45ae-8a07-0f7b02a2405f req-7b6b42d4-e330-4e2a-b700-b55a353b50f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044358 Aug 24 04:48:09.762445 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3580/7432] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:10.206895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:10.207963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:10.215618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:10.216143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:10.216636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:10.217476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:10.218113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:10.218545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:10.390992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:10.401650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b716c383-e512-4c4b-8c03-aa5d327e1bd5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1365 microversion: 2.1 time: 0.201564 Aug 24 04:48:10.402279 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3853/7433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:10 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:11.427524 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:11.428160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:11.435406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:11.436290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:11.437033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:11.438012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:11.438485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:11.438919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:11.603372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:11.614432 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-06e99ee4-00af-4a88-a35f-a2b224f6af64 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1365 microversion: 2.1 time: 0.193689 Aug 24 04:48:11.615321 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3581/7434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:11 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:12.645823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:12.646605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:12.654515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:12.655014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:12.655459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:12.656203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:12.656714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:12.657090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:12.798734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:12.806908 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-941ce4c4-fc4a-416b-b622-884844a25bc4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1365 microversion: 2.1 time: 0.165404 Aug 24 04:48:12.807487 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3854/7435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:12 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:13.829820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:13.830426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:13.838530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:13.839044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:13.839503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:13.840291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:13.840770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:13.841242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:13.989840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:14.005469 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5dffc978-0261-4d57-9dbb-b009e301daa7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1365 microversion: 2.1 time: 0.178096 Aug 24 04:48:14.005469 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3582/7436] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:13 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:15.038669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:15.039757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:15.047475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:15.048109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:15.048647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:15.049374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:15.049832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:15.050260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:15.219883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:15.230103 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cecc54d9-11bb-47ac-83f6-560ad9d0859d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1365 microversion: 2.1 time: 0.195461 Aug 24 04:48:15.230865 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3855/7437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:15 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:15.986197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bac10e45-24ea-41f8-86e2-67d5f403da74 req-aecb6698-18c3-4bac-8bfb-9dd061290044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "name": "network-vif-plugged", "status": "completed", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:15.998997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bac10e45-24ea-41f8-86e2-67d5f403da74 req-aecb6698-18c3-4bac-8bfb-9dd061290044 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:15.999765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bac10e45-24ea-41f8-86e2-67d5f403da74 req-aecb6698-18c3-4bac-8bfb-9dd061290044 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:16.000432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bac10e45-24ea-41f8-86e2-67d5f403da74 req-aecb6698-18c3-4bac-8bfb-9dd061290044 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:16.015020 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bac10e45-24ea-41f8-86e2-67d5f403da74 req-aecb6698-18c3-4bac-8bfb-9dd061290044 service nova] Creating event network-vif-plugged:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h2-846470-15 Aug 24 04:48:16.020696 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bac10e45-24ea-41f8-86e2-67d5f403da74 req-aecb6698-18c3-4bac-8bfb-9dd061290044 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 Aug 24 04:48:16.021310 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3583/7438] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:16.255709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:16.256347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:16.267503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:16.268338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:16.269069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:16.270437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:16.270824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:16.271559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:16.430614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:16.438864 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8a18d04a-e93b-4449-92ad-fc6c84ef8d41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1365 microversion: 2.1 time: 0.189278 Aug 24 04:48:16.439415 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3856/7439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:16 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:17.458540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:17.459318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:17.465243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:17.466018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:17.473257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:17.473832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:17.474333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:17.475780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:17.475780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:17.476278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:17.626838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:17.635975 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4e32827-4a8b-41c2-918d-9d05b3fd0e8f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1365 microversion: 2.1 time: 0.178506 Aug 24 04:48:17.636655 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3584/7440] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:17 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:18.658069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:18.658658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:18.661029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:18.669244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:18.669973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:18.670572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:18.671503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:18.672012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:18.672438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:18.815236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:48:18.824732 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c0045764-f984-4519-96fb-e087a0783708 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1552 microversion: 2.1 time: 0.170725 Aug 24 04:48:18.825628 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3857/7441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:48:18 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:18.846777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:18.847302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:48:18.855274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:18.855789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:18.856262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:18.856946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:18.857411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:18.857877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:18.939819 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1208bae2-014b-4960-8918-aebc0137b5eb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096723 Aug 24 04:48:18.940685 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3585/7442] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:48:18 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:19.997224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6a73aa4d-06da-4784-909e-77591a7f9f7a req-25a9f3d2-810d-4ddc-b265-379722b95c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:20.007528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a73aa4d-06da-4784-909e-77591a7f9f7a req-25a9f3d2-810d-4ddc-b265-379722b95c76 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:48:20.008809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a73aa4d-06da-4784-909e-77591a7f9f7a req-25a9f3d2-810d-4ddc-b265-379722b95c76 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:48:20.008809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6a73aa4d-06da-4784-909e-77591a7f9f7a req-25a9f3d2-810d-4ddc-b265-379722b95c76 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:48:20.025229 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6a73aa4d-06da-4784-909e-77591a7f9f7a req-25a9f3d2-810d-4ddc-b265-379722b95c76 service nova] Creating event network-changed:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h2-846470-15 Aug 24 04:48:20.030680 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6a73aa4d-06da-4784-909e-77591a7f9f7a req-25a9f3d2-810d-4ddc-b265-379722b95c76 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039292 Aug 24 04:48:20.032512 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3858/7443] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:36.844766 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:48:36.845427 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:49:33.437961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:33.438757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:33.443132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:33.443794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:33.451593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.452201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.452660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.453425 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.453896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.454337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.693473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:33.702531 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2223828e-1c82-46e3-ba60-ca52ec0eec23 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1670 microversion: 2.1 time: 0.266549 Aug 24 04:49:33.703138 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3586/7444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:33 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1670 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:33.722419 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=33 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:33.723166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=78 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:33.727876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6309306-f005-4819-917b-cfc3d6408d13"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:33.730317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:33.738188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.738686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.739120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:33.739937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:33.740399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:33.740829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:34.136047 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-205719ec-5ee0-4ea0-92f3-30e10c0ba7b6 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416060 Aug 24 04:49:34.136694 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3859/7445] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:49:33 2022] POST /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:49:45.978763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:49:45.981047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:45.983964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:45.984662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:45.991493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.992017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.992467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:45.993175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:45.993641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:45.994057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.099240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.106200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Old instance type m1.heat2, new instance type m1.heat {{(pid=122535) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 04:49:46.114460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:49:46.114897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:49:46.115378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:49:46.115839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:49:46.116260 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:49:46.196164 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7429a532-4325-4345-ab50-0dead354393c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/action" status: 202 len: 0 microversion: 2.1 time: 0.221328 Aug 24 04:49:46.196806 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3587/7446] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:49:45 2022] POST /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:49:46.206692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:46.207436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:46.211698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:46.212682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:46.216972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.218114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.218309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.219110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:46.219744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:46.220354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:46.397477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:46.407104 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07d5ab99-6768-4acf-921f-2c9fd5958372 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1725 microversion: 2.1 time: 0.205236 Aug 24 04:49:46.407717 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3860/7447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:46 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:47.430719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:47.431328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:47.438550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.439062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.439514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.440291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:47.440758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:47.441205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:47.596274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:47.606356 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4ba7b796-d521-4641-95ee-6dabb669618a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1725 microversion: 2.1 time: 0.180606 Aug 24 04:49:47.606930 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3588/7448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:47 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:48.628906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:48.629487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:48.636914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.637379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.637816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:48.638519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:48.639006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:48.639445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:48.777887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:48.787916 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e50bcff0-483d-48e0-acf3-ea80bced7ba9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.162938 Aug 24 04:49:48.788497 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3861/7449] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:48 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:49.810583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:49.811372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:49.818759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.819272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.819769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.820512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:49.820991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:49.821449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:49.978127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:49.986992 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-62ad421e-5eb3-40a5-a486-53f49de2c4f0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.180729 Aug 24 04:49:49.987575 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3589/7450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:49 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:51.011456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:51.012222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:51.019559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.020089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.020551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.021254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:51.021722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:51.022157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:51.166918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:51.176091 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc41589e-dc2e-4aa0-a78e-c6c16952ca28 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.168472 Aug 24 04:49:51.176896 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3862/7451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:51 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:52.199308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:52.199937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:52.208122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:52.208612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:52.209092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:52.209807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:52.210279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:52.210719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:52.351994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:52.361060 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e679ac59-c36d-4d32-8fcf-3cdea912421c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.166082 Aug 24 04:49:52.361650 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3590/7452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:52 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:53.385779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:53.386389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:53.393660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:53.394163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:53.394607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:53.395340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:53.395819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:53.396257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:53.537878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:53.547384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d8473016-ac0d-4af1-9d10-5b4174b37249 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.165673 Aug 24 04:49:53.548010 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3863/7453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:53 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:54.571038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:54.571728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:54.579654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:54.580194 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:54.580645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:54.581391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:54.581863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:54.582363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:54.724794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:54.733776 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b3a97ce1-b90f-4680-8a92-da70ee85c84b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.166792 Aug 24 04:49:54.734359 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3591/7454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:54 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:55.755934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:55.756688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:55.764143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:55.764642 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:55.765135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:55.765840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:55.766306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:55.766738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:55.908772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:55.917729 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bfc256c-56a6-434c-9fd8-b1eba1a99b1f tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.165809 Aug 24 04:49:55.918323 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3864/7455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:55 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:56.939415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:56.940227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:56.952133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:56.952855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:56.953517 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:56.955475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:56.956067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:56.956574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:57.213090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:57.226413 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ed7b18f-a87a-4f1e-90fe-4fd357723f3b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.291425 Aug 24 04:49:57.227226 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3592/7456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:56 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:58.251647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:58.252287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:58.259811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:58.260540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:58.260919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:58.261607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:58.262066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:58.262487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:58.410720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:58.420723 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8b31820e-e5a7-43a0-9fc0-925b1256dbb7 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.172840 Aug 24 04:49:58.421307 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3865/7457] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:58 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:49:59.443639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:49:59.444235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:49:59.452476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:59.452988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:59.453438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:59.454152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:49:59.454620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:49:59.455053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:49:59.596747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:49:59.608752 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-36e0b545-15d8-4c3b-b98c-0e5db7331b01 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.169064 Aug 24 04:49:59.609347 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3593/7458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:49:59 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:00.630852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:00.631502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:00.639213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:00.639947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:00.640415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:00.641133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:00.641592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:00.642021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:00.781463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:00.794750 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6a779821-3b88-4655-b42b-f7fa18d92a41 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.163668 Aug 24 04:50:00.794750 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3866/7459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:00 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:01.812675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:01.813275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:01.820989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:01.821493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:01.821942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:01.822659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:01.823125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:01.823565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:01.962151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:01.971119 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac307336-a3d6-4887-b5ce-2da6d584f6b9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1730 microversion: 2.1 time: 0.162730 Aug 24 04:50:01.971963 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3594/7460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:01 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:02.854007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f31a1d6e-6968-4ee6-9a0b-92051d4ab75f req-3fdb4a95-bffa-4e04-bda7-757bbca572b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "name": "network-vif-unplugged", "status": "completed", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:02.865867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f31a1d6e-6968-4ee6-9a0b-92051d4ab75f req-3fdb4a95-bffa-4e04-bda7-757bbca572b2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:02.866354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f31a1d6e-6968-4ee6-9a0b-92051d4ab75f req-3fdb4a95-bffa-4e04-bda7-757bbca572b2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:02.866785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f31a1d6e-6968-4ee6-9a0b-92051d4ab75f req-3fdb4a95-bffa-4e04-bda7-757bbca572b2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:02.880074 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f31a1d6e-6968-4ee6-9a0b-92051d4ab75f req-3fdb4a95-bffa-4e04-bda7-757bbca572b2 service nova] Creating event network-vif-unplugged:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h1-846470-15 Aug 24 04:50:02.886023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-f31a1d6e-6968-4ee6-9a0b-92051d4ab75f req-3fdb4a95-bffa-4e04-bda7-757bbca572b2 service nova] Instance 03d6b3cb-c410-4046-8679-18dae1759142 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:50:02.898729 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f31a1d6e-6968-4ee6-9a0b-92051d4ab75f req-3fdb4a95-bffa-4e04-bda7-757bbca572b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048809 Aug 24 04:50:02.899346 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3867/7461] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:02.994387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:02.995035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:03.004838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:03.004838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:03.004838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:03.005462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:03.005937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:03.006384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:03.540752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:03.550986 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e2702c9c-08cb-49ac-9b41-e1a1cef37a52 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1729 microversion: 2.1 time: 0.560445 Aug 24 04:50:03.551597 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3595/7462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:02 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1729 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:04.577096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:04.577835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:04.584792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:04.585347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:04.585884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:04.586644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:04.587134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:04.587804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:04.732250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:04.741286 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a1666a46-b2d0-4b8c-ab96-99ada264c94e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1729 microversion: 2.1 time: 0.170570 Aug 24 04:50:04.741878 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3868/7463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:04 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:04.936623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7abdc3ab-c164-4461-a4be-8a60ca875126 req-8e9e105c-c698-4a7e-a96f-3aac8e09f75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:04.948461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7abdc3ab-c164-4461-a4be-8a60ca875126 req-8e9e105c-c698-4a7e-a96f-3aac8e09f75a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:04.948951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7abdc3ab-c164-4461-a4be-8a60ca875126 req-8e9e105c-c698-4a7e-a96f-3aac8e09f75a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:04.949389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7abdc3ab-c164-4461-a4be-8a60ca875126 req-8e9e105c-c698-4a7e-a96f-3aac8e09f75a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:04.963159 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7abdc3ab-c164-4461-a4be-8a60ca875126 req-8e9e105c-c698-4a7e-a96f-3aac8e09f75a service nova] Creating event network-changed:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h1-846470-15 Aug 24 04:50:04.969962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-7abdc3ab-c164-4461-a4be-8a60ca875126 req-8e9e105c-c698-4a7e-a96f-3aac8e09f75a service nova] Instance 03d6b3cb-c410-4046-8679-18dae1759142 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:50:04.981610 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7abdc3ab-c164-4461-a4be-8a60ca875126 req-8e9e105c-c698-4a7e-a96f-3aac8e09f75a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049793 Aug 24 04:50:04.982248 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3596/7464] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:50:05.767181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:05.767885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:05.777827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:05.778653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:05.779409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:05.780710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:05.781486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:05.782195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:05.957142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:05.965742 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4cca417c-c514-48fd-b782-8a3335858edb tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.202809 Aug 24 04:50:05.967711 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3869/7465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:05 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:06.991400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:06.992293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:06.999705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:07.000604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:07.001595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:07.001781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:07.002419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:07.002865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:07.175197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:07.184380 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-995a3ee4-6bd4-4662-8d3d-d67b36c99d7c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.199336 Aug 24 04:50:07.184968 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3597/7466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:06 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:08.207099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:08.207741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:08.215131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:08.215608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:08.216026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:08.216783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:08.217829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:08.218217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:08.375526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:08.384351 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-902170d7-f92d-48b7-a571-f321550e8775 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.181218 Aug 24 04:50:08.384925 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3870/7467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:08 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:09.407571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:09.408154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:09.416911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:09.417435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:09.417927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:09.418683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:09.419189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:09.419687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:09.569817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:09.580286 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d685ce1b-68d3-479c-8d87-331833204b9e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.176823 Aug 24 04:50:09.580939 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3598/7468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:09 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:10.616285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:10.617310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:10.627276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:10.627829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:10.628277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:10.629000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:10.629473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:10.629916 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:10.781151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:10.790015 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-77814de0-05c1-4a2d-af77-4f9179cca3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.179663 Aug 24 04:50:10.790622 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3871/7469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:10 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:11.812732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:11.813385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:11.820798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:11.821340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:11.821798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:11.822530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:11.823004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:11.823445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:11.975334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:11.986105 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69a93632-e57c-4666-816d-34c886d3f3a8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.177569 Aug 24 04:50:11.986730 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3599/7470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:11 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:13.010664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:13.011302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:13.018884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:13.019382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:13.019910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:13.020604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:13.021061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:13.021538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:13.165790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:13.174652 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e7766d65-3fac-4e9c-bde3-f4d591699f85 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.168060 Aug 24 04:50:13.175250 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3872/7471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:13 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:14.197763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:14.198399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:14.206198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:14.206706 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:14.207133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:14.207909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:14.208373 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:14.208802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:14.347221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:14.357556 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98cfcadc-7387-4c9c-aaf6-e8fe2aed5ac5 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.163604 Aug 24 04:50:14.358774 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3600/7472] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:14 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:15.380779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:15.381566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:15.388711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:15.389728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:15.389728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:15.390459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:15.390918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:15.391349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:15.534399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:15.543060 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8c4a180-fe2a-487c-8eb8-c06cd500f76d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.166378 Aug 24 04:50:15.543650 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3873/7473] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:15 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:16.571739 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:16.572559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:16.576445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=33 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:16.583494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:16.584060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:16.584555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:16.585341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:16.585896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:16.586402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:16.589873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:16.738414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:16.750217 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cfd78e8c-2d62-4c10-a056-f6074194e817 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.187179 Aug 24 04:50:16.750995 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3601/7474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:16 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:17.773354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:17.774208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:17.777761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=29 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:17.785912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:17.786481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:17.786921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:17.787635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:17.788136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:17.788562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:17.791541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=83 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:17.938754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:17.950054 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c5f17027-6efc-499a-9a4d-47f3e470cb5e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.180717 Aug 24 04:50:17.951043 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3874/7475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:17 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:18.974196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:18.974815 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:18.983565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:18.984450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:18.984910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:18.985641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:18.986117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:18.986586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:19.151044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:19.163060 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-76dae6f8-f136-450e-ad34-25d3bf86b7ce tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1727 microversion: 2.1 time: 0.193086 Aug 24 04:50:19.163704 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3602/7476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:18 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:20.187500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:20.188326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:20.198668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.199229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.199736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.200653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.201991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.202577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.369551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:20.379963 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b09556d-d11d-428b-9515-c009f87f9271 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1724 microversion: 2.1 time: 0.197057 Aug 24 04:50:20.380650 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3875/7477] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:20 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:20.401968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:20.402559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:20.410321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.410822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.411269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.412004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.412468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.412904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.463731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.464264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.464796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.465608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.466134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.466663 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.488227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:50:20.493837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Getting quotas for user c7e86d3ac0e74a8886f56c8b32e63333 and project 406d494d9545497db446811a4b13adac. Resources: {'cores', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:50:20.621164 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-40a4f489-e41d-4b35-b596-c1f7cf3bfbdc tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "POST /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/action" status: 202 len: 0 microversion: 2.1 time: 0.222261 Aug 24 04:50:20.624538 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3603/7478] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:50:20 2022] POST /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:50:20.632833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:20.633416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:20.641212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.642299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.643147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.645246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:20.646381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:20.647210 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:20.801670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:20.812846 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0abbcdc3-00e1-4084-95cf-34b3500d3e40 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.184904 Aug 24 04:50:20.814350 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3876/7479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:20 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:21.838590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:21.840120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:21.851999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:21.852942 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:21.853702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:21.854897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:21.855688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:21.856535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:22.026726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:22.039163 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a235a09-4d3d-4ac6-9f26-e5cf34b32eb9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.207241 Aug 24 04:50:22.040355 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3604/7480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:21 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:23.065533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:23.066130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:23.073883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:23.074627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:23.076300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:23.077172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:23.077668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:23.078110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:23.235541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:23.245213 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bd87100f-677e-494c-bd34-34cc6f78fdac tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.183701 Aug 24 04:50:23.245848 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3877/7481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:23 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:23.594588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-92822737-bb67-492b-afda-733f3a834c13 req-f51a504b-1e7e-4e0d-8a35-8d62ab48d5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "name": "network-vif-plugged", "status": "completed", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:23.613767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-92822737-bb67-492b-afda-733f3a834c13 req-f51a504b-1e7e-4e0d-8a35-8d62ab48d5df service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:23.614898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-92822737-bb67-492b-afda-733f3a834c13 req-f51a504b-1e7e-4e0d-8a35-8d62ab48d5df service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:23.615769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-92822737-bb67-492b-afda-733f3a834c13 req-f51a504b-1e7e-4e0d-8a35-8d62ab48d5df service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:23.639422 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-92822737-bb67-492b-afda-733f3a834c13 req-f51a504b-1e7e-4e0d-8a35-8d62ab48d5df service nova] Creating event network-vif-plugged:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h1-846470-15 Aug 24 04:50:23.648419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-92822737-bb67-492b-afda-733f3a834c13 req-f51a504b-1e7e-4e0d-8a35-8d62ab48d5df service nova] Instance 03d6b3cb-c410-4046-8679-18dae1759142 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:50:23.664346 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-92822737-bb67-492b-afda-733f3a834c13 req-f51a504b-1e7e-4e0d-8a35-8d62ab48d5df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077549 Aug 24 04:50:23.665376 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3605/7482] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:24.270819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:24.271957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:24.283176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:24.284032 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:24.284739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:24.285952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:24.286659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:24.287391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:24.472018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:24.487995 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-65aafe7d-7896-4dfa-9326-23ba3fb07204 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.223829 Aug 24 04:50:24.488866 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3878/7483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:24 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:25.518349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:25.519060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:25.526700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:25.527213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:25.527728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:25.528673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:25.529185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:25.529639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:25.686627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:25.701494 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c49693fb-d50b-4d2b-bb6f-4a1a31590a1a tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.188555 Aug 24 04:50:25.702332 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3606/7484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:25 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:26.620729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-53805364-e7de-40c2-80fa-3b4e65a32c09 req-8d8eefee-92d0-4c9a-b465-80ff7a32b2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "name": "network-vif-unplugged", "status": "completed", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:26.634781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-53805364-e7de-40c2-80fa-3b4e65a32c09 req-8d8eefee-92d0-4c9a-b465-80ff7a32b2f2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:26.635413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-53805364-e7de-40c2-80fa-3b4e65a32c09 req-8d8eefee-92d0-4c9a-b465-80ff7a32b2f2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:26.635955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-53805364-e7de-40c2-80fa-3b4e65a32c09 req-8d8eefee-92d0-4c9a-b465-80ff7a32b2f2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:26.649854 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-53805364-e7de-40c2-80fa-3b4e65a32c09 req-8d8eefee-92d0-4c9a-b465-80ff7a32b2f2 service nova] Creating event network-vif-unplugged:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h2-846470-15 Aug 24 04:50:26.660904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-53805364-e7de-40c2-80fa-3b4e65a32c09 req-8d8eefee-92d0-4c9a-b465-80ff7a32b2f2 service nova] Instance 03d6b3cb-c410-4046-8679-18dae1759142 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:50:26.674857 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-53805364-e7de-40c2-80fa-3b4e65a32c09 req-8d8eefee-92d0-4c9a-b465-80ff7a32b2f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058991 Aug 24 04:50:26.675470 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3879/7485] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:26.724457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:26.725274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:26.732861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:26.733733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:26.735336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:26.736716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:26.737621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:26.738423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:27.008005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:27.017118 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-28f729b1-c945-4793-ba1f-87cf41df6113 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.296858 Aug 24 04:50:27.017775 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3607/7486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:26 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:28.042040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:28.042743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:28.050120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:28.050529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:28.050974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:28.051725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:28.052194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:28.052624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:28.216010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:28.225135 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5009c0c0-cae2-46be-8919-5d09f96bc2c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.188498 Aug 24 04:50:28.225738 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3880/7487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:28 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:28.709275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-693efebd-386d-475d-83e1-5cbd4a09a3ef req-0d64ae44-78f1-4439-a118-9d1e6c82f1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:28.720621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-693efebd-386d-475d-83e1-5cbd4a09a3ef req-0d64ae44-78f1-4439-a118-9d1e6c82f1f3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:28.721113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-693efebd-386d-475d-83e1-5cbd4a09a3ef req-0d64ae44-78f1-4439-a118-9d1e6c82f1f3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:28.721550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-693efebd-386d-475d-83e1-5cbd4a09a3ef req-0d64ae44-78f1-4439-a118-9d1e6c82f1f3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:28.738106 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-693efebd-386d-475d-83e1-5cbd4a09a3ef req-0d64ae44-78f1-4439-a118-9d1e6c82f1f3 service nova] Creating event network-changed:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h2-846470-15 Aug 24 04:50:28.744789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-693efebd-386d-475d-83e1-5cbd4a09a3ef req-0d64ae44-78f1-4439-a118-9d1e6c82f1f3 service nova] Instance 03d6b3cb-c410-4046-8679-18dae1759142 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 04:50:28.757133 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-693efebd-386d-475d-83e1-5cbd4a09a3ef req-0d64ae44-78f1-4439-a118-9d1e6c82f1f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051879 Aug 24 04:50:28.758122 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3608/7488] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:50:29.253463 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:29.255621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:29.269243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:29.269947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:29.270987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:29.272124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:29.273190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:29.274227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:29.482925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:29.498290 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14b5e4db-16c9-4afd-8fb9-04c05f49591d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.252074 Aug 24 04:50:29.499741 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3881/7489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:29 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:30.521128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:30.525572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:30.526327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:30.534003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:30.534512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:30.534971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:30.535825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:30.536197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:30.536641 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:30.681244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:30.691112 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-56cd928f-dd29-4783-8710-64cebc81615d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.172121 Aug 24 04:50:30.691723 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3609/7490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:30 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:31.714043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:31.714636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:31.722289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:31.722923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:31.723533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:31.724567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:31.725284 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:31.725770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:31.876561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:31.885962 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-afa2bbce-7164-4912-a5f9-8e0674f69970 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.175865 Aug 24 04:50:31.886799 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3882/7491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:31 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:32.908642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:32.909417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:32.916681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:32.917190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:32.917631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:32.918340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:32.918812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:32.919244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:33.064731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:33.073968 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bbbe4133-df2e-4b9b-bb93-49875e362ba4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.169681 Aug 24 04:50:33.074583 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3610/7492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:32 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:34.113915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:34.114522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:34.122798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:34.123382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:34.123958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:34.124791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:34.125434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:34.126020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:34.280631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:34.289715 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a6b6ce3c-c903-492a-9ae0-4117292722cf tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.179735 Aug 24 04:50:34.290315 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3883/7493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:34 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:35.313852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:35.314465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:35.322013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:35.322512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:35.322958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:35.323699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:35.324161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:35.324593 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:35.464122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:35.473740 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-42d59506-940a-4a20-8aa8-6991208202ba tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.164282 Aug 24 04:50:35.474317 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3611/7494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:35 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:36.497450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:36.498730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:36.506055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:36.506544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:36.506985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:36.507697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:36.508181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:36.508613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:36.655472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:36.665947 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-408b4589-fbdf-4473-95c6-59c91a4054e8 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.172616 Aug 24 04:50:36.666539 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3884/7495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:36 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:37.688676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:37.689235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:37.696803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:37.697306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:37.697771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:37.698568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:37.698985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:37.699418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:37.842789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:37.857205 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-60ac152b-958a-4cb8-a555-6712d811be5d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.172321 Aug 24 04:50:37.857813 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3612/7496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:37 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:38.879179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:38.879832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:38.886889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:38.887375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:38.887857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:38.888758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:38.889469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:38.889906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:39.033908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:39.042595 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d5a52a9-ab8e-4c66-8bb5-b1566d638329 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.167508 Aug 24 04:50:39.043153 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3885/7497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:38 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:40.063730 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:40.064365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:40.071837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:40.072352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:40.072837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:40.073580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:40.074053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:40.074488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:40.221059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:40.230787 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c861f0f1-e726-4b7d-a68e-d2e6dee322c4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.170064 Aug 24 04:50:40.230787 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3613/7498] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:40 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:41.252944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:41.253563 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:41.260782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:41.261301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:41.261740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:41.262448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:41.262912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:41.263837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:41.420532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:41.429131 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8642bf51-303f-4c83-9ae9-e4fdec38d68b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1723 microversion: 2.1 time: 0.180830 Aug 24 04:50:41.429697 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3886/7499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:41 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:42.453845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:42.454395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:42.460899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.461405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.461922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.462562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.463023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.463474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.608522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:42.620845 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26b3d89c-f979-4a9e-a394-74dd2d11d026 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1716 microversion: 2.1 time: 0.172313 Aug 24 04:50:42.621431 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3614/7500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:42 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:50:42.643305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:42.643953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:42.651053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.651542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.652009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.652743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.653201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.653794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.795089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:42.806809 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3be640f4-4848-423c-8ea3-3c8d7da39b36 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1716 microversion: 2.1 time: 0.167330 Aug 24 04:50:42.807411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3887/7501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:42 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:42.828416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:42.829130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:42.835992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.836504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.836976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.837684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:42.838196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:42.838646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:42.854726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:42.981021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:42.990615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fcc9266b-7196-42a7-877c-022689332ec2 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1716 microversion: 2.1 time: 0.166420 Aug 24 04:50:42.991129 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3615/7502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:42 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:43.011433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:43.012342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:43.020337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:43.020835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:43.021406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:43.021977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:43.022437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:43.022864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:43.050998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:50:43.145630 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-49dffd2f-3220-48d9-b01e-9cc2ab9a6672 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 204 len: 0 microversion: 2.1 time: 0.137713 Aug 24 04:50:43.146988 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3888/7503] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:50:43 2022] DELETE /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:50:43.155589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-026390d8-a7e0-47da-a3f7-3739b0906915 req-c9093937-9eae-48a1-8206-3f31e28675ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "name": "network-vif-plugged", "status": "completed", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:43.160209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:43.160932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:43.168782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-026390d8-a7e0-47da-a3f7-3739b0906915 req-c9093937-9eae-48a1-8206-3f31e28675ca service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:43.169194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:43.169685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-026390d8-a7e0-47da-a3f7-3739b0906915 req-c9093937-9eae-48a1-8206-3f31e28675ca service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:43.169820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:43.170127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:43.170795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-026390d8-a7e0-47da-a3f7-3739b0906915 req-c9093937-9eae-48a1-8206-3f31e28675ca service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:43.170964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:43.171830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:43.172218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:43.184153 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-026390d8-a7e0-47da-a3f7-3739b0906915 req-c9093937-9eae-48a1-8206-3f31e28675ca service nova] Creating event network-vif-plugged:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h2-846470-15 Aug 24 04:50:43.190597 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-026390d8-a7e0-47da-a3f7-3739b0906915 req-c9093937-9eae-48a1-8206-3f31e28675ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044435 Aug 24 04:50:43.191455 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3616/7504] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:43.195065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:43.325271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:43.334581 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c356ea06-204d-42db-aca5-671d40a0ce07 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1722 microversion: 2.1 time: 0.182910 Aug 24 04:50:43.335183 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3889/7505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:43 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:44.358048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:44.358674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:44.365212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:44.365714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:44.366161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:44.366918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:44.367365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:44.367837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:44.507132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:44.515977 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dccb6c1c-d0c7-462c-8145-4aec7f174070 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1722 microversion: 2.1 time: 0.163043 Aug 24 04:50:44.516573 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3617/7506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:44 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:45.539082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:45.539718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:45.547035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:45.547645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:45.548226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:45.549065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:45.549605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:45.550112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:45.732327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:45.753812 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-18a228f6-4a87-462d-85bf-75183b5f1320 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1722 microversion: 2.1 time: 0.218944 Aug 24 04:50:45.754715 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3890/7507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:45 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:46.075767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7c2060c9-ff4b-4fb3-9f4d-bbef4f65eaf7 req-66f49e2c-0c7d-42a4-8800-4313b4f0af61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d6b3cb-c410-4046-8679-18dae1759142", "name": "network-vif-deleted", "tag": "5d8400a2-e1bb-4899-b301-522f899c6bdf"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:50:46.090463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7c2060c9-ff4b-4fb3-9f4d-bbef4f65eaf7 req-66f49e2c-0c7d-42a4-8800-4313b4f0af61 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:46.091330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7c2060c9-ff4b-4fb3-9f4d-bbef4f65eaf7 req-66f49e2c-0c7d-42a4-8800-4313b4f0af61 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:46.092002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7c2060c9-ff4b-4fb3-9f4d-bbef4f65eaf7 req-66f49e2c-0c7d-42a4-8800-4313b4f0af61 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:46.108061 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7c2060c9-ff4b-4fb3-9f4d-bbef4f65eaf7 req-66f49e2c-0c7d-42a4-8800-4313b4f0af61 service nova] Creating event network-vif-deleted:5d8400a2-e1bb-4899-b301-522f899c6bdf for instance 03d6b3cb-c410-4046-8679-18dae1759142 on n-h2-846470-15 Aug 24 04:50:46.113931 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7c2060c9-ff4b-4fb3-9f4d-bbef4f65eaf7 req-66f49e2c-0c7d-42a4-8800-4313b4f0af61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043445 Aug 24 04:50:46.115064 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3618/7508] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:50:46.787591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:46.789319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:46.802843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:46.804177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:46.805316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:46.807443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:46.808525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:46.810729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:46.901450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:46.912359 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-dfa4b66e-a437-4565-8f44-f0f36385551b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1370 microversion: 2.1 time: 0.128913 Aug 24 04:50:46.914091 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3891/7509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:46 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1370 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:47.941790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:47.942535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:47.944713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:47.950827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:47.951871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:47.952357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:47.953124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:47.953604 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:47.954053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:48.027629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:48.037345 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-214fd241-9517-4c34-9e4c-f84aec8f2d6e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1370 microversion: 2.1 time: 0.100900 Aug 24 04:50:48.037951 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3619/7510] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:47 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:49.120873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:49.121483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:49.124557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:49.130577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:49.131069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:49.131506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:49.132252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:49.132692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:49.133117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:49.201694 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:49.210406 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5ef7ddc-6cf5-4f5d-8821-5a0f43fb356d tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1370 microversion: 2.1 time: 0.093544 Aug 24 04:50:49.210993 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3892/7511] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:49 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:50.232286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:50.233577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:50.241014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:50.241514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:50.241997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:50.242738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:50.243209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:50.243651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:50.311935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e86d3ac0e74a8886f56c8b32e63333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406d494d9545497db446811a4b13adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:50:50.321988 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-aae0b191-508f-47c7-bc69-41da9f805bc9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 200 len: 1370 microversion: 2.1 time: 0.093794 Aug 24 04:50:50.322587 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3620/7512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:50 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:50:51.344166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:51.344761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:51.352137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:51.352624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:51.353055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:51.353755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:51.354216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:51.354636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:51.369495 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 HTTP/1.1 Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '03d6b3cb-c410-4046-8679-18dae1759142'} Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:51.371167 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc9cc4e0-f1ee-468d-9599-f3a0dcd177a0 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 404 len: 111 microversion: 2.1 time: 0.032773 Aug 24 04:50:51.375519 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3893/7513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:51 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:51.437647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:51.445262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:51.452969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:51.453477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:51.453932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:51.454634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:51.455124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:51.455563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:51.469038 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/os-volume_attachments HTTP/1.1 Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': '03d6b3cb-c410-4046-8679-18dae1759142'} Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:51.470878 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d040a6a9-503f-4c8e-a6d8-cf7f6f8391e4 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039245 Aug 24 04:50:51.475648 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3621/7514] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:50:51 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:54.860285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:54.860994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:54.868252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.868776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.869215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.869913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.870368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.870789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.887031 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 HTTP/1.1 Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '03d6b3cb-c410-4046-8679-18dae1759142'} Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:54.889389 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db87d56b-03e5-4766-9878-419d71c2069c tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 404 len: 111 microversion: 2.1 time: 0.034813 Aug 24 04:50:54.893455 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3894/7515] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:50:54 2022] DELETE /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:54.899903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:54.900544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 03d6b3cb-c410-4046-8679-18dae1759142] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:54.908451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.908964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.909429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.910152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.910626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.911070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.925488 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 HTTP/1.1 Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '03d6b3cb-c410-4046-8679-18dae1759142'} Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:54.928051 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 03d6b3cb-c410-4046-8679-18dae1759142 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dcd63ed4-0011-4bf1-a535-ed0bab2c2bf3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142" status: 404 len: 111 microversion: 2.1 time: 0.033816 Aug 24 04:50:54.932768 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3622/7516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:54 2022] GET /compute/v2.1/servers/03d6b3cb-c410-4046-8679-18dae1759142 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:54.939470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:54.939995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:54.946433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.946923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.947363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.948143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.948722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.949154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.964674 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf HTTP/1.1 Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '58f71cdb-a8ac-46bf-aedc-d65e417c3fdf'} Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:54.967135 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f3b8fbb-c2a6-45c8-ae28-43435b102109 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 404 len: 111 microversion: 2.1 time: 0.033861 Aug 24 04:50:54.974028 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3895/7517] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:50:54 2022] DELETE /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:54.978595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:54.979193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:54.986314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.986821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.987270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:54.988026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:54.988665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:54.989315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.004127 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf HTTP/1.1 Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '58f71cdb-a8ac-46bf-aedc-d65e417c3fdf'} Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.005722 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 58f71cdb-a8ac-46bf-aedc-d65e417c3fdf could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ebb6b77-9f2d-4da8-b7e0-3ff524046277 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf" status: 404 len: 111 microversion: 2.1 time: 0.033108 Aug 24 04:50:55.010299 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3623/7518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:54 2022] GET /compute/v2.1/servers/58f71cdb-a8ac-46bf-aedc-d65e417c3fdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:50:55.016470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:55.016977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:55.023307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:55.023806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:55.024276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.024974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:55.025427 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:55.025847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.040664 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b HTTP/1.1 Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'd86d31dd-200a-4b74-a511-00e59467bb1b'} Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:55.042271 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9cd4bab4-fb67-4cd8-aec7-a83643092673 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 404 len: 111 microversion: 2.1 time: 0.031193 Aug 24 04:50:55.047456 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3896/7519] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:50:55 2022] DELETE /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:55.052545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:55.053165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: d86d31dd-200a-4b74-a511-00e59467bb1b] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:55.060499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:55.060996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:55.061444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.062153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:55.062620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:55.063059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.079428 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b HTTP/1.1 Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'd86d31dd-200a-4b74-a511-00e59467bb1b'} Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.081220 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance d86d31dd-200a-4b74-a511-00e59467bb1b could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8f640ed2-4da8-4a2c-9ee9-c37e49cb52c3 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b" status: 404 len: 111 microversion: 2.1 time: 0.034672 Aug 24 04:50:55.085839 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3624/7520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:55 2022] GET /compute/v2.1/servers/d86d31dd-200a-4b74-a511-00e59467bb1b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:55.093221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:55.093867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:55.100637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:55.101135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:55.101576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.102326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:55.102795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:55.103259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.118436 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 HTTP/1.1 Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '61d2b6e5-13ad-45e7-827f-67eb65b866a2'} Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:55.120096 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:55.125686 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c657e873-69af-4f97-b664-294424cbc25e tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 404 len: 111 microversion: 2.1 time: 0.033419 Aug 24 04:50:55.127696 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3897/7521] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:50:55 2022] DELETE /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:55.131964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:55.132628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [instance: 61d2b6e5-13ad-45e7-827f-67eb65b866a2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:50:55.139299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:55.139836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:55.140288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.141019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:50:55.141486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:50:55.141923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:50:55.157925 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] HTTP exception thrown: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Request method failure captured: Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 HTTP/1.1 Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBawgnfaXpZFRB9wTAXW94YIfgZmNlq9yFK19HYy9GwEbOaRu9E8HExPmionqhKRvzf1g4EVE-Eef-50klEbRoQTPUlgaxoJfHfxzjjrD5B6I8NLl-tENkbcUyxKTaYz1Noh5uUzVtRPTFOohuwD23Oc4dhlqW9BaYWO3mwFYAyqiN3I Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_406d494d9545497db446811a4b13adac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/406d494d9545497db446811a4b13adac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/406d494d9545497db446811a4b13adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 406d494d9545497db446811a4b13adac Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServerActionsTestJSON-298303896 Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: c7e86d3ac0e74a8886f56c8b32e63333 Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServerActionsTestJSON-298303896-project Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '61d2b6e5-13ad-45e7-827f-67eb65b866a2'} Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:50:55.159519 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Returning 404 to user: Instance 61d2b6e5-13ad-45e7-827f-67eb65b866a2 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c01bd8c5-c56e-4c39-9874-4442244c84d9 tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2" status: 404 len: 111 microversion: 2.1 time: 0.033145 Aug 24 04:50:55.166380 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3625/7522] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:50:55 2022] GET /compute/v2.1/servers/61d2b6e5-13ad-45e7-827f-67eb65b866a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:55.173696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3c113ed9-55e8-42be-915e-e1ee44db823b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] Calling method '.version_select at 0x7f102208df70>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:50:55.180746 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c113ed9-55e8-42be-915e-e1ee44db823b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:50:56.188736 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c113ed9-55e8-42be-915e-e1ee44db823b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 59628. Aug 24 04:50:56.216319 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3c113ed9-55e8-42be-915e-e1ee44db823b tempest-ServerActionsTestJSON-298303896 tempest-ServerActionsTestJSON-298303896-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213395054" status: 202 len: 0 microversion: 2.1 time: 1.048846 Aug 24 04:50:56.216815 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3898/7523] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 24 04:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213395054 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:51:06.816997 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=13 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:06.817767 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=35 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:06.963230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1240530817", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "fcf3ba28-8ffc-4d83-a01a-bc2d9701dc37"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:07.030238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] validate_networks() for [('fcf3ba28-8ffc-4d83-a01a-bc2d9701dc37', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:51:07.468213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:51:07.468692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:51:07.469188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:51:07.469616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:51:07.470049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:51:07.479878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:07.480400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:07.480907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:07.481742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:07.482251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:07.482780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:07.500827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Getting quotas for project 968bcd849c334808bf06cc37af977d25. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:07.506733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Getting quotas for user 203a9716accc4606abd2ed89433a1853 and project 968bcd849c334808bf06cc37af977d25. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:07.520958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:51:07.523356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:51:07.576897 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2409d9f5-35fd-4484-844a-578b6b1e598a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765222 Aug 24 04:51:07.583556 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3626/7524] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:51:07.586525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=31 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:07.587286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:07.591304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67803f16-b34a-4c30-a3b1-b5692a725f75 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:07.592201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67803f16-b34a-4c30-a3b1-b5692a725f75 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:07.659693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67803f16-b34a-4c30-a3b1-b5692a725f75 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:07.669963 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67803f16-b34a-4c30-a3b1-b5692a725f75 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1217 microversion: 2.1 time: 0.085078 Aug 24 04:51:07.670571 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3899/7525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:07 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:08.694451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-81c3fde8-11fb-4cad-b681-d5d07efb6f77 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:08.695072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-81c3fde8-11fb-4cad-b681-d5d07efb6f77 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:08.766193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-81c3fde8-11fb-4cad-b681-d5d07efb6f77 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:08.773752 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-81c3fde8-11fb-4cad-b681-d5d07efb6f77 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1217 microversion: 2.1 time: 0.084866 Aug 24 04:51:08.774415 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3627/7526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:08 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:09.795493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-522322de-eba3-44ff-972e-f29ca2402344 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:09.796259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-522322de-eba3-44ff-972e-f29ca2402344 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:09.864183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-522322de-eba3-44ff-972e-f29ca2402344 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:09.872243 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-522322de-eba3-44ff-972e-f29ca2402344 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1217 microversion: 2.1 time: 0.081192 Aug 24 04:51:09.872894 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3900/7527] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:09 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:10.893544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fd064bc9-0919-4f62-aa4f-18ed3a7a1bad tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:10.894110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fd064bc9-0919-4f62-aa4f-18ed3a7a1bad tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:10.960359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fd064bc9-0919-4f62-aa4f-18ed3a7a1bad tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:10.971616 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fd064bc9-0919-4f62-aa4f-18ed3a7a1bad tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1217 microversion: 2.1 time: 0.081979 Aug 24 04:51:10.972178 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3628/7528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:10 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:11.995730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:11.996349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:12.004085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:12.004585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:12.005027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:12.005746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:12.006213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:12.006651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:12.081440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:12.089694 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-915d9b7c-3375-4187-8129-630d2e5f6955 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1221 microversion: 2.1 time: 0.097851 Aug 24 04:51:12.090277 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3901/7529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:11 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:13.111398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:13.112102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:13.120568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:13.121057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:13.121510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:13.123065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:13.123580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:13.124061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:13.493785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:13.502286 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef6fe24e-4a7e-49dc-9b6e-11a7b383bbf5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1275 microversion: 2.1 time: 0.395550 Aug 24 04:51:13.502932 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3629/7530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:13 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1275 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:14.524398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:14.525185 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:14.532781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:14.533268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:14.533700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:14.534439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:14.534898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:14.535477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:14.675631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bfc7ffd2-48c5-4def-9d39-9238cb2d7395 req-2d6fb125-f160-41f0-9f43-a16e0398acd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac747a1-f75a-4fc1-805a-8bba7cb879e2", "tag": "4f1f5c09-651d-4123-94ea-57fffda6148f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:14.689003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfc7ffd2-48c5-4def-9d39-9238cb2d7395 req-2d6fb125-f160-41f0-9f43-a16e0398acd2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:14.689606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfc7ffd2-48c5-4def-9d39-9238cb2d7395 req-2d6fb125-f160-41f0-9f43-a16e0398acd2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:14.690124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bfc7ffd2-48c5-4def-9d39-9238cb2d7395 req-2d6fb125-f160-41f0-9f43-a16e0398acd2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:14.705522 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bfc7ffd2-48c5-4def-9d39-9238cb2d7395 req-2d6fb125-f160-41f0-9f43-a16e0398acd2 service nova] Creating event network-changed:4f1f5c09-651d-4123-94ea-57fffda6148f for instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 on n-h2-846470-15 Aug 24 04:51:14.709235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:14.711201 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bfc7ffd2-48c5-4def-9d39-9238cb2d7395 req-2d6fb125-f160-41f0-9f43-a16e0398acd2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111330 Aug 24 04:51:14.712333 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3630/7531] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:14.725571 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67fd58e6-dbe8-4deb-80d2-24cea534ed08 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1317 microversion: 2.1 time: 0.204803 Aug 24 04:51:14.726599 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3902/7532] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:14 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:15.750301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:15.751023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:15.758162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:15.758682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:15.759129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:15.759900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:15.760379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:15.760810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:15.914567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:15.923540 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d2ec3153-da12-43f5-935f-1e90f867ed1c tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1317 microversion: 2.1 time: 0.178375 Aug 24 04:51:15.924191 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3631/7533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:15 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:16.946882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:16.947462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:16.955226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:16.955806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:16.956298 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:16.957005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:16.957580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:16.957882 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:17.093174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:17.103407 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c4d68df-c6b4-4499-bade-b873d5be4dbd tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1317 microversion: 2.1 time: 0.160285 Aug 24 04:51:17.104074 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3903/7534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:16 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:18.129576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:18.130622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:18.135164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:18.142944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:18.143436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:18.143927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:18.144729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:18.145207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:18.145664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:18.298522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:18.307313 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a9c77272-3889-4ab9-949a-f84f070d2b1e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1317 microversion: 2.1 time: 0.185726 Aug 24 04:51:18.307996 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3632/7535] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:18 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:19.329680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:19.330399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:19.337764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:19.338238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:19.338675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:19.339394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:19.339886 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:19.340325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:19.488929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:19.498919 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-22263ea3-244d-4616-9694-16437c5d47ee tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1317 microversion: 2.1 time: 0.173486 Aug 24 04:51:19.499630 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3904/7536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:19 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:20.520579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:20.521220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:20.527978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:20.528564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:20.529020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:20.529737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:20.530210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:20.530685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:20.670105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:20.678380 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-409067a5-9616-4813-9246-afe4cb5357cf tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1317 microversion: 2.1 time: 0.161890 Aug 24 04:51:20.678980 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3633/7537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:20 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:21.376574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:21.444927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b4220e4d-52ec-4865-b4e2-80c8a6924b1c req-42a3502b-804a-4cf7-9493-1d5db50920c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac747a1-f75a-4fc1-805a-8bba7cb879e2", "name": "network-vif-plugged", "status": "completed", "tag": "4f1f5c09-651d-4123-94ea-57fffda6148f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:21.455490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b4220e4d-52ec-4865-b4e2-80c8a6924b1c req-42a3502b-804a-4cf7-9493-1d5db50920c2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:21.455932 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b4220e4d-52ec-4865-b4e2-80c8a6924b1c req-42a3502b-804a-4cf7-9493-1d5db50920c2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:21.456373 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b4220e4d-52ec-4865-b4e2-80c8a6924b1c req-42a3502b-804a-4cf7-9493-1d5db50920c2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:21.468178 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b4220e4d-52ec-4865-b4e2-80c8a6924b1c req-42a3502b-804a-4cf7-9493-1d5db50920c2 service nova] Creating event network-vif-plugged:4f1f5c09-651d-4123-94ea-57fffda6148f for instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 on n-h2-846470-15 Aug 24 04:51:21.474148 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b4220e4d-52ec-4865-b4e2-80c8a6924b1c req-42a3502b-804a-4cf7-9493-1d5db50920c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102447 Aug 24 04:51:21.474751 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3905/7538] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:21.704134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:21.705084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:21.708050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=10 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:21.717746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:21.718519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:21.718988 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:21.720057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:21.720892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:21.721610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:21.871387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:21.880383 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f2269a1-edf1-4203-8779-bc63ca9be799 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1317 microversion: 2.1 time: 0.183638 Aug 24 04:51:21.880973 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3634/7539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:21 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:22.904915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:22.905685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:22.912480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:22.912961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:22.913711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:22.914411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:22.914875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:22.915303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:23.060289 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:23.071380 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-451059ce-b928-486a-8517-321665061021 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1317 microversion: 2.1 time: 0.171674 Aug 24 04:51:23.072431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3906/7540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:22 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:24.093320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:24.093923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:24.101355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:24.101857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:24.102309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:24.103021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:24.103493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:24.103971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:24.250983 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:24.259265 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dd69dde4-ef5b-4b8b-8c5f-2a26094dc0f5 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1506 microversion: 2.1 time: 0.169875 Aug 24 04:51:24.259953 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3635/7541] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:24 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:24.328603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-325006776", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "fcf3ba28-8ffc-4d83-a01a-bc2d9701dc37"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:24.401599 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] validate_networks() for [('fcf3ba28-8ffc-4d83-a01a-bc2d9701dc37', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:51:25.200553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:51:25.200979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:51:25.201757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:51:25.202190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:51:25.202608 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:51:25.212573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.213061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.213504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:25.214238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:25.214696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:25.215126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:25.232591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Getting quotas for project 968bcd849c334808bf06cc37af977d25. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:51:25.238781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Getting quotas for user 203a9716accc4606abd2ed89433a1853 and project 968bcd849c334808bf06cc37af977d25. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:51:25.255415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:51:25.257866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:51:25.306387 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9a26c951-e879-40fc-946e-3edb2ae313ec tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983921 Aug 24 04:51:25.307365 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3907/7542] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:51:25.323069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9170f72d-f5c2-44d9-ab60-d03b3bbeb765 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:25.324274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9170f72d-f5c2-44d9-ab60-d03b3bbeb765 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:25.400280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9170f72d-f5c2-44d9-ab60-d03b3bbeb765 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:25.415716 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9170f72d-f5c2-44d9-ab60-d03b3bbeb765 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1216 microversion: 2.1 time: 0.100811 Aug 24 04:51:25.428010 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3636/7543] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:25 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:26.437538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:26.438102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:26.446632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:26.447160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:26.447600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:26.448346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:26.448834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:26.449266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:26.552678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:26.562019 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d5ba3fd3-a8ff-43f1-be16-975c3659a446 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1268 microversion: 2.1 time: 0.128724 Aug 24 04:51:26.562596 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3908/7544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:26 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1268 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:27.583763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:27.584325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:27.592163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:27.592664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:27.593153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:27.593897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:27.594364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:27.594804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:27.830028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:27.838879 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98fb2176-1a1e-4a40-838c-596822dc5c37 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1316 microversion: 2.1 time: 0.259149 Aug 24 04:51:27.839401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3637/7545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:27 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:28.157953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-25009fea-c488-4086-9ce6-b5e0a7b83c20 req-253f3cde-75f5-4f1e-b9e1-6c9f5cf25bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58aacdc0-6f84-4393-b702-7d7aa6105463", "tag": "5ec92545-0653-4e6a-95e2-3814015bbb04"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:28.169892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-25009fea-c488-4086-9ce6-b5e0a7b83c20 req-253f3cde-75f5-4f1e-b9e1-6c9f5cf25bf1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:28.170546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-25009fea-c488-4086-9ce6-b5e0a7b83c20 req-253f3cde-75f5-4f1e-b9e1-6c9f5cf25bf1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:28.170987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-25009fea-c488-4086-9ce6-b5e0a7b83c20 req-253f3cde-75f5-4f1e-b9e1-6c9f5cf25bf1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:28.183340 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-25009fea-c488-4086-9ce6-b5e0a7b83c20 req-253f3cde-75f5-4f1e-b9e1-6c9f5cf25bf1 service nova] Creating event network-changed:5ec92545-0653-4e6a-95e2-3814015bbb04 for instance 58aacdc0-6f84-4393-b702-7d7aa6105463 on n-h1-846470-15 Aug 24 04:51:28.188936 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-25009fea-c488-4086-9ce6-b5e0a7b83c20 req-253f3cde-75f5-4f1e-b9e1-6c9f5cf25bf1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035695 Aug 24 04:51:28.189551 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3909/7546] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:28.860602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:28.861246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:28.869388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:28.869920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:28.870364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:28.871053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:28.871634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:28.872490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:29.012821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:29.020942 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea56cc09-8ff2-4ab0-b925-9a7f4fd9712f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1316 microversion: 2.1 time: 0.164661 Aug 24 04:51:29.021523 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3638/7547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:28 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:30.048001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:30.049133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:30.060664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:30.061430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:30.062121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:30.063225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:30.063977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:30.064647 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:30.226341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:30.235179 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-725dc9ac-d28e-4f30-a206-dc1b28beca26 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1316 microversion: 2.1 time: 0.194643 Aug 24 04:51:30.235883 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3910/7548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:30 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:31.257980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:31.258640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:31.266634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:31.267171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:31.267629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:31.268419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:31.268911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:31.269355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:31.507330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:31.518405 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e4c10f7c-5351-4ec2-a5b4-0560f8a3836d tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1316 microversion: 2.1 time: 0.264675 Aug 24 04:51:31.519057 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3639/7549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:31 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:32.540444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:32.541085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:32.550357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:32.550848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:32.551290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:32.552062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:32.552527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:32.552952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:32.695525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:32.704540 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ea864340-914a-4d3c-9046-71a525e3fb53 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1316 microversion: 2.1 time: 0.168350 Aug 24 04:51:32.705212 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3911/7550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:32 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:33.726930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:33.727687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:33.736796 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:33.737424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:33.737889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:33.738908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:33.739409 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:33.739911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:33.892882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:33.901533 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f95e01af-4c67-47da-972d-7a8cfbc61c54 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1316 microversion: 2.1 time: 0.178799 Aug 24 04:51:33.902120 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3640/7551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:33 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:34.923983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:34.924701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:34.932016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:34.932509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:34.932946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:34.933646 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:34.934144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:34.934561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:35.077535 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:35.087870 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc637dbd-48c9-44b9-ab54-cd83830cd017 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1316 microversion: 2.1 time: 0.168072 Aug 24 04:51:35.088646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3912/7552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:34 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:35.753445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ffa73ba4-6d07-4fa6-a831-748192f6eceb req-cf0da01a-69ef-4c97-8370-efa21554a384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aacdc0-6f84-4393-b702-7d7aa6105463", "name": "network-vif-plugged", "status": "completed", "tag": "5ec92545-0653-4e6a-95e2-3814015bbb04"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:35.759383 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:35.767102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ffa73ba4-6d07-4fa6-a831-748192f6eceb req-cf0da01a-69ef-4c97-8370-efa21554a384 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:35.767603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ffa73ba4-6d07-4fa6-a831-748192f6eceb req-cf0da01a-69ef-4c97-8370-efa21554a384 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:35.768420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ffa73ba4-6d07-4fa6-a831-748192f6eceb req-cf0da01a-69ef-4c97-8370-efa21554a384 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:35.781396 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ffa73ba4-6d07-4fa6-a831-748192f6eceb req-cf0da01a-69ef-4c97-8370-efa21554a384 service nova] Creating event network-vif-plugged:5ec92545-0653-4e6a-95e2-3814015bbb04 for instance 58aacdc0-6f84-4393-b702-7d7aa6105463 on n-h1-846470-15 Aug 24 04:51:35.786855 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ffa73ba4-6d07-4fa6-a831-748192f6eceb req-cf0da01a-69ef-4c97-8370-efa21554a384 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Aug 24 04:51:35.787765 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3641/7553] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:36.114288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:36.115260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:36.118292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:36.119308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:36.130391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:36.131143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:36.131875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:36.132967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:36.133675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:36.134344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:36.276930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:36.285341 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60169fb9-64fa-4467-9be9-4c37938b42ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1316 microversion: 2.1 time: 0.177755 Aug 24 04:51:36.285939 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3913/7554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:36 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:37.308572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:37.310474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:37.314515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:37.321329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:37.322237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.322865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.324155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:37.324811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.325239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.330221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=67 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:37.484379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:37.492747 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8cda0b8b-b1ef-4d80-b202-697fc1c37e5f tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1505 microversion: 2.1 time: 0.188652 Aug 24 04:51:37.493342 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3642/7555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:37 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:37.513492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:37.514042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:37.520819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:37.521306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.521742 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.522433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:37.522880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.523303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.554113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:51:37.602769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:37.622888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:37.644696 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2fcb54ba-c0c9-4e34-8663-4ae8071b596e tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "DELETE /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 204 len: 0 microversion: 2.1 time: 0.134753 Aug 24 04:51:37.645656 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3914/7556] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:51:37 2022] DELETE /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:51:37.653910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:37.654573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:37.662060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:37.662906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.663696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.664821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:37.665598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:37.666317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:37.817077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:37.825734 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1dbf5de9-d475-4e77-9e48-a403d2e985b1 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1511 microversion: 2.1 time: 0.175931 Aug 24 04:51:37.826701 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3643/7557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:37 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:38.847629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:38.848368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:38.855365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:38.856268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:38.856413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:38.857146 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:38.857607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:38.858037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:39.014268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:39.028902 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-62dd5e7b-2ba2-4dbc-b31d-75b8b99c4a5b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1511 microversion: 2.1 time: 0.185128 Aug 24 04:51:39.030041 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3915/7558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:38 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:39.738086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f6a678d2-0bda-462d-9b39-85e3d6475ec8 req-d1063476-928e-4254-b39a-4a64e2fd1742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aacdc0-6f84-4393-b702-7d7aa6105463", "name": "network-vif-deleted", "tag": "5ec92545-0653-4e6a-95e2-3814015bbb04"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:39.754652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f6a678d2-0bda-462d-9b39-85e3d6475ec8 req-d1063476-928e-4254-b39a-4a64e2fd1742 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:39.755847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f6a678d2-0bda-462d-9b39-85e3d6475ec8 req-d1063476-928e-4254-b39a-4a64e2fd1742 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:39.756376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f6a678d2-0bda-462d-9b39-85e3d6475ec8 req-d1063476-928e-4254-b39a-4a64e2fd1742 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:39.769333 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f6a678d2-0bda-462d-9b39-85e3d6475ec8 req-d1063476-928e-4254-b39a-4a64e2fd1742 service nova] Creating event network-vif-deleted:5ec92545-0653-4e6a-95e2-3814015bbb04 for instance 58aacdc0-6f84-4393-b702-7d7aa6105463 on n-h1-846470-15 Aug 24 04:51:39.776122 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f6a678d2-0bda-462d-9b39-85e3d6475ec8 req-d1063476-928e-4254-b39a-4a64e2fd1742 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041558 Aug 24 04:51:39.777086 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3644/7559] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:40.050633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:40.051226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:40.058615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:40.059087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:40.059739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:40.060588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:40.061115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:40.061547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:40.101696 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:40.102188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:40.102627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:40.103081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lazy-loading 'fault' on Instance uuid 58aacdc0-6f84-4393-b702-7d7aa6105463 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:51:40.149358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:40.161521 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aa56d5d0-3bc7-4cf8-b153-56ad1bc27729 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 200 len: 1306 microversion: 2.1 time: 0.114563 Aug 24 04:51:40.162357 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3916/7560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:40 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 1306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:41.185981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:41.187289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:41.203154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.203712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.204171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.204896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.205363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.205869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] HTTP exception thrown: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Request method failure captured: Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 HTTP/1.1 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa46uf9p4mrWYxTqJbRJrI7DjhqzQ6WlikcG59wgvMndLRLEm5tbLKjKf3NcBXeYiPDz_cE5TRT9mrO0NNJuDI9rdjv4vNv8QV8VajhlSCTRcI3sH-RAOwiw1y1hrzFzrstOQtgbgJqk4xRNlEbDGSrPCpUkXSCmiLKofZSbKCX_l9A Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_968bcd849c334808bf06cc37af977d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/968bcd849c334808bf06cc37af977d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 203a9716accc4606abd2ed89433a1853 Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '58aacdc0-6f84-4393-b702-7d7aa6105463'} Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:51:41.224811 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Returning 404 to user: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0b4fd285-8b8c-4cbf-b755-f0937bd5119b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 404 len: 111 microversion: 2.1 time: 0.043957 Aug 24 04:51:41.230697 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3645/7561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:41 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:51:41.235621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:41.236264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:41.243395 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.243917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.244358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.245054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.245508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.245935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.385700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:41.394020 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc85cc25-346a-461e-a7b2-cbac81fef380 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1506 microversion: 2.1 time: 0.162728 Aug 24 04:51:41.394618 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3917/7562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:41 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:41.415955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-575b9ab6-d441-4d66-9175-16165c8ae9c7 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:41.418314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-575b9ab6-d441-4d66-9175-16165c8ae9c7 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: f13090b7-bb4b-468c-858c-e9ed461dc90e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:41.424369 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-575b9ab6-d441-4d66-9175-16165c8ae9c7 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] HTTP exception thrown: Instance f13090b7-bb4b-468c-858c-e9ed461dc90e could not be found. Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-575b9ab6-d441-4d66-9175-16165c8ae9c7 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Request method failure captured: Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/f13090b7-bb4b-468c-858c-e9ed461dc90e/action HTTP/1.1 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 32 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa46uf9p4mrWYxTqJbRJrI7DjhqzQ6WlikcG59wgvMndLRLEm5tbLKjKf3NcBXeYiPDz_cE5TRT9mrO0NNJuDI9rdjv4vNv8QV8VajhlSCTRcI3sH-RAOwiw1y1hrzFzrstOQtgbgJqk4xRNlEbDGSrPCpUkXSCmiLKofZSbKCX_l9A Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_968bcd849c334808bf06cc37af977d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/968bcd849c334808bf06cc37af977d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 203a9716accc4606abd2ed89433a1853 Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: {"resize": {"flavorRef": "452"}} Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance f13090b7-bb4b-468c-858c-e9ed461dc90e could not be found. Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'f13090b7-bb4b-468c-858c-e9ed461dc90e', 'body': {'resize': {'flavorRef': '452'}}} Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13090b7-bb4b-468c-858c-e9ed461dc90e could not be found. Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:51:41.426000 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13090b7-bb4b-468c-858c-e9ed461dc90e could not be found. Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13090b7-bb4b-468c-858c-e9ed461dc90e could not be found. Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-575b9ab6-d441-4d66-9175-16165c8ae9c7 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Returning 404 to user: Instance f13090b7-bb4b-468c-858c-e9ed461dc90e could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-575b9ab6-d441-4d66-9175-16165c8ae9c7 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "POST /compute/v2.1/servers/f13090b7-bb4b-468c-858c-e9ed461dc90e/action" status: 404 len: 111 microversion: 2.1 time: 0.015705 Aug 24 04:51:41.430445 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3646/7563] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:51:41 2022] POST /compute/v2.1/servers/f13090b7-bb4b-468c-858c-e9ed461dc90e/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:51:41.436848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:41.437457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:41.443582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.444103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.444534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.445228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.445676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.446096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.590127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:41.599013 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1f5ba860-0c62-49c2-894f-791f3d877805 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1506 microversion: 2.1 time: 0.166457 Aug 24 04:51:41.599604 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3918/7564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:41 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:41.621084 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:41.621802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:41.628987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.629493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.629944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.630649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.631122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.631566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.773463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:41.782206 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e0aedc26-d239-4214-a041-7c2a24378bdc tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1506 microversion: 2.1 time: 0.165048 Aug 24 04:51:41.782878 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3647/7565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:41 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:41.803060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "651d8329-9971-4cd1-b875-53ee1acd1d99"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:41.805576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:41.812277 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.812770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.813247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.813957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.814415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.814896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.859594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:41.865704 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] HTTP exception thrown: Flavor 651d8329-9971-4cd1-b875-53ee1acd1d99 could not be found. Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Request method failure captured: Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: request: POST /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2/action HTTP/1.1 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 65 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBa46uf9p4mrWYxTqJbRJrI7DjhqzQ6WlikcG59wgvMndLRLEm5tbLKjKf3NcBXeYiPDz_cE5TRT9mrO0NNJuDI9rdjv4vNv8QV8VajhlSCTRcI3sH-RAOwiw1y1hrzFzrstOQtgbgJqk4xRNlEbDGSrPCpUkXSCmiLKofZSbKCX_l9A Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_968bcd849c334808bf06cc37af977d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/968bcd849c334808bf06cc37af977d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 203a9716accc4606abd2ed89433a1853 Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: {"resize": {"flavorRef": "651d8329-9971-4cd1-b875-53ee1acd1d99"}} Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: exception: Flavor 651d8329-9971-4cd1-b875-53ee1acd1d99 could not be found. Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '3ac747a1-f75a-4fc1-805a-8bba7cb879e2', 'body': {'resize': {'flavorRef': '651d8329-9971-4cd1-b875-53ee1acd1d99'}}} Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4185, in resize Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:41.867812 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 651d8329-9971-4cd1-b875-53ee1acd1d99 could not be found. Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 651d8329-9971-4cd1-b875-53ee1acd1d99 could not be found. Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 651d8329-9971-4cd1-b875-53ee1acd1d99 could not be found. Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Returning 400 to user: Flavor 651d8329-9971-4cd1-b875-53ee1acd1d99 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75d8beb7-002e-4b27-879c-94f330bcfb79 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "POST /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2/action" status: 400 len: 107 microversion: 2.1 time: 0.070203 Aug 24 04:51:41.872238 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3919/7566] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:51:41 2022] POST /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2/action => generated 107 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 04:51:41.879902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:41.880582 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:41.887166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.887752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.888146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:41.888865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:41.889328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:41.889766 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.033670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.042073 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fdf0a7a7-73de-4360-8bd7-814e210c55ef tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1506 microversion: 2.1 time: 0.167399 Aug 24 04:51:42.042658 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3648/7567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:41 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:42.063966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:42.064678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:42.071157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.071645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.072107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.072814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.073447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.074085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.219476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.227650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ed0c2767-204a-47c5-9ef2-9e9edc81bd03 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1506 microversion: 2.1 time: 0.167681 Aug 24 04:51:42.228262 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3920/7568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:42 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:42.249785 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24a4d135-656d-4d62-9ba5-ba939bb83399 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24a4d135-656d-4d62-9ba5-ba939bb83399 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Request method failure captured: Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: request: POST /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2/action HTTP/1.1 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 29 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa46uf9p4mrWYxTqJbRJrI7DjhqzQ6WlikcG59wgvMndLRLEm5tbLKjKf3NcBXeYiPDz_cE5TRT9mrO0NNJuDI9rdjv4vNv8QV8VajhlSCTRcI3sH-RAOwiw1y1hrzFzrstOQtgbgJqk4xRNlEbDGSrPCpUkXSCmiLKofZSbKCX_l9A Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_968bcd849c334808bf06cc37af977d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/968bcd849c334808bf06cc37af977d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 203a9716accc4606abd2ed89433a1853 Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: {"resize": {"flavorRef": ""}} Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '3ac747a1-f75a-4fc1-805a-8bba7cb879e2', 'body': {'resize': {'flavorRef': ''}}} Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi '' Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.253504 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-24a4d135-656d-4d62-9ba5-ba939bb83399 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-24a4d135-656d-4d62-9ba5-ba939bb83399 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "POST /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2/action" status: 400 len: 113 microversion: 2.1 time: 0.009778 Aug 24 04:51:42.261210 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3649/7569] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:51:42 2022] POST /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2/action => generated 113 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:51:42.266926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:42.267548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:42.274975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.275452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.275913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.276604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.277052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.277473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.423871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.432058 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1c280c6e-5bf2-4260-8a5c-0ab21442b092 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1506 microversion: 2.1 time: 0.169304 Aug 24 04:51:42.432646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3921/7570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:42 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:51:42.457834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:42.458333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:42.466914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.467457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.467959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.468684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.469156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.469595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.485347 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] HTTP exception thrown: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Request method failure captured: Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 HTTP/1.1 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa46uf9p4mrWYxTqJbRJrI7DjhqzQ6WlikcG59wgvMndLRLEm5tbLKjKf3NcBXeYiPDz_cE5TRT9mrO0NNJuDI9rdjv4vNv8QV8VajhlSCTRcI3sH-RAOwiw1y1hrzFzrstOQtgbgJqk4xRNlEbDGSrPCpUkXSCmiLKofZSbKCX_l9A Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_968bcd849c334808bf06cc37af977d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/968bcd849c334808bf06cc37af977d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 203a9716accc4606abd2ed89433a1853 Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '58aacdc0-6f84-4393-b702-7d7aa6105463'} Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:51:42.486974 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Returning 404 to user: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8cfc06c6-8cb9-4ead-a114-0f25c3197fd0 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "DELETE /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 404 len: 111 microversion: 2.1 time: 0.035629 Aug 24 04:51:42.494030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3650/7571] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:51:42 2022] DELETE /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:51:42.498443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:42.499047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 58aacdc0-6f84-4393-b702-7d7aa6105463] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:42.505328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.505825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.506263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.506993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.507447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.507905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.522496 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] HTTP exception thrown: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Request method failure captured: Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 HTTP/1.1 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBa46uf9p4mrWYxTqJbRJrI7DjhqzQ6WlikcG59wgvMndLRLEm5tbLKjKf3NcBXeYiPDz_cE5TRT9mrO0NNJuDI9rdjv4vNv8QV8VajhlSCTRcI3sH-RAOwiw1y1hrzFzrstOQtgbgJqk4xRNlEbDGSrPCpUkXSCmiLKofZSbKCX_l9A Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_968bcd849c334808bf06cc37af977d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/968bcd849c334808bf06cc37af977d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 203a9716accc4606abd2ed89433a1853 Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '58aacdc0-6f84-4393-b702-7d7aa6105463'} Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:42.524113 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Returning 404 to user: Instance 58aacdc0-6f84-4393-b702-7d7aa6105463 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1047eff-68c9-45fd-af33-c44249d9951b tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463" status: 404 len: 111 microversion: 2.1 time: 0.032000 Aug 24 04:51:42.528378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3922/7572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:42 2022] GET /compute/v2.1/servers/58aacdc0-6f84-4393-b702-7d7aa6105463 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:51:42.535375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:42.535808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:42.542179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.542684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.543133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.544661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.545131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.545579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.572753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:51:42.665742 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fb3bb990-f353-4263-be50-432cebdbee27 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 204 len: 0 microversion: 2.1 time: 0.134116 Aug 24 04:51:42.666428 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3651/7573] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:51:42 2022] DELETE /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:51:42.675566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:42.676181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:42.682905 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.683400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.683965 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.684964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:42.685200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:42.685632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:42.845781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:42.854161 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b284c675-b925-4cc3-a2ce-d84bb8271207 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1512 microversion: 2.1 time: 0.182759 Aug 24 04:51:42.854774 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3923/7574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:42 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:43.877298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:43.878364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:43.886257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:43.886779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:43.887325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:43.888192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:43.888725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:43.889188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:44.047050 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:44.055321 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b50bd283-6d69-48bf-aa47-9210bf961122 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1512 microversion: 2.1 time: 0.182712 Aug 24 04:51:44.060731 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3652/7575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:43 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:45.082074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:45.083192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:45.095197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.096102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.096914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.098163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.098801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.099439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.285313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203a9716accc4606abd2ed89433a1853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968bcd849c334808bf06cc37af977d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:51:45.296792 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3eed34a4-5631-440c-ac18-af951db44d7a tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 200 len: 1512 microversion: 2.1 time: 0.222576 Aug 24 04:51:45.297396 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3924/7576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:45 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:45.489625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-08c5aaa9-d275-4149-a00d-fc87e7023a01 req-eb8f2c94-8d03-4669-bd0d-e99aa511fecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac747a1-f75a-4fc1-805a-8bba7cb879e2", "name": "network-vif-deleted", "tag": "4f1f5c09-651d-4123-94ea-57fffda6148f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:51:45.506877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-08c5aaa9-d275-4149-a00d-fc87e7023a01 req-eb8f2c94-8d03-4669-bd0d-e99aa511fecb service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:45.507461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-08c5aaa9-d275-4149-a00d-fc87e7023a01 req-eb8f2c94-8d03-4669-bd0d-e99aa511fecb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:45.507977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-08c5aaa9-d275-4149-a00d-fc87e7023a01 req-eb8f2c94-8d03-4669-bd0d-e99aa511fecb service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:45.526378 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-08c5aaa9-d275-4149-a00d-fc87e7023a01 req-eb8f2c94-8d03-4669-bd0d-e99aa511fecb service nova] Creating event network-vif-deleted:4f1f5c09-651d-4123-94ea-57fffda6148f for instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 on n-h2-846470-15 Aug 24 04:51:45.534428 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-08c5aaa9-d275-4149-a00d-fc87e7023a01 req-eb8f2c94-8d03-4669-bd0d-e99aa511fecb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049004 Aug 24 04:51:45.535368 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3653/7577] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:46.318596 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:46.319245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] [instance: 3ac747a1-f75a-4fc1-805a-8bba7cb879e2] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:51:46.328512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:46.329052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:46.329495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:46.330206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:46.330668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:46.331103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:46.345908 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] HTTP exception thrown: Instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 could not be found. Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Request method failure captured: Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 HTTP/1.1 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBa46uf9p4mrWYxTqJbRJrI7DjhqzQ6WlikcG59wgvMndLRLEm5tbLKjKf3NcBXeYiPDz_cE5TRT9mrO0NNJuDI9rdjv4vNv8QV8VajhlSCTRcI3sH-RAOwiw1y1hrzFzrstOQtgbgJqk4xRNlEbDGSrPCpUkXSCmiLKofZSbKCX_l9A Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_968bcd849c334808bf06cc37af977d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/968bcd849c334808bf06cc37af977d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/968bcd849c334808bf06cc37af977d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 968bcd849c334808bf06cc37af977d25 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1946157550 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 203a9716accc4606abd2ed89433a1853 Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-ServersNegativeTestJSON-1946157550-project Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 could not be found. Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '3ac747a1-f75a-4fc1-805a-8bba7cb879e2'} Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 could not be found. Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 could not be found. Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:51:46.347503 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 could not be found. Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] Returning 404 to user: Instance 3ac747a1-f75a-4fc1-805a-8bba7cb879e2 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3ffcfa75-1966-40c6-8c98-b22bc96d4a16 tempest-ServersNegativeTestJSON-1946157550 tempest-ServersNegativeTestJSON-1946157550-project] 10.222.0.58 "GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2" status: 404 len: 111 microversion: 2.1 time: 0.034445 Aug 24 04:51:46.352161 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3925/7578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:51:46 2022] GET /compute/v2.1/servers/3ac747a1-f75a-4fc1-805a-8bba7cb879e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:51:56.855204 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:51:56.856572 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:52:20.291388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:20.292176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:20.529006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-149509ae-17ee-4fe7-a2ab-3c48c4befe45 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: .version_select at 0x7f102a7979d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1429510375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUptlrPZfrIrXaPGZq/DQuCrsXyRCfLkdrT9r32Z+88a/+rvgqcphJWNyTsViwi+y9cNnZ2lq3qgPnvVvyzg/I56k5JpJvemPh3UGjxmdwIUe5kFYgtpw5VmiZ+Hb0zWA=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:20.547417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-149509ae-17ee-4fe7-a2ab-3c48c4befe45 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for project 5704e734c11d4891863166716b79b278. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:52:20.553602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-149509ae-17ee-4fe7-a2ab-3c48c4befe45 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for user a8d668680d5548e1bcd7630d4d6df8fc and project 5704e734c11d4891863166716b79b278. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:52:20.592739 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-149509ae-17ee-4fe7-a2ab-3c48c4befe45 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.303579 Aug 24 04:52:20.598176 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3654/7579] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:52:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:20.651490 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-206658491", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1429510375", "networks": [{"uuid": "c9f4ea4b-6251-4bd5-9d31-9ab4b8faadee"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:20.661002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:20.662043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:20.750837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] validate_networks() for [('c9f4ea4b-6251-4bd5-9d31-9ab4b8faadee', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:52:21.220442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:52:21.220866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:52:21.221340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:52:21.221755 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:52:21.222193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:52:21.232229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.232698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.233223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.234258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:21.234708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:21.235160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:21.255703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for project 5704e734c11d4891863166716b79b278. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:52:21.261884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for user a8d668680d5548e1bcd7630d4d6df8fc and project 5704e734c11d4891863166716b79b278. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:52:21.276556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:52:21.278983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:52:21.336602 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-992bd4e3-c6c3-4115-b531-7fd214a3610d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689028 Aug 24 04:52:21.337248 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3926/7580] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:52:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:52:21.350182 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2ff6b17-b2cc-4756-8510-063dcfe9176a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:21.351035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f2ff6b17-b2cc-4756-8510-063dcfe9176a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:21.416468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2ff6b17-b2cc-4756-8510-063dcfe9176a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:21.426184 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2ff6b17-b2cc-4756-8510-063dcfe9176a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1262 microversion: 2.1 time: 0.080897 Aug 24 04:52:21.426792 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3655/7581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:21 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:22.448791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:22.450528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:22.461660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.462870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.463909 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.464859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:22.466081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:22.466929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:22.544035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:22.554904 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fdd4e89-2cd5-4eca-a2e2-ea5f46e11235 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1314 microversion: 2.1 time: 0.111861 Aug 24 04:52:22.555545 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3927/7582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:22 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1314 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:23.577925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:23.578586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:23.589240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.590080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.590776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.591847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:23.592339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:23.592956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:23.949581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:23.958645 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2b49cb52-3468-476f-a015-022da8191cef tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.385468 Aug 24 04:52:23.972338 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3656/7583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:23 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:24.312894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-42660290-634c-4382-a964-a15c01874ead req-773c72ba-8b79-4ec9-bc26-f28a265c3637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ba9bb3-2108-4ae3-b464-f0a34295e7f9", "tag": "dc34847a-0ed3-45c6-b496-afb50de81617"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:24.328159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-42660290-634c-4382-a964-a15c01874ead req-773c72ba-8b79-4ec9-bc26-f28a265c3637 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.329184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-42660290-634c-4382-a964-a15c01874ead req-773c72ba-8b79-4ec9-bc26-f28a265c3637 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.329841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-42660290-634c-4382-a964-a15c01874ead req-773c72ba-8b79-4ec9-bc26-f28a265c3637 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.346872 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-42660290-634c-4382-a964-a15c01874ead req-773c72ba-8b79-4ec9-bc26-f28a265c3637 service nova] Creating event network-changed:dc34847a-0ed3-45c6-b496-afb50de81617 for instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 on n-h2-846470-15 Aug 24 04:52:24.352214 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-42660290-634c-4382-a964-a15c01874ead req-773c72ba-8b79-4ec9-bc26-f28a265c3637 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044488 Aug 24 04:52:24.353238 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3928/7584] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:24.984507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:24.985131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:24.992858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.993399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.993828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:24.994558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:24.995051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:24.995509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:25.148806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:25.157558 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8a1b6f1-4797-460e-9694-b136e8d35544 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.178172 Aug 24 04:52:25.158138 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3657/7585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:24 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:26.184579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:26.185288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:26.192420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.192914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.193335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.194050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:26.194506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:26.194933 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:26.348325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:26.357282 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58b4f1f1-b9b0-4dea-a6f9-d2a2e2018e66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.180634 Aug 24 04:52:26.357282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3929/7586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:26 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:27.380300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:27.381074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:27.392279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:27.393147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:27.393918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:27.395107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:27.395962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:27.396525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:27.548547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:27.556844 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8c89b71c-2fe5-43a4-82d2-9924420f5963 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.182481 Aug 24 04:52:27.557435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3658/7587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:27 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:28.579827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:28.580452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:28.587848 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.588341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.588775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.589501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:28.590133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:28.590771 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:28.742968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:28.753606 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-97587580-65fb-4b7d-829a-27d39b0a4179 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.176777 Aug 24 04:52:28.753606 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3930/7588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:28 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:29.774361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:29.775185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:29.787770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.788971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.788971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.789660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:29.790206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:29.790776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:29.946712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:29.955591 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b73c945a-9751-442b-866b-8a65607df2b7 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.185261 Aug 24 04:52:29.956238 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3659/7589] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:29 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:30.977514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:30.978081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:30.986168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.986936 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.987381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:30.988147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:30.988777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:30.989436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.134508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:31.143804 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bb70e865-e9d3-453d-b346-0ef6e3cd89d4 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.170237 Aug 24 04:52:31.144440 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3931/7590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:30 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:31.870513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-e42db7f6-477b-424b-8fe3-724d7bc793f2 req-5ccd50c9-27bf-4899-a411-772bb4ef4279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ba9bb3-2108-4ae3-b464-f0a34295e7f9", "name": "network-vif-plugged", "status": "completed", "tag": "dc34847a-0ed3-45c6-b496-afb50de81617"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:31.877548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:31.884489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e42db7f6-477b-424b-8fe3-724d7bc793f2 req-5ccd50c9-27bf-4899-a411-772bb4ef4279 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:31.884993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e42db7f6-477b-424b-8fe3-724d7bc793f2 req-5ccd50c9-27bf-4899-a411-772bb4ef4279 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:31.885689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-e42db7f6-477b-424b-8fe3-724d7bc793f2 req-5ccd50c9-27bf-4899-a411-772bb4ef4279 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:31.897806 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-e42db7f6-477b-424b-8fe3-724d7bc793f2 req-5ccd50c9-27bf-4899-a411-772bb4ef4279 service nova] Creating event network-vif-plugged:dc34847a-0ed3-45c6-b496-afb50de81617 for instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 on n-h2-846470-15 Aug 24 04:52:31.903649 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-e42db7f6-477b-424b-8fe3-724d7bc793f2 req-5ccd50c9-27bf-4899-a411-772bb4ef4279 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037678 Aug 24 04:52:31.904320 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3660/7591] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:32.165292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:32.165892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:32.170261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:32.170261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:32.177163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.177884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.178085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.179079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:32.179609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:32.180055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:32.337033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:32.345183 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4201b035-ced0-4535-94fe-1e793aac6dca tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.183929 Aug 24 04:52:32.345772 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3932/7592] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:32 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:33.370519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:33.371335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:33.378229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.378740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.379196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.379979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:33.380453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:33.380905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:33.525443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:33.534538 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-46e41783-6ffa-4fae-9215-935d79aef297 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1362 microversion: 2.1 time: 0.170941 Aug 24 04:52:33.535171 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3661/7593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:33 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:34.560701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:34.562351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:34.572919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.573789 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.574292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.575005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.575462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.575915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.719017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.728495 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ef9d65bf-09ba-4b94-af08-fa9dc205d9d5 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1555 microversion: 2.1 time: 0.174902 Aug 24 04:52:34.729395 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3933/7594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:34 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:34.750438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:34.751138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:34.758698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.759309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.759905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.760740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:34.761884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:34.762381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:34.908179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:34.916421 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f7131ffc-85cd-4da7-a17a-1b66c682fc87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1555 microversion: 2.1 time: 0.170035 Aug 24 04:52:34.917030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3662/7595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:34 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:36.586738 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be4a8d33-d3ed-434e-bcaf-67e404d8c4ea"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:52:36.589100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:36.596462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.596949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.597382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.598079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:36.598529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:36.598949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:36.891915 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f15b2734-4912-42de-8614-285fda33d102 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309315 Aug 24 04:52:36.892672 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3934/7596] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:52:36 2022] POST /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:48.749672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:48.750267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:48.752705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:48.753377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=38 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:48.759956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:48.760463 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:48.760919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:48.761653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:48.762122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:48.762562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:48.856834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lazy-loading 'services' on Instance uuid c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:52:48.931969 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5dad6732-0e12-4444-a115-c73dcc25f16e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments/be4a8d33-d3ed-434e-bcaf-67e404d8c4ea" status: 202 len: 0 microversion: 2.1 time: 0.186987 Aug 24 04:52:48.932581 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3663/7597] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:52:48 2022] DELETE /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments/be4a8d33-d3ed-434e-bcaf-67e404d8c4ea => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:52:48.939243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:48.940821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:48.946071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:48.948517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:48.958591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:48.959171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:48.959764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:48.960603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:48.961058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:48.961476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:49.005395 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-031ccd69-bc38-4a68-bef9-9ef815a93d22 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068053 Aug 24 04:52:49.006165 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3935/7598] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:52:48 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:50.020847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:50.023253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:50.031154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:50.031689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:50.032152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:50.032881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:50.033438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:50.033883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:50.069792 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9e022558-b08e-4bdc-9838-18a2f964148f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054387 Aug 24 04:52:50.074264 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3664/7599] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:52:50 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:51.082656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:51.084973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:51.094100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.094640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.095078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.095871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:51.096354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:51.096791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:51.129962 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-777ff04d-dcf6-4001-92e2-7ad2f2610dbb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051332 Aug 24 04:52:51.130843 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3936/7600] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:52:51 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:52.142937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:52.145197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:52.152745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.153255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.153711 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.154504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:52.154966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:52.155403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:52.187703 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9c336477-3a64-48be-86cf-0bfac572565a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048755 Aug 24 04:52:52.188303 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3665/7601] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:52:52 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:53.203159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:53.205511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:53.212890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:53.213379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:53.213816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:53.214876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:53.215558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:53.218425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:53.255828 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d03694d2-b84e-4107-985a-b88c0dd70faf tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058383 Aug 24 04:52:53.256434 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3937/7602] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:52:53 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:54.268557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:54.272303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:54.282483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:54.282995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:54.283461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:54.284229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:54.284700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:54.285145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:54.323199 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fc63e0a1-639f-49ac-b627-9f444cc77156 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058800 Aug 24 04:52:54.323826 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3666/7603] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:52:54 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:52:54.336094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:54.336660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:54.344147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:54.344623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:54.345057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:54.345752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:54.346201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:54.346621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:54.428626 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] HTTP exception thrown: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 is not attached to volume be4a8d33-d3ed-434e-bcaf-67e404d8c4ea Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Request method failure captured: Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments/be4a8d33-d3ed-434e-bcaf-67e404d8c4ea HTTP/1.1 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBa5-hqyGDEtRfjggJxyy-y_Wylb6ICnh59a-A85Hj2A3xjjiF4_grvZIladcSa0fkMMIZsXRw2Gj8HAYXWyyFpBMFj_Icng-09psWYD0JSLkh5rfg2i-6-iDASQucMHnxSpHhMO7qal_FTXAvmT9fg3ArYR9dWxuHOMyw19CuYXHF0s Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5704e734c11d4891863166716b79b278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5704e734c11d4891863166716b79b278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: a8d668680d5548e1bcd7630d4d6df8fc Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 is not attached to volume be4a8d33-d3ed-434e-bcaf-67e404d8c4ea Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': 'c8ba9bb3-2108-4ae3-b464-f0a34295e7f9', 'id': 'be4a8d33-d3ed-434e-bcaf-67e404d8c4ea'} Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id be4a8d33-d3ed-434e-bcaf-67e404d8c4ea. Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 is not attached to volume be4a8d33-d3ed-434e-bcaf-67e404d8c4ea Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:52:54.435235 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:52:54.441348 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:52:54.441348 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:52:54.441348 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 is not attached to volume be4a8d33-d3ed-434e-bcaf-67e404d8c4ea Aug 24 04:52:54.441348 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:52:54.441348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Returning 404 to user: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 is not attached to volume be4a8d33-d3ed-434e-bcaf-67e404d8c4ea {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:52:54.441348 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b99a46ca-7f39-41a7-aa42-3d1d0baa778d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments/be4a8d33-d3ed-434e-bcaf-67e404d8c4ea" status: 404 len: 154 microversion: 2.1 time: 0.105031 Aug 24 04:52:54.441348 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3938/7604] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:52:54 2022] DELETE /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9/os-volume_attachments/be4a8d33-d3ed-434e-bcaf-67e404d8c4ea => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:52:57.875475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:57.876125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:57.883842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:57.884453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:57.884888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:57.885697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:57.886201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:57.886702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:57.922424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:52:58.017183 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ebcc36aa-3a63-411b-98cc-d902a8940de2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 204 len: 0 microversion: 2.1 time: 0.145745 Aug 24 04:52:58.017794 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3667/7605] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:52:57 2022] DELETE /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:52:58.026926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:58.028030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:58.038761 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:58.039257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:58.039740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:58.040464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:58.040924 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:58.041355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:58.192930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:58.202352 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0421ffa1-22e0-4239-b2a7-142678b80958 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1561 microversion: 2.1 time: 0.179617 Aug 24 04:52:58.203075 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3939/7606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:58 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:52:59.225740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:59.226812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:52:59.238761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:59.238761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:59.238761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:59.239477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:59.239971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:59.240633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:59.397302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:52:59.408310 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-257a5db9-19f6-4832-9c66-b0c0e12a2853 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1561 microversion: 2.1 time: 0.187025 Aug 24 04:52:59.408929 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3668/7607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:52:59 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:00.433223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:00.433815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:00.441632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:00.442128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:00.442568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:00.443291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:00.443786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:00.444198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:00.619843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:00.629782 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86031dfb-92c9-4d78-9ca2-3073d810a47b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1561 microversion: 2.1 time: 0.200906 Aug 24 04:53:00.630392 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3940/7608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:00 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:01.095921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1db6ec9e-cb6e-40c3-bdcd-edd3a2e97849 req-baf5bc39-ad00-4f1d-8e6e-f4e2b0b652ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ba9bb3-2108-4ae3-b464-f0a34295e7f9", "name": "network-vif-deleted", "tag": "dc34847a-0ed3-45c6-b496-afb50de81617"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:01.111110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1db6ec9e-cb6e-40c3-bdcd-edd3a2e97849 req-baf5bc39-ad00-4f1d-8e6e-f4e2b0b652ae service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:01.113015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1db6ec9e-cb6e-40c3-bdcd-edd3a2e97849 req-baf5bc39-ad00-4f1d-8e6e-f4e2b0b652ae service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:01.113015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1db6ec9e-cb6e-40c3-bdcd-edd3a2e97849 req-baf5bc39-ad00-4f1d-8e6e-f4e2b0b652ae service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:01.126938 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1db6ec9e-cb6e-40c3-bdcd-edd3a2e97849 req-baf5bc39-ad00-4f1d-8e6e-f4e2b0b652ae service nova] Creating event network-vif-deleted:dc34847a-0ed3-45c6-b496-afb50de81617 for instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 on n-h2-846470-15 Aug 24 04:53:01.132980 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1db6ec9e-cb6e-40c3-bdcd-edd3a2e97849 req-baf5bc39-ad00-4f1d-8e6e-f4e2b0b652ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041587 Aug 24 04:53:01.134281 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3669/7609] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:01.652865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:01.653643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:01.661630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:01.662137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:01.662568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:01.663283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:01.663765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:01.664198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:01.702072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:01.702597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:01.703047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:01.703555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lazy-loading 'fault' on Instance uuid c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:53:01.752026 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:01.764316 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3573cc96-cdd3-4770-a992-b2f2854b6b87 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 200 len: 1352 microversion: 2.1 time: 0.113445 Aug 24 04:53:01.764945 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3941/7610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:01 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:02.790788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:02.791513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: c8ba9bb3-2108-4ae3-b464-f0a34295e7f9] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:02.798392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:02.798908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:02.799368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:02.800124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:02.800602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:02.801048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:02.816827 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] HTTP exception thrown: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 could not be found. Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Request method failure captured: Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 HTTP/1.1 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa5-hqyGDEtRfjggJxyy-y_Wylb6ICnh59a-A85Hj2A3xjjiF4_grvZIladcSa0fkMMIZsXRw2Gj8HAYXWyyFpBMFj_Icng-09psWYD0JSLkh5rfg2i-6-iDASQucMHnxSpHhMO7qal_FTXAvmT9fg3ArYR9dWxuHOMyw19CuYXHF0s Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5704e734c11d4891863166716b79b278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5704e734c11d4891863166716b79b278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: a8d668680d5548e1bcd7630d4d6df8fc Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 could not be found. Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'c8ba9bb3-2108-4ae3-b464-f0a34295e7f9'} Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 could not be found. Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 could not be found. Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:02.819348 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 could not be found. Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Returning 404 to user: Instance c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dc83813a-b906-4f29-83df-4db89b1cd4ba tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9" status: 404 len: 111 microversion: 2.1 time: 0.037066 Aug 24 04:53:02.824290 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3670/7611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:02 2022] GET /compute/v2.1/servers/c8ba9bb3-2108-4ae3-b464-f0a34295e7f9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:02.833828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7283b4ae-7d91-4c5b-8e2a-34601afa44a2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '.version_select at 0x7f10226e2280>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:02.864634 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7283b4ae-7d91-4c5b-8e2a-34601afa44a2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1429510375" status: 202 len: 0 microversion: 2.1 time: 0.037294 Aug 24 04:53:02.865582 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3942/7612] 10.222.0.58 () {58 vars in 1278 bytes} [Wed Aug 24 04:53:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1429510375 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:53:02.883927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-479a599b-ebc9-427c-8e59-8fe1d0edfb3e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: .version_select at 0x7f1029c56310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-344725016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOn2qWuKK49uTujYd6w9kgcmz53sGkHZ9YARBHVaZ7mnGVEhJftml5p5qh2kSNjK6wjl0CwgDPjhbJ23ycA6bTFy04nhCEhKb6EIpIKVmUE2oSfu/AqEqyOEtzML25AHkw=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:02.904707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-479a599b-ebc9-427c-8e59-8fe1d0edfb3e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for project 5704e734c11d4891863166716b79b278. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:53:02.912295 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-479a599b-ebc9-427c-8e59-8fe1d0edfb3e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for user a8d668680d5548e1bcd7630d4d6df8fc and project 5704e734c11d4891863166716b79b278. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:53:02.942466 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-479a599b-ebc9-427c-8e59-8fe1d0edfb3e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.062389 Aug 24 04:53:02.943072 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3671/7613] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:53:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:03.000470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-82853466", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-344725016", "networks": [{"uuid": "c9f4ea4b-6251-4bd5-9d31-9ab4b8faadee"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:03.060706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] validate_networks() for [('c9f4ea4b-6251-4bd5-9d31-9ab4b8faadee', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:53:03.486166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:53:03.486607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:53:03.487075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:53:03.487519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:53:03.487942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:53:03.497721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:03.498263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:03.498709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:03.499445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:03.499954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:03.500387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:03.517683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for project 5704e734c11d4891863166716b79b278. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:53:03.523234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for user a8d668680d5548e1bcd7630d4d6df8fc and project 5704e734c11d4891863166716b79b278. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:53:03.536193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:53:03.538557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:53:03.588779 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-108ae65a-205e-4469-989a-d3a02df5a5a0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592653 Aug 24 04:53:03.589440 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3943/7614] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:53:03.602540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a3d365d2-c992-45f7-8273-0fbdd10c2411 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:03.603166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a3d365d2-c992-45f7-8273-0fbdd10c2411 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:03.665191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a3d365d2-c992-45f7-8273-0fbdd10c2411 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:03.672552 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a3d365d2-c992-45f7-8273-0fbdd10c2411 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1260 microversion: 2.1 time: 0.074689 Aug 24 04:53:03.673166 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3672/7615] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:03 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1260 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:04.695645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:04.696266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:04.704024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:04.704516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:04.704928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:04.705639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:04.706095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:04.706752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:04.782273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:04.790253 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4a2c6db3-2d69-4682-9871-4f9e3df3794e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1320 microversion: 2.1 time: 0.099811 Aug 24 04:53:04.790835 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3944/7616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:04 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1320 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:05.813319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:05.813872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:05.828176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:05.828872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:05.829489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:05.830220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:05.830684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:05.831094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:06.076184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:06.085194 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9d504ecc-f679-4b98-9ad9-d76be4b0a7c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1360 microversion: 2.1 time: 0.276316 Aug 24 04:53:06.085820 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3673/7617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:05 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1360 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:06.200213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-8d98770f-cfd5-4df8-8a8a-1905bfd22cd1 req-9b4409f9-37d5-4b2a-8f69-de08d767b3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5ea315-1414-418f-bdcf-bcc99fe747d4", "tag": "c1062d5c-228f-4b2c-a72a-b1d87a55b0e9"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:06.221412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8d98770f-cfd5-4df8-8a8a-1905bfd22cd1 req-9b4409f9-37d5-4b2a-8f69-de08d767b3d0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:06.229678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8d98770f-cfd5-4df8-8a8a-1905bfd22cd1 req-9b4409f9-37d5-4b2a-8f69-de08d767b3d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:06.230457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8d98770f-cfd5-4df8-8a8a-1905bfd22cd1 req-9b4409f9-37d5-4b2a-8f69-de08d767b3d0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:06.243136 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-8d98770f-cfd5-4df8-8a8a-1905bfd22cd1 req-9b4409f9-37d5-4b2a-8f69-de08d767b3d0 service nova] Creating event network-changed:c1062d5c-228f-4b2c-a72a-b1d87a55b0e9 for instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 on n-h2-846470-15 Aug 24 04:53:06.249441 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-8d98770f-cfd5-4df8-8a8a-1905bfd22cd1 req-9b4409f9-37d5-4b2a-8f69-de08d767b3d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052926 Aug 24 04:53:06.250070 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3945/7618] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:07.106917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:07.107889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:07.115651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:07.116183 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:07.116633 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:07.117381 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:07.117845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:07.118285 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:07.269292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:07.279643 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-df5640a1-f14a-40ee-b8da-823d56115990 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1360 microversion: 2.1 time: 0.176367 Aug 24 04:53:07.280239 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3674/7619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:07 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:08.303359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:08.304121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:08.311205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:08.311722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:08.312161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:08.312869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:08.313321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:08.313745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:08.458732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:08.469244 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-262031b1-4a14-4f36-8524-868f73d7cab9 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1360 microversion: 2.1 time: 0.171261 Aug 24 04:53:08.470975 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3946/7620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:08 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:09.498120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:09.498857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:09.506396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:09.506937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:09.507356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:09.508187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:09.508651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:09.509083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:09.741539 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:09.750455 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1889ff23-d5ba-4594-8797-09f5aa48c0e0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1360 microversion: 2.1 time: 0.256477 Aug 24 04:53:09.751269 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3675/7621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:09 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1360 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:10.772290 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:10.772869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:10.780623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:10.782046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:10.782046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:10.782428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:10.782689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:10.783139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:10.922990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:10.931384 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53963bb8-1cb1-42e9-9521-9d989bc9ae06 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1360 microversion: 2.1 time: 0.163033 Aug 24 04:53:10.931931 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3947/7622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:10 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:11.930170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-18ee17d4-df24-480f-b64b-565ddc738746 req-74d728b1-611c-4e85-9c62-f38474381cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5ea315-1414-418f-bdcf-bcc99fe747d4", "name": "network-vif-plugged", "status": "completed", "tag": "c1062d5c-228f-4b2c-a72a-b1d87a55b0e9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:11.941628 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-18ee17d4-df24-480f-b64b-565ddc738746 req-74d728b1-611c-4e85-9c62-f38474381cb8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:11.942206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-18ee17d4-df24-480f-b64b-565ddc738746 req-74d728b1-611c-4e85-9c62-f38474381cb8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:11.942650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-18ee17d4-df24-480f-b64b-565ddc738746 req-74d728b1-611c-4e85-9c62-f38474381cb8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:11.952499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:11.953842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:11.955367 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-18ee17d4-df24-480f-b64b-565ddc738746 req-74d728b1-611c-4e85-9c62-f38474381cb8 service nova] Creating event network-vif-plugged:c1062d5c-228f-4b2c-a72a-b1d87a55b0e9 for instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 on n-h2-846470-15 Aug 24 04:53:11.960511 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-18ee17d4-df24-480f-b64b-565ddc738746 req-74d728b1-611c-4e85-9c62-f38474381cb8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034169 Aug 24 04:53:11.961284 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3676/7623] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:11.962132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:11.962713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:11.963248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:11.964080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:11.964631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:11.965188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:12.123047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:12.131083 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9c0f3a86-5f25-4ce7-8169-22da8e6097cb tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1360 microversion: 2.1 time: 0.183179 Aug 24 04:53:12.131690 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3948/7624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:11 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:13.159758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:13.161005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:13.170922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:13.171431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:13.171932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:13.172632 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:13.173106 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:13.173576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:13.315564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:13.323925 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-284d97c2-c593-4fc9-9416-96910736698d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1360 microversion: 2.1 time: 0.172726 Aug 24 04:53:13.324529 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3677/7625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:13 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:14.348355 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:14.348955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:14.351891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:14.352559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:14.359505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:14.360035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:14.360479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:14.361230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:14.361739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:14.362163 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:14.505473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:14.513833 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-198c0143-5bbc-4007-9ce8-e833c1a60f36 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1552 microversion: 2.1 time: 0.169485 Aug 24 04:53:14.514440 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3949/7626] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:14 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:14.536652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:14.537418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:14.539704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:14.546034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:14.546545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:14.546995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:14.547694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:14.548303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:14.548741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:14.688502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:14.696676 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f4fc4b4c-8010-47d6-99f8-eebdce470d7c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1552 microversion: 2.1 time: 0.165861 Aug 24 04:53:14.697265 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3678/7627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:14 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:16.232086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8a33d53-863d-46bd-8050-76953ab38fa3"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:16.234666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:16.242021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:16.242508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:16.242942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:16.243640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:16.244121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:16.244548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:16.505638 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-648dabf8-03a9-4b0b-8572-e05933040cd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277620 Aug 24 04:53:16.506289 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3950/7628] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:53:16 2022] POST /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:28.372137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:28.372817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:28.379302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:28.379302 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:28.384388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:28.384906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:28.385361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.386089 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:28.386563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:28.387002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.480004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lazy-loading 'services' on Instance uuid 5b5ea315-1414-418f-bdcf-bcc99fe747d4 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:53:28.562863 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-33efbee1-e3a7-407c-b449-7379da895908 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments/d8a33d53-863d-46bd-8050-76953ab38fa3" status: 202 len: 0 microversion: 2.1 time: 0.193488 Aug 24 04:53:28.564467 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3679/7629] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:53:28 2022] DELETE /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments/d8a33d53-863d-46bd-8050-76953ab38fa3 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:53:28.575695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:28.579243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:28.583522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:28.584369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:28.593135 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:28.593869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:28.594397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.595230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:28.595759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:28.596238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:28.637184 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4394249c-546d-47d5-ae10-0d8fa7e1846b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066022 Aug 24 04:53:28.637755 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3951/7630] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:28 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:29.651501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:29.653908 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:29.662345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:29.662855 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:29.663301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:29.664090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:29.664542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:29.664981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:29.698025 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bc4ceda3-c58d-4000-a934-36259418926d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050981 Aug 24 04:53:29.698923 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3680/7631] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:29 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:30.711208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:30.713572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:30.721317 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:30.721871 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:30.722247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:30.722968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:30.723445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:30.723897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:30.756652 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f05d02d2-84f7-40a8-ad53-6e60b40d20c2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049600 Aug 24 04:53:30.757300 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3952/7632] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:30 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:31.769870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:31.772177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:31.780049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:31.780608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:31.781059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:31.781772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:31.782267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:31.782715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:31.817913 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7343b77c-c58c-4b52-9952-5520aa1efa2a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052118 Aug 24 04:53:31.818506 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3681/7633] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:31 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:32.831798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:32.834394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:32.842096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:32.842589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:32.843029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:32.843776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:32.844227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:32.844653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:32.878480 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3d2fa83-f1c9-4a18-b064-06526de4730d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051243 Aug 24 04:53:32.879318 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3953/7634] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:32 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:33.898133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:33.901659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:33.913346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:33.914179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:33.914937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:33.916181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:33.916967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:33.917751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:33.949907 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0794d0fa-5cb3-4d8d-b63d-7ef2f7558fcd tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058541 Aug 24 04:53:33.950484 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3682/7635] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:53:33 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:53:33.962350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:33.962937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:33.970107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:33.970594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:33.971019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:33.971728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:33.972178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:33.972598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:34.061214 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] HTTP exception thrown: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 is not attached to volume d8a33d53-863d-46bd-8050-76953ab38fa3 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Request method failure captured: Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments/d8a33d53-863d-46bd-8050-76953ab38fa3 HTTP/1.1 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBa5-hqyGDEtRfjggJxyy-y_Wylb6ICnh59a-A85Hj2A3xjjiF4_grvZIladcSa0fkMMIZsXRw2Gj8HAYXWyyFpBMFj_Icng-09psWYD0JSLkh5rfg2i-6-iDASQucMHnxSpHhMO7qal_FTXAvmT9fg3ArYR9dWxuHOMyw19CuYXHF0s Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5704e734c11d4891863166716b79b278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5704e734c11d4891863166716b79b278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: a8d668680d5548e1bcd7630d4d6df8fc Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 is not attached to volume d8a33d53-863d-46bd-8050-76953ab38fa3 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': '5b5ea315-1414-418f-bdcf-bcc99fe747d4', 'id': 'd8a33d53-863d-46bd-8050-76953ab38fa3'} Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d8a33d53-863d-46bd-8050-76953ab38fa3. Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 is not attached to volume d8a33d53-863d-46bd-8050-76953ab38fa3 Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:34.063071 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:34.067544 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:34.067544 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:34.067544 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 is not attached to volume d8a33d53-863d-46bd-8050-76953ab38fa3 Aug 24 04:53:34.067544 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:34.067544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Returning 404 to user: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 is not attached to volume d8a33d53-863d-46bd-8050-76953ab38fa3 {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:34.067544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-00d95498-85fb-425d-ac54-c68a78dee15a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments/d8a33d53-863d-46bd-8050-76953ab38fa3" status: 404 len: 154 microversion: 2.1 time: 0.106633 Aug 24 04:53:34.067544 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3954/7636] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:53:33 2022] DELETE /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4/os-volume_attachments/d8a33d53-863d-46bd-8050-76953ab38fa3 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:37.458949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:37.459525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:37.467255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:37.467810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:37.468271 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:37.469029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:37.469506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:37.469951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:37.499149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:53:37.592157 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5097f523-3d03-476f-b44a-d3e7a3304e94 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 204 len: 0 microversion: 2.1 time: 0.136507 Aug 24 04:53:37.593420 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3683/7637] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:53:37 2022] DELETE /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:53:37.601820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:37.602436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:37.609582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:37.610078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:37.610520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:37.611238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:37.611718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:37.612151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:37.757826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:37.766519 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f1664c57-60b8-4503-a4b5-adf528e61fb1 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1558 microversion: 2.1 time: 0.168783 Aug 24 04:53:37.767098 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3955/7638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:37 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:38.789142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:38.789831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:38.797410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:38.797949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:38.798390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:38.799121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:38.799601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:38.800076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:38.945443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:38.955467 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-26f8cb29-6dfd-47b0-a9b4-ae8f7f14b20d tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1558 microversion: 2.1 time: 0.170475 Aug 24 04:53:38.956346 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3684/7639] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:38 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:39.978835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:39.979450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:39.987598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:39.988147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:39.988566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:39.989288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:39.989752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:39.990183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:40.129665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:40.138024 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da3722b6-40d3-4426-bb0d-c2ed8daa2338 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 200 len: 1558 microversion: 2.1 time: 0.163188 Aug 24 04:53:40.138989 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3956/7640] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:39 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:40.471266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cfcfd810-a160-485b-a53f-302fcdeaab70 req-6f4e4a28-4248-4028-a3ec-ee7775514610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5ea315-1414-418f-bdcf-bcc99fe747d4", "name": "network-vif-deleted", "tag": "c1062d5c-228f-4b2c-a72a-b1d87a55b0e9"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:40.481654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfcfd810-a160-485b-a53f-302fcdeaab70 req-6f4e4a28-4248-4028-a3ec-ee7775514610 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:40.482148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfcfd810-a160-485b-a53f-302fcdeaab70 req-6f4e4a28-4248-4028-a3ec-ee7775514610 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:40.482827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cfcfd810-a160-485b-a53f-302fcdeaab70 req-6f4e4a28-4248-4028-a3ec-ee7775514610 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:40.506705 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cfcfd810-a160-485b-a53f-302fcdeaab70 req-6f4e4a28-4248-4028-a3ec-ee7775514610 service nova] Creating event network-vif-deleted:c1062d5c-228f-4b2c-a72a-b1d87a55b0e9 for instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 on n-h2-846470-15 Aug 24 04:53:40.511266 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cfcfd810-a160-485b-a53f-302fcdeaab70 req-6f4e4a28-4248-4028-a3ec-ee7775514610 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043900 Aug 24 04:53:40.515094 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3685/7641] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:41.160780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:41.161370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 5b5ea315-1414-418f-bdcf-bcc99fe747d4] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:41.168718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:41.169206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:41.169783 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:41.170481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:41.170956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:41.171367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:41.185494 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] HTTP exception thrown: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 could not be found. Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Request method failure captured: Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 HTTP/1.1 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBa5-hqyGDEtRfjggJxyy-y_Wylb6ICnh59a-A85Hj2A3xjjiF4_grvZIladcSa0fkMMIZsXRw2Gj8HAYXWyyFpBMFj_Icng-09psWYD0JSLkh5rfg2i-6-iDASQucMHnxSpHhMO7qal_FTXAvmT9fg3ArYR9dWxuHOMyw19CuYXHF0s Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5704e734c11d4891863166716b79b278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5704e734c11d4891863166716b79b278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: a8d668680d5548e1bcd7630d4d6df8fc Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 could not be found. Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '5b5ea315-1414-418f-bdcf-bcc99fe747d4'} Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 could not be found. Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 could not be found. Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:41.186981 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 could not be found. Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Returning 404 to user: Instance 5b5ea315-1414-418f-bdcf-bcc99fe747d4 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a334c136-6213-4508-afd8-bed45acc9a24 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4" status: 404 len: 111 microversion: 2.1 time: 0.032047 Aug 24 04:53:41.191457 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3957/7642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:41 2022] GET /compute/v2.1/servers/5b5ea315-1414-418f-bdcf-bcc99fe747d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:41.198036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9cd8296f-b1e8-48be-981c-ffc839e5e323 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '.version_select at 0x7f1029c36430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:41.220675 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9cd8296f-b1e8-48be-981c-ffc839e5e323 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-344725016" status: 202 len: 0 microversion: 2.1 time: 0.026906 Aug 24 04:53:41.221240 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3686/7643] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:53:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-344725016 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:53:41.237537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6e6c9fce-287a-46fa-9e8a-bb12cc054bf2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: .version_select at 0x7f10230a43a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-611237656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWYQytvE8NsgotvoM57b2E3SOHj5fj5tsLGslF2jScM2Quk5VLbkZDHtGQQh/wwXIAfVzaLTQ6fN0SYV/79yL09T7v5nNImZdVoUEmhoyO2pGQKEVIFkDtCG0qphjECBw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:41.254272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-6e6c9fce-287a-46fa-9e8a-bb12cc054bf2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for project 5704e734c11d4891863166716b79b278. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:53:41.259578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-6e6c9fce-287a-46fa-9e8a-bb12cc054bf2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for user a8d668680d5548e1bcd7630d4d6df8fc and project 5704e734c11d4891863166716b79b278. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:53:41.285109 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6e6c9fce-287a-46fa-9e8a-bb12cc054bf2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051503 Aug 24 04:53:41.285719 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3958/7644] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:53:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:53:41.338377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-726788017", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-611237656", "networks": [{"uuid": "c9f4ea4b-6251-4bd5-9d31-9ab4b8faadee"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:41.392937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] validate_networks() for [('c9f4ea4b-6251-4bd5-9d31-9ab4b8faadee', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:53:41.780079 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:53:41.780676 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:53:41.781003 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:53:41.781430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:53:41.781862 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:53:41.791444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:41.791977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:41.792433 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:41.793179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:41.793649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:41.794091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:41.812251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for project 5704e734c11d4891863166716b79b278. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:53:41.818009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Getting quotas for user a8d668680d5548e1bcd7630d4d6df8fc and project 5704e734c11d4891863166716b79b278. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:53:41.831154 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:53:41.833649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:53:41.881502 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-366671de-418d-47d4-94d4-1ce0c6ebeb54 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547102 Aug 24 04:53:41.882399 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3687/7645] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:53:41.894044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89945a36-a77a-46ca-b08b-fd5ed02b8712 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:41.894660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-89945a36-a77a-46ca-b08b-fd5ed02b8712 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:41.952852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-89945a36-a77a-46ca-b08b-fd5ed02b8712 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:41.963259 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-89945a36-a77a-46ca-b08b-fd5ed02b8712 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1261 microversion: 2.1 time: 0.073372 Aug 24 04:53:41.963924 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3959/7646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:41 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1261 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:42.986417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:42.987002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:42.994464 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:42.994963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:42.995411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:42.996153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:42.996577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:42.997043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:43.063790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:43.073304 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bdd1e2c3-89d4-4dcb-a171-e172511dffd6 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1313 microversion: 2.1 time: 0.092166 Aug 24 04:53:43.076432 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3688/7647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:42 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1313 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:44.097598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:44.099208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:44.106689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:44.107186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:44.107836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:44.108797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:44.109260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:44.109686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:44.250296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:44.258674 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce9b1a02-29d1-4cc4-9553-247951803855 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1361 microversion: 2.1 time: 0.165404 Aug 24 04:53:44.271691 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3960/7648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:44 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:44.502650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-006b4db9-435b-4a18-85bf-b2f91a918864 req-39c29ae5-3bc3-4bc5-afb8-aa0b8ad43ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948f520f-b652-47c5-a659-a5b24e5ffa1a", "tag": "173356f1-01f1-4abe-b6d3-1ba245010b0d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:44.515123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-006b4db9-435b-4a18-85bf-b2f91a918864 req-39c29ae5-3bc3-4bc5-afb8-aa0b8ad43ce9 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:44.515684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-006b4db9-435b-4a18-85bf-b2f91a918864 req-39c29ae5-3bc3-4bc5-afb8-aa0b8ad43ce9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:44.516228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-006b4db9-435b-4a18-85bf-b2f91a918864 req-39c29ae5-3bc3-4bc5-afb8-aa0b8ad43ce9 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:44.535220 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-006b4db9-435b-4a18-85bf-b2f91a918864 req-39c29ae5-3bc3-4bc5-afb8-aa0b8ad43ce9 service nova] Creating event network-changed:173356f1-01f1-4abe-b6d3-1ba245010b0d for instance 948f520f-b652-47c5-a659-a5b24e5ffa1a on n-h2-846470-15 Aug 24 04:53:44.541557 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-006b4db9-435b-4a18-85bf-b2f91a918864 req-39c29ae5-3bc3-4bc5-afb8-aa0b8ad43ce9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043542 Aug 24 04:53:44.542185 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3689/7649] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:45.282249 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:45.282885 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:45.290337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:45.290829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:45.291268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:45.292008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:45.292466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:45.292897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:45.427898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:45.436641 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fc2f37e0-2d67-4c39-b330-69650941d10b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1361 microversion: 2.1 time: 0.158978 Aug 24 04:53:45.437214 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3961/7650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:45 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:46.459892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:46.460569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:46.467393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:46.467934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:46.468393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:46.469126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:46.469609 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:46.470054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:46.614354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:46.622599 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07cd1b33-a9aa-494d-b0ce-0242f9753cd0 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1361 microversion: 2.1 time: 0.167850 Aug 24 04:53:46.623939 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3690/7651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:46 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:47.645015 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:47.645591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:47.652970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:47.653462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:47.654018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:47.654707 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:47.655162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:47.655589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:47.811170 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:47.820015 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ae8a6cd4-d0f3-48b0-bd3e-33213cdae72a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1361 microversion: 2.1 time: 0.179133 Aug 24 04:53:47.834008 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3962/7652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:47 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:48.842220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:48.843045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:48.850367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:48.850876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:48.851325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:48.852075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:48.852515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:48.852957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:48.999416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:49.011316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a66cd7a8-a4cf-4c6a-a13e-464b3225a92b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1361 microversion: 2.1 time: 0.173280 Aug 24 04:53:49.012151 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3691/7653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:48 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:50.032913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:50.033532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:50.041235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:50.041719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:50.042169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:50.042879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:50.043331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:50.043800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:50.111301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-56d72d9f-58d8-4a63-8e49-834d6963dee1 req-8f5501d0-25e5-456c-bf79-cd8df54e9b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948f520f-b652-47c5-a659-a5b24e5ffa1a", "name": "network-vif-plugged", "status": "completed", "tag": "173356f1-01f1-4abe-b6d3-1ba245010b0d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:50.123738 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-56d72d9f-58d8-4a63-8e49-834d6963dee1 req-8f5501d0-25e5-456c-bf79-cd8df54e9b44 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:50.124613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-56d72d9f-58d8-4a63-8e49-834d6963dee1 req-8f5501d0-25e5-456c-bf79-cd8df54e9b44 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:50.124852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-56d72d9f-58d8-4a63-8e49-834d6963dee1 req-8f5501d0-25e5-456c-bf79-cd8df54e9b44 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:50.143741 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-56d72d9f-58d8-4a63-8e49-834d6963dee1 req-8f5501d0-25e5-456c-bf79-cd8df54e9b44 service nova] Creating event network-vif-plugged:173356f1-01f1-4abe-b6d3-1ba245010b0d for instance 948f520f-b652-47c5-a659-a5b24e5ffa1a on n-h2-846470-15 Aug 24 04:53:50.149126 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-56d72d9f-58d8-4a63-8e49-834d6963dee1 req-8f5501d0-25e5-456c-bf79-cd8df54e9b44 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042248 Aug 24 04:53:50.150302 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3692/7654] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:53:50.191926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:50.201960 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e1b737bb-c20c-436c-9a8a-9f22536d4673 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1361 microversion: 2.1 time: 0.173290 Aug 24 04:53:50.202933 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3963/7655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:50 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:51.224854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:51.225594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:51.234063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:51.234974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:51.234974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:51.236056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:51.236532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:51.237009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:51.378494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:51.386370 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f3bc8c90-b7e9-4cf0-b487-8590c735ff1c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1361 microversion: 2.1 time: 0.165918 Aug 24 04:53:51.386949 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3693/7656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:51 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:52.408766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:52.409300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:52.412195 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:52.417813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:52.418280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:52.418717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:52.419439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:52.419926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:52.420339 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:52.558637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:52.568524 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-eb768aa3-d4a5-4bf4-b505-0c9f3e0c15d3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1553 microversion: 2.1 time: 0.163932 Aug 24 04:53:52.569103 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3964/7657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:52 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:52.590012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:52.590643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:52.592690 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:52.593369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:52.600716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:52.601226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:52.601707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:52.602428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:52.602900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:52.603342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:52.737059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:53:52.745336 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-826303ee-6784-499d-98f2-796a887ce42b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1553 microversion: 2.1 time: 0.159254 Aug 24 04:53:52.745921 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3694/7658] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:53:52 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:53:54.279775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:54.282201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:53:54.289444 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:54.289934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:54.290377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:54.291084 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:54.291541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:54.292008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:54.580893 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4cfb99b3-08fb-4b69-b05c-ff7d6f33e755 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "POST /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305111 Aug 24 04:53:54.581630 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3965/7659] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:53:54 2022] POST /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:06.446457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.447085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:06.450058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:06.450831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:06.459036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.459548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.460034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.460756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.461227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.461673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.547608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lazy-loading 'services' on Instance uuid 948f520f-b652-47c5-a659-a5b24e5ffa1a {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:54:06.622427 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b539cf9d-2b2c-40dc-b598-0f8547d00ea3 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments/28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd" status: 202 len: 0 microversion: 2.1 time: 0.179839 Aug 24 04:54:06.623183 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3695/7660] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:54:06 2022] DELETE /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments/28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:54:06.630380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:06.631262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:06.636042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.638492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:06.648145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.648639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.649194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.649907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.650400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.650832 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.686792 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59c33962-d1db-4a4f-aba5-4130e86f2c5e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058381 Aug 24 04:54:06.687816 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3966/7661] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:06 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:07.701742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.704745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:07.711886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:07.712387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:07.712836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:07.713545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:07.714039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:07.714476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:07.751607 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7a20bc74-6f56-44fa-864b-0cf0eb9a6d12 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055282 Aug 24 04:54:07.752328 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3696/7662] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:07 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:08.765881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.768474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:08.775469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:08.775979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:08.776410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:08.777300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:08.777726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:08.778154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:08.812275 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d805b2f3-383c-4441-873a-a1301f810f66 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051050 Aug 24 04:54:08.812884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3967/7663] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:09.826082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:09.829560 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:09.836238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:09.836742 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:09.837188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:09.837911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:09.838354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:09.838789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:09.872825 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1d8ceb23-c0fc-4159-9ee9-4e7721049217 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051623 Aug 24 04:54:09.873613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3697/7664] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:09 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:10.886099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:10.888302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:10.896583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:10.897071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:10.897512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:10.898235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:10.898689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:10.899121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:10.934733 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7578d367-3b26-4f92-b77e-bd1cfae4557e tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052736 Aug 24 04:54:10.935220 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3968/7665] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:10 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:11.948033 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:11.950538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:11.960736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:11.961249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:11.961701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:11.962487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:11.962968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:11.963748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:12.005179 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-69a97703-6a04-4e2c-8275-966831f47e3f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061560 Aug 24 04:54:12.005815 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3698/7666] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:54:11 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:54:12.018181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:12.019049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:12.026525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:12.027025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:12.027469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:12.028217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:12.028679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:12.029167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:12.123972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] HTTP exception thrown: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a is not attached to volume 28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Request method failure captured: Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: request: DELETE /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments/28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd HTTP/1.1 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBa5-hqyGDEtRfjggJxyy-y_Wylb6ICnh59a-A85Hj2A3xjjiF4_grvZIladcSa0fkMMIZsXRw2Gj8HAYXWyyFpBMFj_Icng-09psWYD0JSLkh5rfg2i-6-iDASQucMHnxSpHhMO7qal_FTXAvmT9fg3ArYR9dWxuHOMyw19CuYXHF0s Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5704e734c11d4891863166716b79b278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5704e734c11d4891863166716b79b278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: a8d668680d5548e1bcd7630d4d6df8fc Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a is not attached to volume 28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'server_id': '948f520f-b652-47c5-a659-a5b24e5ffa1a', 'id': '28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd'} Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd. Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a is not attached to volume 28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:12.126049 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:12.131017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:12.131017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:12.131017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a is not attached to volume 28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd Aug 24 04:54:12.131017 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 04:54:12.131017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Returning 404 to user: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a is not attached to volume 28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:12.131017 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-324ce47b-b3dc-4130-a299-df29f51296da tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments/28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd" status: 404 len: 154 microversion: 2.1 time: 0.114678 Aug 24 04:54:12.131017 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3969/7667] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:54:12 2022] DELETE /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a/os-volume_attachments/28bdb0bf-fa15-4c5e-9f1d-d0222da13bcd => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:15.523703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:15.524293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:15.531779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.532606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.533058 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.533777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.534240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.534678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.565188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:54:15.651030 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7deb0af5-2d50-4767-97ea-9c4992c5350f tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 204 len: 0 microversion: 2.1 time: 0.131438 Aug 24 04:54:15.652085 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3699/7668] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:54:15 2022] DELETE /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:54:15.663006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:15.663817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:15.673082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.673595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.674137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.674898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.675367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.675855 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.829211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:15.837856 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b2fb293f-4eca-4d95-af5e-3a55448d4e6c tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1559 microversion: 2.1 time: 0.181141 Aug 24 04:54:15.838564 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3970/7669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:15 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:16.861140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:16.861909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:16.869376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:16.869878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:16.870332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:16.871048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:16.871523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:16.871993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:17.029991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:17.038724 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-811f9ed1-0978-40f5-a568-c4778d2ed93b tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1559 microversion: 2.1 time: 0.182241 Aug 24 04:54:17.039275 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3700/7670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:16 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:18.062197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:18.062818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:18.073283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.073807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.074327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.075236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.075404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.075999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.216544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:18.225207 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c8674907-85ef-4b17-b1d8-e4b8ae15b4ab tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1559 microversion: 2.1 time: 0.167322 Aug 24 04:54:18.225796 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3971/7671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:18 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:18.621573 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ba8869e9-a15d-42b8-b42f-482cc59171ef req-6a405538-d42d-4fb5-8b0d-49cb88ea1bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948f520f-b652-47c5-a659-a5b24e5ffa1a", "name": "network-vif-deleted", "tag": "173356f1-01f1-4abe-b6d3-1ba245010b0d"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:18.632282 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ba8869e9-a15d-42b8-b42f-482cc59171ef req-6a405538-d42d-4fb5-8b0d-49cb88ea1bff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.633158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ba8869e9-a15d-42b8-b42f-482cc59171ef req-6a405538-d42d-4fb5-8b0d-49cb88ea1bff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.633610 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ba8869e9-a15d-42b8-b42f-482cc59171ef req-6a405538-d42d-4fb5-8b0d-49cb88ea1bff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.667857 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ba8869e9-a15d-42b8-b42f-482cc59171ef req-6a405538-d42d-4fb5-8b0d-49cb88ea1bff service nova] Creating event network-vif-deleted:173356f1-01f1-4abe-b6d3-1ba245010b0d for instance 948f520f-b652-47c5-a659-a5b24e5ffa1a on n-h2-846470-15 Aug 24 04:54:18.674767 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ba8869e9-a15d-42b8-b42f-482cc59171ef req-6a405538-d42d-4fb5-8b0d-49cb88ea1bff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056291 Aug 24 04:54:18.676834 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3701/7672] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:19.248788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:19.249587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:19.258934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.259398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.259782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.260492 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.261024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.261394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.299610 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:19.300200 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:19.300634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:19.302623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lazy-loading 'fault' on Instance uuid 948f520f-b652-47c5-a659-a5b24e5ffa1a {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:54:19.346847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d668680d5548e1bcd7630d4d6df8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5704e734c11d4891863166716b79b278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:19.355251 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-005d670f-daed-4a35-9094-014fd735e2e2 tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 200 len: 1351 microversion: 2.1 time: 0.111182 Aug 24 04:54:19.355869 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3972/7673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:19 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:20.381713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:20.382569 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] [instance: 948f520f-b652-47c5-a659-a5b24e5ffa1a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:20.390848 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:20.391355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:20.391846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:20.392572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:20.393045 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:20.393621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:20.411115 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] HTTP exception thrown: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a could not be found. Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Request method failure captured: Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a HTTP/1.1 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa5-hqyGDEtRfjggJxyy-y_Wylb6ICnh59a-A85Hj2A3xjjiF4_grvZIladcSa0fkMMIZsXRw2Gj8HAYXWyyFpBMFj_Icng-09psWYD0JSLkh5rfg2i-6-iDASQucMHnxSpHhMO7qal_FTXAvmT9fg3ArYR9dWxuHOMyw19CuYXHF0s Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5704e734c11d4891863166716b79b278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5704e734c11d4891863166716b79b278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5704e734c11d4891863166716b79b278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 5704e734c11d4891863166716b79b278 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-464743158 Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: a8d668680d5548e1bcd7630d4d6df8fc Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestEncryptedCinderVolumes-464743158-project Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a could not be found. Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '948f520f-b652-47c5-a659-a5b24e5ffa1a'} Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a could not be found. Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a could not be found. Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:20.412869 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a could not be found. Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Returning 404 to user: Instance 948f520f-b652-47c5-a659-a5b24e5ffa1a could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1745892f-3b26-4e1a-bddd-d5666c94ceaa tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a" status: 404 len: 111 microversion: 2.1 time: 0.038835 Aug 24 04:54:20.417232 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3702/7674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:20 2022] GET /compute/v2.1/servers/948f520f-b652-47c5-a659-a5b24e5ffa1a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:20.424043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da8525b8-05a9-4633-94e6-194544cac73a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] Calling method '.version_select at 0x7f1023305d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:20.449010 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da8525b8-05a9-4633-94e6-194544cac73a tempest-TestEncryptedCinderVolumes-464743158 tempest-TestEncryptedCinderVolumes-464743158-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-611237656" status: 202 len: 0 microversion: 2.1 time: 0.029211 Aug 24 04:54:20.449950 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3973/7675] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 24 04:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-611237656 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:54:48.838909 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-031fc0eb-4941-4914-9778-9ae92c4f827e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'create', calling method: .version_select at 0x7f10343829d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-231074617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESsASjV68Ay8B6zKowUQuR4LulHJWgOyzvvZ8ETYWhvnF4MX8MQQAhfVt0BO+YtEAX0/TfAOZBPiz7PnJcwAYalffTBCQ7twJEUZDVf3f5mcdtMatuSNbW3BVqIJC1UXg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:48.845131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:48.845794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:48.861146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-031fc0eb-4941-4914-9778-9ae92c4f827e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Getting quotas for project 0f1683d541dd44579a2c27816642b065. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:48.866684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-031fc0eb-4941-4914-9778-9ae92c4f827e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Getting quotas for user ce74e4db3c9b4d8ab5675487105df429 and project 0f1683d541dd44579a2c27816642b065. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:48.896292 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-031fc0eb-4941-4914-9778-9ae92c4f827e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061192 Aug 24 04:54:48.897274 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3703/7676] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 04:54:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:48.958370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1185394169", "imageRef": "9cd47c09-27d5-4475-947d-8ea0313823e8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-231074617", "networks": [{"uuid": "a876d6a6-aa4d-495a-a307-215087a98c22"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:48.967348 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=44 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:48.968272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:49.145211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] validate_networks() for [('a876d6a6-aa4d-495a-a307-215087a98c22', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:49.569564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:49.569986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:49.570489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:49.570902 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:49.571310 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:49.585614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.586294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.587065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.587836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.588312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.588751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.607406 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Getting quotas for project 0f1683d541dd44579a2c27816642b065. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:49.614227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Getting quotas for user ce74e4db3c9b4d8ab5675487105df429 and project 0f1683d541dd44579a2c27816642b065. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:49.628081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:49.630345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9cd47c09-27d5-4475-947d-8ea0313823e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:49.679318 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-55163c85-ec4c-43e4-9c06-b03835b1394d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725000 Aug 24 04:54:49.680687 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3974/7677] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 04:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:54:49.696116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f2dc9a07-cd26-428c-b095-0c7c2386c2bf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:49.696831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f2dc9a07-cd26-428c-b095-0c7c2386c2bf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:49.880248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f2dc9a07-cd26-428c-b095-0c7c2386c2bf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:49.893518 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f2dc9a07-cd26-428c-b095-0c7c2386c2bf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1258 microversion: 2.1 time: 0.201072 Aug 24 04:54:49.894348 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3704/7678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:49 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:50.927296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:50.927953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:50.935230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.935980 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.936538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.937506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.937967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.938401 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.010299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:51.020393 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-245ef708-5468-47c3-a385-71d6c90a9f77 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1316 microversion: 2.1 time: 0.098862 Aug 24 04:54:51.021179 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3975/7679] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:50 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1316 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:52.042897 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:52.043513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:52.051488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.052048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.052728 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.053466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.053925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.055218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.237150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:52.245174 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0e3ba8f8-96db-4606-8e29-244ac1f0a0f1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.206522 Aug 24 04:54:52.245757 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3705/7680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:52 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:53.266827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:53.267436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:53.274943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:53.275548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:53.275972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:53.276821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:53.277139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:53.277545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:53.449660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:53.460352 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d072e52-fec1-46b4-b790-48a3ce3c99cd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.197565 Aug 24 04:54:53.461170 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3976/7681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:53 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:54.484071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:54.485515 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:54.493734 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.494453 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.494921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.495721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.496273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.496754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.658652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:54.667149 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-dae61445-743f-4cfa-9251-b8f9eaf37c49 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.189311 Aug 24 04:54:54.667783 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3706/7682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:54 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:55.689462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:55.690094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:55.698126 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.698623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.699069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.699806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.700270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.700698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.849191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:55.859362 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e2c92399-003d-4144-8b8d-e5a2db4e6e58 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.174062 Aug 24 04:54:55.860387 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3977/7683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:55 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:56.881869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:56.882461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:56.890458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.890971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.891594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.892377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.892852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.893275 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.084784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:57.093914 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f57465d6-47ed-4a95-9e06-8d7375b9d0c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.216145 Aug 24 04:54:57.094556 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3707/7684] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:56 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:58.114841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:58.115491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:58.122892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:58.123392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:58.124040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.124792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:58.125248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:58.125680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.280731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:58.293485 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cce11094-ae01-47cb-9db8-60ab2d25c1e2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.182392 Aug 24 04:54:58.304567 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3978/7685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:58 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:59.315921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:59.316586 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:59.324028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.324542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.324999 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.325727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.326197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.326630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.476135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:59.487289 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f97dade5-d88e-40e6-a65f-535f71499a67 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.175137 Aug 24 04:54:59.488220 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3708/7686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:59 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:00.508948 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:00.509605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:00.512299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:00.513037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:00.520335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.520840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.521272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.521979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.522428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.522850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.672976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:00.681264 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6600fd2a-9058-46dc-8ebb-ee817a5cbae2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.176207 Aug 24 04:55:00.681766 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3979/7687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:00 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:01.703546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:01.704191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:01.706175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:01.714530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.715125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.715585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.716334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.716809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.717248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.889487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:01.901139 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c618a34a-61e5-468d-b1c5-829fab973118 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.202540 Aug 24 04:55:01.901720 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3709/7688] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:01 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:02.720487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-8cd90ba2-71a6-4b2b-9648-65feb4a4b0eb req-066c53fb-91cf-4196-a7bf-db338802fb16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e2c446-3aef-422e-b4be-cfac973d3588", "tag": "9a0c2fe7-d035-4496-ad2b-fef5c3f80385"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:02.732680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cd90ba2-71a6-4b2b-9648-65feb4a4b0eb req-066c53fb-91cf-4196-a7bf-db338802fb16 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.733354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cd90ba2-71a6-4b2b-9648-65feb4a4b0eb req-066c53fb-91cf-4196-a7bf-db338802fb16 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.733834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-8cd90ba2-71a6-4b2b-9648-65feb4a4b0eb req-066c53fb-91cf-4196-a7bf-db338802fb16 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.746097 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-8cd90ba2-71a6-4b2b-9648-65feb4a4b0eb req-066c53fb-91cf-4196-a7bf-db338802fb16 service nova] Creating event network-changed:9a0c2fe7-d035-4496-ad2b-fef5c3f80385 for instance 52e2c446-3aef-422e-b4be-cfac973d3588 on n-h2-846470-15 Aug 24 04:55:02.751645 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-8cd90ba2-71a6-4b2b-9648-65feb4a4b0eb req-066c53fb-91cf-4196-a7bf-db338802fb16 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035216 Aug 24 04:55:02.752278 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3980/7689] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:02.925138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:02.925860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:02.934521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.934521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.934733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.935444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.935947 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.936682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.138201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:03.147454 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae34f759-ab6f-42ae-9880-4b78d2a8e43c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.226474 Aug 24 04:55:03.148128 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3710/7690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:02 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:04.171497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:04.172224 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:04.179034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:04.179516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:04.180000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:04.180698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:04.181152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:04.181571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:04.331780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:04.339962 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f516491-13a7-4637-8147-e48d04ed9fe8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.174436 Aug 24 04:55:04.340522 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3981/7691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:04 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:05.364974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:05.365540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:05.375698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.376217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.376665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.377380 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.377860 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.378279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.519247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:05.527467 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3844548d-833c-493d-8093-7da0e449f732 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.169097 Aug 24 04:55:05.528123 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3711/7692] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:05 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:06.551287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:06.551962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:06.559407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.560119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.560814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.562072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.562603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.563046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.725782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:06.734821 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-feba4220-02b7-4de6-8a8d-4612167d4ea3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.189391 Aug 24 04:55:06.735845 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3982/7693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:06 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:07.764556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:07.765208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:07.772727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.773237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.773666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.774389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.774923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.775365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.915648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:07.925527 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-d8251bbe-caf2-4bab-805c-ccdf21d3f27f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.167271 Aug 24 04:55:07.926162 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3712/7694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:07 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:08.493577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-29c0775d-da04-40c0-838a-3c81d9bada15 req-7f5ebdf7-9bc5-4d2b-b435-1cbda036984b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e2c446-3aef-422e-b4be-cfac973d3588", "name": "network-vif-plugged", "status": "completed", "tag": "9a0c2fe7-d035-4496-ad2b-fef5c3f80385"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:08.504772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-29c0775d-da04-40c0-838a-3c81d9bada15 req-7f5ebdf7-9bc5-4d2b-b435-1cbda036984b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.508009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-29c0775d-da04-40c0-838a-3c81d9bada15 req-7f5ebdf7-9bc5-4d2b-b435-1cbda036984b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.508009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-29c0775d-da04-40c0-838a-3c81d9bada15 req-7f5ebdf7-9bc5-4d2b-b435-1cbda036984b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.521544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-29c0775d-da04-40c0-838a-3c81d9bada15 req-7f5ebdf7-9bc5-4d2b-b435-1cbda036984b service nova] Creating event network-vif-plugged:9a0c2fe7-d035-4496-ad2b-fef5c3f80385 for instance 52e2c446-3aef-422e-b4be-cfac973d3588 on n-h2-846470-15 Aug 24 04:55:08.527924 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-29c0775d-da04-40c0-838a-3c81d9bada15 req-7f5ebdf7-9bc5-4d2b-b435-1cbda036984b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038394 Aug 24 04:55:08.528712 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3983/7695] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:08.947601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:08.948202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:08.956572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.957107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.957552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.958245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.958736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.959171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.102092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:09.111062 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1b002406-4b73-4984-a9af-9ea0d0dce4e9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.167414 Aug 24 04:55:09.111886 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3713/7696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:08 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:10.133588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:10.134256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:10.141191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.141682 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.142122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.142895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.143375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.143834 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.293906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:10.304263 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0ea0a1c-875f-4ee8-bfee-1927c9936b99 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1358 microversion: 2.1 time: 0.175893 Aug 24 04:55:10.304867 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3984/7697] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:10 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:11.327793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:11.328404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:11.335990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.336478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.336927 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.337647 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.338119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.338564 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.820218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:11.829302 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-123f2362-f951-4371-9684-45f91cda401a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1548 microversion: 2.1 time: 0.506613 Aug 24 04:55:11.829892 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3714/7698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:11 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1548 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:11.851070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:11.851846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:11.860233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.860736 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.861181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.861896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.862359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.862837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.015034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.024220 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d7d45486-0f83-4df3-bb29-9036167c4684 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1548 microversion: 2.1 time: 0.177003 Aug 24 04:55:12.024830 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3985/7699] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:11 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:12.046428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:12.051491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.052198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Searching by: {'deleted': False, 'project_id': '0f1683d541dd44579a2c27816642b065'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:55:12.058937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.059440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.059931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.060673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.062111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.062603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.100888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 04:55:12.129395 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-778eda14-fa0f-4d7d-aa28-5f1c71d5f97f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.087177 Aug 24 04:55:12.129986 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3715/7700] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 04:55:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:12.142010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:12.142611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:12.149247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.149731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.150160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.150849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.151303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.151754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.297720 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.306747 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0b260e6b-fb64-4f50-9c17-1c1590784dff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1548 microversion: 2.1 time: 0.168635 Aug 24 04:55:12.307497 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3986/7701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:12 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:13.927760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca6df498-a619-4dba-9244-6cf36057e757"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:13.930243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:13.938158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.938671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.939131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:13.939952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.940405 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.940847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:14.214359 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ce021b30-c7d6-470f-819f-c7e0a34e057b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290721 Aug 24 04:55:14.215161 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3716/7702] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 04:55:13 2022] POST /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:28.487545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:28.488307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:28.491285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:28.491968 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=66 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:28.498804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.499412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.500380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.501085 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.501864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.502291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.646598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:28.657933 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07451fc6-c85f-450b-835f-4d218002f77f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1594 microversion: 2.1 time: 0.175050 Aug 24 04:55:28.658526 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3987/7703] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:28 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1594 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:30.515139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:30.516403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:30.517621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:30.525419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7822d915-80fe-4143-b040-6c99b023e2a4 req-b9d16c71-8e31-4a50-9e16-1ed8354d2fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e2c446-3aef-422e-b4be-cfac973d3588", "tag": "9a0c2fe7-d035-4496-ad2b-fef5c3f80385"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:30.538990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7822d915-80fe-4143-b040-6c99b023e2a4 req-b9d16c71-8e31-4a50-9e16-1ed8354d2fab service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:30.540242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7822d915-80fe-4143-b040-6c99b023e2a4 req-b9d16c71-8e31-4a50-9e16-1ed8354d2fab service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:30.540747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7822d915-80fe-4143-b040-6c99b023e2a4 req-b9d16c71-8e31-4a50-9e16-1ed8354d2fab service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:30.556039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7822d915-80fe-4143-b040-6c99b023e2a4 req-b9d16c71-8e31-4a50-9e16-1ed8354d2fab service nova] Creating event network-changed:9a0c2fe7-d035-4496-ad2b-fef5c3f80385 for instance 52e2c446-3aef-422e-b4be-cfac973d3588 on n-h2-846470-15 Aug 24 04:55:30.562035 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7822d915-80fe-4143-b040-6c99b023e2a4 req-b9d16c71-8e31-4a50-9e16-1ed8354d2fab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048635 Aug 24 04:55:30.563299 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3717/7704] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:31.712279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-496532005"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:31.712969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:31.720496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.720997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.721448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.722176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.722793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.723379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.871289 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.network.security_group_api [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Adding security group f013fc37-58cc-43bd-96ab-4ef54f2a4e71 to port 9a0c2fe7-d035-4496-ad2b-fef5c3f80385 Aug 24 04:55:32.244904 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-612d237a-5cef-441d-a64d-babba81ecd30 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/action" status: 202 len: 0 microversion: 2.1 time: 0.536549 Aug 24 04:55:32.246381 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3988/7705] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:55:31 2022] POST /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:55:32.270966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:32.275149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:32.301367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.306078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.308056 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.309086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.309900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.310810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.343770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-0e4bd140-c432-4462-8952-7de20500761b req-d02f06e4-916a-4afb-b10a-c2e86e91721e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e2c446-3aef-422e-b4be-cfac973d3588", "tag": "9a0c2fe7-d035-4496-ad2b-fef5c3f80385"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:32.364309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0e4bd140-c432-4462-8952-7de20500761b req-d02f06e4-916a-4afb-b10a-c2e86e91721e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:32.365179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0e4bd140-c432-4462-8952-7de20500761b req-d02f06e4-916a-4afb-b10a-c2e86e91721e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:32.365998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-0e4bd140-c432-4462-8952-7de20500761b req-d02f06e4-916a-4afb-b10a-c2e86e91721e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:32.391504 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-0e4bd140-c432-4462-8952-7de20500761b req-d02f06e4-916a-4afb-b10a-c2e86e91721e service nova] Creating event network-changed:9a0c2fe7-d035-4496-ad2b-fef5c3f80385 for instance 52e2c446-3aef-422e-b4be-cfac973d3588 on n-h2-846470-15 Aug 24 04:55:32.397124 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-0e4bd140-c432-4462-8952-7de20500761b req-d02f06e4-916a-4afb-b10a-c2e86e91721e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145643 Aug 24 04:55:32.398476 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3718/7706] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:32.507911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:32.516716 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-173b0384-ef8f-493c-bbbc-4c7e8fb39a54 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1758 microversion: 2.1 time: 0.262827 Aug 24 04:55:32.517965 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3989/7707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:32 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1758 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:24.407365 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:56:24.407996 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:56:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:56:56.867955 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:56:56.867955 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:56:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:57:54.308959 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:57:54.309836 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:57:57.434020 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:57:57.434998 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:57:57.435607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:57.436508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:57.441762 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:57.444237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:57.452117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:57.452625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:57.453083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:57.454140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:57.454611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:57.455055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:57.532795 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [8c0ad50f-b1b7-422c-9351-9a83b2038e53] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 04:57:58.446389 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60956. Aug 24 04:57:58.447179 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60954. Aug 24 04:57:58.541561 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [8c0ad50f-b1b7-422c-9351-9a83b2038e53] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60958. Aug 24 04:57:58.546401 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3882a28a-6605-4a8d-a680-b2bfdd2f2edb tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/action" status: 202 len: 0 microversion: 2.1 time: 1.114355 Aug 24 04:57:58.547455 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3719/7708] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:57:57 2022] POST /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/action => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:57:58.554911 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 04:57:58.556304 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 04:57:58.556807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:58.557545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=16 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:58.562377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:58.563022 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:58.572270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:58.572796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:58.574360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:58.575539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:58.576039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:58.576466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:58.735095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:58.744333 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b3bc813-825d-4b13-b831-361c6c61d64e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1760 microversion: 2.1 time: 0.191702 Aug 24 04:57:58.745062 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3990/7709] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:58 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:59.768416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:59.769116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:59.776619 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:59.777134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:59.777592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:59.778337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:59.778801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:59.779246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:00.260826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:00.271410 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-98797628-4c82-4109-a1e7-5c0186a8dbbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1760 microversion: 2.1 time: 0.508234 Aug 24 04:58:00.272114 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3720/7710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:59 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1760 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:01.296121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:01.297055 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:01.313091 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60970. Aug 24 04:58:01.316530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:01.317017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:01.317453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:01.318142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:01.318594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:01.319013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:01.322764 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60972. Aug 24 04:58:01.484836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:01.493548 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ff6bf238-bd3e-4ef4-bc93-5a842be16470 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1758 microversion: 2.1 time: 0.202128 Aug 24 04:58:01.494133 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3991/7711] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:01 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:13.197240 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:58:13.198206 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:58:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:59:34.312654 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:59:34.313536 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 04:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:59:44.416900 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:59:44.417476 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 04:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:59:47.747776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:47.748707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:47.875367 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-496532005"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:47.876391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:47.885733 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.886370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.886984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:47.888063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:47.888758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:47.889273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.041216 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.network.security_group_api [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Removing security group f013fc37-58cc-43bd-96ab-4ef54f2a4e71 from port 9a0c2fe7-d035-4496-ad2b-fef5c3f80385 Aug 24 04:59:48.375157 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c4ca4e2-75c0-4af8-9021-8b5cb9b82e81 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/action" status: 202 len: 0 microversion: 2.1 time: 0.629810 Aug 24 04:59:48.376065 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3721/7712] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 04:59:47 2022] POST /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:59:48.385960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:48.387239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:48.491314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d2ef8daf-ed72-4f7c-a941-b6eccb6bf0f5 req-8f1636a5-7787-42ae-8c29-1238a3046bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e2c446-3aef-422e-b4be-cfac973d3588", "tag": "9a0c2fe7-d035-4496-ad2b-fef5c3f80385"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:48.501452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2ef8daf-ed72-4f7c-a941-b6eccb6bf0f5 req-8f1636a5-7787-42ae-8c29-1238a3046bff service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:48.503066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2ef8daf-ed72-4f7c-a941-b6eccb6bf0f5 req-8f1636a5-7787-42ae-8c29-1238a3046bff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:48.503506 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2ef8daf-ed72-4f7c-a941-b6eccb6bf0f5 req-8f1636a5-7787-42ae-8c29-1238a3046bff service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:48.517555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d2ef8daf-ed72-4f7c-a941-b6eccb6bf0f5 req-8f1636a5-7787-42ae-8c29-1238a3046bff service nova] Creating event network-changed:9a0c2fe7-d035-4496-ad2b-fef5c3f80385 for instance 52e2c446-3aef-422e-b4be-cfac973d3588 on n-h2-846470-15 Aug 24 04:59:48.525413 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d2ef8daf-ed72-4f7c-a941-b6eccb6bf0f5 req-8f1636a5-7787-42ae-8c29-1238a3046bff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144273 Aug 24 04:59:48.526703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3992/7713] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:49.930578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:49.931111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:49.937388 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.937893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.938334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:49.939088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:49.939779 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:49.940480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.152981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lazy-loading 'services' on Instance uuid 52e2c446-3aef-422e-b4be-cfac973d3588 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:59:50.239961 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-89d00c4a-ef83-490c-b014-8cf2e060a67f tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "DELETE /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments/ca6df498-a619-4dba-9244-6cf36057e757" status: 202 len: 0 microversion: 2.1 time: 0.314069 Aug 24 04:59:50.240566 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3722/7714] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:59:49 2022] DELETE /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments/ca6df498-a619-4dba-9244-6cf36057e757 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:59:50.252657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:50.255830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:50.263205 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.263788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.264281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.264990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.265456 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.266332 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.301201 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a353337-7a80-4770-bfe6-935ac2041ef7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054806 Aug 24 04:59:50.301810 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3993/7715] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:59:50 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:50.542250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-40f2d441-363b-438e-b356-cbe4d3d851a5 req-ec9dec7e-dc07-4f67-ae0c-11d0e92e33cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e2c446-3aef-422e-b4be-cfac973d3588", "tag": "9a0c2fe7-d035-4496-ad2b-fef5c3f80385"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:50.552559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-40f2d441-363b-438e-b356-cbe4d3d851a5 req-ec9dec7e-dc07-4f67-ae0c-11d0e92e33cc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:50.553026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-40f2d441-363b-438e-b356-cbe4d3d851a5 req-ec9dec7e-dc07-4f67-ae0c-11d0e92e33cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:50.553468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-40f2d441-363b-438e-b356-cbe4d3d851a5 req-ec9dec7e-dc07-4f67-ae0c-11d0e92e33cc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:50.565617 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-40f2d441-363b-438e-b356-cbe4d3d851a5 req-ec9dec7e-dc07-4f67-ae0c-11d0e92e33cc service nova] Creating event network-changed:9a0c2fe7-d035-4496-ad2b-fef5c3f80385 for instance 52e2c446-3aef-422e-b4be-cfac973d3588 on n-h2-846470-15 Aug 24 04:59:50.571161 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-40f2d441-363b-438e-b356-cbe4d3d851a5 req-ec9dec7e-dc07-4f67-ae0c-11d0e92e33cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032765 Aug 24 04:59:50.571534 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3723/7716] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:51.318622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:51.321672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:51.329479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:51.329967 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:51.330404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:51.331078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:51.331814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:51.332758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:51.367413 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-561e655e-e929-41fc-a3e9-5b53e7f1668a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053719 Aug 24 04:59:51.368525 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3994/7717] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:59:51 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:52.384090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:52.386774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:52.394547 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.395076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.395574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.396360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:52.396874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:52.397320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:52.434886 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2fb61cb6-c1ce-4097-94dc-1c1b7288cab5 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056697 Aug 24 04:59:52.435441 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3724/7718] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:59:52 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:53.452627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:53.455324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:53.462998 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:53.463960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:53.464476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:53.465237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:53.465683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:53.466107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:53.498169 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1b980de4-2c80-4aa3-a544-0becbbe9f283 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052606 Aug 24 04:59:53.498779 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3995/7719] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:59:53 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:54.511417 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:54.513680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:54.521185 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.521718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.522160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.522863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:54.523303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:54.523775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:54.555587 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c02d7f91-f757-4bf5-a0c6-fc49f0ef1520 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048493 Aug 24 04:59:54.556251 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3725/7720] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:59:54 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:55.570759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:55.573578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:55.582597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.583095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.583974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.584469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.584926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.585352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.616225 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b3c1087e-5f1e-4ffd-901b-f5ca6f2ae77a tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051237 Aug 24 04:59:55.616801 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3996/7721] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 04:59:55 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:59:55.627835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:55.628391 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:55.635937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.636448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.636904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.637622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:55.638094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:55.638541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:55.723009 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] HTTP exception thrown: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 is not attached to volume ca6df498-a619-4dba-9244-6cf36057e757 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Request method failure captured: Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments/ca6df498-a619-4dba-9244-6cf36057e757 HTTP/1.1 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa8JGqx1JR6zMua1VEO32EewjOric9zcCnSvMa5LFvO6LZwzRu7hYH3pifG6jcfEtR2z_DE1wMEojy0miPlKpfe5EoE_fJyfnL8XeRV36FSmDIJ5eKgYRr1iDKiQ7mzIntK_3KDfdeRt2Zx8pUXkcrB02j2JyHWsY7S39q6G-btQejM Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0f1683d541dd44579a2c27816642b065 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestMinimumBasicScenario-566477786 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0f1683d541dd44579a2c27816642b065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0f1683d541dd44579a2c27816642b065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f1683d541dd44579a2c27816642b065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f1683d541dd44579a2c27816642b065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestMinimumBasicScenario-566477786 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0f1683d541dd44579a2c27816642b065 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestMinimumBasicScenario-566477786 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestMinimumBasicScenario-566477786-project Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ce74e4db3c9b4d8ab5675487105df429 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestMinimumBasicScenario-566477786-project Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 is not attached to volume ca6df498-a619-4dba-9244-6cf36057e757 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': '52e2c446-3aef-422e-b4be-cfac973d3588', 'id': 'ca6df498-a619-4dba-9244-6cf36057e757'} Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ca6df498-a619-4dba-9244-6cf36057e757. Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 is not attached to volume ca6df498-a619-4dba-9244-6cf36057e757 Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:59:55.725047 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:59:55.729879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:59:55.729879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:59:55.729879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 is not attached to volume ca6df498-a619-4dba-9244-6cf36057e757 Aug 24 04:59:55.729879 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 04:59:55.729879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Returning 404 to user: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 is not attached to volume ca6df498-a619-4dba-9244-6cf36057e757 {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:59:55.729879 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-38e7d24d-4844-4560-aec1-3e653c990abc tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "DELETE /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments/ca6df498-a619-4dba-9244-6cf36057e757" status: 404 len: 154 microversion: 2.1 time: 0.102877 Aug 24 04:59:55.729879 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3726/7722] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 04:59:55 2022] DELETE /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588/os-volume_attachments/ca6df498-a619-4dba-9244-6cf36057e757 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:58.991505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:58.992092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:58.999423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.000028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.000532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.001301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.001830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.002337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.030930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:59:59.120491 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a1edf760-c3db-4517-aace-47713e35f75d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "DELETE /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 204 len: 0 microversion: 2.1 time: 0.132742 Aug 24 04:59:59.122080 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3997/7723] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 04:59:58 2022] DELETE /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:59:59.132439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:59.133064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:59.140071 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.140605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.141048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.141975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:59.142451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:59.142894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:59.293702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:59.302647 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5be65e65-d3fb-4013-b0a8-2ea826dc47e3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1554 microversion: 2.1 time: 0.174552 Aug 24 04:59:59.303200 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3727/7724] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:59 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:00.327592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:00.328393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:00.336028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:00.336555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:00.336946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:00.337684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:00.338132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:00.338554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:00.547697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:00.556301 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-842be968-97cb-4e3e-9df5-d07d04756f2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1554 microversion: 2.1 time: 0.233424 Aug 24 05:00:00.556881 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3998/7725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:00 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:01.577867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:01.578487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:01.586911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.587404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.587943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.588696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.589170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.589614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.791012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:01.800163 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-399f8b3b-a966-488d-a6e8-c8b009bc3fda tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 200 len: 1554 microversion: 2.1 time: 0.226296 Aug 24 05:00:01.800744 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3728/7726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:01 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:01.945510 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-37d0614b-71d0-4e3a-a3e1-91ad288ce671 req-3487fb2b-d278-46ce-a2d4-fe29c07c376c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e2c446-3aef-422e-b4be-cfac973d3588", "name": "network-vif-deleted", "tag": "9a0c2fe7-d035-4496-ad2b-fef5c3f80385"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:01.958740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-37d0614b-71d0-4e3a-a3e1-91ad288ce671 req-3487fb2b-d278-46ce-a2d4-fe29c07c376c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:01.959222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-37d0614b-71d0-4e3a-a3e1-91ad288ce671 req-3487fb2b-d278-46ce-a2d4-fe29c07c376c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:01.959653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-37d0614b-71d0-4e3a-a3e1-91ad288ce671 req-3487fb2b-d278-46ce-a2d4-fe29c07c376c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:01.972064 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-37d0614b-71d0-4e3a-a3e1-91ad288ce671 req-3487fb2b-d278-46ce-a2d4-fe29c07c376c service nova] Creating event network-vif-deleted:9a0c2fe7-d035-4496-ad2b-fef5c3f80385 for instance 52e2c446-3aef-422e-b4be-cfac973d3588 on n-h2-846470-15 Aug 24 05:00:01.978299 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-37d0614b-71d0-4e3a-a3e1-91ad288ce671 req-3487fb2b-d278-46ce-a2d4-fe29c07c376c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036621 Aug 24 05:00:01.979776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 3999/7727] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:02.826364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:02.827012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: 52e2c446-3aef-422e-b4be-cfac973d3588] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:02.833912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.834410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.834876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.835579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:02.836073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:02.836511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:02.852843 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] HTTP exception thrown: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 could not be found. Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Request method failure captured: Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 HTTP/1.1 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa8JGqx1JR6zMua1VEO32EewjOric9zcCnSvMa5LFvO6LZwzRu7hYH3pifG6jcfEtR2z_DE1wMEojy0miPlKpfe5EoE_fJyfnL8XeRV36FSmDIJ5eKgYRr1iDKiQ7mzIntK_3KDfdeRt2Zx8pUXkcrB02j2JyHWsY7S39q6G-btQejM Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0f1683d541dd44579a2c27816642b065 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0f1683d541dd44579a2c27816642b065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0f1683d541dd44579a2c27816642b065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f1683d541dd44579a2c27816642b065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f1683d541dd44579a2c27816642b065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0f1683d541dd44579a2c27816642b065 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestMinimumBasicScenario-566477786-project Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ce74e4db3c9b4d8ab5675487105df429 Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestMinimumBasicScenario-566477786-project Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 could not be found. Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '52e2c446-3aef-422e-b4be-cfac973d3588'} Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 could not be found. Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 could not be found. Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:00:02.854635 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 could not be found. Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Returning 404 to user: Instance 52e2c446-3aef-422e-b4be-cfac973d3588 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b1661e4a-4156-4704-a26b-b7c21e7f79b4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588" status: 404 len: 111 microversion: 2.1 time: 0.034967 Aug 24 05:00:02.859559 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3729/7728] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:02 2022] GET /compute/v2.1/servers/52e2c446-3aef-422e-b4be-cfac973d3588 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:00:02.868876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-13a8d78d-3161-44cf-a1c5-a7f40b07821e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '.version_select at 0x7f1021b5ec10>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:02.899780 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-13a8d78d-3161-44cf-a1c5-a7f40b07821e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-231074617" status: 202 len: 0 microversion: 2.1 time: 0.037525 Aug 24 05:00:02.900559 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4000/7729] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 05:00:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-231074617 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:00:12.265415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f6e60cc0-7168-4454-9230-67dfb0e86769 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'create', calling method: .version_select at 0x7f1029ebf160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-281280034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbEvsIg+Qm5mq4hx+sX+5/G1sBvJLzJyy3IuIoprLH0AIEbFxN3s/DwMQ+6F8dFzfOH7jPG8cmq9zcxpoM62lseGaGacfLPkcLWiA5zYE9D+0Xqs12dVK3S3VXcUqYK8w=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:12.282498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f6e60cc0-7168-4454-9230-67dfb0e86769 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Getting quotas for project 0f1683d541dd44579a2c27816642b065. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:00:12.288896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f6e60cc0-7168-4454-9230-67dfb0e86769 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Getting quotas for user ce74e4db3c9b4d8ab5675487105df429 and project 0f1683d541dd44579a2c27816642b065. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:00:12.302725 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f6e60cc0-7168-4454-9230-67dfb0e86769 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [44c85499-2d2d-4e55-9f8a-ec7342fc405e] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:00:12.841536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:13.311048 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [None req-f6e60cc0-7168-4454-9230-67dfb0e86769 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [44c85499-2d2d-4e55-9f8a-ec7342fc405e] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 32954. Aug 24 05:00:13.331510 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f6e60cc0-7168-4454-9230-67dfb0e86769 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.069938 Aug 24 05:00:13.332083 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3730/7730] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:00:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:13.390860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1554427582", "imageRef": "fdabdee0-18aa-4120-89c0-cfd5ef5852c1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-281280034", "networks": [{"uuid": "a876d6a6-aa4d-495a-a307-215087a98c22"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:13.405331 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:13.406318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:13.460661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] validate_networks() for [('a876d6a6-aa4d-495a-a307-215087a98c22', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:00:13.941818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:00:13.942471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:00:13.943236 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:00:13.943923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:00:13.944652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:00:13.959368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:13.960154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:13.960837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.962212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:13.963319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:13.963781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:13.981360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Getting quotas for project 0f1683d541dd44579a2c27816642b065. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:00:13.987109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Getting quotas for user ce74e4db3c9b4d8ab5675487105df429 and project 0f1683d541dd44579a2c27816642b065. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:00:14.001156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:00:14.003526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fdabdee0-18aa-4120-89c0-cfd5ef5852c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:00:14.057217 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c57e4bd8-214b-43db-8376-f10e2466b49b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672458 Aug 24 05:00:14.057884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4001/7731] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:00:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:00:14.069161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-64b41696-8553-451a-a025-01736e6e7bbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:14.069793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-64b41696-8553-451a-a025-01736e6e7bbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:14.129846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-64b41696-8553-451a-a025-01736e6e7bbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:14.138249 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-64b41696-8553-451a-a025-01736e6e7bbd tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1258 microversion: 2.1 time: 0.073069 Aug 24 05:00:14.138935 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3731/7732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:14 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:15.161571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:15.162193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:15.170880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:15.171374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:15.171854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:15.172566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:15.173016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:15.173441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:15.263927 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:15.274846 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2fa0f5f7-c169-4a0b-b84d-f7901bc6b765 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1318 microversion: 2.1 time: 0.118239 Aug 24 05:00:15.279542 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4002/7733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:15 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1318 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:16.302830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:16.304594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:16.314823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.315876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.316659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.317616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:16.318697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:16.319511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:16.495719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:16.506632 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b8d2f34d-d58d-441a-8022-b222f2624a1c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.209178 Aug 24 05:00:16.512945 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3732/7734] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:16 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:17.530570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:17.531384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:17.538447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.539198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.539629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.540530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:17.540976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:17.541443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:17.770679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:17.786555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-74705ab4-4127-4176-bcc7-75b5bbf1dd32 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.259749 Aug 24 05:00:17.788177 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4003/7735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:17 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:18.823550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:18.824169 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:18.827059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:18.833202 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.833758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.834221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:18.835011 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:18.835654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:18.836148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.034688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:19.044602 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-152b4656-ced5-42c2-b972-c407c1808c2b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.225514 Aug 24 05:00:19.045446 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3733/7736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:18 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:20.072072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:20.079039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:20.089402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.090057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.090572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.091387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.091930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.092627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.370131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:20.386555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5ff8fad8-7386-4e53-89e7-77a55ea0b834 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.323129 Aug 24 05:00:20.412570 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4004/7737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:20 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:21.421284 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:21.421887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:21.429527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.430124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.430615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.431487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.432078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.432602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.629653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.638740 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4b5c7f9a-8157-40f1-80d2-478dfe21739d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.221711 Aug 24 05:00:21.653497 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3734/7738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:21 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:22.662836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:22.664237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:22.673131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.675438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.676347 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.678422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.679448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.680643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.865017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:22.874504 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2451ed57-2b80-4e29-b234-108a5cac5434 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.216743 Aug 24 05:00:22.875107 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4005/7739] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:22 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:23.896752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:23.897397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:23.905436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:23.905957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:23.906413 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:23.907153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:23.907625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:23.908108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.044030 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:24.052280 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3facbe2d-4966-40e1-85ba-58e8775a48a8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.159490 Aug 24 05:00:24.052845 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3735/7740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:23 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:25.075001 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:25.075580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:25.081477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:25.082209 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:25.090678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.091171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.091613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.092423 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.092910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.093345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.235188 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.243645 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-439747f1-7eb7-4e24-8e9b-7188163535c6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.173375 Aug 24 05:00:25.244258 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4006/7741] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:25 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:26.265572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:26.266255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:26.268255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:26.274565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.275065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.275489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.276890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.277365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.277810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.413526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:26.421818 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b84cd320-f1c0-4706-9aca-73e79a4ea039 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.160144 Aug 24 05:00:26.422814 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3736/7742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:26 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:27.444722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:27.445407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:27.452953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.453434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.454223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.455041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.455522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.455984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.589453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:27.597429 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-af6ffa80-2f47-4be8-a8ac-66842af662b6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.156780 Aug 24 05:00:27.598125 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4007/7743] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:27 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:28.619901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:28.620590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:28.627814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:28.628315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:28.628794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.629521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:28.629995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:28.630419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.832056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.840758 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2907e1a7-097f-4846-a8f2-a40d942449ff tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.224931 Aug 24 05:00:28.841538 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3737/7744] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:28 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:29.356940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ad385ba5-9ddb-4a89-830f-a063d3af8ddb req-3d748b6e-e438-4af3-ac2c-3cd410af67b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babf0ddd-a899-44a3-8a28-e0ff5c4228cd", "tag": "b328fcd2-7bc6-47cd-b482-411c69530688"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:29.368442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad385ba5-9ddb-4a89-830f-a063d3af8ddb req-3d748b6e-e438-4af3-ac2c-3cd410af67b3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.369002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad385ba5-9ddb-4a89-830f-a063d3af8ddb req-3d748b6e-e438-4af3-ac2c-3cd410af67b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.369999 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ad385ba5-9ddb-4a89-830f-a063d3af8ddb req-3d748b6e-e438-4af3-ac2c-3cd410af67b3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.382248 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ad385ba5-9ddb-4a89-830f-a063d3af8ddb req-3d748b6e-e438-4af3-ac2c-3cd410af67b3 service nova] Creating event network-changed:b328fcd2-7bc6-47cd-b482-411c69530688 for instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd on n-h2-846470-15 Aug 24 05:00:29.387637 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ad385ba5-9ddb-4a89-830f-a063d3af8ddb req-3d748b6e-e438-4af3-ac2c-3cd410af67b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034777 Aug 24 05:00:29.388271 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4008/7745] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:00:29.863755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:29.864424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:29.873314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.874159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.874650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.875541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.876155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.876655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.273026 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.282202 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-10974edc-7b54-4f59-8503-be0eb2e0fba6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.422864 Aug 24 05:00:30.282978 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3738/7746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:29 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:31.305618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:31.308360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:31.315031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.315552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.316083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.316894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.317442 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.317958 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.464799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:31.473283 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-efac4d7c-d034-4504-9bb4-56aa5f4fd745 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.171953 Aug 24 05:00:31.473873 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4009/7747] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:31 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:32.495057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:32.495951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:32.503247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.503774 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.504229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.504948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.505419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.505861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.637497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:32.645507 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-47a2497f-6348-49d3-b6d3-94c3f12aeb3e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.154517 Aug 24 05:00:32.646080 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3739/7748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:32 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:33.667311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:33.667914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:33.675452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.675981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.676421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.677130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.677590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.678021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.817418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:33.825650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-999da84e-e92f-4d08-8a75-00d78f9c077d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.162719 Aug 24 05:00:33.826240 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4010/7749] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:33 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:34.846977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:34.847613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:34.855952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.856651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.857137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.857964 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.858587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.859077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.002694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.011971 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b56c06e0-b477-47d3-a194-75cef7f2d5e6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.168938 Aug 24 05:00:35.012535 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3740/7750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:34 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:36.033884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:36.034762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:36.042453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.042993 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.043522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.044244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.044712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.045158 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.201807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:36.210979 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4427ddf9-50b9-4673-9ef5-6059108c58d3 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.181059 Aug 24 05:00:36.211628 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4011/7751] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:36 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:37.234393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:37.235007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:37.242498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.243007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.243461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.244581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.245024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.245465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.386615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:37.397453 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-05d07b62-520e-49cb-a5b7-7c7ec6c7008e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.166689 Aug 24 05:00:37.398260 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3741/7752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:37 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:38.230276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d2aede8a-1f24-4756-9653-a8f0ba7f78cd req-188a6e36-373d-45c3-85af-a9179e63a116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babf0ddd-a899-44a3-8a28-e0ff5c4228cd", "name": "network-vif-plugged", "status": "completed", "tag": "b328fcd2-7bc6-47cd-b482-411c69530688"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:38.240814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2aede8a-1f24-4756-9653-a8f0ba7f78cd req-188a6e36-373d-45c3-85af-a9179e63a116 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.241309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2aede8a-1f24-4756-9653-a8f0ba7f78cd req-188a6e36-373d-45c3-85af-a9179e63a116 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.241711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d2aede8a-1f24-4756-9653-a8f0ba7f78cd req-188a6e36-373d-45c3-85af-a9179e63a116 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.254247 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d2aede8a-1f24-4756-9653-a8f0ba7f78cd req-188a6e36-373d-45c3-85af-a9179e63a116 service nova] Creating event network-vif-plugged:b328fcd2-7bc6-47cd-b482-411c69530688 for instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd on n-h2-846470-15 Aug 24 05:00:38.260344 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d2aede8a-1f24-4756-9653-a8f0ba7f78cd req-188a6e36-373d-45c3-85af-a9179e63a116 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118198 Aug 24 05:00:38.261109 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4012/7753] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:38.423768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:38.424406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:38.432379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.432932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.433385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.434121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.434727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.435175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.573922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:38.583484 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc1f9e8d-89f7-4d3c-b25b-8a7f544a1257 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.165232 Aug 24 05:00:38.584288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3742/7754] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:38 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:39.608472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:39.609397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:39.616533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.617034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.617488 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.618219 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.618686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.619420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.773629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.785987 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b79c54b9-7a9b-420b-b96d-926794c49dcf tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1358 microversion: 2.1 time: 0.184016 Aug 24 05:00:39.786834 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4013/7755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:39 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:40.815622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:40.816286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:40.823916 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.824430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.824892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.825626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.826108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.826557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.970962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.980170 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-32293aa4-069b-4c2c-b823-b89dde285c35 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1548 microversion: 2.1 time: 0.168444 Aug 24 05:00:40.980773 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3743/7756] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:40 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:41.000515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:41.001161 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:41.008378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.008893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.009302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.010113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.010567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.010991 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.158039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:41.166721 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-10dc55bc-6ea4-4487-be5d-48773d32c83c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1548 microversion: 2.1 time: 0.170040 Aug 24 05:00:41.167291 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4014/7757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:40 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:41.186807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:41.191357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:41.192072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Searching by: {'deleted': False, 'project_id': '0f1683d541dd44579a2c27816642b065'} {{(pid=122535) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 05:00:41.197995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.198496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.198950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.199694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.200165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.200603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.227114 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.multi_cell_list [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 05:00:41.257338 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0d1eada5-eee1-46ce-a636-4227eacc8c31 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.074383 Aug 24 05:00:41.257906 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3744/7758] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 24 05:00:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:00:41.269536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:41.270149 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:41.277225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.277719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.278278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.279023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.279481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.279942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.427363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:41.436495 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5dbbde99-a96e-46b2-a735-462b44211df4 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1548 microversion: 2.1 time: 0.170925 Aug 24 05:00:41.437117 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4015/7759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:41 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:42.983419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4d92473-71ed-4a25-8844-d08090f93747"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:42.985880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:42.993279 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.993813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.994494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.995307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.995933 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.996475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.999191 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=81 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:43.265139 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07655920-3180-404d-91a0-d9dba74437b7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286066 Aug 24 05:00:43.266141 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3745/7760] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 24 05:00:42 2022] POST /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:55.164930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:55.165715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:55.169665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:55.170384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=78 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:55.177309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:55.177803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:55.178245 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:55.178962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:55.179414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:55.179878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:55.316796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:55.326405 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d39b1cf3-4c71-4846-a29c-509051d856d2 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1594 microversion: 2.1 time: 0.165665 Aug 24 05:00:55.327045 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4016/7761] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:55 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:57.171857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fb2ed3a1-7a10-4cce-bb6b-8fc871a2be16 req-63761d3d-217c-489d-8933-5b23c5db42d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babf0ddd-a899-44a3-8a28-e0ff5c4228cd", "tag": "b328fcd2-7bc6-47cd-b482-411c69530688"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:57.187430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:57.187430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=25 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:57.188392 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:57.192424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fb2ed3a1-7a10-4cce-bb6b-8fc871a2be16 req-63761d3d-217c-489d-8933-5b23c5db42d4 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:57.193361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fb2ed3a1-7a10-4cce-bb6b-8fc871a2be16 req-63761d3d-217c-489d-8933-5b23c5db42d4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:57.194131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fb2ed3a1-7a10-4cce-bb6b-8fc871a2be16 req-63761d3d-217c-489d-8933-5b23c5db42d4 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:57.213620 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fb2ed3a1-7a10-4cce-bb6b-8fc871a2be16 req-63761d3d-217c-489d-8933-5b23c5db42d4 service nova] Creating event network-changed:b328fcd2-7bc6-47cd-b482-411c69530688 for instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd on n-h2-846470-15 Aug 24 05:00:57.219268 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fb2ed3a1-7a10-4cce-bb6b-8fc871a2be16 req-63761d3d-217c-489d-8933-5b23c5db42d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053810 Aug 24 05:00:57.220340 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3746/7762] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:58.369341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1407434448"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:58.371117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:58.378611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.379100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.379536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:58.380314 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.380811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.381560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:58.519859 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.network.security_group_api [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Adding security group eb9c7036-5473-42d8-89f7-997e9ebe4e9b to port b328fcd2-7bc6-47cd-b482-411c69530688 Aug 24 05:00:58.866491 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b75a0762-9d60-437a-a260-a11ac6d670be tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/action" status: 202 len: 0 microversion: 2.1 time: 0.501393 Aug 24 05:00:58.867117 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4017/7763] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:00:58 2022] POST /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:00:58.876908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:58.878012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:58.886375 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.886903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.887352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:58.888139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.888605 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.889033 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:58.939805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-17bbedee-cfc7-44f5-826b-7e1abfa4355b req-fb87a8ae-c75e-4e5b-85ee-cc718e53d8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babf0ddd-a899-44a3-8a28-e0ff5c4228cd", "tag": "b328fcd2-7bc6-47cd-b482-411c69530688"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:58.951813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-17bbedee-cfc7-44f5-826b-7e1abfa4355b req-fb87a8ae-c75e-4e5b-85ee-cc718e53d8bc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.952341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-17bbedee-cfc7-44f5-826b-7e1abfa4355b req-fb87a8ae-c75e-4e5b-85ee-cc718e53d8bc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.952744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-17bbedee-cfc7-44f5-826b-7e1abfa4355b req-fb87a8ae-c75e-4e5b-85ee-cc718e53d8bc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:58.967932 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-17bbedee-cfc7-44f5-826b-7e1abfa4355b req-fb87a8ae-c75e-4e5b-85ee-cc718e53d8bc service nova] Creating event network-changed:b328fcd2-7bc6-47cd-b482-411c69530688 for instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd on n-h2-846470-15 Aug 24 05:00:58.974299 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-17bbedee-cfc7-44f5-826b-7e1abfa4355b req-fb87a8ae-c75e-4e5b-85ee-cc718e53d8bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102684 Aug 24 05:00:58.976749 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3747/7764] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:59.088160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:59.098514 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-07187c67-8803-48ff-8bb9-d52a942908c9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1760 microversion: 2.1 time: 0.225425 Aug 24 05:00:59.099494 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4018/7765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:58 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1760 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:01:59.685115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:59.685921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:59.691697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:59.694129 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:59.702132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:59.702654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:59.703119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.703865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:59.704682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:59.705121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.789147 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c4cdd1ec-8209-4672-86d4-8c39e8e8652d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/action" status: 202 len: 0 microversion: 2.1 time: 0.105979 Aug 24 05:01:59.790095 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3748/7766] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:01:59 2022] POST /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:01:59.801511 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:59.802247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:59.805248 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:59.805976 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=16 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:59.810833 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:59.811537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:59.812024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.812756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:59.813221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:59.813893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:59.967840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:59.977071 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c1b9ac25-4440-4c14-9b80-32e001e50cc1 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1752 microversion: 2.1 time: 0.180509 Aug 24 05:01:59.977794 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4019/7767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:59 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:01.003913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:01.004713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:01.013192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.013717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.014171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.014877 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:01.015553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:01.016085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:01.183203 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:01.192173 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ef7fdd3c-2c2c-4f9f-9004-c97545ffd767 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.194182 Aug 24 05:02:01.192568 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3749/7768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:00 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:02.214879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:02.215579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:02.222232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:02.226659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:02.227110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:02.227889 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:02.228491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:02.228946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:02.384262 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:02.397311 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a3e7314-0cf1-4bc6-930a-ef865fb65c0c tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.187128 Aug 24 05:02:02.398408 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4020/7769] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:02 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:03.426561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:03.427219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:03.435249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:03.435782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:03.436241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:03.436955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:03.437426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:03.437869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:03.593613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:03.604755 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-342f428b-11aa-4bf9-8b4a-6defa8ff10ed tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.182185 Aug 24 05:02:03.605695 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3750/7770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:03 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:04.627313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:04.627957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:04.638949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:04.639612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:04.640069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:04.640764 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:04.641380 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:04.641813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:04.791480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:04.800529 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-28662283-2551-494a-92e9-76494af9a64b tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.177295 Aug 24 05:02:04.801136 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4021/7771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:04 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:05.825376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:05.825996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:05.836308 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.836854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.837509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:05.838654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:05.839657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:05.840127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:06.010070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:06.021855 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7d0446fb-a5f0-4077-b128-d4b87c408862 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.202460 Aug 24 05:02:06.022604 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3751/7772] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:05 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:07.045389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:07.046021 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:07.053381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:07.053864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:07.054294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:07.055006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:07.055630 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:07.056307 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:07.213352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:07.227394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-676d7f46-32f0-433d-a397-7167274026b8 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.186219 Aug 24 05:02:07.228199 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4022/7773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:07 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:08.251702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:08.252337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:08.260061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:08.260572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:08.261029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:08.261744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:08.262241 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:08.262692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:08.435741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:08.449392 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4904776-b8be-4820-a47e-3fb455740495 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.201790 Aug 24 05:02:08.450261 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3752/7774] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:08 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:09.481658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:09.482602 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:09.493618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:09.494438 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:09.495130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:09.496344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:09.497097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:09.497802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:09.669159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:09.681140 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f19d2702-d290-4881-9d40-3e97ce5f9f89 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.205357 Aug 24 05:02:09.682055 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4023/7775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:09 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:10.707167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:10.707844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:10.716821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:10.717639 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:10.717937 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:10.718946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:10.719426 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:10.720001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:10.884874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:10.895543 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bda5062e-6c5c-44e9-b095-53f92b620015 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1757 microversion: 2.1 time: 0.193621 Aug 24 05:02:10.896213 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3753/7776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:10 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:11.923246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:11.924498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:11.937335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:11.937847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:11.938272 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:11.939016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:11.939469 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:11.939950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:12.117204 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:12.126456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d26a4bdb-7b5b-4b29-889b-501d85e4a712 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1760 microversion: 2.1 time: 0.209323 Aug 24 05:02:12.127051 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4024/7777] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:11 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1760 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:54.322257 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:02:54.323898 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:02:54.325228 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:02:54.325469 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:03:04.426729 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:03:04.427596 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:03:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:03:13.209295 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:03:13.209913 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:03:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:03:19.039334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=12 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:19.040142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:19.044770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1407434448"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:19.045316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:19.052753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.053306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.053750 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.054489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.055113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.055550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.197088 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.network.security_group_api [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Removing security group eb9c7036-5473-42d8-89f7-997e9ebe4e9b from port b328fcd2-7bc6-47cd-b482-411c69530688 Aug 24 05:03:19.550490 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-49b97821-e4bd-4640-ad3a-7a54aeaa8f10 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "POST /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/action" status: 202 len: 0 microversion: 2.1 time: 0.513148 Aug 24 05:03:19.551289 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3754/7778] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:03:19 2022] POST /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:03:19.567943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e12b29b8-6273-4eab-90c7-4c742cdd399d req-e09bdca6-bbd8-409b-88c6-99bb13261a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babf0ddd-a899-44a3-8a28-e0ff5c4228cd", "tag": "b328fcd2-7bc6-47cd-b482-411c69530688"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:19.592215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:19.593182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=36 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:19.598578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e12b29b8-6273-4eab-90c7-4c742cdd399d req-e09bdca6-bbd8-409b-88c6-99bb13261a19 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.599366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e12b29b8-6273-4eab-90c7-4c742cdd399d req-e09bdca6-bbd8-409b-88c6-99bb13261a19 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.600156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e12b29b8-6273-4eab-90c7-4c742cdd399d req-e09bdca6-bbd8-409b-88c6-99bb13261a19 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.615549 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e12b29b8-6273-4eab-90c7-4c742cdd399d req-e09bdca6-bbd8-409b-88c6-99bb13261a19 service nova] Creating event network-changed:b328fcd2-7bc6-47cd-b482-411c69530688 for instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd on n-h2-846470-15 Aug 24 05:03:19.623892 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e12b29b8-6273-4eab-90c7-4c742cdd399d req-e09bdca6-bbd8-409b-88c6-99bb13261a19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061601 Aug 24 05:03:19.625073 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4025/7779] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:21.130695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:21.131305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:21.137975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.138488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.138945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.139727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.140175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.140731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.234485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lazy-loading 'services' on Instance uuid babf0ddd-a899-44a3-8a28-e0ff5c4228cd {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:03:21.320757 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3afd6d94-1e62-488e-8f93-d3075a3ac1a7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "DELETE /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments/f4d92473-71ed-4a25-8844-d08090f93747" status: 202 len: 0 microversion: 2.1 time: 0.195856 Aug 24 05:03:21.321685 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3755/7780] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 05:03:21 2022] DELETE /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments/f4d92473-71ed-4a25-8844-d08090f93747 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:03:21.332614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:21.335153 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:21.343212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.344843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.345695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.346541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.347092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.347594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.383514 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-573315a3-b8a8-48d5-8b64-a0eb67badac0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055878 Aug 24 05:03:21.384263 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4026/7781] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 05:03:21 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:21.646239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cba731c6-a024-4181-afef-2924d1ff22e1 req-c583fe25-e581-4067-9beb-6fdfc18a367e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babf0ddd-a899-44a3-8a28-e0ff5c4228cd", "tag": "b328fcd2-7bc6-47cd-b482-411c69530688"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:21.657318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cba731c6-a024-4181-afef-2924d1ff22e1 req-c583fe25-e581-4067-9beb-6fdfc18a367e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.657921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cba731c6-a024-4181-afef-2924d1ff22e1 req-c583fe25-e581-4067-9beb-6fdfc18a367e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.658439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cba731c6-a024-4181-afef-2924d1ff22e1 req-c583fe25-e581-4067-9beb-6fdfc18a367e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.674740 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cba731c6-a024-4181-afef-2924d1ff22e1 req-c583fe25-e581-4067-9beb-6fdfc18a367e service nova] Creating event network-changed:b328fcd2-7bc6-47cd-b482-411c69530688 for instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd on n-h2-846470-15 Aug 24 05:03:21.680466 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cba731c6-a024-4181-afef-2924d1ff22e1 req-c583fe25-e581-4067-9beb-6fdfc18a367e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038869 Aug 24 05:03:21.680903 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3756/7782] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:22.399878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:22.402369 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:22.420680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:22.421303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:22.421987 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.423121 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:22.423706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:22.425228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.471555 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-91133905-ea97-4b67-aa5b-faad524a73d0 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077864 Aug 24 05:03:22.473335 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4027/7783] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 05:03:22 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:23.486571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:23.489298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:23.500416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:23.501252 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:23.501991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:23.502806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:23.503352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:23.504526 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:23.541812 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a9d7594-5739-4af2-9b74-f9ab0d3f305d tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060075 Aug 24 05:03:23.549369 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3757/7784] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 05:03:23 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:24.554241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:24.556689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:24.564514 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.565517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.566152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.566863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.567325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.567779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.605301 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a075ef6f-963f-48af-ad21-61039f4c7779 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054816 Aug 24 05:03:24.606228 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4028/7785] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 05:03:24 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:25.622553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:25.625009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:25.632991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:25.633548 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:25.634016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.634761 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:25.635230 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:25.635698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.670980 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b006a3e8-64aa-4994-b538-50b8e97ac77e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053718 Aug 24 05:03:25.671565 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3758/7786] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 05:03:25 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:26.686133 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:26.688548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:26.696614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.697114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.697635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.698229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.698667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.699120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.732474 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6bde2aaa-45cb-41c9-a2e8-00e24bf6be16 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050501 Aug 24 05:03:26.733054 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4029/7787] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 24 05:03:26 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:03:26.744717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:26.745327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:26.753832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.754341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.754802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.755531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.756047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.756487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.850303 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] HTTP exception thrown: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd is not attached to volume f4d92473-71ed-4a25-8844-d08090f93747 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Request method failure captured: Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: request: DELETE /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments/f4d92473-71ed-4a25-8844-d08090f93747 HTTP/1.1 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa8JGqx1JR6zMua1VEO32EewjOric9zcCnSvMa5LFvO6LZwzRu7hYH3pifG6jcfEtR2z_DE1wMEojy0miPlKpfe5EoE_fJyfnL8XeRV36FSmDIJ5eKgYRr1iDKiQ7mzIntK_3KDfdeRt2Zx8pUXkcrB02j2JyHWsY7S39q6G-btQejM Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0f1683d541dd44579a2c27816642b065 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0f1683d541dd44579a2c27816642b065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0f1683d541dd44579a2c27816642b065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f1683d541dd44579a2c27816642b065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f1683d541dd44579a2c27816642b065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0f1683d541dd44579a2c27816642b065 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestMinimumBasicScenario-566477786-project Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ce74e4db3c9b4d8ab5675487105df429 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestMinimumBasicScenario-566477786-project Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd is not attached to volume f4d92473-71ed-4a25-8844-d08090f93747 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'server_id': 'babf0ddd-a899-44a3-8a28-e0ff5c4228cd', 'id': 'f4d92473-71ed-4a25-8844-d08090f93747'} Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f4d92473-71ed-4a25-8844-d08090f93747. Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd is not attached to volume f4d92473-71ed-4a25-8844-d08090f93747 Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:03:26.851994 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:03:26.857699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:03:26.857699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:03:26.857699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd is not attached to volume f4d92473-71ed-4a25-8844-d08090f93747 Aug 24 05:03:26.857699 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:26.857699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Returning 404 to user: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd is not attached to volume f4d92473-71ed-4a25-8844-d08090f93747 {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:03:26.857699 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-51f226a1-0184-4a33-bcca-d0786cb587a6 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "DELETE /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments/f4d92473-71ed-4a25-8844-d08090f93747" status: 404 len: 154 microversion: 2.1 time: 0.112979 Aug 24 05:03:26.857699 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3759/7788] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 24 05:03:26 2022] DELETE /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd/os-volume_attachments/f4d92473-71ed-4a25-8844-d08090f93747 => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:03:30.148097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:30.148877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:30.160938 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.161432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.161870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.162590 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.163040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.163459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.191962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:03:30.303418 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bf61ff9b-a5c6-43fa-9a45-05ca19452c59 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "DELETE /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 204 len: 0 microversion: 2.1 time: 0.161629 Aug 24 05:03:30.306511 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4030/7789] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:03:30 2022] DELETE /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:03:30.315318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:30.316070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:30.322537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.323122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.323636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.324460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.325062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.325514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.482077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:30.491949 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27b728dd-8c51-49ee-978a-3ae485cb0933 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1554 microversion: 2.1 time: 0.182057 Aug 24 05:03:30.492616 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3760/7790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:30 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:31.518281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:31.519352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:31.527281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:31.527856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:31.528328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:31.529047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:31.530615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:31.530615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:31.682578 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:31.691793 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e4c3ce96-68c3-41f6-89cd-8c7df9b2b6c7 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1554 microversion: 2.1 time: 0.180731 Aug 24 05:03:31.692382 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4031/7791] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:31 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:32.718653 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:32.719870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:32.732051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:32.732985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:32.733782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:32.734982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:32.735918 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:32.736727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:32.940887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74e4db3c9b4d8ab5675487105df429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1683d541dd44579a2c27816642b065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:32.950019 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b05a377-9c3d-4e43-9a21-d09cc37f55fe tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 200 len: 1554 microversion: 2.1 time: 0.238681 Aug 24 05:03:32.950673 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3761/7792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:32 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:33.058501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-30b2b80e-8146-4872-84d0-a48332d60a13 req-4bb7be46-cd8a-4b40-8ea1-2b0a4e8221c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babf0ddd-a899-44a3-8a28-e0ff5c4228cd", "name": "network-vif-deleted", "tag": "b328fcd2-7bc6-47cd-b482-411c69530688"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:33.073327 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-30b2b80e-8146-4872-84d0-a48332d60a13 req-4bb7be46-cd8a-4b40-8ea1-2b0a4e8221c1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.074102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-30b2b80e-8146-4872-84d0-a48332d60a13 req-4bb7be46-cd8a-4b40-8ea1-2b0a4e8221c1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.074701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-30b2b80e-8146-4872-84d0-a48332d60a13 req-4bb7be46-cd8a-4b40-8ea1-2b0a4e8221c1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:33.090637 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-30b2b80e-8146-4872-84d0-a48332d60a13 req-4bb7be46-cd8a-4b40-8ea1-2b0a4e8221c1 service nova] Creating event network-vif-deleted:b328fcd2-7bc6-47cd-b482-411c69530688 for instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd on n-h2-846470-15 Aug 24 05:03:33.096747 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-30b2b80e-8146-4872-84d0-a48332d60a13 req-4bb7be46-cd8a-4b40-8ea1-2b0a4e8221c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042208 Aug 24 05:03:33.097355 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4032/7793] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:33.973168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:33.973829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] [instance: babf0ddd-a899-44a3-8a28-e0ff5c4228cd] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:33.981270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.981781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.982298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:33.983229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.983776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.984220 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:34.002880 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] HTTP exception thrown: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd could not be found. Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Request method failure captured: Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd HTTP/1.1 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBa8JGqx1JR6zMua1VEO32EewjOric9zcCnSvMa5LFvO6LZwzRu7hYH3pifG6jcfEtR2z_DE1wMEojy0miPlKpfe5EoE_fJyfnL8XeRV36FSmDIJ5eKgYRr1iDKiQ7mzIntK_3KDfdeRt2Zx8pUXkcrB02j2JyHWsY7S39q6G-btQejM Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 0f1683d541dd44579a2c27816642b065 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0f1683d541dd44579a2c27816642b065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0f1683d541dd44579a2c27816642b065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f1683d541dd44579a2c27816642b065"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f1683d541dd44579a2c27816642b065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 0f1683d541dd44579a2c27816642b065 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestMinimumBasicScenario-566477786 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestMinimumBasicScenario-566477786-project Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: ce74e4db3c9b4d8ab5675487105df429 Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestMinimumBasicScenario-566477786-project Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd could not be found. Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'babf0ddd-a899-44a3-8a28-e0ff5c4228cd'} Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd could not be found. Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd could not be found. Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:03:34.004480 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd could not be found. Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Returning 404 to user: Instance babf0ddd-a899-44a3-8a28-e0ff5c4228cd could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3122dde5-250a-4940-875e-6c26d2f94ea9 tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd" status: 404 len: 111 microversion: 2.1 time: 0.037442 Aug 24 05:03:34.009449 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3762/7794] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:33 2022] GET /compute/v2.1/servers/babf0ddd-a899-44a3-8a28-e0ff5c4228cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:03:34.015606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7f4d2afc-455e-4301-b833-c4d3b393a73e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] Calling method '.version_select at 0x7f1021b5eee0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:34.041065 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7f4d2afc-455e-4301-b833-c4d3b393a73e tempest-TestMinimumBasicScenario-566477786 tempest-TestMinimumBasicScenario-566477786-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-281280034" status: 202 len: 0 microversion: 2.1 time: 0.029661 Aug 24 05:03:34.041662 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4033/7795] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 24 05:03:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-281280034 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:03:43.978792 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=18 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:43.990674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:43.996824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-20d78ce8-7731-4ee6-bc20-b4e8c1bad134 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: .version_select at 0x7f10283a5e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1502698602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5qsTYR/hxZx1GM2G2hR0xH83RI2reSH8xVlKGisCWnHQnFNp3E6YOcxcKhWO+ms9Zl5WdhaFjahplY423z/lQw4s1l/hVzFdeidw4c7+U+5sjj5UPXxoKqF/tzT/wwxw=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:44.014709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-20d78ce8-7731-4ee6-bc20-b4e8c1bad134 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:03:44.021527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-20d78ce8-7731-4ee6-bc20-b4e8c1bad134 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:03:44.050372 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-20d78ce8-7731-4ee6-bc20-b4e8c1bad134 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.251817 Aug 24 05:03:44.051054 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3763/7796] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:03:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:50.422807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:50.423580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:50.428269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-247428235", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "afffda30-6f8c-4a76-88b5-4b44b9cc6d07"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1502698602", "security_groups": [{"name": "tempest-secgroup-smoke-2122340018"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:50.561796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] validate_networks() for [('afffda30-6f8c-4a76-88b5-4b44b9cc6d07', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:03:51.115639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:03:51.115887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:03:51.116397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:03:51.116798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:03:51.117462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:03:51.131118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:51.131609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:51.132070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:51.132795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:51.133253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:51.133678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:51.160421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:03:51.161669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:03:51.176831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:03:51.179371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:03:51.243971 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e07fe305-ab48-4147-9f06-0959101ea863 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.820435 Aug 24 05:03:51.247688 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4034/7797] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:03:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:03:51.260188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a66c2fb-7650-4924-b5b8-8af5f7836817 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:51.268010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a66c2fb-7650-4924-b5b8-8af5f7836817 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:51.360852 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4a66c2fb-7650-4924-b5b8-8af5f7836817 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:51.371233 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a66c2fb-7650-4924-b5b8-8af5f7836817 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1266 microversion: 2.1 time: 0.115026 Aug 24 05:03:51.372802 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3764/7798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:51 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:03:52.394986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:52.395617 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:52.404192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:52.404681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:52.405124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:52.405826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:52.406346 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:52.407111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:52.505319 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:52.514295 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-733f7192-2e58-43c1-b35f-fdbb62d62b7c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1318 microversion: 2.1 time: 0.124317 Aug 24 05:03:52.514893 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4035/7799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:52 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1318 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:53.538450 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:53.539250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:53.547435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:53.548064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:53.548594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:53.549490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:53.550068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:53.550552 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:53.744072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:53.755187 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf6aea7d-3755-4388-aa10-64c7da676e38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1392 microversion: 2.1 time: 0.220884 Aug 24 05:03:53.756004 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3765/7800] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:53 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1392 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:54.408776 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-fddf0dcc-43b5-4294-aa3b-730ff011b7c4 req-5a569d57-acb3-4891-8165-0080fa521d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac46ac80-5d53-4516-9ba1-59bc69aa6df1", "tag": "230f0154-2dc5-40ec-a4c4-97c7fec6a0e4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:03:54.421491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fddf0dcc-43b5-4294-aa3b-730ff011b7c4 req-5a569d57-acb3-4891-8165-0080fa521d19 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:54.422507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fddf0dcc-43b5-4294-aa3b-730ff011b7c4 req-5a569d57-acb3-4891-8165-0080fa521d19 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:54.423117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fddf0dcc-43b5-4294-aa3b-730ff011b7c4 req-5a569d57-acb3-4891-8165-0080fa521d19 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:54.440636 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fddf0dcc-43b5-4294-aa3b-730ff011b7c4 req-5a569d57-acb3-4891-8165-0080fa521d19 service nova] Creating event network-changed:230f0154-2dc5-40ec-a4c4-97c7fec6a0e4 for instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 on n-h1-846470-15 Aug 24 05:03:54.446171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-fddf0dcc-43b5-4294-aa3b-730ff011b7c4 req-5a569d57-acb3-4891-8165-0080fa521d19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043101 Aug 24 05:03:54.448203 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4036/7801] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:03:54.793320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:54.793951 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:54.802013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:54.802522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:54.802969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:54.804116 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:54.804869 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:54.805562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:54.994101 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:55.002262 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e7af173-3b66-4254-b6b7-7208081703ad tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1392 microversion: 2.1 time: 0.212924 Aug 24 05:03:55.002848 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3766/7802] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:54 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1392 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:56.024216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:56.024890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:56.032606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:56.033710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:56.034152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:56.034988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:56.035522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:56.036107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:56.182731 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:56.191232 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-48f7dfa8-007d-4e7c-973b-90d16b01846d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1392 microversion: 2.1 time: 0.172294 Aug 24 05:03:56.191850 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4037/7803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:56 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:57.213990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:57.214581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:57.222176 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:57.222675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:57.223125 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:57.223920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:57.224332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:57.224768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:57.365244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:57.373114 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab57bfd9-399d-484c-9f45-894805a7d570 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1392 microversion: 2.1 time: 0.163169 Aug 24 05:03:57.373705 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3767/7804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:57 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:58.394763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:58.395365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:58.403116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:58.404201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:58.404201 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:58.404756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:58.405214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:58.405648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:58.558636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:58.568651 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6c976b3a-cf81-4951-aff6-b0f2edbb25af tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1392 microversion: 2.1 time: 0.177866 Aug 24 05:03:58.569357 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4038/7805] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:58 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:59.591372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:59.592024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:59.599291 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.599811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.600333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.601046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.601511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.601955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.748681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:59.756751 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cde98dca-636d-42aa-923e-e1713169e277 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1392 microversion: 2.1 time: 0.169681 Aug 24 05:03:59.757319 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3768/7806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:59 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:00.600271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c15d2ad6-2850-44da-a2d6-45f45a9fb75d req-8516c0a6-c5b5-418a-bf40-601d2da9212a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac46ac80-5d53-4516-9ba1-59bc69aa6df1", "name": "network-vif-plugged", "status": "completed", "tag": "230f0154-2dc5-40ec-a4c4-97c7fec6a0e4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:00.611458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c15d2ad6-2850-44da-a2d6-45f45a9fb75d req-8516c0a6-c5b5-418a-bf40-601d2da9212a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:00.612984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c15d2ad6-2850-44da-a2d6-45f45a9fb75d req-8516c0a6-c5b5-418a-bf40-601d2da9212a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:00.613541 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c15d2ad6-2850-44da-a2d6-45f45a9fb75d req-8516c0a6-c5b5-418a-bf40-601d2da9212a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:00.626608 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c15d2ad6-2850-44da-a2d6-45f45a9fb75d req-8516c0a6-c5b5-418a-bf40-601d2da9212a service nova] Creating event network-vif-plugged:230f0154-2dc5-40ec-a4c4-97c7fec6a0e4 for instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 on n-h1-846470-15 Aug 24 05:04:00.632551 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c15d2ad6-2850-44da-a2d6-45f45a9fb75d req-8516c0a6-c5b5-418a-bf40-601d2da9212a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036717 Aug 24 05:04:00.633169 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4039/7807] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:04:00.778446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:00.779128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:00.787270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:00.787801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:00.788243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:00.788979 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:00.789645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:00.790092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:00.945614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:00.954681 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a4246134-42b9-45ba-b109-ff90e4bf3a31 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1392 microversion: 2.1 time: 0.179999 Aug 24 05:04:00.955305 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3769/7808] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:00 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:01.973512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:01.974308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:01.980159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:01.980865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:01.988825 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:01.989399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:01.990008 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:01.990807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:01.991259 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:01.991808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:02.157569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:02.167315 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63b1e1a9-1414-489f-b39c-57788bdb0b33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1392 microversion: 2.1 time: 0.194089 Aug 24 05:04:02.168370 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4040/7809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:01 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:03.190561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:03.191411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:03.193349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:03.200797 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:03.201608 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:03.202363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.203562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:03.204307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:03.205375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.363247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:03.371575 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f1ce8c22-ff67-4357-bb08-4129298ebb02 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1562 microversion: 2.1 time: 0.185126 Aug 24 05:04:03.372572 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3770/7810] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:03 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:03.394508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:03.395160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:03.403714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:03.404379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:03.404839 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.405773 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:03.406320 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:03.406751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.559227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:03.568298 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-19d99903-cbb5-4a21-85fc-66216d42a670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1562 microversion: 2.1 time: 0.178343 Aug 24 05:04:03.568881 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4041/7811] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:03 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:05.667521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b52d8da8-3819-49fd-9807-1ac4bfeb756a req-585b97f7-f585-48d3-b29d-8c54f598dc08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac46ac80-5d53-4516-9ba1-59bc69aa6df1", "tag": "230f0154-2dc5-40ec-a4c4-97c7fec6a0e4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:05.668315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:05.669012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:05.680042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b52d8da8-3819-49fd-9807-1ac4bfeb756a req-585b97f7-f585-48d3-b29d-8c54f598dc08 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:05.680510 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:05.681136 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b52d8da8-3819-49fd-9807-1ac4bfeb756a req-585b97f7-f585-48d3-b29d-8c54f598dc08 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:05.681266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:05.681651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b52d8da8-3819-49fd-9807-1ac4bfeb756a req-585b97f7-f585-48d3-b29d-8c54f598dc08 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:05.681950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:05.683062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:05.683811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:05.684503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:05.694863 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b52d8da8-3819-49fd-9807-1ac4bfeb756a req-585b97f7-f585-48d3-b29d-8c54f598dc08 service nova] Creating event network-changed:230f0154-2dc5-40ec-a4c4-97c7fec6a0e4 for instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 on n-h1-846470-15 Aug 24 05:04:05.700808 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b52d8da8-3819-49fd-9807-1ac4bfeb756a req-585b97f7-f585-48d3-b29d-8c54f598dc08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037467 Aug 24 05:04:05.701646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4042/7812] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:04:06.223978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:06.233674 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6b8ffe29-cf12-43d5-bc0f-05c12dae3121 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1562 microversion: 2.1 time: 0.572318 Aug 24 05:04:06.244365 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3771/7813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:05 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1562 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:49.620781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:49.621538 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=38 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:49.625879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:04:49.628174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:49.636752 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:49.637228 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:49.637661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:49.638344 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:49.638772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:49.639192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:49.713834 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-32882b75-6a14-4e6b-9074-754e28b218f6 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action" status: 200 len: 24569 microversion: 2.1 time: 0.095618 Aug 24 05:04:49.714521 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4043/7814] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:04:49 2022] POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action => generated 24569 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:05:28.508987 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:28.509839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=42 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:28.515257 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:28.516005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:28.524859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.525375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.525831 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.527205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.527714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.528166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.605681 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ca28e7c-88e5-4b5d-9d47-5b0ea0e5e638 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action" status: 202 len: 0 microversion: 2.1 time: 0.098411 Aug 24 05:05:28.607757 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3772/7815] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:05:28 2022] POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:05:28.618778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:28.619483 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:28.622634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:28.623305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:28.637238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.637717 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.638129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.638845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.639308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.639768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.866429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:28.876342 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4e50750f-78b6-4b95-accb-490596fd531f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1686 microversion: 2.1 time: 0.264793 Aug 24 05:05:28.876916 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4044/7816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:28 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1686 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:29.903583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:29.904458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:29.913247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.913760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.914214 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.914912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.915419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.915913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:30.134473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:30.143756 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f9e7d5ba-e32f-4c16-9b95-fb1949f1453d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1666 microversion: 2.1 time: 0.247477 Aug 24 05:05:30.144471 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3773/7817] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:29 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1666 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:31.245357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:31.248677 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:31.256108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.256595 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.257028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.257791 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.258191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.258606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.331721 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3b7d7a22-68e4-4f07-ad1d-c4157d7e5881 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action" status: 200 len: 32636 microversion: 2.1 time: 0.090011 Aug 24 05:05:31.342099 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4045/7818] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:05:31 2022] POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action => generated 32636 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:05:31.346226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:31.346756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:31.354525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.355064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.356146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.356377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.356835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.357301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.437205 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7cecbba8-dce2-4e20-8c75-da0acdbc5f30 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action" status: 202 len: 0 microversion: 2.1 time: 0.094501 Aug 24 05:05:31.438033 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3774/7819] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:05:31 2022] POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:05:31.448349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:31.449288 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:31.456640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.457698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.458111 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.458817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.459443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.459897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.615410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:31.626935 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c6f85414-7d24-4331-989f-ab8fd454a36e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1673 microversion: 2.1 time: 0.183152 Aug 24 05:05:31.627523 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4046/7820] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:31 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:32.657217 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:32.657945 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:32.672134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.672976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.673731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:32.674965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.675707 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.676441 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:32.827205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:32.836046 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-75ef96b0-c9d7-467c-9427-45355e81095d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1681 microversion: 2.1 time: 0.184883 Aug 24 05:05:32.836635 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3775/7821] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:32 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:32.944662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:32.944662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:32.950996 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.951487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.951955 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:32.952654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.953108 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.953530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:33.020105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0b0b01e0-4e73-49f4-89dd-49603bd1b094 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action" status: 200 len: 38558 microversion: 2.1 time: 0.082985 Aug 24 05:05:33.020826 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4047/7822] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:05:32 2022] POST /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1/action => generated 38558 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:05:34.087655 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:34.088341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:34.092031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-bcc29b99-039f-45a2-add6-48f122ca5b1c req-510782cb-968b-4680-a61d-d915fefa581a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac46ac80-5d53-4516-9ba1-59bc69aa6df1", "tag": "230f0154-2dc5-40ec-a4c4-97c7fec6a0e4"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:34.097165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.097749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.098445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.099244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.099952 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.100488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.105175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bcc29b99-039f-45a2-add6-48f122ca5b1c req-510782cb-968b-4680-a61d-d915fefa581a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.105811 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bcc29b99-039f-45a2-add6-48f122ca5b1c req-510782cb-968b-4680-a61d-d915fefa581a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.106603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bcc29b99-039f-45a2-add6-48f122ca5b1c req-510782cb-968b-4680-a61d-d915fefa581a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.120445 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bcc29b99-039f-45a2-add6-48f122ca5b1c req-510782cb-968b-4680-a61d-d915fefa581a service nova] Creating event network-changed:230f0154-2dc5-40ec-a4c4-97c7fec6a0e4 for instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 on n-h1-846470-15 Aug 24 05:05:34.127298 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-bcc29b99-039f-45a2-add6-48f122ca5b1c req-510782cb-968b-4680-a61d-d915fefa581a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039675 Aug 24 05:05:34.127976 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4048/7823] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:05:34.134350 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:05:34.240213 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c797569-2a2e-4207-921d-780d6afe7036 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 204 len: 0 microversion: 2.1 time: 0.156150 Aug 24 05:05:34.241161 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3776/7824] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:05:34 2022] DELETE /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:05:34.253124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:34.253851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:34.260926 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.261532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.261969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.262676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.263125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.263546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.415329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:34.424574 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e3c49575-b719-4140-9f50-909fe48caea7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1687 microversion: 2.1 time: 0.176035 Aug 24 05:05:34.425129 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4049/7825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:34 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:35.447612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:35.448371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:35.456098 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.456621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.457086 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:35.457824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.458306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.458756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:35.630167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:35.640011 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-35ee6700-9845-4b11-881a-9d308d3689a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1687 microversion: 2.1 time: 0.196673 Aug 24 05:05:35.640822 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3777/7826] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:35 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1687 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:36.662662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:36.663276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:36.670829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:36.671350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:36.671806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:36.672526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:36.672969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:36.673420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:36.859400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:36.868432 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58b8bd77-d2cd-4e56-b84e-da877d3557e9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 200 len: 1568 microversion: 2.1 time: 0.209868 Aug 24 05:05:36.869087 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4050/7827] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:36 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:36.955578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f0901f5c-3688-4ef4-a37d-02b83c17a38f req-df54aa2c-5979-400c-9bbd-677ff5ea3034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac46ac80-5d53-4516-9ba1-59bc69aa6df1", "name": "network-vif-deleted", "tag": "230f0154-2dc5-40ec-a4c4-97c7fec6a0e4"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:36.965953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f0901f5c-3688-4ef4-a37d-02b83c17a38f req-df54aa2c-5979-400c-9bbd-677ff5ea3034 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:36.966457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f0901f5c-3688-4ef4-a37d-02b83c17a38f req-df54aa2c-5979-400c-9bbd-677ff5ea3034 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:36.970535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f0901f5c-3688-4ef4-a37d-02b83c17a38f req-df54aa2c-5979-400c-9bbd-677ff5ea3034 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:36.979719 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f0901f5c-3688-4ef4-a37d-02b83c17a38f req-df54aa2c-5979-400c-9bbd-677ff5ea3034 service nova] Creating event network-vif-deleted:230f0154-2dc5-40ec-a4c4-97c7fec6a0e4 for instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 on n-h1-846470-15 Aug 24 05:05:36.985576 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f0901f5c-3688-4ef4-a37d-02b83c17a38f req-df54aa2c-5979-400c-9bbd-677ff5ea3034 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101116 Aug 24 05:05:36.986240 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3778/7828] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:05:37.891302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:37.892118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: ac46ac80-5d53-4516-9ba1-59bc69aa6df1] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:37.901235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:37.901840 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:37.902592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:37.903306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:37.903793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:37.904299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:37.920921 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] HTTP exception thrown: Instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 could not be found. Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Request method failure captured: Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 HTTP/1.1 Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBbEvKYPgqPxpnDhV9uBDgd7u5XnHcuI2s0cITxqMjgcVtdLn4aQik_-igzwNK5lm0UnILHEc47uOx9o2BaAN-zHWLFXfjLN9jpaY2PSL70mpj9TRhbbTQZOW9GXtF0_9O628MrRRcxXS5Ec1Hp2yb3ADr2wudWoga-fZ4WGyMQkMBWM Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: 0db8e97b2d3b4d9bbbe077307c004ed6 Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 could not be found. Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': 'ac46ac80-5d53-4516-9ba1-59bc69aa6df1'} Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 could not be found. Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 could not be found. Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.922618 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 could not be found. Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Returning 404 to user: Instance ac46ac80-5d53-4516-9ba1-59bc69aa6df1 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-45912ec6-0cfc-48f5-838f-518dbf2bb201 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1" status: 404 len: 111 microversion: 2.1 time: 0.037174 Aug 24 05:05:37.927513 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4051/7829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:37 2022] GET /compute/v2.1/servers/ac46ac80-5d53-4516-9ba1-59bc69aa6df1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:05:41.358591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-724a6a31-b498-4f34-ad62-ae97b9884d38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '.version_select at 0x7f1034382430>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:41.385401 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-724a6a31-b498-4f34-ad62-ae97b9884d38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1502698602" status: 202 len: 0 microversion: 2.1 time: 0.034591 Aug 24 05:05:41.385993 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3779/7830] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 24 05:05:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1502698602 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:05:41.413733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-445cdba7-0ea8-4e33-a912-51fe319659d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: .version_select at 0x7f1021ffce50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1973450736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3idfkKOAxIGU4Kq1o7jnj4lGnAY6fw4Ka3/iO5hZx27DrXY5fk/XOBy3/O/HFI/TuJOAKWOFDvF0RlxcQ3WpGDCjXDYum0N7gp35xiVMpwtzXot25z9+P4ycl3BXe7Tw=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:41.431762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-445cdba7-0ea8-4e33-a912-51fe319659d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:05:41.438285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-445cdba7-0ea8-4e33-a912-51fe319659d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:05:41.464575 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-445cdba7-0ea8-4e33-a912-51fe319659d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055782 Aug 24 05:05:41.465226 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4052/7831] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:05:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:05:48.184002 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1779788445", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "3fe9746d-287a-4664-bb03-d05c0fd03fb5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1973450736", "security_groups": [{"name": "tempest-secgroup-smoke-1898411851"}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:48.195420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:48.321225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] validate_networks() for [('3fe9746d-287a-4664-bb03-d05c0fd03fb5', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:05:48.808837 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:05:48.809365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:05:48.810157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:05:48.810591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:05:48.811189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:05:48.821147 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:48.821768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:48.822229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:48.822976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:48.823891 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:48.824407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:48.845508 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:05:48.852636 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:05:48.872136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:05:48.874704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:05:48.938065 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e88c9853-2e92-4b90-a1b4-b20a0d5d7210 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759112 Aug 24 05:05:48.948910 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3780/7832] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:05:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:05:48.955523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=36 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:48.965019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5e3ce9a0-0d7e-462b-b3f7-bcdd5a72a60d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:48.966883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5e3ce9a0-0d7e-462b-b3f7-bcdd5a72a60d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:49.074271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5e3ce9a0-0d7e-462b-b3f7-bcdd5a72a60d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:49.087092 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5e3ce9a0-0d7e-462b-b3f7-bcdd5a72a60d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1267 microversion: 2.1 time: 0.135129 Aug 24 05:05:49.087505 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4053/7833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:48 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:50.123255 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:50.124280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:50.135166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:50.135814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:50.136782 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:50.137545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:50.137998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:50.138436 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:50.210886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:50.222355 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-833b4fac-317c-41bb-9d55-eab2c2d25284 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1319 microversion: 2.1 time: 0.104059 Aug 24 05:05:50.223030 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3781/7834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:50 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1319 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:51.246754 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:51.247949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:51.266428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:51.266891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:51.267341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:51.268421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:51.268896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:51.274495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:51.445058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:51.462097 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3092f066-a8dc-49d6-82c5-fb0729153746 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.219765 Aug 24 05:05:51.471316 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4054/7835] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:51 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:51.973857 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-945702cc-c313-4b34-92ae-2fbe96555f5a req-63be31e4-8dff-4334-b06b-918e507533c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bce0eb-8c91-4f0e-8baa-88a430dfbd75", "tag": "1755ec92-2470-4ab0-8ca6-6a35eaeae3be"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:51.986878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-945702cc-c313-4b34-92ae-2fbe96555f5a req-63be31e4-8dff-4334-b06b-918e507533c8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:51.987379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-945702cc-c313-4b34-92ae-2fbe96555f5a req-63be31e4-8dff-4334-b06b-918e507533c8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:51.987932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-945702cc-c313-4b34-92ae-2fbe96555f5a req-63be31e4-8dff-4334-b06b-918e507533c8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:52.001235 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-945702cc-c313-4b34-92ae-2fbe96555f5a req-63be31e4-8dff-4334-b06b-918e507533c8 service nova] Creating event network-changed:1755ec92-2470-4ab0-8ca6-6a35eaeae3be for instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 on n-h2-846470-15 Aug 24 05:05:52.009149 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-945702cc-c313-4b34-92ae-2fbe96555f5a req-63be31e4-8dff-4334-b06b-918e507533c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039047 Aug 24 05:05:52.010137 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3782/7836] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:05:52.487432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:52.488061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:52.495732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:52.496241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:52.496728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:52.497611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:52.498194 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:52.498631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:52.648680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:52.658630 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0b50945b-0404-471d-bfe3-d0f9fc3c281c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.175369 Aug 24 05:05:52.659203 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4055/7837] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:52 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:53.683188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:53.683941 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:53.691159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:53.691689 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:53.692148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:53.692878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:53.693364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:53.693799 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:53.840150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:53.848594 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-629c661c-b1fd-46e7-a979-2e2c316959ee tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.170737 Aug 24 05:05:53.849185 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3783/7838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:53 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:54.871383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:54.872072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:54.879545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:54.880078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:54.880520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:54.881235 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:54.881697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:54.882131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:55.026952 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:55.041481 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-35913ac8-055a-479a-be27-997ac3cb94e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.168291 Aug 24 05:05:55.041481 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4056/7839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:54 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:56.057982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:56.058882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:56.070321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.071121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.071883 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.073055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:56.073934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:56.074671 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:56.230554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:56.240844 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5a2b7105-0974-4842-b3e2-5005be3e70dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.186872 Aug 24 05:05:56.241511 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3784/7840] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:56 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:57.272665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:57.273234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:57.281923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:57.282768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:57.283466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:57.284687 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:57.285440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:57.286139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:57.441557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:57.450684 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-88f613eb-7c62-4ffd-a59a-98e848931ba3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.181973 Aug 24 05:05:57.451273 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4057/7841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:57 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:58.473095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:58.473956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:58.481494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:58.482001 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:58.482473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:58.483795 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:58.484180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:58.484626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:58.648288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:58.656771 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1f69e8e6-5b98-4921-b819-fb95af38355a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.187977 Aug 24 05:05:58.657371 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3785/7842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:58 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:59.683874 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:59.684983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:59.689575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:59.691171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:59.699082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.699556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.700019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:59.700748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.701186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.701613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:59.866303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:59.875112 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-362a8954-7034-4516-8853-7109d83ea14b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.197755 Aug 24 05:05:59.875733 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4058/7843] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:59 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:59.904075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:59.905019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:59.976914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c5fe266a-17c9-4bd4-878d-a898e775b74d req-94ed3614-9a82-471d-9f6a-11bb9090e82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bce0eb-8c91-4f0e-8baa-88a430dfbd75", "name": "network-vif-plugged", "status": "completed", "tag": "1755ec92-2470-4ab0-8ca6-6a35eaeae3be"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:05:59.982304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:59.989781 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5fe266a-17c9-4bd4-878d-a898e775b74d req-94ed3614-9a82-471d-9f6a-11bb9090e82a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:59.990281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5fe266a-17c9-4bd4-878d-a898e775b74d req-94ed3614-9a82-471d-9f6a-11bb9090e82a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:59.990982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c5fe266a-17c9-4bd4-878d-a898e775b74d req-94ed3614-9a82-471d-9f6a-11bb9090e82a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:00.004579 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c5fe266a-17c9-4bd4-878d-a898e775b74d req-94ed3614-9a82-471d-9f6a-11bb9090e82a service nova] Creating event network-vif-plugged:1755ec92-2470-4ab0-8ca6-6a35eaeae3be for instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 on n-h2-846470-15 Aug 24 05:06:00.009910 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c5fe266a-17c9-4bd4-878d-a898e775b74d req-94ed3614-9a82-471d-9f6a-11bb9090e82a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110867 Aug 24 05:06:00.010516 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3786/7844] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:00.897029 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:00.897749 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:00.905527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:00.906009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:00.906440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:00.907142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:00.907589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:00.908044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:01.063068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:01.072062 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-06b3c395-5ade-4fae-8862-29f49f4accb8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1393 microversion: 2.1 time: 0.179265 Aug 24 05:06:01.072833 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4059/7845] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:06:00 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:02.098755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:02.099516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:02.109917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:02.110407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:02.110863 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:02.111599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:02.112110 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:02.112555 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:02.601723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:02.611126 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2a31f5b6-8c39-4ef7-929b-a00079a6fed9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1566 microversion: 2.1 time: 0.519116 Aug 24 05:06:02.611965 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3787/7846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:06:02 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1566 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:02.632127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:02.632762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:02.640516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:02.640992 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:02.641453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:02.642169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:02.642623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:02.643046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:02.793896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:02.806181 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-001bb901-115b-4097-983f-bff6accbba04 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1566 microversion: 2.1 time: 0.177755 Aug 24 05:06:02.807232 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4060/7847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:06:02 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:04.605404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-27cbdc78-755a-40ba-aeea-5ec27ef5be98 req-53c68cbf-72c0-4c0e-87ce-cb5a0deac0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bce0eb-8c91-4f0e-8baa-88a430dfbd75", "tag": "1755ec92-2470-4ab0-8ca6-6a35eaeae3be"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:04.606687 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:06:04.608471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:04.618895 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-27cbdc78-755a-40ba-aeea-5ec27ef5be98 req-53c68cbf-72c0-4c0e-87ce-cb5a0deac0af service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.619478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-27cbdc78-755a-40ba-aeea-5ec27ef5be98 req-53c68cbf-72c0-4c0e-87ce-cb5a0deac0af service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.620113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.620269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-27cbdc78-755a-40ba-aeea-5ec27ef5be98 req-53c68cbf-72c0-4c0e-87ce-cb5a0deac0af service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.620905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.621613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.622907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:04.623686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:04.624404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:04.634279 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-27cbdc78-755a-40ba-aeea-5ec27ef5be98 req-53c68cbf-72c0-4c0e-87ce-cb5a0deac0af service nova] Creating event network-changed:1755ec92-2470-4ab0-8ca6-6a35eaeae3be for instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 on n-h2-846470-15 Aug 24 05:06:04.640401 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-27cbdc78-755a-40ba-aeea-5ec27ef5be98 req-53c68cbf-72c0-4c0e-87ce-cb5a0deac0af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038651 Aug 24 05:06:04.641311 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4061/7848] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:06:04.876422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:06:04.886286 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45d33908-a049-4edf-8e29-89bfb3a7958b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1566 microversion: 2.1 time: 0.286172 Aug 24 05:06:04.892076 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3788/7849] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:06:04 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:06:14.339479 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:06:14.339479 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:06:40.206957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=7 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:40.208143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=44 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:40.213579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:06:40.216028 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:06:40.225006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:40.225527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:40.225920 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:40.226669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:06:40.227128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:06:40.227559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:06:40.281361 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3fa091d2-b518-49e0-9992-16ebcfb19174 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75/action" status: 200 len: 24572 microversion: 2.1 time: 0.078187 Aug 24 05:06:40.282040 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4062/7850] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:06:40 2022] POST /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:07:19.044880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=5 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:19.045984 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=42 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:19.050494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:07:19.053013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:19.060330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:19.060917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:19.061374 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:19.062108 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:19.062592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:19.063046 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:19.148280 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-888f3b17-1b6e-4803-b1f1-24622e2367c1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75/action" status: 202 len: 0 microversion: 2.1 time: 0.104999 Aug 24 05:07:19.148955 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3789/7851] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:07:19 2022] POST /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:07:19.159176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:19.160109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:19.166740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:19.167518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:19.171409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:19.172014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:19.172793 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:19.173829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:19.174409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:19.175234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:19.325768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:19.335130 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7592b6c1-5e0e-4b1d-acc5-b1f83d55b9dd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1677 microversion: 2.1 time: 0.180414 Aug 24 05:07:19.335770 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4063/7852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:19 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:20.360078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:20.360678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:20.368834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:20.369348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:20.369807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:20.370540 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:20.371016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:20.371494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:20.523460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:20.534360 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cc3f799b-18ea-4292-81d8-16b2c05ea7ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.178761 Aug 24 05:07:20.534953 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3790/7853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:20 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:21.557089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:21.557725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:21.566177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:21.566665 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:21.567104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:21.567850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:21.568356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:21.568758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:21.718301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:21.726551 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da5c9ff4-5b76-42f8-a23a-c1e68561b5fc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.173542 Aug 24 05:07:21.727132 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4064/7854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:21 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:22.748963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:22.749556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:22.756961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:22.757475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:22.757931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:22.758656 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:22.759132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:22.759580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:22.911955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:22.921125 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-415d8cc8-cbce-4cfc-a9d3-ca70e79b5c27 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.176343 Aug 24 05:07:22.921989 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3791/7855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:22 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:23.948458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:23.949038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:23.960432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:23.961239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:23.961961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:23.962989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:23.964190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:23.964798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:24.113089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:24.121213 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5fc5722c-d78a-4a35-b8b8-ce7983ea1e62 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.179492 Aug 24 05:07:24.121794 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4065/7856] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:23 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:25.144204 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:25.145345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:25.152822 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:25.153337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:25.154157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:25.154953 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:25.155430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:25.155911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:25.291557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:25.300543 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f22f8115-46f8-49fa-8b0f-a2317e09d7de tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.160510 Aug 24 05:07:25.301297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3792/7857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:25 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:26.324131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:26.324814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:26.332701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:26.333196 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:26.333639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:26.334351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:26.334815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:26.335247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:26.479452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:26.487933 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-db499467-130e-4aee-ae39-6f5c334524ab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.167741 Aug 24 05:07:26.488470 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4066/7858] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:26 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:27.513709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:27.514758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:27.522703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.523273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.523882 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.524630 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:27.525100 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:27.525594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:27.684944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:27.693300 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-07820277-14da-405a-90b3-8eaa3f7ce419 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.186562 Aug 24 05:07:27.693950 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3793/7859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:27 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:28.720858 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:28.721498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:28.728890 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:28.729379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:28.729812 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:28.730504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:28.730988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:28.731413 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:28.869555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:28.877918 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9acc8267-6065-4c88-94a8-cdb3fac3b5b2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.161039 Aug 24 05:07:28.878501 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4067/7860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:28 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:29.900989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:29.901629 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:29.908849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:29.909357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:29.909811 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:29.910558 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:29.911027 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:29.911492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:30.046878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:30.054998 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cd34918a-0498-4f6f-9e20-51e037b0a227 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.158259 Aug 24 05:07:30.055587 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3794/7861] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:29 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:31.079087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:31.079650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:31.087304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:31.087831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:31.088265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:31.088969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:31.089424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:31.089846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:31.238582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:31.246685 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-003852c8-ca44-4249-89b8-f46aa1e253b5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.172502 Aug 24 05:07:31.247242 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4068/7862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:31 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:32.272077 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:32.272700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:32.280512 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:32.281037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:32.281513 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:32.282237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:32.282718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:32.283172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:32.422083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:32.430850 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-54f62af6-c567-4f88-a13a-df9984e4de79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.162824 Aug 24 05:07:32.431550 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3795/7863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:32 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:33.455580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:33.456208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:33.462918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:33.463408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:33.463884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:33.464583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:33.465037 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:33.465457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:33.608105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:33.616272 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b655e62b-fd01-4f7a-ae8d-49f331a7c275 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.166391 Aug 24 05:07:33.616858 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4069/7864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:33 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:34.639073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:34.639813 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:34.647240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:34.647772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:34.648224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:34.648936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:34.649407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:34.649850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:34.788992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:34.797255 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bffbfd3c-b9b7-4773-b146-331b9771bd13 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1682 microversion: 2.1 time: 0.162470 Aug 24 05:07:34.797963 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3796/7865] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:34 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:35.819003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:07:35.819719 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:07:35.827115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:35.827601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:35.828069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:35.828772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:07:35.829221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:07:35.829656 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:07:35.972370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:07:35.980588 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fadd95cf-889f-4abd-b293-97d0cbb18eab tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1685 microversion: 2.1 time: 0.165651 Aug 24 05:07:35.981317 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4070/7866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:07:35 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:07:54.343649 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:07:54.344701 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:08:04.439406 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:08:04.439406 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:08:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:08:10.230393 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:10.232621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:10.234989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=16 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:10.235692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:10.242083 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:10.242590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:10.243038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:10.243780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:10.244246 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:10.244680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:10.305390 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4e8313b4-6198-4fd5-9fb9-ef654f2dccd0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75/action" status: 200 len: 69081 microversion: 2.1 time: 0.078975 Aug 24 05:08:10.306086 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3797/7867] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:08:10 2022] POST /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75/action => generated 69081 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:08:34.307251 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-d7337a58-b3e5-4915-b7bc-ae225c94c7a0 req-f81be85e-011b-4513-a7cf-1e08545b360c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bce0eb-8c91-4f0e-8baa-88a430dfbd75", "tag": "1755ec92-2470-4ab0-8ca6-6a35eaeae3be"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:34.311303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:34.312215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:34.314700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=16 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:34.315623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=48 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:34.324740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:34.325562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:34.325946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.326515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.326950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.327712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.328394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.328841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.331444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d7337a58-b3e5-4915-b7bc-ae225c94c7a0 req-f81be85e-011b-4513-a7cf-1e08545b360c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.332052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d7337a58-b3e5-4915-b7bc-ae225c94c7a0 req-f81be85e-011b-4513-a7cf-1e08545b360c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.332556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-d7337a58-b3e5-4915-b7bc-ae225c94c7a0 req-f81be85e-011b-4513-a7cf-1e08545b360c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.348689 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-d7337a58-b3e5-4915-b7bc-ae225c94c7a0 req-f81be85e-011b-4513-a7cf-1e08545b360c service nova] Creating event network-changed:1755ec92-2470-4ab0-8ca6-6a35eaeae3be for instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 on n-h2-846470-15 Aug 24 05:08:34.352099 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-d7337a58-b3e5-4915-b7bc-ae225c94c7a0 req-f81be85e-011b-4513-a7cf-1e08545b360c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049128 Aug 24 05:08:34.353225 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3798/7868] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:34.358925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:08:34.471924 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6200de3e-f0a6-43f4-b25f-b2315bd3584a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 204 len: 0 microversion: 2.1 time: 0.170198 Aug 24 05:08:34.473288 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4071/7869] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:08:34 2022] DELETE /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:08:34.485281 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:34.486207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:34.494060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.494844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.495503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.496290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:34.496777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:34.497222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:34.664269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:34.678328 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bf7e13e0-88a2-4877-837c-0250efc05c51 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1691 microversion: 2.1 time: 0.199417 Aug 24 05:08:34.679392 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3799/7870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:34 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:08:35.703877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:35.704691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:35.713167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.713660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.714099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.714809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.715267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.715704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.861631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:35.869692 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7514f967-249f-4edf-a3e3-a8b205c93307 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1691 microversion: 2.1 time: 0.171109 Aug 24 05:08:35.870271 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4072/7871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:35 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:36.618390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-1b71e70f-0c3d-4f36-9886-36459bb1fb4a req-8b251a94-62a1-42e1-971d-df99c562bedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bce0eb-8c91-4f0e-8baa-88a430dfbd75", "name": "network-vif-deleted", "tag": "1755ec92-2470-4ab0-8ca6-6a35eaeae3be"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:36.629998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1b71e70f-0c3d-4f36-9886-36459bb1fb4a req-8b251a94-62a1-42e1-971d-df99c562bedd service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:36.630509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1b71e70f-0c3d-4f36-9886-36459bb1fb4a req-8b251a94-62a1-42e1-971d-df99c562bedd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:36.630981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-1b71e70f-0c3d-4f36-9886-36459bb1fb4a req-8b251a94-62a1-42e1-971d-df99c562bedd service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:36.643959 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-1b71e70f-0c3d-4f36-9886-36459bb1fb4a req-8b251a94-62a1-42e1-971d-df99c562bedd service nova] Creating event network-vif-deleted:1755ec92-2470-4ab0-8ca6-6a35eaeae3be for instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 on n-h2-846470-15 Aug 24 05:08:36.649229 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-1b71e70f-0c3d-4f36-9886-36459bb1fb4a req-8b251a94-62a1-42e1-971d-df99c562bedd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034868 Aug 24 05:08:36.650748 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3800/7872] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:36.887217 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:08:36.887439 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:08:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:08:36.894699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:36.895481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:36.903144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:36.903883 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:36.904393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:36.905202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:36.905972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:36.906718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:36.948555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:36.949142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:36.949585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:36.950040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lazy-loading 'fault' on Instance uuid 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:08:37.000805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:37.014396 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e33feaa8-ff22-402b-9de2-2ae4c4c56ddb tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 200 len: 1357 microversion: 2.1 time: 0.125909 Aug 24 05:08:37.015282 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4073/7873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:36 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 1357 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:38.042009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:38.043066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 00bce0eb-8c91-4f0e-8baa-88a430dfbd75] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:38.052511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:38.053025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:38.053522 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:38.054245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:38.054698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:38.055179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:38.069226 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] HTTP exception thrown: Instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 could not be found. Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Request method failure captured: Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 HTTP/1.1 Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBbEvKYPgqPxpnDhV9uBDgd7u5XnHcuI2s0cITxqMjgcVtdLn4aQik_-igzwNK5lm0UnILHEc47uOx9o2BaAN-zHWLFXfjLN9jpaY2PSL70mpj9TRhbbTQZOW9GXtF0_9O628MrRRcxXS5Ec1Hp2yb3ADr2wudWoga-fZ4WGyMQkMBWM Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0db8e97b2d3b4d9bbbe077307c004ed6 Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 could not be found. Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '00bce0eb-8c91-4f0e-8baa-88a430dfbd75'} Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 could not be found. Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 could not be found. Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:08:38.070961 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 could not be found. Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Returning 404 to user: Instance 00bce0eb-8c91-4f0e-8baa-88a430dfbd75 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67583ba3-6301-43f8-8858-44e86d38eb06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75" status: 404 len: 111 microversion: 2.1 time: 0.037977 Aug 24 05:08:38.075816 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3801/7874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:38 2022] GET /compute/v2.1/servers/00bce0eb-8c91-4f0e-8baa-88a430dfbd75 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:08:41.634402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a36c3459-38e2-496c-b876-473ebc1e8cfc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '.version_select at 0x7f1021eff790>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:41.673560 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a36c3459-38e2-496c-b876-473ebc1e8cfc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1973450736" status: 202 len: 0 microversion: 2.1 time: 0.043341 Aug 24 05:08:41.674095 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4074/7875] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 24 05:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1973450736 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:08:41.711562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84e6cbd7-2dea-40d6-9558-d04c1ba3afe2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: .version_select at 0x7f103424b040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1304213084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKch4OkkvGveokKHaKfpCtufBeWVZR2Tu410NOYJ3cnosvG7WpNW8jAt5QIaVAmaFwQ+mUe/BWcZDn77iZp+eCjmZ+jXK8vAsAH1LA/pCa3jwgiTjIWwkwn16+mwQSGKQ=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:41.729754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-84e6cbd7-2dea-40d6-9558-d04c1ba3afe2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:08:41.735233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-84e6cbd7-2dea-40d6-9558-d04c1ba3afe2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:08:41.769047 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84e6cbd7-2dea-40d6-9558-d04c1ba3afe2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063867 Aug 24 05:08:41.769665 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3802/7876] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:08:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:08:47.452686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1152179732", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "1499de4b-5142-4a31-a372-07c31b0a6058"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1304213084", "security_groups": [{"name": "tempest-secgroup-smoke-954773068"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:47.483638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:47.599769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] validate_networks() for [('1499de4b-5142-4a31-a372-07c31b0a6058', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:08:48.104024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:08:48.104439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:08:48.104919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:08:48.105325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:08:48.105747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:08:48.118165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:48.118659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:48.119100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:48.119879 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:48.120335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:48.120760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:48.145528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:08:48.151497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:08:48.170691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:08:48.173586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:08:48.230508 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-98084de6-704d-442a-98bc-524c9710dc60 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.781791 Aug 24 05:08:48.231486 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4075/7877] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:08:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:08:48.240612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=12 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:48.245290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-febee057-6dd5-446d-8c4d-bccba21dd857 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:48.245934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-febee057-6dd5-446d-8c4d-bccba21dd857 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:48.324535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-febee057-6dd5-446d-8c4d-bccba21dd857 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:48.342975 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-febee057-6dd5-446d-8c4d-bccba21dd857 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1267 microversion: 2.1 time: 0.103954 Aug 24 05:08:48.356623 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3803/7878] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:48 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:49.367096 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:49.367985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:49.392052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:49.393520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:49.394591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:49.395877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:49.396585 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:49.397335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:49.508676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:49.523288 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b93a7f71-b9ae-4148-bc69-3dbca4369d63 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1319 microversion: 2.1 time: 0.158814 Aug 24 05:08:49.524294 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4076/7879] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:49 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:50.548337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:50.549694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:50.562912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:50.563485 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:50.564047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:50.564802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:50.565278 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:50.565721 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:50.817266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:50.826461 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4e3026b-0dc2-43c3-8d2f-eaffadad4593 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.282259 Aug 24 05:08:50.827069 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3804/7880] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:50 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:51.302552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f6504c33-9de5-408e-b2b4-050864a2f35b req-9faf1970-477f-4ca1-9621-669faaf1df01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec4c169-ab4f-42bc-aa70-009b3f54907a", "tag": "2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:51.332872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f6504c33-9de5-408e-b2b4-050864a2f35b req-9faf1970-477f-4ca1-9621-669faaf1df01 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:51.333512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f6504c33-9de5-408e-b2b4-050864a2f35b req-9faf1970-477f-4ca1-9621-669faaf1df01 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:51.334016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f6504c33-9de5-408e-b2b4-050864a2f35b req-9faf1970-477f-4ca1-9621-669faaf1df01 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:51.350349 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f6504c33-9de5-408e-b2b4-050864a2f35b req-9faf1970-477f-4ca1-9621-669faaf1df01 service nova] Creating event network-changed:2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98 for instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a on n-h1-846470-15 Aug 24 05:08:51.357583 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f6504c33-9de5-408e-b2b4-050864a2f35b req-9faf1970-477f-4ca1-9621-669faaf1df01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058702 Aug 24 05:08:51.359400 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4077/7881] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:08:51.850364 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:51.851121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:51.858708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:51.859234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:51.859968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:51.860584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:51.861063 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:51.861534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:52.196346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:52.204633 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ba92296-0e77-421a-a9fa-bf34df33909d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.358543 Aug 24 05:08:52.205598 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3805/7882] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:51 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:53.227172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:53.228013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:53.235247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:53.235863 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:53.236409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:53.237183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:53.237691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:53.238230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:53.389034 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:53.397543 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e96e56b9-4aae-4c7c-a967-c5b81a34bb5e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.175731 Aug 24 05:08:53.398136 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4078/7883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:53 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:54.419206 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:54.419818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:54.427336 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:54.427870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:54.428323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:54.429038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:54.429501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:54.429939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:54.613873 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:54.622801 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3983211a-b38a-40c7-bff1-b3824e14447c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.207611 Aug 24 05:08:54.623401 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3806/7884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:54 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:55.644845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:55.645428 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:55.652766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:55.653264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:55.653713 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:55.654787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:55.655254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:55.655692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:55.819481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:55.827544 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b04984b-a378-4e13-902b-1709c94002a8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.186736 Aug 24 05:08:55.828466 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4079/7885] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:55 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:56.863222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:56.863858 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:56.871386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:56.871931 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:56.872387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:56.873111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:56.873589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:56.874038 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:57.025081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:57.033524 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c811d130-0968-4552-a446-e635261703f0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.174546 Aug 24 05:08:57.034109 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3807/7886] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:56 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:58.054066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:58.054631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:58.062066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:58.062830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:58.063226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:58.063966 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:58.064424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:58.064877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:58.128279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:58.161260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:58.207765 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:58.215587 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-80809821-b689-4913-a3d6-5cab9f314448 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.165547 Aug 24 05:08:58.216251 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4080/7887] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:58 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:59.239222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:59.239864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:59.242414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:59.250821 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:59.251319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:59.251819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:59.252556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:59.253028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:59.253477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:59.409029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:59.419130 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bb1dd465-1034-4e36-9e86-fb1935fe71fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.184475 Aug 24 05:08:59.419720 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3808/7888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:59 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:59.917963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-17b93baa-6c2d-47bb-a285-5b70098b9237 req-70d0f466-1166-475b-8790-95b79e07d9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec4c169-ab4f-42bc-aa70-009b3f54907a", "name": "network-vif-plugged", "status": "completed", "tag": "2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:08:59.935295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17b93baa-6c2d-47bb-a285-5b70098b9237 req-70d0f466-1166-475b-8790-95b79e07d9d5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:59.935813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17b93baa-6c2d-47bb-a285-5b70098b9237 req-70d0f466-1166-475b-8790-95b79e07d9d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:59.936250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-17b93baa-6c2d-47bb-a285-5b70098b9237 req-70d0f466-1166-475b-8790-95b79e07d9d5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:59.949168 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-17b93baa-6c2d-47bb-a285-5b70098b9237 req-70d0f466-1166-475b-8790-95b79e07d9d5 service nova] Creating event network-vif-plugged:2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98 for instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a on n-h1-846470-15 Aug 24 05:08:59.954580 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-17b93baa-6c2d-47bb-a285-5b70098b9237 req-70d0f466-1166-475b-8790-95b79e07d9d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040654 Aug 24 05:08:59.955913 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4081/7889] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:09:00.441682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:00.442304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:00.449482 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:00.449992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:00.450471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:00.451192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:00.451694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:00.452155 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:00.594506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:00.602895 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c9ae40f3-88f8-43fa-b211-c29610950c99 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1392 microversion: 2.1 time: 0.166204 Aug 24 05:09:00.603479 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3809/7890] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:09:00 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:01.628593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:01.629565 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:01.640379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:01.641018 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:01.641470 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:01.642168 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:01.642615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:01.643036 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:01.790503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:01.799873 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-89f3d41e-2af8-43a8-ae3e-4b0d54cdb5d5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1562 microversion: 2.1 time: 0.178095 Aug 24 05:09:01.800465 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4082/7891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:09:01 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:09:01.820919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:01.821556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:01.829645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:01.830499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:01.830967 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:01.831740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:01.832218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:01.832659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:01.980419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:01.989683 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-577d289b-0d8a-4d59-88d7-b37d489923e1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1562 microversion: 2.1 time: 0.172840 Aug 24 05:09:01.990279 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3810/7892] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:09:01 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:03.754090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:09:03.755529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:03.757729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-57bd2744-326f-4345-a5ee-7f4b5140536a req-660e96c3-164d-4e19-aa6e-7d18dddb46bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec4c169-ab4f-42bc-aa70-009b3f54907a", "tag": "2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:03.765598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:03.766293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:03.767024 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:03.767860 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:03.768389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:03.769053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:03.770461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-57bd2744-326f-4345-a5ee-7f4b5140536a req-660e96c3-164d-4e19-aa6e-7d18dddb46bf service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:03.770958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-57bd2744-326f-4345-a5ee-7f4b5140536a req-660e96c3-164d-4e19-aa6e-7d18dddb46bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:03.771403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-57bd2744-326f-4345-a5ee-7f4b5140536a req-660e96c3-164d-4e19-aa6e-7d18dddb46bf service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:03.784818 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-57bd2744-326f-4345-a5ee-7f4b5140536a req-660e96c3-164d-4e19-aa6e-7d18dddb46bf service nova] Creating event network-changed:2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98 for instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a on n-h1-846470-15 Aug 24 05:09:03.792653 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-57bd2744-326f-4345-a5ee-7f4b5140536a req-660e96c3-164d-4e19-aa6e-7d18dddb46bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039207 Aug 24 05:09:03.793265 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3811/7893] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:09:03.927495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:09:03.936061 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b561cc23-3990-4ada-ab7a-c6004c93efb1 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1562 microversion: 2.1 time: 0.185957 Aug 24 05:09:03.936672 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4083/7894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:09:03 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:09:43.293109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:43.293954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=44 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:43.300020 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:09:43.302359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:09:43.310803 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:43.311311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:43.311808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:43.312535 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:09:43.313005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:09:43.313493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:09:43.389350 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1c25bbf9-2b2d-43e9-aac0-19daeba4e969 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a/action" status: 200 len: 24572 microversion: 2.1 time: 0.099488 Aug 24 05:09:43.389953 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3812/7895] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:09:43 2022] POST /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a/action => generated 24572 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:10:22.378175 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:22.379545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=42 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:22.386635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:22.389318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:22.397493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:22.398006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:22.398439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:22.399157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:22.399616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:22.400147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:22.451261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:22.459044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Old instance type m1.heat2, new instance type m1.heat {{(pid=122536) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 05:10:22.466477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:10:22.466887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:10:22.467353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:10:22.467797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:10:22.468434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:10:22.544153 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-aad909f6-e8b1-4691-8ca9-16983f751a98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a/action" status: 202 len: 0 microversion: 2.1 time: 0.169418 Aug 24 05:10:22.545396 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4084/7896] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:10:22 2022] POST /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:10:22.555935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:22.556884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:22.559840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:22.560491 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:22.569912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:22.570845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:22.571504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:22.572277 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:22.572760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:22.573218 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:22.759993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:22.772084 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c5e03f9c-b106-4daf-89df-0871ba264c55 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1690 microversion: 2.1 time: 0.221652 Aug 24 05:10:22.772839 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3813/7897] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:22 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:10:23.799536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:23.800486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:23.808281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:23.808872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:23.809357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:23.810189 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:23.810730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:23.811103 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:23.978901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:23.988391 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9a8c20a7-91b3-41cb-88d1-b506b24f47fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1690 microversion: 2.1 time: 0.194608 Aug 24 05:10:23.989015 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4085/7898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:23 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:25.017290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:25.017917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:25.025506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:25.026025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:25.026478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:25.027210 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:25.027702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:25.028228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:25.192294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:25.201211 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3f2b7378-ac8c-4ca6-b94c-ee0813c8d780 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.187872 Aug 24 05:10:25.202061 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3814/7899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:25 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:26.228131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:26.229143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:26.237748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:26.238389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:26.238828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:26.239540 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:26.240035 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:26.240464 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:26.388684 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:26.397170 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4339bf26-c804-47d2-af1a-ca2f6e211eaf tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.175957 Aug 24 05:10:26.397750 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4086/7900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:26 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:27.420474 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:27.421068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:27.429354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:27.429872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:27.430330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:27.431067 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:27.431536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:27.432010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:27.570892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:27.579858 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-413d4320-b15a-40f9-ad56-9ad6ea3b65fe tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.163450 Aug 24 05:10:27.580773 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3815/7901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:27 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:28.602528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:28.603167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:28.611178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:28.611708 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:28.612134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:28.612900 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:28.613313 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:28.613746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:28.755957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:28.764302 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fb4bfe7c-e66e-4f3e-b443-0baa66767364 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.165717 Aug 24 05:10:28.764884 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4087/7902] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:28 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:29.787719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:29.788340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:29.795167 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:29.795697 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:29.796142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:29.796885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:29.797352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:29.797786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:29.996347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:30.005996 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6d59b8ad-aa37-4f76-a6c0-1bcdf00f3796 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.222579 Aug 24 05:10:30.006613 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3816/7903] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:29 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:31.028678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:31.029308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:31.036893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.037383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.037820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.038517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:31.038975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:31.039404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:31.228080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:31.236443 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9672404f-afa5-4de7-9ea6-c75be6e81bfd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.211706 Aug 24 05:10:31.236991 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4088/7904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:31 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:32.259052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:32.259740 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:32.267390 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:32.267902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:32.268428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:32.269321 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:32.269613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:32.270056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:32.405764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:32.414946 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b27e7d89-94a8-4811-bb19-1d70253d4708 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.160256 Aug 24 05:10:32.415583 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3817/7905] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:32 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:33.442690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:33.443559 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:33.458919 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.459758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.460006 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.460981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:33.461586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:33.462009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:33.609898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:33.619397 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cebfb4db-ae7f-493f-83c9-58342fa82b38 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.184322 Aug 24 05:10:33.620408 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4089/7906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:33 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:34.641280 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:34.642023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:34.650051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:34.650574 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:34.651043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:34.651804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:34.652290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:34.652744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:34.788948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:34.797438 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3a0a79df-b856-47de-a673-024bdfed4057 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.160252 Aug 24 05:10:34.798032 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3818/7907] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:34 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:35.820059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:35.820918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:35.829942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:35.830794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:35.831263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:35.832005 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:35.832489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:35.832974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:35.987712 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:35.999860 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bcd8659d-118f-4282-a63f-d7be14c48dd3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1695 microversion: 2.1 time: 0.184068 Aug 24 05:10:36.000759 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4090/7908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:35 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:37.023468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.024190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.031763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.032288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.032749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.033489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.033971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.034422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.280805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:37.294750 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-485452b3-336c-4865-9daa-cf9c9a094f7b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1694 microversion: 2.1 time: 0.275579 Aug 24 05:10:37.295367 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3819/7909] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:37.673612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-b9c53951-ca98-4a35-bcaf-99c4c09c0054 req-ff6b690b-b124-4a8c-bbda-de521fdd87d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec4c169-ab4f-42bc-aa70-009b3f54907a", "name": "network-vif-unplugged", "status": "completed", "tag": "2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:37.684174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b9c53951-ca98-4a35-bcaf-99c4c09c0054 req-ff6b690b-b124-4a8c-bbda-de521fdd87d6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.684672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b9c53951-ca98-4a35-bcaf-99c4c09c0054 req-ff6b690b-b124-4a8c-bbda-de521fdd87d6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.685110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-b9c53951-ca98-4a35-bcaf-99c4c09c0054 req-ff6b690b-b124-4a8c-bbda-de521fdd87d6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.698802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-b9c53951-ca98-4a35-bcaf-99c4c09c0054 req-ff6b690b-b124-4a8c-bbda-de521fdd87d6 service nova] Creating event network-vif-unplugged:2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98 for instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a on n-h2-846470-15 Aug 24 05:10:37.706553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [req-b9c53951-ca98-4a35-bcaf-99c4c09c0054 req-ff6b690b-b124-4a8c-bbda-de521fdd87d6 service nova] Instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122536) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 05:10:37.720219 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-b9c53951-ca98-4a35-bcaf-99c4c09c0054 req-ff6b690b-b124-4a8c-bbda-de521fdd87d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125192 Aug 24 05:10:37.720912 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4091/7910] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:38.318634 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:38.319323 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:38.327736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.328267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.328752 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.329618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.330235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.330959 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.590105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:38.599322 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f933a13a-feda-49b7-a806-6419d7d688d8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1694 microversion: 2.1 time: 0.284880 Aug 24 05:10:38.599942 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3820/7911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:38 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1694 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:39.622690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:39.623466 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:39.630328 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.630815 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.631258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.632012 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.632433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.632873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.777792 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:39.786392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5e2a296-94f0-4d8e-a491-a6f117878ac8 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1692 microversion: 2.1 time: 0.168918 Aug 24 05:10:39.787035 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4092/7912] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:39 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:39.997142 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-60ac3b0d-acd9-4e58-9643-4be24d35bc7c req-a371e05e-b022-494d-9646-f078b67337e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec4c169-ab4f-42bc-aa70-009b3f54907a", "tag": "2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:40.008471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-60ac3b0d-acd9-4e58-9643-4be24d35bc7c req-a371e05e-b022-494d-9646-f078b67337e5 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.008971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-60ac3b0d-acd9-4e58-9643-4be24d35bc7c req-a371e05e-b022-494d-9646-f078b67337e5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.009423 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-60ac3b0d-acd9-4e58-9643-4be24d35bc7c req-a371e05e-b022-494d-9646-f078b67337e5 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.022097 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-60ac3b0d-acd9-4e58-9643-4be24d35bc7c req-a371e05e-b022-494d-9646-f078b67337e5 service nova] Creating event network-changed:2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98 for instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a on n-h2-846470-15 Aug 24 05:10:40.028127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [req-60ac3b0d-acd9-4e58-9643-4be24d35bc7c req-a371e05e-b022-494d-9646-f078b67337e5 service nova] Instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846470-15', 'n-h2-846470-15'} {{(pid=122535) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 05:10:40.040040 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-60ac3b0d-acd9-4e58-9643-4be24d35bc7c req-a371e05e-b022-494d-9646-f078b67337e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046602 Aug 24 05:10:40.040681 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3821/7913] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:40.808338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:40.808984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:40.816302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.817013 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.817930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.818636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.819090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.819505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.959990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:40.968529 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72930131-ab6a-4858-baf1-cf8a3717a6a9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1692 microversion: 2.1 time: 0.164366 Aug 24 05:10:40.969078 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4093/7914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:40 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:41.993648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:41.994579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:42.003123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:42.003688 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:42.004301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.005043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:42.005667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:42.006117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.157259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:42.166807 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-57a0c3dd-dd93-4259-ae72-9b995e2f5956 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1692 microversion: 2.1 time: 0.179195 Aug 24 05:10:42.167701 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3822/7915] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:41 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:43.191589 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:43.192226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:43.199781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.200304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.200748 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.201460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.201904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.202345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.352296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:43.360917 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2cba3811-1bda-4bba-ac89-9812805d72e3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1689 microversion: 2.1 time: 0.173183 Aug 24 05:10:43.361487 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4094/7916] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:43 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:43.383854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:43.384511 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:43.392054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.392570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.393023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.393772 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.394229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.394704 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.465059 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-292709cb-8d11-45de-b9d7-019fbbbb8915 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a/action" status: 204 len: 0 microversion: 2.1 time: 0.085481 Aug 24 05:10:43.465861 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3823/7917] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:10:43 2022] POST /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:10:43.474495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:43.475193 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:43.491780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.492297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.492797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.493526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.494038 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.494471 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.654020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:43.662142 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a2edd6a4-0667-459a-96f8-c65263f34682 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1689 microversion: 2.1 time: 0.191850 Aug 24 05:10:43.662913 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4095/7918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:43 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:43.682968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:43.683763 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:43.690213 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.690718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.691172 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.692023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.692501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.693010 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.933324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:43.941939 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3c2bb9f2-2828-4492-b252-1c19fce6a929 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1689 microversion: 2.1 time: 0.263134 Aug 24 05:10:43.942909 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3824/7919] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:43 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:44.964668 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:44.965300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:44.974782 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.975283 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.975790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.976509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.976972 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.977402 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.119569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:45.127758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-96299143-b753-45c6-96d1-0b5cf6a12a6a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1681 microversion: 2.1 time: 0.167042 Aug 24 05:10:45.128312 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4096/7920] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:44 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:45.351748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ab24cf4c-94b4-4ccf-a31e-1198af3b8cad req-06d2990d-e7d2-42a6-8181-20a664e0de29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec4c169-ab4f-42bc-aa70-009b3f54907a", "name": "network-vif-plugged", "status": "completed", "tag": "2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:45.365898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab24cf4c-94b4-4ccf-a31e-1198af3b8cad req-06d2990d-e7d2-42a6-8181-20a664e0de29 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.366493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab24cf4c-94b4-4ccf-a31e-1198af3b8cad req-06d2990d-e7d2-42a6-8181-20a664e0de29 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.366851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab24cf4c-94b4-4ccf-a31e-1198af3b8cad req-06d2990d-e7d2-42a6-8181-20a664e0de29 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.380155 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ab24cf4c-94b4-4ccf-a31e-1198af3b8cad req-06d2990d-e7d2-42a6-8181-20a664e0de29 service nova] Creating event network-vif-plugged:2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98 for instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a on n-h2-846470-15 Aug 24 05:10:45.385847 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ab24cf4c-94b4-4ccf-a31e-1198af3b8cad req-06d2990d-e7d2-42a6-8181-20a664e0de29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038007 Aug 24 05:10:45.386177 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3825/7921] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:14.354112 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:11:14.354877 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:11:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:11:21.375691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:11:21.378182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:21.380946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=30 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:21.382213 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:21.388060 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:21.388550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:21.388990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:21.389706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:21.390160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:21.390582 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:21.461259 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-64a656d5-dd4c-40bc-86cc-9165ecd46200 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a/action" status: 200 len: 24575 microversion: 2.1 time: 0.089203 Aug 24 05:11:21.461863 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4097/7922] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:11:21 2022] POST /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a/action => generated 24575 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:11:24.450056 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:11:24.450056 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:11:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:11:45.450132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=26 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:45.451090 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-f267d827-fa0f-443a-b0c0-8ee3c9cbeded req-a511732d-b262-47b2-941f-fd6118e7aa1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec4c169-ab4f-42bc-aa70-009b3f54907a", "tag": "2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:11:45.451521 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:45.456830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:45.457739 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:45.458434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:45.460136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:45.465560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f267d827-fa0f-443a-b0c0-8ee3c9cbeded req-a511732d-b262-47b2-941f-fd6118e7aa1f service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.466053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f267d827-fa0f-443a-b0c0-8ee3c9cbeded req-a511732d-b262-47b2-941f-fd6118e7aa1f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.466474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-f267d827-fa0f-443a-b0c0-8ee3c9cbeded req-a511732d-b262-47b2-941f-fd6118e7aa1f service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.472112 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.472620 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.473332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.474107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.474584 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.475157 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.481098 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-f267d827-fa0f-443a-b0c0-8ee3c9cbeded req-a511732d-b262-47b2-941f-fd6118e7aa1f service nova] Creating event network-changed:2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98 for instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a on n-h2-846470-15 Aug 24 05:11:45.487026 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-f267d827-fa0f-443a-b0c0-8ee3c9cbeded req-a511732d-b262-47b2-941f-fd6118e7aa1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041679 Aug 24 05:11:45.488134 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4098/7923] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:45.506047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:11:45.604451 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84d357d1-a1b1-4596-8db2-b94ca61ac84d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 204 len: 0 microversion: 2.1 time: 0.161581 Aug 24 05:11:45.610297 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3826/7924] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:11:45 2022] DELETE /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:11:45.617072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:45.618447 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:45.626207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.626704 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.627144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.627893 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.628354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.629010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.788057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:45.796818 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-12be5af0-9721-4b76-b4f9-85c45354a567 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1687 microversion: 2.1 time: 0.184869 Aug 24 05:11:45.797413 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4099/7925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:11:45 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:11:46.822090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:46.822804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:46.830317 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:46.831196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:46.831644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:46.832397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:46.832865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:46.833303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.044724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:47.059852 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-63ff46e0-cb93-4f41-babd-be22a1ce4cc9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1687 microversion: 2.1 time: 0.237482 Aug 24 05:11:47.059852 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3827/7926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:11:46 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1687 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:11:48.080356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:48.081333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:48.089727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.090226 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.090666 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.091400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.091859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.092293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.115545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2303cf69-1e70-426c-93fd-bb9da92b2737 req-7bcc501f-677d-4438-a3b9-8f82c84a7b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec4c169-ab4f-42bc-aa70-009b3f54907a", "name": "network-vif-deleted", "tag": "2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:11:48.126828 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2303cf69-1e70-426c-93fd-bb9da92b2737 req-7bcc501f-677d-4438-a3b9-8f82c84a7b88 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.127334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2303cf69-1e70-426c-93fd-bb9da92b2737 req-7bcc501f-677d-4438-a3b9-8f82c84a7b88 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.127820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2303cf69-1e70-426c-93fd-bb9da92b2737 req-7bcc501f-677d-4438-a3b9-8f82c84a7b88 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.139987 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2303cf69-1e70-426c-93fd-bb9da92b2737 req-7bcc501f-677d-4438-a3b9-8f82c84a7b88 service nova] Creating event network-vif-deleted:2f3c2ac6-039c-4f3b-be2f-9cc0b9463b98 for instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a on n-h2-846470-15 Aug 24 05:11:48.145168 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2303cf69-1e70-426c-93fd-bb9da92b2737 req-7bcc501f-677d-4438-a3b9-8f82c84a7b88 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034215 Aug 24 05:11:48.145793 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3828/7927] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:48.162379 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:11:48.173370 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-14a7b60e-80bf-421c-b542-7e69fcebb9a3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 200 len: 1501 microversion: 2.1 time: 0.097804 Aug 24 05:11:48.174050 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4100/7928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:11:48 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 1501 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:11:49.197472 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:49.198160 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 0ec4c169-ab4f-42bc-aa70-009b3f54907a] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:49.205234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.206107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.206592 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.207313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.207814 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.208254 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.222964 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] HTTP exception thrown: Instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a could not be found. Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Request method failure captured: Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a HTTP/1.1 Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBbEvKYPgqPxpnDhV9uBDgd7u5XnHcuI2s0cITxqMjgcVtdLn4aQik_-igzwNK5lm0UnILHEc47uOx9o2BaAN-zHWLFXfjLN9jpaY2PSL70mpj9TRhbbTQZOW9GXtF0_9O628MrRRcxXS5Ec1Hp2yb3ADr2wudWoga-fZ4WGyMQkMBWM Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0db8e97b2d3b4d9bbbe077307c004ed6 Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a could not be found. Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '0ec4c169-ab4f-42bc-aa70-009b3f54907a'} Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a could not be found. Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a could not be found. Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.225196 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a could not be found. Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Returning 404 to user: Instance 0ec4c169-ab4f-42bc-aa70-009b3f54907a could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-16e5dce5-3fd4-4467-9146-f0637d695676 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a" status: 404 len: 111 microversion: 2.1 time: 0.036419 Aug 24 05:11:49.230415 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3829/7929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:11:49 2022] GET /compute/v2.1/servers/0ec4c169-ab4f-42bc-aa70-009b3f54907a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:11:52.791117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1cb402d8-c26a-4de7-81ef-5cd47b1b4263 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '.version_select at 0x7f10343c0d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:52.823924 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1cb402d8-c26a-4de7-81ef-5cd47b1b4263 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1304213084" status: 202 len: 0 microversion: 2.1 time: 0.036636 Aug 24 05:11:52.824897 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4101/7930] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 24 05:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1304213084 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:11:52.854009 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1b3c17f4-7b1b-462f-9799-a4c1360372f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: .version_select at 0x7f102835b8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1146892549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfjP3/8T9GsdgEReaYX4HIs4X0gVFW86tlXIKzYVMllFgJlLze/Fy/lOHr5padDk793s1dSZjEvWmnDHWdaOP9jyFG3UT6MEewUTM49T2JIfLhmq5FIhitrhEibuOHTXQ=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:11:52.873064 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-1b3c17f4-7b1b-462f-9799-a4c1360372f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:11:52.878694 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-1b3c17f4-7b1b-462f-9799-a4c1360372f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:11:52.902279 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1b3c17f4-7b1b-462f-9799-a4c1360372f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [44c85499-2d2d-4e55-9f8a-ec7342fc405e] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:11:53.912259 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [None req-1b3c17f4-7b1b-462f-9799-a4c1360372f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [44c85499-2d2d-4e55-9f8a-ec7342fc405e] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34142. Aug 24 05:11:53.933160 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1b3c17f4-7b1b-462f-9799-a4c1360372f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.083883 Aug 24 05:11:53.933759 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3830/7931] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:11:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:59.379827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1008534307", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "e7d4e175-9e87-4e07-aa29-c69c00f511bf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1146892549", "security_groups": [{"name": "tempest-secgroup-smoke-1016941994"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:11:59.391418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=14 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:59.513145 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] validate_networks() for [('e7d4e175-9e87-4e07-aa29-c69c00f511bf', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:11:59.956951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:11:59.957386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:11:59.957867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:11:59.958285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:11:59.958734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:11:59.968156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:59.968649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:59.969094 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:59.969829 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:59.970292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:59.970723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:59.988531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:11:59.994412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:12:00.008836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:12:00.011207 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:12:00.060950 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fee96895-7625-4b57-ae62-2a9aa057f012 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685174 Aug 24 05:12:00.061623 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4102/7932] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:11:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 05:12:00.077768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e9fee977-f01a-4eb7-8cdf-5f9037de7a79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:00.078414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e9fee977-f01a-4eb7-8cdf-5f9037de7a79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:00.085454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:00.154587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e9fee977-f01a-4eb7-8cdf-5f9037de7a79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:00.165828 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e9fee977-f01a-4eb7-8cdf-5f9037de7a79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1267 microversion: 2.1 time: 0.096459 Aug 24 05:12:00.166808 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3831/7933] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:00 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:01.189623 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:01.191023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:01.199495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:01.200119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:01.200727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:01.201586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:01.202100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:01.202788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:01.309066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:01.327252 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-58902e76-2e58-42f1-bf71-237dfbd2cf26 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1327 microversion: 2.1 time: 0.143260 Aug 24 05:12:01.336176 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4103/7934] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:01 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:02.352516 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:02.354288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:02.362948 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:02.363444 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:02.364128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:02.365097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:02.365585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:02.366177 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:02.822360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:02.831362 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-83be3224-4b7d-4ad4-87f5-63bb11a74960 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1393 microversion: 2.1 time: 0.483911 Aug 24 05:12:02.832180 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3832/7935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:02 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1393 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:03.255014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-c55f4812-1e8c-4ef2-ba1c-798eba45115e req-4b279524-22b0-48a0-905f-c7bbf8c50982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986ac6e6-1ae6-4919-a330-1ce7635d7092", "tag": "c7ca680c-2f42-4b4b-a295-3bae6166bfd7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:12:03.273867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c55f4812-1e8c-4ef2-ba1c-798eba45115e req-4b279524-22b0-48a0-905f-c7bbf8c50982 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.274686 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c55f4812-1e8c-4ef2-ba1c-798eba45115e req-4b279524-22b0-48a0-905f-c7bbf8c50982 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.276058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-c55f4812-1e8c-4ef2-ba1c-798eba45115e req-4b279524-22b0-48a0-905f-c7bbf8c50982 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:03.289634 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-c55f4812-1e8c-4ef2-ba1c-798eba45115e req-4b279524-22b0-48a0-905f-c7bbf8c50982 service nova] Creating event network-changed:c7ca680c-2f42-4b4b-a295-3bae6166bfd7 for instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 on n-h2-846470-15 Aug 24 05:12:03.296200 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-c55f4812-1e8c-4ef2-ba1c-798eba45115e req-4b279524-22b0-48a0-905f-c7bbf8c50982 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050258 Aug 24 05:12:03.297036 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4104/7936] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:03.856024 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:03.856645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:03.864394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.864825 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.865288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:03.866080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.866603 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.867289 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:04.011576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:04.019638 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ba79b68b-8103-4170-a55b-6ad1f1bc01a2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1393 microversion: 2.1 time: 0.168551 Aug 24 05:12:04.020267 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3833/7937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:03 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:05.042711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:05.043410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:05.050359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:05.050854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:05.051294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:05.052048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:05.052504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:05.052931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:05.207122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:05.216430 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2000e358-8edc-4428-89c0-36617d34cf12 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1393 microversion: 2.1 time: 0.178856 Aug 24 05:12:05.217059 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4105/7938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:05 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:06.238719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:06.239445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:06.247181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:06.247826 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:06.248466 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:06.249397 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:06.250049 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:06.250495 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:06.425764 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:06.434439 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e3e04555-1b16-48d6-b5c9-26ca5d6c0fc7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1393 microversion: 2.1 time: 0.199712 Aug 24 05:12:06.435011 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3834/7939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:06 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1393 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:12:07.458598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:07.459311 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:07.467017 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:07.467508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:07.467979 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:07.468685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:07.469141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:07.469564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:07.606747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:07.615448 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-31bc18af-895b-4b39-8ecb-de2f04234578 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1393 microversion: 2.1 time: 0.162710 Aug 24 05:12:07.616086 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4106/7940] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:07 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:08.637783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:08.638402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:08.646594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:08.647151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:08.647709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:08.648506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:08.649028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:08.649519 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:08.795163 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:08.806387 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-4a05286e-4de3-4082-8c05-00dac4589bc3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1393 microversion: 2.1 time: 0.173152 Aug 24 05:12:08.807036 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3835/7941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:08 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:09.753851 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-7f0a0000-ecee-4a46-8da3-b8991c272e1c req-2226ca64-7be1-4c0b-9314-caa06373e3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986ac6e6-1ae6-4919-a330-1ce7635d7092", "name": "network-vif-plugged", "status": "completed", "tag": "c7ca680c-2f42-4b4b-a295-3bae6166bfd7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:12:09.763494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7f0a0000-ecee-4a46-8da3-b8991c272e1c req-2226ca64-7be1-4c0b-9314-caa06373e3a2 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:09.764014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7f0a0000-ecee-4a46-8da3-b8991c272e1c req-2226ca64-7be1-4c0b-9314-caa06373e3a2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:09.764657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-7f0a0000-ecee-4a46-8da3-b8991c272e1c req-2226ca64-7be1-4c0b-9314-caa06373e3a2 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:09.776263 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-7f0a0000-ecee-4a46-8da3-b8991c272e1c req-2226ca64-7be1-4c0b-9314-caa06373e3a2 service nova] Creating event network-vif-plugged:c7ca680c-2f42-4b4b-a295-3bae6166bfd7 for instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 on n-h2-846470-15 Aug 24 05:12:09.781422 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-7f0a0000-ecee-4a46-8da3-b8991c272e1c req-2226ca64-7be1-4c0b-9314-caa06373e3a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086743 Aug 24 05:12:09.782175 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4107/7942] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:09.828757 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:09.829468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:09.838274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:09.838807 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:09.839319 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:09.840094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:09.840606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:09.841037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:10.029356 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:10.037727 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3942cc99-a961-489b-b626-bca39a4018d7 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1393 microversion: 2.1 time: 0.213756 Aug 24 05:12:10.038276 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3836/7943] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:09 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1393 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:11.057392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:11.058176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:11.063645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:11.064374 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:11.071622 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:11.072132 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:11.072561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:11.073260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:11.073710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:11.074129 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:11.232050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:11.240090 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-668773b7-b83c-4d86-a503-cd939f1e73bc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1393 microversion: 2.1 time: 0.183679 Aug 24 05:12:11.241297 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4108/7944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:11 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:12.264244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:12.264939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:12.267234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:12.275566 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:12.276267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:12.276939 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:12.277890 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:12.278543 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:12.279134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:12.429765 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:12.443580 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c882e9ef-039d-4de2-bcca-9048c53cde79 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1564 microversion: 2.1 time: 0.183911 Aug 24 05:12:12.444608 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3837/7945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:12 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:12.468944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:12.469555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:12.476878 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:12.477416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:12.477881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:12.478576 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:12.479089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:12.479533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:12.623700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:12.631699 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3cee13a3-f9ae-40c0-9b94-eb4c47cf33fd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1564 microversion: 2.1 time: 0.166653 Aug 24 05:12:12.632278 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4109/7946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:12 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:14.704646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:14.707180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:14.715231 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.715876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.716411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.717605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.718469 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.719031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.768846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-4e94c85d-384f-408d-87cb-8c630e64431f req-91ad903b-cd11-4e42-a28b-8aa599fb8267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986ac6e6-1ae6-4919-a330-1ce7635d7092", "tag": "c7ca680c-2f42-4b4b-a295-3bae6166bfd7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:12:14.779867 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4e94c85d-384f-408d-87cb-8c630e64431f req-91ad903b-cd11-4e42-a28b-8aa599fb8267 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.780412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4e94c85d-384f-408d-87cb-8c630e64431f req-91ad903b-cd11-4e42-a28b-8aa599fb8267 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.780970 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-4e94c85d-384f-408d-87cb-8c630e64431f req-91ad903b-cd11-4e42-a28b-8aa599fb8267 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.793360 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-4e94c85d-384f-408d-87cb-8c630e64431f req-91ad903b-cd11-4e42-a28b-8aa599fb8267 service nova] Creating event network-changed:c7ca680c-2f42-4b4b-a295-3bae6166bfd7 for instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 on n-h2-846470-15 Aug 24 05:12:14.798674 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-4e94c85d-384f-408d-87cb-8c630e64431f req-91ad903b-cd11-4e42-a28b-8aa599fb8267 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101808 Aug 24 05:12:14.799765 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4110/7947] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:14.911334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:12:14.920355 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6abf4a4e-99e4-4ea0-9865-6070e3ad61c9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1564 microversion: 2.1 time: 0.225527 Aug 24 05:12:14.927559 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3838/7948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:12:14 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1564 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:12:48.264870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:48.265673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=38 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:48.270212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:12:48.272594 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:48.280727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:48.281212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:48.281652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:48.282354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:48.282806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:48.283231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:48.337914 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9f49d29b-efe7-4e80-b1df-150179f3f126 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action" status: 200 len: 24567 microversion: 2.1 time: 0.075311 Aug 24 05:12:48.338502 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4111/7949] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:12:48 2022] POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action => generated 24567 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:13:27.216262 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:13:27.217039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:27.218015 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=42 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:27.224207 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-841eb6df-f0b0-4ed1-9d34-6e808869361f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:13:27.236536 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841eb6df-f0b0-4ed1-9d34-6e808869361f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.237402 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841eb6df-f0b0-4ed1-9d34-6e808869361f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.238141 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-841eb6df-f0b0-4ed1-9d34-6e808869361f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.263713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-841eb6df-f0b0-4ed1-9d34-6e808869361f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Going to try to stop instance {{(pid=122535) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 05:13:27.317460 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-841eb6df-f0b0-4ed1-9d34-6e808869361f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action" status: 202 len: 0 microversion: 2.1 time: 0.104841 Aug 24 05:13:27.318065 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3839/7950] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:13:27 2022] POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:13:27.331875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:27.332527 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:27.337631 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:27.338517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:27.343710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.344241 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.344685 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.345394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.345852 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.346287 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.496400 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:27.504658 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a5e2330f-75ad-4935-bba8-7f31fc68eeea tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.179861 Aug 24 05:13:27.505233 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4112/7951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:27 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:28.536118 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:28.537137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:28.547133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:28.547652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:28.548124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:28.548836 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:28.549304 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:28.549737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:28.550447 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34280. Aug 24 05:13:28.695161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:28.704091 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9f4b6873-0817-4403-a63a-e8a52f3985c2 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.178366 Aug 24 05:13:28.704945 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3840/7952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:28 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:29.730663 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:29.731411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:29.742498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:29.742977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:29.743410 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:29.744143 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:29.744593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:29.745040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:29.893157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:29.901985 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4032667a-62da-454c-b789-c00f4fc5112d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.177840 Aug 24 05:13:29.903298 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4113/7953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:29 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:30.927478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:30.928492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:30.935923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:30.936435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:30.936896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:30.937621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:30.938093 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:30.938541 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:31.083076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:31.091566 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ea1faa5f-27a2-4954-ba1c-455b77cf4670 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.170305 Aug 24 05:13:31.092187 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3841/7954] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:30 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:32.113800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:32.114422 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:32.121461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:32.121947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:32.122390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:32.123091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:32.123544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:32.124007 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:32.272105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:32.280313 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b9a5ad8c-7f20-4633-9189-fad317905e40 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.170515 Aug 24 05:13:32.280919 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4114/7955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:32 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:33.307068 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:33.307598 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:33.315034 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:33.315537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:33.316056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:33.316771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:33.317238 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:33.317681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:33.474666 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:33.483412 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8ed1b7bc-140f-4c58-844e-f75e39687a58 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.181529 Aug 24 05:13:33.484014 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3842/7956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:33 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:34.508906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:34.509509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:34.516850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:34.517338 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:34.517785 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:34.518479 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:34.518934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:34.519363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:34.661345 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:34.670193 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-925c16ae-67bc-4edf-8174-bd4b52187e15 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.166846 Aug 24 05:13:34.670776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4115/7957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:34 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:35.694069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:35.694709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:35.703525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:35.704149 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:35.704684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:35.705530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:35.706451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:35.707017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:35.848354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:35.857447 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-44972229-11de-42b1-ac80-a9719ff2d217 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.168175 Aug 24 05:13:35.858094 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3843/7958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:35 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:36.885089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:36.885676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:36.892957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:36.893476 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:36.893892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:36.894606 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:36.895070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:36.895501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:37.041091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:37.049626 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-86e1d586-4495-4ab5-8fd7-aac8bb36f101 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1692 microversion: 2.1 time: 0.168595 Aug 24 05:13:37.050284 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4116/7959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:36 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:38.075290 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:38.075958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:38.084928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:38.085442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:38.085901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:38.087439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:38.087966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:38.088406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:38.237476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:38.248578 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-04215a69-c84b-4fa0-b7b6-da8b1f194c9d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1669 microversion: 2.1 time: 0.179266 Aug 24 05:13:38.249348 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3844/7960] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:38 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1669 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:39.356810 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:13:39.358963 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:39.366486 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.366975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.367414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:39.368866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.369340 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.369770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:39.425166 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5beb32eb-abbb-4d35-9a34-830927706e5a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action" status: 200 len: 38345 microversion: 2.1 time: 0.072627 Aug 24 05:13:39.425849 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4117/7961] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:13:39 2022] POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action => generated 38345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:13:39.440400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ae900878-5dfc-417b-8f9a-fc5f0efb3af0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:13:39.447591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae900878-5dfc-417b-8f9a-fc5f0efb3af0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.448138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae900878-5dfc-417b-8f9a-fc5f0efb3af0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.448602 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ae900878-5dfc-417b-8f9a-fc5f0efb3af0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:39.476180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ae900878-5dfc-417b-8f9a-fc5f0efb3af0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Going to try to start instance {{(pid=122535) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 05:13:39.525117 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ae900878-5dfc-417b-8f9a-fc5f0efb3af0 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action" status: 202 len: 0 microversion: 2.1 time: 0.088185 Aug 24 05:13:39.525770 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3845/7962] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:13:39 2022] POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:13:39.535869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:39.536560 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:39.545747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.546243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.546667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:39.547531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.548025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.548455 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:39.694371 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:39.702424 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-53e9de8b-8b39-4186-a9a5-280c7087c53d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1678 microversion: 2.1 time: 0.171555 Aug 24 05:13:39.702992 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4118/7963] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:39 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:40.726362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:40.726935 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:40.734489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:40.735004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:40.735473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:40.736237 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:40.736715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:40.737171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:40.882509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:40.890730 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-477ce7b1-47b6-45c6-81b5-a5b09d7fdc64 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1678 microversion: 2.1 time: 0.169780 Aug 24 05:13:40.891326 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3846/7964] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:40 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:13:41.916491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:41.917120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:41.924384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:41.924866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:41.925296 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:41.925984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:41.926433 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:41.926857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:42.075227 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:13:42.084610 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d19e9592-7387-4929-a7bd-1b8e3890a7dc tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1682 microversion: 2.1 time: 0.174031 Aug 24 05:13:42.085198 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4119/7965] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:13:41 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:18.374720 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=16 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:18.375375 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:18.623718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:18.626197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:18.633240 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.633736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.634187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.634901 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.635372 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.635846 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.699204 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3037779f-f8a8-4902-9c3b-687a9b58dd52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action" status: 200 len: 62908 microversion: 2.1 time: 0.329542 Aug 24 05:14:18.699905 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3847/7966] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:14:18 2022] POST /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092/action => generated 62908 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:14:34.356152 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:14:34.356873 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:14:34.365928 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:14:34.366156 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:14:42.686387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=16 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:42.687414 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=46 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:42.691644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:42.692051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-bbe3ab86-d5c5-40cc-bf5e-19d0e5a85a35 req-4d5b0f85-2c3a-4b38-bfa2-0f087af0e31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986ac6e6-1ae6-4919-a330-1ce7635d7092", "tag": "c7ca680c-2f42-4b4b-a295-3bae6166bfd7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:42.692743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:42.699907 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:42.700640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:42.701846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.702333 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.702981 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.704192 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.704654 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.705081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.709256 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bbe3ab86-d5c5-40cc-bf5e-19d0e5a85a35 req-4d5b0f85-2c3a-4b38-bfa2-0f087af0e31d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.709768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bbe3ab86-d5c5-40cc-bf5e-19d0e5a85a35 req-4d5b0f85-2c3a-4b38-bfa2-0f087af0e31d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.710325 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-bbe3ab86-d5c5-40cc-bf5e-19d0e5a85a35 req-4d5b0f85-2c3a-4b38-bfa2-0f087af0e31d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.723834 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-bbe3ab86-d5c5-40cc-bf5e-19d0e5a85a35 req-4d5b0f85-2c3a-4b38-bfa2-0f087af0e31d service nova] Creating event network-changed:c7ca680c-2f42-4b4b-a295-3bae6166bfd7 for instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 on n-h2-846470-15 Aug 24 05:14:42.729948 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-bbe3ab86-d5c5-40cc-bf5e-19d0e5a85a35 req-4d5b0f85-2c3a-4b38-bfa2-0f087af0e31d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042976 Aug 24 05:14:42.730896 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3848/7967] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:42.733629 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:14:42.828522 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9ce02596-3441-4f3f-8b7c-efa1038e546b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 204 len: 0 microversion: 2.1 time: 0.143654 Aug 24 05:14:42.829481 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4120/7968] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:14:42 2022] DELETE /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:14:42.842292 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:42.843053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:42.850445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.851092 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.851702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.852590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.853193 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.854057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:43.011679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:43.023330 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-962f1d02-3465-47f4-8b76-7cca07cf38ca tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1688 microversion: 2.1 time: 0.188219 Aug 24 05:14:43.024104 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3849/7969] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:14:42 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:44.049165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:44.049805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:44.057577 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:44.058082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:44.058494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:44.059229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:44.059703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:44.060127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:44.199477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:44.208761 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ac0dcbc6-d5d9-4aed-a27b-ac05431f6a83 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1688 microversion: 2.1 time: 0.164009 Aug 24 05:14:44.208951 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4121/7970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:14:44 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:44.461312 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:14:44.461932 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:14:45.130200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-fa92966e-ae42-486b-a2a7-1913cfc53689 req-fdc61930-72dd-4e93-a6ac-2d2de434bfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986ac6e6-1ae6-4919-a330-1ce7635d7092", "name": "network-vif-deleted", "tag": "c7ca680c-2f42-4b4b-a295-3bae6166bfd7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:45.143051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fa92966e-ae42-486b-a2a7-1913cfc53689 req-fdc61930-72dd-4e93-a6ac-2d2de434bfc8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.143550 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fa92966e-ae42-486b-a2a7-1913cfc53689 req-fdc61930-72dd-4e93-a6ac-2d2de434bfc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.144028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-fa92966e-ae42-486b-a2a7-1913cfc53689 req-fdc61930-72dd-4e93-a6ac-2d2de434bfc8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.156376 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-fa92966e-ae42-486b-a2a7-1913cfc53689 req-fdc61930-72dd-4e93-a6ac-2d2de434bfc8 service nova] Creating event network-vif-deleted:c7ca680c-2f42-4b4b-a295-3bae6166bfd7 for instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 on n-h2-846470-15 Aug 24 05:14:45.163044 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-fa92966e-ae42-486b-a2a7-1913cfc53689 req-fdc61930-72dd-4e93-a6ac-2d2de434bfc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036612 Aug 24 05:14:45.163644 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3850/7971] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:45.229809 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:45.230432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:45.237659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.238160 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.238609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.239318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.240237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.240788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.273702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.274183 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.274620 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.275104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lazy-loading 'fault' on Instance uuid 986ac6e6-1ae6-4919-a330-1ce7635d7092 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:14:45.316079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:45.324289 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7d7a7ce8-45dd-4759-aff6-24723f959657 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 200 len: 1357 microversion: 2.1 time: 0.098596 Aug 24 05:14:45.324859 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4122/7972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:14:45 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:46.352242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:46.352949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: 986ac6e6-1ae6-4919-a330-1ce7635d7092] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:46.359914 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:46.360414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:46.360866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:46.361577 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:46.362043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:46.362484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:46.377227 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] HTTP exception thrown: Instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 could not be found. Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Request method failure captured: Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 HTTP/1.1 Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBbEvKYPgqPxpnDhV9uBDgd7u5XnHcuI2s0cITxqMjgcVtdLn4aQik_-igzwNK5lm0UnILHEc47uOx9o2BaAN-zHWLFXfjLN9jpaY2PSL70mpj9TRhbbTQZOW9GXtF0_9O628MrRRcxXS5Ec1Hp2yb3ADr2wudWoga-fZ4WGyMQkMBWM Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0db8e97b2d3b4d9bbbe077307c004ed6 Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 could not be found. Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '986ac6e6-1ae6-4919-a330-1ce7635d7092'} Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 could not be found. Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 could not be found. Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:14:46.378881 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 could not be found. Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Returning 404 to user: Instance 986ac6e6-1ae6-4919-a330-1ce7635d7092 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-74b1870f-ac90-47f2-8004-19e54f2117f3 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092" status: 404 len: 111 microversion: 2.1 time: 0.034968 Aug 24 05:14:46.383790 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3851/7973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:14:46 2022] GET /compute/v2.1/servers/986ac6e6-1ae6-4919-a330-1ce7635d7092 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:14:49.533092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-46c6635a-115a-48f5-843a-a87947dc8f52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '.version_select at 0x7f1022e05dc0>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:49.564026 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-46c6635a-115a-48f5-843a-a87947dc8f52 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1146892549" status: 202 len: 0 microversion: 2.1 time: 0.034818 Aug 24 05:14:49.564628 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4123/7974] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 24 05:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1146892549 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:14:49.602055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-621c27f8-1fa8-41ba-8b5b-45a2ffb30153 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: .version_select at 0x7f1029c1b4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-832414275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK4/HuiRcCr96t9BbgUmpQmbiodD4R5D5PnWB62HyhXST38sOqyGrVMhOFfglDVeVqikriFaeW0oLQIji+nkKNC7gkr9RII6nI7yNOnj0EoHMsfrUw2bbeWkHMVD2QjLg=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:49.621723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-621c27f8-1fa8-41ba-8b5b-45a2ffb30153 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:14:49.628366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-621c27f8-1fa8-41ba-8b5b-45a2ffb30153 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:14:49.658329 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-621c27f8-1fa8-41ba-8b5b-45a2ffb30153 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.061610 Aug 24 05:14:49.658947 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3852/7975] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:14:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:55.802152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:55.806790 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-750760807", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "networks": [{"uuid": "2cdb4919-20bc-4ba3-9957-85733db407b7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-832414275", "security_groups": [{"name": "tempest-secgroup-smoke-1890256169"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:55.926454 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] validate_networks() for [('2cdb4919-20bc-4ba3-9957-85733db407b7', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:14:56.430797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:14:56.431384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:14:56.431917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:14:56.432326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:14:56.432741 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:14:56.442377 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:56.442891 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:56.443336 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:56.444099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:56.444554 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:56.445003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:56.463580 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:14:56.474384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Getting quotas for user 0db8e97b2d3b4d9bbbe077307c004ed6 and project 9b9dd08f198f4d15a69c91c1de72fc0c. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:14:56.489876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:14:56.492342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:14:56.555429 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1d31a33e-e524-4fe7-bd14-62aae52d57f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754956 Aug 24 05:14:56.556209 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4124/7976] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:14:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:14:56.570435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-134ad361-621a-4aa6-900e-e81001c5505e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:56.571874 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-134ad361-621a-4aa6-900e-e81001c5505e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:56.595944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=12 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:56.665562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-134ad361-621a-4aa6-900e-e81001c5505e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:56.674622 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-134ad361-621a-4aa6-900e-e81001c5505e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1265 microversion: 2.1 time: 0.110412 Aug 24 05:14:56.684047 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3853/7977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:14:56 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:57.696961 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:57.698520 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:57.709003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:57.709651 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:57.710120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:57.710828 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:57.711329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:57.711797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:57.808281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:57.817187 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f4c3645c-39e8-40cd-8da0-50dd4ab6a770 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1317 microversion: 2.1 time: 0.124244 Aug 24 05:14:57.818144 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4125/7978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:14:57 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1317 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:58.840315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:58.841305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:58.851727 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:58.852435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:58.854075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:58.856225 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:58.858611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:58.859354 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:59.092729 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:14:59.101821 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5b1e8bae-ba68-449c-8a3d-d70fbd6fca98 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1391 microversion: 2.1 time: 0.266993 Aug 24 05:14:59.102436 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3854/7979] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:14:58 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:14:59.797568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-fb36f993-e0e3-443e-be79-ee065905e747 req-61fe269a-fc22-42eb-bc43-c9689c883a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e899b318-0707-4daa-a059-92f677c9c332", "tag": "891426b6-2380-4545-a882-ce636a02bee0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:14:59.810801 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fb36f993-e0e3-443e-be79-ee065905e747 req-61fe269a-fc22-42eb-bc43-c9689c883a52 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:59.811278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fb36f993-e0e3-443e-be79-ee065905e747 req-61fe269a-fc22-42eb-bc43-c9689c883a52 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:59.811725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-fb36f993-e0e3-443e-be79-ee065905e747 req-61fe269a-fc22-42eb-bc43-c9689c883a52 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:59.823144 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-fb36f993-e0e3-443e-be79-ee065905e747 req-61fe269a-fc22-42eb-bc43-c9689c883a52 service nova] Creating event network-changed:891426b6-2380-4545-a882-ce636a02bee0 for instance e899b318-0707-4daa-a059-92f677c9c332 on n-h1-846470-15 Aug 24 05:14:59.828161 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-fb36f993-e0e3-443e-be79-ee065905e747 req-61fe269a-fc22-42eb-bc43-c9689c883a52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035212 Aug 24 05:14:59.828754 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4126/7980] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:00.124527 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:00.125164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:00.132972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:00.133487 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:00.133944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:00.134703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:00.135151 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:00.135599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:00.341296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:00.350052 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-499fd7d6-15f2-4d91-977b-568d88487776 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1391 microversion: 2.1 time: 0.229377 Aug 24 05:15:00.350623 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3855/7981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:00 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:01.371681 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:01.372389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:01.379095 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:01.379850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:01.380292 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:01.380983 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:01.381430 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:01.381847 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:01.530733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:01.539741 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e5586366-bebf-4206-8733-8ce63a0dc83e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1391 microversion: 2.1 time: 0.172793 Aug 24 05:15:01.540324 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4127/7982] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:01 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:02.566239 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:02.567283 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:02.575104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:02.575622 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:02.576115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:02.576859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:02.577342 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:02.577817 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:02.794370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:02.803092 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-21373299-239e-4412-9f06-1d1f16a6cd33 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1391 microversion: 2.1 time: 0.240939 Aug 24 05:15:02.803821 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3856/7983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:02 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:03.824994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:03.825587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:03.833533 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:03.834020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:03.834458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:03.835147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:03.835626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:03.836091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:03.975769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:03.983991 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-92f2bd33-9038-4a20-b60c-2dc9f02ebf06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1391 microversion: 2.1 time: 0.162945 Aug 24 05:15:03.984573 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4128/7984] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:03 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:05.009298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:05.009893 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:05.017197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.017705 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.018158 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.018865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.019334 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.019805 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.160053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:05.168316 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-48f314f0-ba96-4e35-a1b5-3b07b695b62f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1391 microversion: 2.1 time: 0.165831 Aug 24 05:15:05.168904 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3857/7985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:05 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:05.576864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e5532986-a030-43c2-b654-863aa13e337e req-bf96a507-fc19-4413-8f2a-b6e93a1f26c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e899b318-0707-4daa-a059-92f677c9c332", "name": "network-vif-plugged", "status": "completed", "tag": "891426b6-2380-4545-a882-ce636a02bee0"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:15:05.589087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e5532986-a030-43c2-b654-863aa13e337e req-bf96a507-fc19-4413-8f2a-b6e93a1f26c1 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.589579 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e5532986-a030-43c2-b654-863aa13e337e req-bf96a507-fc19-4413-8f2a-b6e93a1f26c1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.590016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e5532986-a030-43c2-b654-863aa13e337e req-bf96a507-fc19-4413-8f2a-b6e93a1f26c1 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.601622 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e5532986-a030-43c2-b654-863aa13e337e req-bf96a507-fc19-4413-8f2a-b6e93a1f26c1 service nova] Creating event network-vif-plugged:891426b6-2380-4545-a882-ce636a02bee0 for instance e899b318-0707-4daa-a059-92f677c9c332 on n-h1-846470-15 Aug 24 05:15:05.606781 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e5532986-a030-43c2-b654-863aa13e337e req-bf96a507-fc19-4413-8f2a-b6e93a1f26c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Aug 24 05:15:05.607384 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4129/7986] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:06.198035 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:06.198667 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:06.206726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:06.207294 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:06.207783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:06.208502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:06.209043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:06.209483 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:06.362974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:06.371335 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cebf24e1-7ad6-4e41-b52d-57299576e749 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1391 microversion: 2.1 time: 0.179766 Aug 24 05:15:06.371962 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3858/7987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:06 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:07.394046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:07.394734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:07.396799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:07.397459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:07.404570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.405052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.405489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.406182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.406634 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.407054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.553986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:07.562752 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-214d04c5-e780-470d-be25-2c03d8bdc418 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1563 microversion: 2.1 time: 0.173085 Aug 24 05:15:07.563334 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4130/7988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:07 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:07.584173 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:07.584806 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:07.586832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:07.593242 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.593745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.594192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.594899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.595369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.595842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.735272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:07.744365 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fe2deebd-807b-4ae3-b863-e4c7f9e793f5 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1563 microversion: 2.1 time: 0.164543 Aug 24 05:15:07.745289 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3859/7989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:07 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:09.402167 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:09.402868 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:09.404105 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-ab68bb5e-8cd2-48d8-9b19-cff29c3afeea req-29750ff8-f25b-4b72-8dcb-0817850ab8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e899b318-0707-4daa-a059-92f677c9c332", "tag": "891426b6-2380-4545-a882-ce636a02bee0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:15:09.410139 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.410700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.411409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.412237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.412929 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.413385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.414497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab68bb5e-8cd2-48d8-9b19-cff29c3afeea req-29750ff8-f25b-4b72-8dcb-0817850ab8a6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.415216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab68bb5e-8cd2-48d8-9b19-cff29c3afeea req-29750ff8-f25b-4b72-8dcb-0817850ab8a6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.415703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-ab68bb5e-8cd2-48d8-9b19-cff29c3afeea req-29750ff8-f25b-4b72-8dcb-0817850ab8a6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.427464 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-ab68bb5e-8cd2-48d8-9b19-cff29c3afeea req-29750ff8-f25b-4b72-8dcb-0817850ab8a6 service nova] Creating event network-changed:891426b6-2380-4545-a882-ce636a02bee0 for instance e899b318-0707-4daa-a059-92f677c9c332 on n-h1-846470-15 Aug 24 05:15:09.433307 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-ab68bb5e-8cd2-48d8-9b19-cff29c3afeea req-29750ff8-f25b-4b72-8dcb-0817850ab8a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033179 Aug 24 05:15:09.434506 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3860/7990] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:09.567263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:15:09.576654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63eecae2-66ba-4da1-b234-fb5538c8bd08 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1563 microversion: 2.1 time: 0.179292 Aug 24 05:15:09.583512 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4131/7991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:15:09 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:15:44.930465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:15:44.932840 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:44.935047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:44.935743 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=38 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:44.942266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:44.942769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:44.943226 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:44.944004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:44.944478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:44.944921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:45.019206 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-52883e87-d638-40d8-bca0-d12f9518706f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action" status: 200 len: 24549 microversion: 2.1 time: 0.093186 Aug 24 05:15:45.020068 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3861/7992] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:15:44 2022] POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action => generated 24549 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:16:24.089505 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:24.090475 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=36 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:24.096941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:24.097745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:24.107628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.108381 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.109382 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.110532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.111308 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.111941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.140368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lazy-loading 'flavor' on Instance uuid e899b318-0707-4daa-a059-92f677c9c332 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:16:24.214312 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a8aa0507-bec5-4f63-97e4-13d2547c5d06 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action" status: 202 len: 0 microversion: 2.1 time: 0.127219 Aug 24 05:16:24.217082 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4132/7993] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:16:24 2022] POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:16:24.224770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:24.225488 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:24.228288 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:24.229126 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=4 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:24.236303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.236816 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.237276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.238337 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.238809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.239259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.511312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:24.519927 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-18b2b733-9204-481b-9ad0-515326d0f58d tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1690 microversion: 2.1 time: 0.300145 Aug 24 05:16:24.520509 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3862/7994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:24 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1690 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:25.544349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:25.545046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:25.551774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:25.552282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:25.552689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:25.553416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:25.553872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:25.554294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:25.804730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:25.813302 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b8bba3ed-11aa-496f-9689-55e2b348f3cd tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1690 microversion: 2.1 time: 0.274438 Aug 24 05:16:25.813917 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4133/7995] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:25 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:26.840644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:26.841703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:26.856355 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:26.857205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:26.857975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:26.859435 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:26.860534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:26.860974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:26.998122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:27.006667 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e5e98a72-c705-4e30-ba85-b8e1f3a07c1b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1673 microversion: 2.1 time: 0.173500 Aug 24 05:16:27.007242 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3863/7996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:26 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:28.112023 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:28.114291 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:28.122574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.123086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.123523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.124265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.124721 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.125180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.196424 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-42253285-5058-4a4b-88ce-b2d608a5abe9 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action" status: 200 len: 38346 microversion: 2.1 time: 0.089122 Aug 24 05:16:28.197533 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4134/7997] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:16:28 2022] POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action => generated 38346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:16:28.212768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:28.213377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:28.220832 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.221344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.221938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.222974 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.223561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.224047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.320157 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-de706f93-7100-4253-9369-6177a8cc8f0c tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action" status: 202 len: 0 microversion: 2.1 time: 0.111798 Aug 24 05:16:28.321958 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3864/7998] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:16:28 2022] POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:16:28.330816 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:28.331917 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:28.339484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.340030 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.340525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.341309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.341766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.342714 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.515159 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:28.526034 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d2a1ea03-7856-4ca3-80b9-8be3e643bc6b tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1679 microversion: 2.1 time: 0.199285 Aug 24 05:16:28.526830 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4135/7999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:28 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:29.559985 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:29.561043 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:29.569014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:29.569518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:29.569994 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:29.570698 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:29.571156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:29.571611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:29.716135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:29.728520 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0238833d-ef14-43e4-b684-ed4405161dec tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1679 microversion: 2.1 time: 0.178896 Aug 24 05:16:29.729353 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3865/8000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:29 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:30.755528 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:30.756326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:30.765398 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:30.766058 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:30.766904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:30.767612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:30.768124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:30.768553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:30.928914 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:30.940498 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8362c894-a8b7-4a6c-9bc6-0e0e0194f70f tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1682 microversion: 2.1 time: 0.190200 Aug 24 05:16:30.941048 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4136/8001] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:30 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:31.043023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:31.045353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:31.053107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:31.053611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:31.054065 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:31.054777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:31.055250 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:31.055712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:31.118965 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5192603e-e5c6-48ee-9842-f1cf688ee37a tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action" status: 200 len: 38346 microversion: 2.1 time: 0.079841 Aug 24 05:16:31.119610 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3866/8002] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:16:31 2022] POST /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332/action => generated 38346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:16:32.178570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:32.179100 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:32.189172 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.189621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.190276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.191390 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.191869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.192295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.219546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:16:32.245923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-7306fd87-5e15-4e43-8482-e07f78feaf69 req-76361e48-4c8d-44ae-9cca-a33ec5009ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e899b318-0707-4daa-a059-92f677c9c332", "tag": "891426b6-2380-4545-a882-ce636a02bee0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:32.260224 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7306fd87-5e15-4e43-8482-e07f78feaf69 req-76361e48-4c8d-44ae-9cca-a33ec5009ad8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.261120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7306fd87-5e15-4e43-8482-e07f78feaf69 req-76361e48-4c8d-44ae-9cca-a33ec5009ad8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.261830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-7306fd87-5e15-4e43-8482-e07f78feaf69 req-76361e48-4c8d-44ae-9cca-a33ec5009ad8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.275019 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-7306fd87-5e15-4e43-8482-e07f78feaf69 req-76361e48-4c8d-44ae-9cca-a33ec5009ad8 service nova] Creating event network-changed:891426b6-2380-4545-a882-ce636a02bee0 for instance e899b318-0707-4daa-a059-92f677c9c332 on n-h1-846470-15 Aug 24 05:16:32.280346 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-7306fd87-5e15-4e43-8482-e07f78feaf69 req-76361e48-4c8d-44ae-9cca-a33ec5009ad8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102932 Aug 24 05:16:32.281435 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3867/8003] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:32.301988 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-445710d5-3149-4bf4-b2da-8a6973251f96 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 204 len: 0 microversion: 2.1 time: 0.127494 Aug 24 05:16:32.303464 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4137/8004] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:16:32 2022] DELETE /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:16:32.312538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:32.313544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:32.321910 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.322692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.323340 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.328301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.329298 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.330745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.490990 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:32.499142 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8046aaf7-115f-4d4a-a595-74e55b9e2003 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1688 microversion: 2.1 time: 0.191010 Aug 24 05:16:32.499774 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3868/8005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:32 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:16:33.527071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:33.527843 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:33.544125 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:33.544743 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:33.545412 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:33.546465 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:33.547113 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:33.547780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:33.692394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:33.700585 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-29048fd9-63a7-49fc-b73d-c32bb9add107 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1688 microversion: 2.1 time: 0.180486 Aug 24 05:16:33.701206 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4138/8006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:33 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:34.674899 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-6b5017df-9fce-4de9-9ac1-21c8a73127c4 req-326f51ac-bc8c-4ef5-a3d3-f29e52947994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e899b318-0707-4daa-a059-92f677c9c332", "name": "network-vif-deleted", "tag": "891426b6-2380-4545-a882-ce636a02bee0"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:34.685793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6b5017df-9fce-4de9-9ac1-21c8a73127c4 req-326f51ac-bc8c-4ef5-a3d3-f29e52947994 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.686243 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6b5017df-9fce-4de9-9ac1-21c8a73127c4 req-326f51ac-bc8c-4ef5-a3d3-f29e52947994 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.686713 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-6b5017df-9fce-4de9-9ac1-21c8a73127c4 req-326f51ac-bc8c-4ef5-a3d3-f29e52947994 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.703865 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-6b5017df-9fce-4de9-9ac1-21c8a73127c4 req-326f51ac-bc8c-4ef5-a3d3-f29e52947994 service nova] Creating event network-vif-deleted:891426b6-2380-4545-a882-ce636a02bee0 for instance e899b318-0707-4daa-a059-92f677c9c332 on n-h1-846470-15 Aug 24 05:16:34.709667 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-6b5017df-9fce-4de9-9ac1-21c8a73127c4 req-326f51ac-bc8c-4ef5-a3d3-f29e52947994 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038545 Aug 24 05:16:34.710288 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3869/8007] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:34.723321 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:34.724086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:34.731616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.732218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.732715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.733459 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.734134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.734640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.801134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db8e97b2d3b4d9bbbe077307c004ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dd08f198f4d15a69c91c1de72fc0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:34.810054 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e79abbb5-381a-4614-b3be-0bb5c738b8fa tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 200 len: 1350 microversion: 2.1 time: 0.091530 Aug 24 05:16:34.810642 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4139/8008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:34 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:35.839443 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:35.840722 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] [instance: e899b318-0707-4daa-a059-92f677c9c332] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:35.853351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:35.854189 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:35.854996 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:35.856234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:35.857028 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:35.857787 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:35.874117 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] HTTP exception thrown: Instance e899b318-0707-4daa-a059-92f677c9c332 could not be found. Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Request method failure captured: Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 HTTP/1.1 Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBbEvKYPgqPxpnDhV9uBDgd7u5XnHcuI2s0cITxqMjgcVtdLn4aQik_-igzwNK5lm0UnILHEc47uOx9o2BaAN-zHWLFXfjLN9jpaY2PSL70mpj9TRhbbTQZOW9GXtF0_9O628MrRRcxXS5Ec1Hp2yb3ADr2wudWoga-fZ4WGyMQkMBWM Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9b9dd08f198f4d15a69c91c1de72fc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 9b9dd08f198f4d15a69c91c1de72fc0c Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1865438404 Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: 0db8e97b2d3b4d9bbbe077307c004ed6 Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1865438404-project Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance e899b318-0707-4daa-a059-92f677c9c332 could not be found. Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'e899b318-0707-4daa-a059-92f677c9c332'} Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e899b318-0707-4daa-a059-92f677c9c332 could not be found. Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e899b318-0707-4daa-a059-92f677c9c332 could not be found. Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:16:35.875834 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e899b318-0707-4daa-a059-92f677c9c332 could not be found. Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Returning 404 to user: Instance e899b318-0707-4daa-a059-92f677c9c332 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fbde0b5c-48d5-43f8-a6d8-ffc5dcbcc84e tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332" status: 404 len: 111 microversion: 2.1 time: 0.047622 Aug 24 05:16:35.880895 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3870/8009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:35 2022] GET /compute/v2.1/servers/e899b318-0707-4daa-a059-92f677c9c332 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:16:38.957939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-105af09e-4745-468a-b6dc-ec753c955053 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] Calling method '.version_select at 0x7f1021ad3e50>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:38.994685 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-105af09e-4745-468a-b6dc-ec753c955053 tempest-TestNetworkAdvancedServerOps-1865438404 tempest-TestNetworkAdvancedServerOps-1865438404-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-832414275" status: 202 len: 0 microversion: 2.1 time: 0.041673 Aug 24 05:16:38.996031 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4140/8010] 10.222.0.58 () {58 vars in 1281 bytes} [Wed Aug 24 05:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-832414275 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:16:51.107955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=18 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:51.110759 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:51.325059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f36bf037-97a6-49f0-849e-ac403e70ee06 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Action: 'create', calling method: .version_select at 0x7f102a556af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-848112196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuA9PTOqrCE/JiV2ZeEhuoayh6Bdm4MWzYukA390gvV5rM+1DQV3xFLbBscUKIhHIRXm+iW6IKhyd07hIES0cfIeuoR3lefqHoN3MdCUTE1h+5KaRfe3al7UiaOW4cCvQ=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:51.343061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f36bf037-97a6-49f0-849e-ac403e70ee06 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Getting quotas for project 5a1ecd0cc6db4fef90f0c36273f69e27. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:16:51.349956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-f36bf037-97a6-49f0-849e-ac403e70ee06 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Getting quotas for user e44a813ef974467c8d9e2570291c3c59 and project 5a1ecd0cc6db4fef90f0c36273f69e27. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:16:51.378824 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f36bf037-97a6-49f0-849e-ac403e70ee06 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.277297 Aug 24 05:16:51.379856 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3871/8011] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:16:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:52.440020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:52.440779 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:52.446020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-266785339", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-848112196", "security_groups": [{"name": "tempest-secgroup-smoke-291143482"}], "networks": [{"uuid": "d4ea3969-e821-4861-ac66-cf47425740d8"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:52.563408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] validate_networks() for [('d4ea3969-e821-4861-ac66-cf47425740d8', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:16:52.949221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:16:52.949691 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:16:52.950268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:16:52.950756 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:16:52.951359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:16:52.961778 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:52.962357 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:52.962870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:52.963690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:52.964211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:52.964729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:52.983061 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Getting quotas for project 5a1ecd0cc6db4fef90f0c36273f69e27. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:16:52.988426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Getting quotas for user e44a813ef974467c8d9e2570291c3c59 and project 5a1ecd0cc6db4fef90f0c36273f69e27. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:16:53.001770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:16:53.004116 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:16:53.053746 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a4192287-b9b5-482b-b06d-205cc1b5b306 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.615506 Aug 24 05:16:53.055817 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4141/8012] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:16:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:16:53.067928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-783b742c-6dc6-435f-855b-35baacd819cf tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:53.069993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-783b742c-6dc6-435f-855b-35baacd819cf tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:53.133954 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-783b742c-6dc6-435f-855b-35baacd819cf tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:53.143113 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-783b742c-6dc6-435f-855b-35baacd819cf tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1245 microversion: 2.1 time: 0.080889 Aug 24 05:16:53.143707 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3872/8013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:53 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:16:54.165497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:54.166067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:54.173637 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:54.174122 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:54.174551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:54.175239 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:54.175702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:54.176237 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:54.269524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:54.278605 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-63a0743c-3ddb-49e2-9ed3-a40bcad64403 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1297 microversion: 2.1 time: 0.118061 Aug 24 05:16:54.279260 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4142/8014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:54 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:55.302845 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:55.303588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:55.311960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:55.312938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:55.313507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:55.314714 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:55.315431 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:55.315881 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:55.574900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:55.584025 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-adc12f2f-b839-431b-87b5-1ca468b06214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1370 microversion: 2.1 time: 0.285523 Aug 24 05:16:55.584619 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3873/8015] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:55 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:55.993217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-95d65e45-8b4e-4dcb-936f-6343b252b366 req-ed595472-2416-4bd9-8cff-9d51f207d57e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:56.004156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-95d65e45-8b4e-4dcb-936f-6343b252b366 req-ed595472-2416-4bd9-8cff-9d51f207d57e service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:56.004730 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-95d65e45-8b4e-4dcb-936f-6343b252b366 req-ed595472-2416-4bd9-8cff-9d51f207d57e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:56.005362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-95d65e45-8b4e-4dcb-936f-6343b252b366 req-ed595472-2416-4bd9-8cff-9d51f207d57e service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:56.017965 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-95d65e45-8b4e-4dcb-936f-6343b252b366 req-ed595472-2416-4bd9-8cff-9d51f207d57e service nova] Creating event network-changed:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h2-846470-15 Aug 24 05:16:56.024171 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-95d65e45-8b4e-4dcb-936f-6343b252b366 req-ed595472-2416-4bd9-8cff-9d51f207d57e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035159 Aug 24 05:16:56.025703 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4143/8016] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:56.606123 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:56.607371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:56.615542 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:56.616449 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:56.616969 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:56.617788 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:56.618460 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:56.619088 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:56.833394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:56.841879 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bb2ef53a-1d69-4d1d-a5b0-6fbaa1f9ad46 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1370 microversion: 2.1 time: 0.239946 Aug 24 05:16:56.842472 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3874/8017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:56 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:57.866532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:57.867246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:57.874989 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:57.875474 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:57.875943 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:57.876672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:57.877093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:57.877516 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:58.038680 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:58.052598 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-a67ee7a4-dc3a-4534-b497-b6a376964509 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1370 microversion: 2.1 time: 0.192140 Aug 24 05:16:58.053716 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4144/8018] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:57 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:59.074396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:59.074968 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:59.082717 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:59.083363 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:59.083876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:59.084607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:59.085090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:59.085533 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:59.233595 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:59.242078 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-27e500fd-a1cb-442e-bd4c-11a7bcbcaa18 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1370 microversion: 2.1 time: 0.171906 Aug 24 05:16:59.242657 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3875/8019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:59 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:00.267221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:00.268256 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:00.276212 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:00.276693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:00.277127 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:00.277819 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:00.278267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:00.278690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:00.414876 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:00.424441 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d9c8250-76c7-44a9-9a9d-e25b31735e63 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1370 microversion: 2.1 time: 0.163881 Aug 24 05:17:00.425018 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4145/8020] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:00 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:01.446753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:01.447351 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:01.454479 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:01.454982 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:01.455434 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:01.456162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:01.457004 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:01.457664 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:01.613055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:01.621423 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5e42ddd7-6012-400f-9f5e-1a1bef7a3371 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1370 microversion: 2.1 time: 0.178811 Aug 24 05:17:01.622246 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3876/8021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:01 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:02.643334 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:02.643915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:02.651165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:02.651652 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:02.652105 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:02.652803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:02.653252 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:02.653675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:02.800499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:02.808715 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b0fa5b52-d578-4cad-bb57-4d765fda3b27 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1370 microversion: 2.1 time: 0.169376 Aug 24 05:17:02.809291 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4146/8022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:02 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:02.985208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-a3d33a8f-cff0-4b56-9ebb-aacda0d48b92 req-b2d100ac-1528-4b66-8fa1-348fad92352d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "name": "network-vif-plugged", "status": "completed", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:17:02.999070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3d33a8f-cff0-4b56-9ebb-aacda0d48b92 req-b2d100ac-1528-4b66-8fa1-348fad92352d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:02.999575 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3d33a8f-cff0-4b56-9ebb-aacda0d48b92 req-b2d100ac-1528-4b66-8fa1-348fad92352d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:03.000471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-a3d33a8f-cff0-4b56-9ebb-aacda0d48b92 req-b2d100ac-1528-4b66-8fa1-348fad92352d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:03.013244 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-a3d33a8f-cff0-4b56-9ebb-aacda0d48b92 req-b2d100ac-1528-4b66-8fa1-348fad92352d service nova] Creating event network-vif-plugged:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h2-846470-15 Aug 24 05:17:03.018722 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-a3d33a8f-cff0-4b56-9ebb-aacda0d48b92 req-b2d100ac-1528-4b66-8fa1-348fad92352d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037824 Aug 24 05:17:03.019465 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3877/8023] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:17:03.834297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:03.834907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:03.836925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:03.837600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:03.844264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:03.844746 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:03.845182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:03.845870 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:03.846322 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:03.846744 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:03.986099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:03.995048 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-918c7896-3029-428c-bdef-cd95e296a4cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1370 microversion: 2.1 time: 0.167428 Aug 24 05:17:03.995683 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4147/8024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:03 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:05.015119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:05.022403 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:05.023432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:05.033462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:05.034148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:05.034712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:05.035851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:05.036506 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:05.037095 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:05.183082 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:05.190967 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f61ee905-3646-4c30-80d7-b71039737fd1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1555 microversion: 2.1 time: 0.177502 Aug 24 05:17:05.191503 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3878/8025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:05 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:05.214570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:05.215849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:05.225823 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:05.226305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:05.226735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:05.227458 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:05.227940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:05.228391 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:05.713547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:05.721592 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6a7571ab-56f8-4c79-832f-82c3c7d3b870 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1555 microversion: 2.1 time: 0.513696 Aug 24 05:17:05.722137 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4148/8026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:05 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1555 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:07.794418 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-30236efa-c22d-4c5f-b92e-ab6ef0902ed3 req-deee4622-18c6-4c63-8133-cf38f39384c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:17:07.806229 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30236efa-c22d-4c5f-b92e-ab6ef0902ed3 req-deee4622-18c6-4c63-8133-cf38f39384c3 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:07.806724 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30236efa-c22d-4c5f-b92e-ab6ef0902ed3 req-deee4622-18c6-4c63-8133-cf38f39384c3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:07.807178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-30236efa-c22d-4c5f-b92e-ab6ef0902ed3 req-deee4622-18c6-4c63-8133-cf38f39384c3 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:07.818714 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-30236efa-c22d-4c5f-b92e-ab6ef0902ed3 req-deee4622-18c6-4c63-8133-cf38f39384c3 service nova] Creating event network-changed:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h2-846470-15 Aug 24 05:17:07.824043 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-30236efa-c22d-4c5f-b92e-ab6ef0902ed3 req-deee4622-18c6-4c63-8133-cf38f39384c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033346 Aug 24 05:17:07.824765 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3879/8027] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:18:04.472342 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:18:04.473398 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:18:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:34.370966 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:34.371579 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:34.377657 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:34.378030 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:53.233634 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:53.234731 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:19:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:55.891124 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:19:55.892463 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:19:55.893302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.894558 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=40 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:55.900539 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:19:55.901394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:55.912729 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:55.913304 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:55.913727 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:55.914405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:55.914854 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:55.915285 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:55.939275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lazy-loading 'flavor' on Instance uuid 8d2a269d-8f74-4ba4-bd83-042bd658f083 {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:19:56.147189 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e04d81d3-363f-4112-b59f-74726852c91a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "POST /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083/action" status: 202 len: 0 microversion: 2.1 time: 0.259086 Aug 24 05:19:56.147760 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4149/8028] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:19:55 2022] POST /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:19:56.154695 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:19:56.155572 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:19:56.156201 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.157136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=34 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:56.162684 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:56.163422 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:56.173804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:56.174314 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:56.174770 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:56.175965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:56.176693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:56.177156 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:56.360311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:56.368865 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-34ad3f48-ea2e-49a3-a76a-3a3ac4152d09 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.216032 Aug 24 05:19:56.369433 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3880/8029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:56 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:57.400112 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:57.401509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:57.417155 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34838. Aug 24 05:19:57.419849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:57.420329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:57.420759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:57.421448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:57.421894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:57.422335 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:57.422880 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34836. Aug 24 05:19:57.569849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:57.578017 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-56bc466f-4a4b-4754-843f-820ff9a37eee tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.189631 Aug 24 05:19:57.578589 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4150/8030] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:57 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:58.601583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:58.602200 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:58.617987 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34846. Aug 24 05:19:58.621734 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34844. Aug 24 05:19:58.624272 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:58.624771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:58.625223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:58.625930 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:58.626406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:58.626950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:58.782343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:58.791582 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-690559ed-4d2e-42bd-bd9a-faa9bfd0c246 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.194362 Aug 24 05:19:58.792255 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3881/8031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:58 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:59.817358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:59.818420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:59.829279 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:59.830071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:59.830734 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:59.832389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:59.833695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:59.834123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:59.990342 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:59.998911 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-880d1091-9d8b-4659-84cf-cb523f3e94ca tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.188084 Aug 24 05:19:59.999486 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4151/8032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:59 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:01.025249 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:01.026037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:01.037048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:01.037645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:01.038138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:01.038866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:01.039339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:01.039819 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:01.195823 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:01.208221 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7558dfa1-c3a9-49ca-9bf4-6a260fa97d9d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.189276 Aug 24 05:20:01.208775 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3882/8033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:01 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:02.233974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:02.235027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:02.244449 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:02.244928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:02.245417 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:02.246099 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:02.246547 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:02.246975 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:02.391052 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:02.403213 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9b259278-4226-45db-a290-69320db0c782 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.175598 Aug 24 05:20:02.404139 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4152/8034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:02 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:03.428076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:03.428652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:03.436324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:03.436827 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:03.437327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:03.438139 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:03.438672 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:03.439228 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:03.592439 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:03.600633 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3b5ffea3-2210-4331-82e0-422d35f01a99 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.178099 Aug 24 05:20:03.601222 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3883/8035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:03 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:04.623162 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:04.623911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:04.632305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:04.632787 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:04.633222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:04.633918 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:04.634370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:04.634795 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:04.778614 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:04.789743 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-67aeca97-ca3c-4d72-9c15-a395c46f6ebb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.171225 Aug 24 05:20:04.790326 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4153/8036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:04 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:05.813889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:05.814490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:05.823075 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:05.823615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:05.824135 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:05.824904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:05.825835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:05.826368 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:05.973305 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:05.986052 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-67c1947b-df4f-41be-99a9-e67e6bbddcba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.177200 Aug 24 05:20:05.986902 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3884/8037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:05 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:07.018557 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:07.019394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:07.031097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:07.031835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:07.032524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:07.033650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:07.034399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:07.035117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:07.181615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:07.190105 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-05ec723c-af26-442e-ba68-3819e7dac82d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.178295 Aug 24 05:20:07.190714 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4154/8038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:07 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:08.213771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:08.215094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:08.227366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:08.228333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:08.229148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:08.229903 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:08.230600 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:08.231385 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:08.398137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:08.406754 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-45103ee1-f801-44a4-8b42-1c4ceafe0a66 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1701 microversion: 2.1 time: 0.198751 Aug 24 05:20:08.407340 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3885/8039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:08 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1701 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:09.430424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:09.431000 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:09.438244 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:09.438725 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:09.439169 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:09.439907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:09.440353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:09.440774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:09.582197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:09.590602 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-59be7c67-143c-4387-9913-7a589528fee1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1701 microversion: 2.1 time: 0.164587 Aug 24 05:20:09.591186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4155/8040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:09 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:10.613198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:10.613887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:10.622376 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:10.622957 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:10.623486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:10.624594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:10.625170 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:10.625715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:10.773991 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:10.786543 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a5332bf5-70a7-4de6-bb7d-e635173e36e9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1701 microversion: 2.1 time: 0.177559 Aug 24 05:20:10.787354 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3886/8041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:10 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1701 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:11.809358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:11.809986 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:11.816947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:11.817445 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:11.817873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:11.818569 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:11.819019 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:11.819440 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:11.910662 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-5261b30b-f011-43fe-aa0f-763cc8f739d8 req-b8633ad6-93ca-40f6-a1d6-c8eaa31a3664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "name": "network-vif-plugged", "status": "completed", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:20:11.924365 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5261b30b-f011-43fe-aa0f-763cc8f739d8 req-b8633ad6-93ca-40f6-a1d6-c8eaa31a3664 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:11.924905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5261b30b-f011-43fe-aa0f-763cc8f739d8 req-b8633ad6-93ca-40f6-a1d6-c8eaa31a3664 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:11.925360 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-5261b30b-f011-43fe-aa0f-763cc8f739d8 req-b8633ad6-93ca-40f6-a1d6-c8eaa31a3664 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:11.937420 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-5261b30b-f011-43fe-aa0f-763cc8f739d8 req-b8633ad6-93ca-40f6-a1d6-c8eaa31a3664 service nova] Creating event network-vif-plugged:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h2-846470-15 Aug 24 05:20:11.942877 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-5261b30b-f011-43fe-aa0f-763cc8f739d8 req-b8633ad6-93ca-40f6-a1d6-c8eaa31a3664 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106737 Aug 24 05:20:11.943489 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3887/8042] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:20:11.974894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:11.983025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-60edc357-b41f-4cf4-a96c-ff068708413b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1701 microversion: 2.1 time: 0.177630 Aug 24 05:20:11.983606 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4156/8043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:11 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1701 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:13.008538 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:13.009978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:13.016583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:13.017085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:13.017568 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:13.018320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:13.018820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:13.019262 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:13.160014 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:13.172916 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-204524a5-1138-498d-b494-5ed429e85844 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1701 microversion: 2.1 time: 0.170979 Aug 24 05:20:13.173687 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3888/8044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:13 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1701 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:14.197803 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:14.199551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:14.207831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:14.208293 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:14.209420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:14.210446 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:14.211263 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:14.211923 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:14.349365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:14.357939 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2d144c44-4e47-49e9-91d4-1a9e5aa06e6e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.164484 Aug 24 05:20:14.358591 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4157/8045] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:14 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:15.381102 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:15.384601 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:15.392113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:15.392917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:15.393589 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:15.394829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:15.395339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:15.396048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:15.550716 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:15.561393 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-99ca717b-c9b1-44dc-bd21-8fd5b8db4fc8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.184169 Aug 24 05:20:15.565410 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3889/8046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:15 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:16.582908 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:16.584358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:16.592575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:16.593223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:16.593760 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:16.594532 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:16.595079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:16.595570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:16.754042 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:16.763392 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-df3326cf-0ffb-4b4a-94ac-65c26d120e1d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.184739 Aug 24 05:20:16.776090 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4158/8047] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:16 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:20:17.786949 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:17.788261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:17.796612 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:17.797133 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:17.797594 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:17.798328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:17.798892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:17.799386 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:17.998329 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:18.007534 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-72d9f9f7-fc97-4608-a25c-6b7386803011 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.224749 Aug 24 05:20:18.008393 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3890/8048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:17 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:19.032067 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:19.032711 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:19.040294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:19.042598 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:19.043222 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:19.047368 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:19.048079 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:19.049260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:19.212075 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:19.221560 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d2053e9-8a0f-40a9-b539-166aaa476551 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.193231 Aug 24 05:20:19.222622 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4159/8049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:19 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:20.244744 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:20.245471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:20.253018 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:20.253520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:20.253975 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:20.254685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:20.255153 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:20.255590 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:20.408497 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:20.417941 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be21e495-6e63-406f-88df-d5977b2c585a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.177384 Aug 24 05:20:20.418549 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3891/8050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:20 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:21.440699 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:21.442002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:21.449703 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:21.450174 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:21.450613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:21.451309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:21.451800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:21.452211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:21.632004 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:21.640982 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-0d15871c-ff77-455f-a4f0-6a0f56d4d910 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.204148 Aug 24 05:20:21.641994 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4160/8051] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:21 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:22.668382 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:22.668995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:22.678640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:22.679234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:22.679847 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:22.680643 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:22.681178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:22.681685 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:22.859211 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:22.868363 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e8837796-3b57-4ba1-a9d6-03421c0ad5d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.207934 Aug 24 05:20:22.880324 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3892/8052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:22 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:23.890844 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:23.891509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:23.900128 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:23.900611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:23.901047 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:23.901747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:23.902211 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:23.902628 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:24.067154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:24.076817 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c94a275f-5799-4608-880e-9167ab81b3c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1696 microversion: 2.1 time: 0.189831 Aug 24 05:20:24.077534 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4161/8053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:23 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:25.098920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:25.099553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:25.109208 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:25.109995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:25.110818 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:25.112066 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:25.112732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:25.113467 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:25.257793 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:25.266039 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-475c6b98-b30a-46c9-8546-ca8c2cbea1ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1678 microversion: 2.1 time: 0.171299 Aug 24 05:20:25.266598 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3893/8054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:25 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:26.292964 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:26.293573 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:26.296337 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=27 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:26.301921 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:26.302409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:26.302845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:26.303545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:26.304031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:26.304461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:26.307397 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:26.448728 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:26.457386 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9fa69ea6-af2b-4428-aff9-607c35d09dba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1678 microversion: 2.1 time: 0.169730 Aug 24 05:20:26.457952 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4162/8055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:26 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:27.484659 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:27.485432 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:27.489219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=31 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:27.496518 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:27.497080 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:27.497911 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:27.499174 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:27.500138 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:27.500596 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:27.504783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=81 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:27.660111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:27.669017 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-10ff4f70-43af-4790-b092-f53f67bd0bb3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1621 microversion: 2.1 time: 0.189724 Aug 24 05:20:27.672544 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3894/8056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:27 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1621 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:27.693351 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:20:27.693944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:27.700341 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:27.700824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:27.701253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:27.701944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:27.702393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:27.702817 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:27.840354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122536) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:20:27.927394 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-23c41658-f934-4903-83b3-01957376ed44 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "POST /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083/action" status: 202 len: 0 microversion: 2.1 time: 0.237828 Aug 24 05:20:27.928186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4163/8057] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:20:27 2022] POST /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:20:27.938440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:27.939131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:27.945498 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:27.946017 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:27.946478 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:27.947273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:27.947925 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:27.948544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:28.094344 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:28.102433 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0075b71d-9acf-43f8-8840-a66b0e6dc85d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1629 microversion: 2.1 time: 0.169051 Aug 24 05:20:28.103075 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3895/8058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:27 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1629 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:29.126215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:29.126794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:29.133181 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:29.133670 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:29.134151 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:29.134864 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:29.135389 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:29.135814 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:29.297751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:29.310096 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-d041399e-23f9-4bc2-8d70-f043a98ee0e3 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1631 microversion: 2.1 time: 0.188742 Aug 24 05:20:29.310880 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4164/8059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:29 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1631 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:30.070221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-f5736c38-8ba5-49c7-ac78-95ae0df9b3fd req-fe6a5c43-905f-4a9a-94cb-9da449164641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "name": "network-vif-unplugged", "status": "completed", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:20:30.082055 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f5736c38-8ba5-49c7-ac78-95ae0df9b3fd req-fe6a5c43-905f-4a9a-94cb-9da449164641 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:30.082447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f5736c38-8ba5-49c7-ac78-95ae0df9b3fd req-fe6a5c43-905f-4a9a-94cb-9da449164641 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:30.082929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-f5736c38-8ba5-49c7-ac78-95ae0df9b3fd req-fe6a5c43-905f-4a9a-94cb-9da449164641 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:30.098499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-f5736c38-8ba5-49c7-ac78-95ae0df9b3fd req-fe6a5c43-905f-4a9a-94cb-9da449164641 service nova] Creating event network-vif-unplugged:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h1-846470-15 Aug 24 05:20:30.103811 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-f5736c38-8ba5-49c7-ac78-95ae0df9b3fd req-fe6a5c43-905f-4a9a-94cb-9da449164641 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125952 Aug 24 05:20:30.105377 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3896/8060] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:20:30.333329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:30.333880 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:30.342062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:30.342556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:30.342974 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:30.343702 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:30.344176 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:30.344604 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:30.602069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:30.610707 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-083cfdb1-5c2d-40f0-85dd-14dd7181a677 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.281777 Aug 24 05:20:30.611373 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4165/8061] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:30 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:31.641349 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:31.643322 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:31.651851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:31.653104 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:31.654178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:31.655130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:31.655829 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:31.656448 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:31.821094 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:31.830557 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-043ac6f9-09f0-415d-b0a2-65f439467904 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.200699 Aug 24 05:20:31.831825 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3897/8062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:31 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:32.124221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-bfcff2ac-cb61-4fd3-8a96-76838f8f0e04 req-fc5ddd04-3679-4f7a-9888-cc0bc6e60a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:20:32.136081 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bfcff2ac-cb61-4fd3-8a96-76838f8f0e04 req-fc5ddd04-3679-4f7a-9888-cc0bc6e60a1d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:32.136639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bfcff2ac-cb61-4fd3-8a96-76838f8f0e04 req-fc5ddd04-3679-4f7a-9888-cc0bc6e60a1d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:32.137082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bfcff2ac-cb61-4fd3-8a96-76838f8f0e04 req-fc5ddd04-3679-4f7a-9888-cc0bc6e60a1d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:32.149193 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bfcff2ac-cb61-4fd3-8a96-76838f8f0e04 req-fc5ddd04-3679-4f7a-9888-cc0bc6e60a1d service nova] Creating event network-changed:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h1-846470-15 Aug 24 05:20:32.155033 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-bfcff2ac-cb61-4fd3-8a96-76838f8f0e04 req-fc5ddd04-3679-4f7a-9888-cc0bc6e60a1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034726 Aug 24 05:20:32.155651 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4166/8063] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:20:32.860128 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:32.861429 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:32.872902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:32.873777 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:32.874544 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:32.875783 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:32.876570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:32.877312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:33.021780 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:33.030234 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-58b024be-1401-4afd-9dfe-360f06eba228 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.175477 Aug 24 05:20:33.045693 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3898/8064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:32 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:34.052612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:34.053429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:34.061897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:34.062496 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:34.063144 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:34.064206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:34.064673 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:34.065106 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:34.213197 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:34.221981 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c605d46c-1a5e-4758-8946-cd6d7bd1d883 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.173482 Aug 24 05:20:34.229602 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4167/8065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:34 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:35.244789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:35.245399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:35.253768 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:35.254293 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:35.254751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:35.255493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:35.256005 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:35.256477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:35.401008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:35.409922 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6d356f4c-3391-4b48-b2b5-e5c7dded9c11 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.169191 Aug 24 05:20:35.410548 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3899/8066] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:35 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:36.431853 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:36.432453 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:36.441258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:36.441799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:36.442243 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:36.443426 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:36.443786 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:36.444216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:36.597179 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:36.606864 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ce839d8a-59d3-41ae-9bff-5b906e5a1ef7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.178988 Aug 24 05:20:36.608473 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4168/8067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:36 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:37.629977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:37.630673 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:37.638037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:37.638537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:37.638989 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:37.639998 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:37.640468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:37.641090 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:37.803545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:37.813530 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-225f7d64-1ceb-45e8-a596-3193236f03b6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.188126 Aug 24 05:20:37.814738 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3900/8068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:37 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:38.838393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:38.839031 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:38.852561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:38.853542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:38.853994 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:38.854726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:38.855191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:38.855626 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:39.067888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:39.072926 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b591f137-c21c-4a94-b9cf-5a6113e47d80 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.238419 Aug 24 05:20:39.073706 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4169/8069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:38 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:40.095919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:40.096668 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:40.104235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:40.104749 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:40.105198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:40.105915 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:40.106384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:40.106864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:40.241981 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:40.253229 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-10e90b51-6576-4ece-b4c3-94dd59d10ccc tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.161587 Aug 24 05:20:40.253832 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3901/8070] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:40 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:41.278649 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:41.279772 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:41.288635 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:41.289110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:41.289542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:41.290231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:41.290664 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:41.291101 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:41.440353 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:41.452081 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1162a3d2-ab62-4212-8698-7007ffae8673 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.179783 Aug 24 05:20:41.452885 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4170/8071] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:41 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:42.480735 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:42.481311 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:42.489657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:42.490168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:42.490625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:42.491346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:42.491853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:42.492301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:42.639631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:42.647933 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c8efc80e-c869-451e-ab55-0f99559bd500 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.175743 Aug 24 05:20:42.648531 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3902/8072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:42 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:43.673441 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:43.674268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:43.681493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:43.681977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:43.682407 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:43.683102 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:43.683552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:43.684003 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:43.828154 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:43.837319 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b832cdf6-cc50-4192-9dc6-c1b9f8c30514 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.170163 Aug 24 05:20:43.837899 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4171/8073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:43 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:44.861746 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:44.862458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:44.872221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:44.872920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:44.873530 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:44.874514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:44.875178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:44.875775 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:45.018454 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:45.031325 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2ba684ae-fd6e-495d-951d-49676ab702af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.175111 Aug 24 05:20:45.032185 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3903/8074] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:44 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:46.058497 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:46.059460 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:46.071043 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:46.071928 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:46.072612 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:46.073800 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:46.074504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:46.075242 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:46.215826 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:46.226025 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cf64d82d-d4bf-456f-9dc8-0ba6dca1fc85 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.174540 Aug 24 05:20:46.227069 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4172/8075] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:46 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:47.255327 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:47.256109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:47.263303 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:47.263970 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:47.264660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:47.265455 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:47.266000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:47.266440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:47.416900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:47.426938 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-19974ebd-97f7-426a-ba90-2376a030db3a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.175557 Aug 24 05:20:47.427939 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3904/8076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:47 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:48.450312 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:48.450935 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:48.459636 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:48.460223 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:48.460697 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:48.461468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:48.461969 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:48.462435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:48.607564 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:48.616326 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b8bfa1a-a53e-4ff5-bd3b-0b40e041724b tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.170481 Aug 24 05:20:48.616892 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4173/8077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:48 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:49.174369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-2b558b1e-06ee-472c-ab4c-fdeab8b3aae1 req-da40dad7-48f2-40f5-ac2f-b9f40b46ba3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "name": "network-vif-plugged", "status": "completed", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:20:49.192896 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b558b1e-06ee-472c-ab4c-fdeab8b3aae1 req-da40dad7-48f2-40f5-ac2f-b9f40b46ba3d service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:49.193399 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b558b1e-06ee-472c-ab4c-fdeab8b3aae1 req-da40dad7-48f2-40f5-ac2f-b9f40b46ba3d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:49.193866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-2b558b1e-06ee-472c-ab4c-fdeab8b3aae1 req-da40dad7-48f2-40f5-ac2f-b9f40b46ba3d service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:49.205496 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-2b558b1e-06ee-472c-ab4c-fdeab8b3aae1 req-da40dad7-48f2-40f5-ac2f-b9f40b46ba3d service nova] Creating event network-vif-plugged:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h1-846470-15 Aug 24 05:20:49.210979 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-2b558b1e-06ee-472c-ab4c-fdeab8b3aae1 req-da40dad7-48f2-40f5-ac2f-b9f40b46ba3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040468 Aug 24 05:20:49.211606 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3905/8078] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:20:49.641267 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:49.641846 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:49.650913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:49.651609 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:49.652109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:49.652887 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:49.653548 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:49.654142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:49.802068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:49.813684 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-de4ab0c2-716c-4fc8-90b6-e538e884ccba tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.176161 Aug 24 05:20:49.814445 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4174/8079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:49 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:50.843307 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:50.844056 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:50.852021 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:50.852534 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:50.852995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:50.854023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:50.854531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:50.854978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:50.998236 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:51.006558 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c87c84f6-61f1-43bd-8961-f55fcf06bf04 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1687 microversion: 2.1 time: 0.167602 Aug 24 05:20:51.007153 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3906/8080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:50 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:52.032009 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:52.032759 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:52.044350 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:52.045086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:52.045777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:52.046872 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:52.047574 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:52.048250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:52.192165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:52.200203 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5b3fcb54-2752-4613-8e86-36fa791fb865 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1674 microversion: 2.1 time: 0.174708 Aug 24 05:20:52.200756 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4175/8081] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:52 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:24.486487 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:21:24.487951 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:21:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:21:56.912673 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:21:56.913515 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:22:40.391758 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:40.392931 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:40.396588 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:40.397134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:40.397502 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-ded060f5-7aa6-4c92-a930-c51d9589232c req-507f1d5e-096a-4e23-a008-d9c270bd8512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:22:40.400695 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=25 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:40.401420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=69 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:40.405359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.405870 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.406335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.407136 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.407615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.408143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.410995 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ded060f5-7aa6-4c92-a930-c51d9589232c req-507f1d5e-096a-4e23-a008-d9c270bd8512 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.411472 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ded060f5-7aa6-4c92-a930-c51d9589232c req-507f1d5e-096a-4e23-a008-d9c270bd8512 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.412065 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-ded060f5-7aa6-4c92-a930-c51d9589232c req-507f1d5e-096a-4e23-a008-d9c270bd8512 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.429557 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-ded060f5-7aa6-4c92-a930-c51d9589232c req-507f1d5e-096a-4e23-a008-d9c270bd8512 service nova] Creating event network-changed:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h1-846470-15 Aug 24 05:22:40.435106 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-ded060f5-7aa6-4c92-a930-c51d9589232c req-507f1d5e-096a-4e23-a008-d9c270bd8512 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045168 Aug 24 05:22:40.436115 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4176/8082] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:22:40.442162 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:22:40.530322 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5dd560a5-d469-413e-a9fc-fe502bfddb0e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 204 len: 0 microversion: 2.1 time: 0.142657 Aug 24 05:22:40.539773 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3907/8083] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:22:40 2022] DELETE /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:22:40.543071 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:40.544050 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:40.551147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.551937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.552372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.553070 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.553518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.553937 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.767016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:40.775216 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-453fd13e-027c-4d1f-a8b4-5f1da2c35c8c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.237763 Aug 24 05:22:40.775839 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4177/8084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:40 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:41.801458 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:41.802127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:41.809892 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:41.810404 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:41.810887 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:41.811616 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:41.812117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:41.812557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:42.020562 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:42.029733 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-181384c4-d041-4795-b9ba-2d274ed1b4d6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1680 microversion: 2.1 time: 0.232741 Aug 24 05:22:42.030295 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3908/8085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:41 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:42.664274 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-924208ac-ecbe-4412-8deb-2a085bb09866 req-e6721662-de39-4d72-a278-eb53912f0823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2a269d-8f74-4ba4-bd83-042bd658f083", "name": "network-vif-deleted", "tag": "05d59813-7a95-4cdc-b1f6-71e06f126ffd"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:22:42.674508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-924208ac-ecbe-4412-8deb-2a085bb09866 req-e6721662-de39-4d72-a278-eb53912f0823 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:42.675045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-924208ac-ecbe-4412-8deb-2a085bb09866 req-e6721662-de39-4d72-a278-eb53912f0823 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:42.675507 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-924208ac-ecbe-4412-8deb-2a085bb09866 req-e6721662-de39-4d72-a278-eb53912f0823 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:42.687339 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-924208ac-ecbe-4412-8deb-2a085bb09866 req-e6721662-de39-4d72-a278-eb53912f0823 service nova] Creating event network-vif-deleted:05d59813-7a95-4cdc-b1f6-71e06f126ffd for instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 on n-h1-846470-15 Aug 24 05:22:42.693855 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-924208ac-ecbe-4412-8deb-2a085bb09866 req-e6721662-de39-4d72-a278-eb53912f0823 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097198 Aug 24 05:22:42.694691 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4178/8086] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:22:43.052346 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:43.052962 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:43.059861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:43.060387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:43.060841 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.061557 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:43.062037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:43.063179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.096986 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:43.097420 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:43.097880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.098316 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lazy-loading 'fault' on Instance uuid 8d2a269d-8f74-4ba4-bd83-042bd658f083 {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:22:43.148331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:43.157922 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-84579825-6a2e-477f-b5f9-602c2bbf0c14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 200 len: 1335 microversion: 2.1 time: 0.109907 Aug 24 05:22:43.158525 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3909/8087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:43 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:44.188142 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:44.189281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 8d2a269d-8f74-4ba4-bd83-042bd658f083] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:44.201911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:44.202689 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:44.203436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:44.205203 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:44.206104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:44.207048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:44.223650 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] HTTP exception thrown: Instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 could not be found. Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Request method failure captured: Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 HTTP/1.1 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBbQ9DD7pSFp7QGpQEEQnq4wUcBUkJ22FwyjTq2YZFZFlPmQGdlP0t0FCcLE7_hBBGC5k4CpDNRhAMxZFojhWj-vJTrjaHAWM-nDOxiuk-cKPZXkvvzHCOwJQYkAasRuwvmUIEhPSzWwYvNsJ1L6oeJnCPkLCMgX7uwwy2--KulNeqtQ Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: 5a1ecd0cc6db4fef90f0c36273f69e27 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestShelveInstance-2103984383 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5a1ecd0cc6db4fef90f0c36273f69e27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5a1ecd0cc6db4fef90f0c36273f69e27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5a1ecd0cc6db4fef90f0c36273f69e27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5a1ecd0cc6db4fef90f0c36273f69e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestShelveInstance-2103984383 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: 5a1ecd0cc6db4fef90f0c36273f69e27 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestShelveInstance-2103984383 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestShelveInstance-2103984383-project Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: e44a813ef974467c8d9e2570291c3c59 Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestShelveInstance-2103984383-project Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 could not be found. Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '8d2a269d-8f74-4ba4-bd83-042bd658f083'} Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 could not be found. Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 could not be found. Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:22:44.225372 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 could not be found. Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Returning 404 to user: Instance 8d2a269d-8f74-4ba4-bd83-042bd658f083 could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-179925fd-37c5-46e8-b19c-a12cfc408a21 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083" status: 404 len: 111 microversion: 2.1 time: 0.047765 Aug 24 05:22:44.230869 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4179/8088] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:44 2022] GET /compute/v2.1/servers/8d2a269d-8f74-4ba4-bd83-042bd658f083 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:22:44.407159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-fb08f0d1-5f9b-4034-b909-8bc8e8ae863d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '.version_select at 0x7f102a7973a0>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:44.434775 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-fb08f0d1-5f9b-4034-b909-8bc8e8ae863d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-848112196" status: 202 len: 0 microversion: 2.1 time: 0.031481 Aug 24 05:22:44.435430 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3910/8089] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 05:22:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-848112196 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:22:44.461051 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7c3a57dc-9825-44b6-85ac-84ed0abb46f7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Action: 'create', calling method: .version_select at 0x7f1021a3cf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-703256110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPye7BZ3kejJzS89wxnFNSdAWLfC2BGQtaHJVL0y12El6r2EVVDjP7tHILWlnHLPaxyktaBKk71IuMT7j3sfQ0HFZEYTzi6v/Jj4BIhN2a5XuKY6KuUQ01MMFst6V7PGeA=="}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:22:44.476600 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-7c3a57dc-9825-44b6-85ac-84ed0abb46f7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Getting quotas for project 5a1ecd0cc6db4fef90f0c36273f69e27. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:22:44.481910 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-7c3a57dc-9825-44b6-85ac-84ed0abb46f7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Getting quotas for user e44a813ef974467c8d9e2570291c3c59 and project 5a1ecd0cc6db4fef90f0c36273f69e27. Resources: {'key_pairs'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:22:44.495644 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c3a57dc-9825-44b6-85ac-84ed0abb46f7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:22:45.505776 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c3a57dc-9825-44b6-85ac-84ed0abb46f7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35174. Aug 24 05:22:45.527869 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7c3a57dc-9825-44b6-85ac-84ed0abb46f7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.070606 Aug 24 05:22:45.533554 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4180/8090] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:22:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:22:54.382730 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:22:54.383379 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:23:03.975036 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:03.975879 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:03.980978 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-646277030", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-703256110", "security_groups": [{"name": "tempest-secgroup-smoke-155577224"}], "networks": [{"uuid": "d4ea3969-e821-4861-ac66-cf47425740d8"}], "block_device_mapping_v2": [{"uuid": "8b3d4dc3-ce4e-40ba-8f20-22528d6a7744", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:23:04.118315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.network.neutron [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] validate_networks() for [('d4ea3969-e821-4861-ac66-cf47425740d8', None, None, None, None, None)] {{(pid=122535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:23:04.575019 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Flavor limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:23:04.575465 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Image limits 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:23:04.576031 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Flavor pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:23:04.576461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Image pref 0:0:0 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:23:04.576866 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.virt.hardware [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:23:04.587338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:04.587976 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:04.588352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:04.589111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:04.589587 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:04.590032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:04.611507 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Getting quotas for project 5a1ecd0cc6db4fef90f0c36273f69e27. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:23:04.620922 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Getting quotas for user e44a813ef974467c8d9e2570291c3c59 and project 5a1ecd0cc6db4fef90f0c36273f69e27. Resources: {'cores', 'instances', 'ram'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:23:04.689665 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Going to run 1 instances... {{(pid=122535) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:23:04.691886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b3d4dc3-ce4e-40ba-8f20-22528d6a7744',volume_size=None,volume_type=None)] {{(pid=122535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:23:04.849003 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-41b5e8e0-30f6-4379-a753-6695d8da4894 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.876995 Aug 24 05:23:04.849544 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3911/8091] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:23:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:23:04.858655 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=12 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:04.859551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=4 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:04.860660 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:04.865086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9c13772d-d81b-4a85-a57d-c111e7a6e6fb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:04.865949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9c13772d-d81b-4a85-a57d-c111e7a6e6fb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:04.924141 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9c13772d-d81b-4a85-a57d-c111e7a6e6fb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:04.932201 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9c13772d-d81b-4a85-a57d-c111e7a6e6fb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1087 microversion: 2.1 time: 0.075216 Aug 24 05:23:04.932754 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4181/8092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:04 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1087 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:05.959561 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-147a986e-2ab6-46ec-b8ea-1d66d8a73b87 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:05.960623 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-147a986e-2ab6-46ec-b8ea-1d66d8a73b87 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:06.028958 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-147a986e-2ab6-46ec-b8ea-1d66d8a73b87 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:06.040359 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-147a986e-2ab6-46ec-b8ea-1d66d8a73b87 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1087 microversion: 2.1 time: 0.089349 Aug 24 05:23:06.040960 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3912/8093] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:05 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1087 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:07.062643 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:07.064020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:07.071807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:07.072500 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:07.073257 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:07.074849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:07.075551 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:07.076217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:07.145073 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:07.153586 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3d949fd1-8207-43ff-81ee-966eaff596c2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1193 microversion: 2.1 time: 0.094845 Aug 24 05:23:07.154186 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4182/8094] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:07 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:08.179039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:08.180481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:08.190669 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.191532 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.192188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.193424 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.194060 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.194661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.412849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:08.421922 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-992764bc-4a97-4eca-9d36-18d9eb84b273 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1270 microversion: 2.1 time: 0.249439 Aug 24 05:23:08.435518 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3913/8095] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:08 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1270 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:08.907710 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e602814c-1b36-497c-a711-cfd3e22c1c6b req-f11d4249-d671-4e5a-92eb-1e22bdb36e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9aa9bb-56db-4aec-be9c-811ad75d9a0e", "tag": "35bd777a-ea63-4209-8302-1c94c032d55f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:23:08.920110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e602814c-1b36-497c-a711-cfd3e22c1c6b req-f11d4249-d671-4e5a-92eb-1e22bdb36e4a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.921269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e602814c-1b36-497c-a711-cfd3e22c1c6b req-f11d4249-d671-4e5a-92eb-1e22bdb36e4a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.921830 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e602814c-1b36-497c-a711-cfd3e22c1c6b req-f11d4249-d671-4e5a-92eb-1e22bdb36e4a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.945503 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e602814c-1b36-497c-a711-cfd3e22c1c6b req-f11d4249-d671-4e5a-92eb-1e22bdb36e4a service nova] Creating event network-changed:35bd777a-ea63-4209-8302-1c94c032d55f for instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e on n-h2-846470-15 Aug 24 05:23:08.951561 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e602814c-1b36-497c-a711-cfd3e22c1c6b req-f11d4249-d671-4e5a-92eb-1e22bdb36e4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047648 Aug 24 05:23:08.952332 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4183/8096] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:23:09.445338 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:09.446117 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:09.454529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:09.455127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:09.455675 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:09.456501 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:09.457054 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:09.458146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:09.706494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:09.715158 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8fe105c-1f6a-4365-b835-27bda2095913 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1270 microversion: 2.1 time: 0.273917 Aug 24 05:23:09.727964 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3914/8097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:09 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:10.738088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:10.738661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:10.745988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:10.746467 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:10.746898 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:10.747586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:10.748068 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:10.748487 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:10.887495 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:10.895828 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7a3faf05-22ed-4602-bc7b-355e904422e2 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1270 microversion: 2.1 time: 0.162963 Aug 24 05:23:10.896408 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4184/8098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:10 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:11.919051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:11.919651 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:11.927119 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:11.927644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:11.928127 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:11.928878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:11.929332 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:11.929776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:12.078140 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:12.089392 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a67f30ad-10fb-4b92-9d1c-685e9816fdb6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1270 microversion: 2.1 time: 0.174927 Aug 24 05:23:12.089970 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3915/8099] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:11 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:13.112807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:13.113603 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:13.121568 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:13.122046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:13.122484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:13.123178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:13.123627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:13.124083 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:13.278232 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:13.286616 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3cfb3de5-baf2-44ed-967d-0270b9dab2da tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.177791 Aug 24 05:23:13.287192 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4185/8100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:13 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:14.308296 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:14.308917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:14.316132 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:14.316640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:14.317097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:14.317808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:14.318286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:14.319072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:14.473312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:14.485076 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b726f09b-e640-434e-b594-dd076fc18a88 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.181328 Aug 24 05:23:14.485872 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3916/8101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:14 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:15.511086 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:15.511877 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:15.515632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:15.521591 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:15.522077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:15.522512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:15.523208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:15.523688 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:15.524184 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:15.674303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:15.682799 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-ad461baa-ea9a-4d4d-8485-a866a7dab272 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.176704 Aug 24 05:23:15.683400 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4186/8102] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:15 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:16.704932 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:16.705640 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:16.708484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:16.710244 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=8 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:16.717146 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:16.717660 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:16.718115 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:16.718850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:16.719348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:16.719820 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:16.878415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:16.886492 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-a90cb531-b750-40c4-bc7e-7e1763e7ac02 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.186149 Aug 24 05:23:16.887073 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3917/8103] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:16 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:17.908813 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:17.909429 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:17.918088 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:17.918662 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:17.919238 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:17.920394 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:17.920856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:17.921282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:18.065949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:18.074187 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-859edc5d-3ad3-4371-930a-6d635ffeede0 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.170212 Aug 24 05:23:18.074776 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4187/8104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:17 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:19.097143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:19.097871 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:19.105111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:19.105605 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:19.106053 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:19.106754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:19.107212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:19.108040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:19.260702 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:19.269574 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-abd35e62-b24c-48b7-bf32-db4a075ae28a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.176529 Aug 24 05:23:19.270161 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3918/8105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:19 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:20.295425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:20.296171 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:20.303411 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:20.303954 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:20.304388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:20.305077 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:20.305529 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:20.305960 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:20.448302 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:20.457023 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-16411fbe-3e75-490c-95dd-2c8a181f203d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.168231 Aug 24 05:23:20.457682 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4188/8106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:20 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:21.480859 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:21.481657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:21.491494 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:21.492039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:21.492490 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:21.493215 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:21.493680 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:21.494134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:21.650377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:21.658646 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f9912dfc-91c4-4b2e-8748-8082eccc4936 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.183189 Aug 24 05:23:21.659234 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3919/8107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:21 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:22.657567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9d9520ce-c2ef-4d75-a881-fdf22d9385c8 req-f05e1dae-b28a-4401-8be1-be0f819c41b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9aa9bb-56db-4aec-be9c-811ad75d9a0e", "name": "network-vif-plugged", "status": "completed", "tag": "35bd777a-ea63-4209-8302-1c94c032d55f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:23:22.668875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9d9520ce-c2ef-4d75-a881-fdf22d9385c8 req-f05e1dae-b28a-4401-8be1-be0f819c41b6 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.669361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9d9520ce-c2ef-4d75-a881-fdf22d9385c8 req-f05e1dae-b28a-4401-8be1-be0f819c41b6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.669806 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9d9520ce-c2ef-4d75-a881-fdf22d9385c8 req-f05e1dae-b28a-4401-8be1-be0f819c41b6 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.681366 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:22.682723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:22.683421 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9d9520ce-c2ef-4d75-a881-fdf22d9385c8 req-f05e1dae-b28a-4401-8be1-be0f819c41b6 service nova] Creating event network-vif-plugged:35bd777a-ea63-4209-8302-1c94c032d55f for instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e on n-h2-846470-15 Aug 24 05:23:22.689714 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9d9520ce-c2ef-4d75-a881-fdf22d9385c8 req-f05e1dae-b28a-4401-8be1-be0f819c41b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036262 Aug 24 05:23:22.690647 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4189/8108] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:23:22.691428 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.692023 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.692719 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.693523 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.694059 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.694599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.914459 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:22.923442 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c96345b0-f082-4a90-84a2-cca4e407dc56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.245985 Aug 24 05:23:22.924098 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3920/8109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:22 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:23.951781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:23.952745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:23.959884 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:23.960366 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:23.960807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:23.961498 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:23.961951 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:23.962378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:24.111361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:24.119626 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1da9d3e8-b493-456e-bef6-f7f293e79029 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1258 microversion: 2.1 time: 0.176570 Aug 24 05:23:24.120243 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4190/8110] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:23 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:25.143264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:25.144192 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:25.154415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:25.155130 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:25.156181 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:25.156872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:25.157345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:25.157786 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:25.304642 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:25.313573 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-684143ee-631d-4e54-a151-2d7440db384e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1442 microversion: 2.1 time: 0.176194 Aug 24 05:23:25.314168 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3921/8111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:25 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1442 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:25.334361 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:25.334875 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:25.342059 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:25.342537 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:25.343450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:25.343698 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:25.344352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:25.344915 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:25.491186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:25.503020 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8561d7f5-80f8-418d-acd5-ec8849cb1bd9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1442 microversion: 2.1 time: 0.172392 Aug 24 05:23:25.503966 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4191/8112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:25 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1442 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:27.237012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-c676584d-91fa-4ce1-8fda-0aeeb7204a7f req-548e96cb-7bc3-4123-8f60-359daba35910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9aa9bb-56db-4aec-be9c-811ad75d9a0e", "tag": "35bd777a-ea63-4209-8302-1c94c032d55f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:23:27.247923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c676584d-91fa-4ce1-8fda-0aeeb7204a7f req-548e96cb-7bc3-4123-8f60-359daba35910 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:27.248419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c676584d-91fa-4ce1-8fda-0aeeb7204a7f req-548e96cb-7bc3-4123-8f60-359daba35910 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:27.248861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-c676584d-91fa-4ce1-8fda-0aeeb7204a7f req-548e96cb-7bc3-4123-8f60-359daba35910 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:27.263913 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-c676584d-91fa-4ce1-8fda-0aeeb7204a7f req-548e96cb-7bc3-4123-8f60-359daba35910 service nova] Creating event network-changed:35bd777a-ea63-4209-8302-1c94c032d55f for instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e on n-h2-846470-15 Aug 24 05:23:27.269772 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-c676584d-91fa-4ce1-8fda-0aeeb7204a7f req-548e96cb-7bc3-4123-8f60-359daba35910 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036463 Aug 24 05:23:27.270623 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3922/8113] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:25:16.922220 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:25:16.922952 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:25:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:25:24.476887 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:25:24.477873 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:25:24.478780 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=24 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:24.479690 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=52 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:24.484797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:25:24.485325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:24.492191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:24.492671 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:24.493104 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:24.493794 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:24.494247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:24.494667 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:24.518657 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.objects.instance [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lazy-loading 'flavor' on Instance uuid 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e {{(pid=122536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:25:24.601456 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7289aaf1-007c-4fdb-8202-5cb84afb757e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "POST /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.127912 Aug 24 05:25:24.602054 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4192/8114] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:25:24 2022] POST /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:25:24.609940 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:25:24.610780 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:25:24.611408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:24.612583 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=58 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:24.617353 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:24.618076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:24.625514 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:24.626013 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:24.626461 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:24.627166 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:24.628286 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:24.628725 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:24.784122 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:24.796764 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-308b27fa-3945-45f8-81e4-ab9949ebb38d tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.189445 Aug 24 05:25:24.797324 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3923/8115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:24 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:25.832640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:25.833781 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:25.847758 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35458. Aug 24 05:25:25.848600 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35456. Aug 24 05:25:25.850039 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:25.850503 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:25.850939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:25.851638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:25.852120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:25.852566 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:26.290650 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:26.300654 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-344aae82-2751-47c6-8c6c-342334c8f5ac tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.478841 Aug 24 05:25:26.301254 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4193/8116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:25 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:27.326554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:27.327361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:27.337451 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:27.337940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:27.338394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:27.339107 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:27.339576 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:27.340048 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:27.347042 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35464. Aug 24 05:25:27.347766 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35466. Aug 24 05:25:27.494737 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:27.507411 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f8901101-00d8-4ec3-8b33-cd7feb25a7c1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.184668 Aug 24 05:25:27.508263 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3924/8117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:27 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:28.535750 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:28.536601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:28.548092 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:28.548583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:28.549040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:28.549740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:28.550198 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:28.550633 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:28.697473 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:28.706834 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4493e21a-0fb6-4b76-b0da-da88e576f320 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.177632 Aug 24 05:25:28.707389 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4194/8118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:28 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:29.736849 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:29.737499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:29.745341 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:29.745856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:29.746313 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:29.747032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:29.747489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:29.748000 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:29.898406 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:29.907170 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b41c6228-8150-4fe9-834a-633e22beb900 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.174443 Aug 24 05:25:29.908052 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3925/8119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:29 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:30.933300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:30.934250 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:30.945462 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:30.946216 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:30.946901 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:30.948131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:30.948818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:30.949530 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:31.100173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:31.110802 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8cf803ba-6074-44dc-a104-3fa9788cbe8a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.183831 Aug 24 05:25:31.111380 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4195/8120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:30 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:32.143301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:32.149921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:32.155956 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:32.156371 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:32.156824 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:32.157545 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:32.158047 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:32.158484 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:32.354264 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:32.363530 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-567aed2b-dfc8-458c-8db1-e92a55e33c70 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.226058 Aug 24 05:25:32.364203 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3926/8121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:32 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:33.390010 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:33.390601 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:33.398046 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:33.398544 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:33.398984 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:33.399701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:33.400190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:33.400619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:33.554586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:33.563156 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-e2307803-aa95-4f91-9752-da0c51ff8249 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.179704 Aug 24 05:25:33.563799 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4196/8122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:33 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:34.586040 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:34.586674 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:34.594025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:34.594830 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:34.595357 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:34.596087 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:34.596556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:34.596995 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:34.740315 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:34.750470 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6a939308-e582-4aae-9148-4a3dbb3142a7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.168722 Aug 24 05:25:34.751055 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3927/8123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:34 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:35.778303 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:35.778888 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:35.786841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:35.787329 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:35.787798 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:35.788587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:35.789048 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:35.789480 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:35.949066 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:35.962492 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-81bc5ac2-d282-4260-8604-6e5109ecdfef tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.187952 Aug 24 05:25:35.963323 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4197/8124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:35 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:36.986678 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:36.987318 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:36.996384 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:36.997537 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:36.998012 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:36.998747 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:36.999227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:36.999700 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:37.156888 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:37.166132 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-be93906b-cb12-4ab2-9075-99de69869d9c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.183503 Aug 24 05:25:37.166771 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3928/8125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:36 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:38.191230 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:38.191841 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:38.198807 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:38.199297 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:38.199770 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:38.200481 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:38.200941 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:38.201356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:38.471268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:38.480061 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-72979623-9a4e-4042-820a-f33dc6b99475 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.292952 Aug 24 05:25:38.480653 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4198/8126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:38 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:39.502493 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:39.503109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:39.510723 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.511245 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.511701 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.512442 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.512923 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.513359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.747165 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:39.755555 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6704baeb-b232-47c1-96e3-543e814252ad tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1508 microversion: 2.1 time: 0.257203 Aug 24 05:25:39.756111 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3929/8127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:39 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:39.776767 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:25:39.777362 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:39.785468 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.786016 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.786461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.787173 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.787709 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.788233 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.819097 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122536) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:25:39.896784 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3447d862-0549-42f3-90f2-9f6156663593 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "POST /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.124072 Aug 24 05:25:39.897744 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4199/8128] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:25:39 2022] POST /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:25:39.907430 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:39.908411 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:39.914867 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.915377 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.915856 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.916570 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.917072 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.917503 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:40.059652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:40.068158 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0c13ffd2-6650-494b-a7f3-e79bff980dd6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1516 microversion: 2.1 time: 0.164614 Aug 24 05:25:40.069013 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3930/8129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:39 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:41.091644 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:41.092363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:41.099054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.099546 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.100014 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.100715 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.101166 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.101593 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.246378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:41.255920 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-8df0c17a-a129-4b9b-8a12-6ffe056be0a1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1518 microversion: 2.1 time: 0.168994 Aug 24 05:25:41.256943 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4200/8130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:41 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:41.319300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-171b3561-9cd6-4ff5-b63e-d65b031e0266 req-ad9e3090-b5d9-463c-a727-b4d2fd310a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9aa9bb-56db-4aec-be9c-811ad75d9a0e", "name": "network-vif-unplugged", "status": "completed", "tag": "35bd777a-ea63-4209-8302-1c94c032d55f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:25:41.330876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-171b3561-9cd6-4ff5-b63e-d65b031e0266 req-ad9e3090-b5d9-463c-a727-b4d2fd310a2c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.331496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-171b3561-9cd6-4ff5-b63e-d65b031e0266 req-ad9e3090-b5d9-463c-a727-b4d2fd310a2c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.332502 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-171b3561-9cd6-4ff5-b63e-d65b031e0266 req-ad9e3090-b5d9-463c-a727-b4d2fd310a2c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.352741 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.compute.server_external_events [req-171b3561-9cd6-4ff5-b63e-d65b031e0266 req-ad9e3090-b5d9-463c-a727-b4d2fd310a2c service nova] Unable to find a host for instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e. Dropping event network-vif-unplugged {{(pid=122535) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 05:25:41.353683 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-171b3561-9cd6-4ff5-b63e-d65b031e0266 req-ad9e3090-b5d9-463c-a727-b4d2fd310a2c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.101167 Aug 24 05:25:41.354287 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3931/8131] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 05:25:42.280491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:42.281082 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:42.288990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:42.289478 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:42.289911 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:42.290607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:42.291064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:42.292182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:42.427282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:42.435367 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f380f042-f358-4d38-9614-f5999e0b49d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1518 microversion: 2.1 time: 0.158946 Aug 24 05:25:42.435966 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4201/8132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:42 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:43.463607 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:43.464946 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:43.474395 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:43.474898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:43.475348 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:43.476097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:43.476567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:43.477007 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:43.612223 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:43.620610 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2426c101-084b-4da6-b2fb-a334c87f7323 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1518 microversion: 2.1 time: 0.164021 Aug 24 05:25:43.621238 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3932/8133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:43 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:44.645229 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:44.645857 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:44.656588 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:44.657294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:44.661693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:44.661693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:44.661693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:44.661693 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:44.799234 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:44.807447 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f2982740-7e60-4e53-8b9e-ee6cc408a3c6 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1518 microversion: 2.1 time: 0.168633 Aug 24 05:25:44.808099 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4202/8134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:44 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:45.830468 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:45.831134 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:45.838606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:45.839120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:45.839580 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:45.840330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:45.840801 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:45.841253 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:46.002751 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:46.015615 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9051e16a-e81c-46bf-bc98-84a39ed67afa tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.189340 Aug 24 05:25:46.016457 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3933/8135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:45 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:47.042261 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:47.043404 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:47.055091 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:47.055957 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:47.056678 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:47.057866 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:47.058625 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:47.059384 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:47.224804 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:47.233043 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fd531188-de00-4f86-b687-51969ac2465f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.197623 Aug 24 05:25:47.233619 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4203/8136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:47 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:48.254731 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:48.255362 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:48.262681 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:48.263184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:48.263618 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:48.264359 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:48.264833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:48.265276 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:48.416051 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:48.425507 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-7109cb33-671e-434b-a798-d0c21a8c67c8 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.174923 Aug 24 05:25:48.426103 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3934/8137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:48 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:49.451732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:49.453118 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:49.464616 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:49.465409 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:49.466182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:49.467330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:49.468134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:49.468849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:49.617309 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:49.628759 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-80f1059d-f5d5-484a-825e-aac7ae3c0a89 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.182965 Aug 24 05:25:49.629660 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4204/8138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:49 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:50.651029 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:50.651654 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:50.659929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:50.660440 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:50.660872 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:50.661614 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:50.662085 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:50.662529 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:50.805992 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:50.814499 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-374e3ce5-7290-4c42-bbfb-fc7e088bed56 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.167392 Aug 24 05:25:50.815185 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3935/8139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:50 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:51.838114 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:51.838692 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:51.847494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:51.848157 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:51.848679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:51.849552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:51.850215 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:51.850669 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:51.871258 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:52.000645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:52.014310 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2a6e2a79-2635-482a-bba0-f66af1566de7 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.180763 Aug 24 05:25:52.015106 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4205/8140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:51 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:53.039585 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:53.040335 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:53.048745 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:53.049378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:53.049913 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:53.051222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:53.052233 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:53.053109 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:53.207499 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:53.216981 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f75bbeb2-8a72-4c5e-8eb0-6c1f2a5a9cbd tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.182792 Aug 24 05:25:53.217574 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3936/8141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:53 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:54.247624 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:54.248306 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:54.256519 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:54.257054 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:54.257534 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:54.258301 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:54.258805 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:54.259278 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:54.400002 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:54.411145 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b291b037-dea9-4191-ad05-b909faed8a3e tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.167637 Aug 24 05:25:54.411911 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4206/8142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:54 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:55.434963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:55.435712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:55.439756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=29 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:55.446670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:55.447331 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:55.447972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:55.449037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:55.449683 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:55.450312 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:55.454709 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=81 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:55.596266 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:55.604945 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6067ae5f-eda9-4104-898b-04e879b55f94 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.175402 Aug 24 05:25:55.605530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3937/8143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:55 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:56.627740 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:56.628385 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:56.630659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:56.636542 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:56.637025 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:56.637457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:56.638208 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:56.638659 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:56.639089 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:56.776953 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:56.788979 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-3fd463b4-5a94-4a53-bd86-ebf18844c4d9 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.164988 Aug 24 05:25:56.789564 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4207/8144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:56 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:57.810963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:57.811579 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:57.818267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:57.818756 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:57.819209 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:57.819966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:57.820462 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:57.821006 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:57.956940 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:57.965642 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c2c20439-1e65-43e8-906d-dad09e172741 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.158602 Aug 24 05:25:57.966242 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3938/8145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:57 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:58.991523 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:58.992524 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:59.004940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.005763 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.006499 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.007658 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.009119 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.009561 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.174836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:59.185055 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b70eabd3-8c55-49d9-b420-6c378311d214 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.200114 Aug 24 05:25:59.185644 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4208/8146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:58 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:59.399658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-00ec6aea-4164-4600-8225-9bac33699555 req-4bec7f70-2b91-47e3-b11b-34740e612a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9aa9bb-56db-4aec-be9c-811ad75d9a0e", "name": "network-vif-plugged", "status": "completed", "tag": "35bd777a-ea63-4209-8302-1c94c032d55f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:25:59.410457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-00ec6aea-4164-4600-8225-9bac33699555 req-4bec7f70-2b91-47e3-b11b-34740e612a45 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.410955 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-00ec6aea-4164-4600-8225-9bac33699555 req-4bec7f70-2b91-47e3-b11b-34740e612a45 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.411398 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-00ec6aea-4164-4600-8225-9bac33699555 req-4bec7f70-2b91-47e3-b11b-34740e612a45 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.424434 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-00ec6aea-4164-4600-8225-9bac33699555 req-4bec7f70-2b91-47e3-b11b-34740e612a45 service nova] Creating event network-vif-plugged:35bd777a-ea63-4209-8302-1c94c032d55f for instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e on n-h2-846470-15 Aug 24 05:25:59.428396 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [req-00ec6aea-4164-4600-8225-9bac33699555 req-4bec7f70-2b91-47e3-b11b-34740e612a45 service nova] [8c0ad50f-b1b7-422c-9351-9a83b2038e53] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:26:00.209359 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:00.210120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:00.217802 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:00.218294 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:00.218732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:00.219432 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:00.219939 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:00.220367 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:00.373572 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:00.384526 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-698dafda-0c67-4d1e-809a-39b3efd61f9a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.180559 Aug 24 05:26:00.385118 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4209/8147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:00 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:00.437382 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [req-00ec6aea-4164-4600-8225-9bac33699555 req-4bec7f70-2b91-47e3-b11b-34740e612a45 service nova] [8c0ad50f-b1b7-422c-9351-9a83b2038e53] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35562. Aug 24 05:26:00.442192 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-00ec6aea-4164-4600-8225-9bac33699555 req-4bec7f70-2b91-47e3-b11b-34740e612a45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.046571 Aug 24 05:26:00.442982 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3939/8148] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:26:01.410137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:01.410831 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:01.422076 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:01.422836 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:01.423522 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:01.424726 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:01.425515 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:01.426087 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:01.595418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:01.603778 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f3d157f8-08bf-4d3d-b065-53de75129f2f tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1574 microversion: 2.1 time: 0.200275 Aug 24 05:26:01.604372 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4210/8149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:01 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:02.628269 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:02.628853 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:02.636062 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:02.636567 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:02.637016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:02.637726 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:02.638197 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:02.638631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:02.784227 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:02.794924 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cdfa40ae-1847-408b-812c-45e3aac39b14 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1561 microversion: 2.1 time: 0.172088 Aug 24 05:26:02.795483 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3940/8150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:02 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:24.500307 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:26:24.501013 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:27:17.119619 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=7 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:17.123410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=7 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:17.124301 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=19 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:17.128109 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=32 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:17.133318 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:17.134388 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:17.141182 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.141675 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.142120 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.142822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.143275 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.143745 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.172509 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Going to try to terminate instance {{(pid=122536) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:27:17.259559 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f8c14e4f-35f3-4007-b62d-4f4df6bfb253 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 204 len: 0 microversion: 2.1 time: 0.141590 Aug 24 05:27:17.259835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-9ad3c3dd-3a94-43f3-a8d5-ec6e45861aba req-0b058751-aa26-4f70-aa27-55a662fd3ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9aa9bb-56db-4aec-be9c-811ad75d9a0e", "tag": "35bd777a-ea63-4209-8302-1c94c032d55f"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:27:17.261887 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4211/8151] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:27:17 2022] DELETE /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:27:17.272437 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:17.274859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:17.275025 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9ad3c3dd-3a94-43f3-a8d5-ec6e45861aba req-0b058751-aa26-4f70-aa27-55a662fd3ff0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.275496 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9ad3c3dd-3a94-43f3-a8d5-ec6e45861aba req-0b058751-aa26-4f70-aa27-55a662fd3ff0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.277400 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-9ad3c3dd-3a94-43f3-a8d5-ec6e45861aba req-0b058751-aa26-4f70-aa27-55a662fd3ff0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.285672 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.286316 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.287286 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.288098 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.288570 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.289525 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.290646 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-9ad3c3dd-3a94-43f3-a8d5-ec6e45861aba req-0b058751-aa26-4f70-aa27-55a662fd3ff0 service nova] Creating event network-changed:35bd777a-ea63-4209-8302-1c94c032d55f for instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e on n-h2-846470-15 Aug 24 05:27:17.296871 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-9ad3c3dd-3a94-43f3-a8d5-ec6e45861aba req-0b058751-aa26-4f70-aa27-55a662fd3ff0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175156 Aug 24 05:27:17.297488 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3941/8152] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:27:17.444418 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:17.453021 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-28e88e6f-6fad-4669-837a-cafa6ad4b71a tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.186819 Aug 24 05:27:17.453608 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4212/8153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:17 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:18.476844 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:18.477563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:18.484184 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:18.484686 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:18.485143 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:18.485861 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:18.486476 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:18.486921 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:18.685387 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:18.696681 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-09419b95-0a2b-49df-a97a-a69edbf64923 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1567 microversion: 2.1 time: 0.225653 Aug 24 05:27:18.697291 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3942/8154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:18 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:19.348587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d8ddfb3c-d516-4cf9-b2d5-33c186f81a26 req-94194699-2b76-44e7-903a-3c8d0c293084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9aa9bb-56db-4aec-be9c-811ad75d9a0e", "name": "network-vif-deleted", "tag": "35bd777a-ea63-4209-8302-1c94c032d55f"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:27:19.362057 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d8ddfb3c-d516-4cf9-b2d5-33c186f81a26 req-94194699-2b76-44e7-903a-3c8d0c293084 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.362679 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d8ddfb3c-d516-4cf9-b2d5-33c186f81a26 req-94194699-2b76-44e7-903a-3c8d0c293084 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.363178 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d8ddfb3c-d516-4cf9-b2d5-33c186f81a26 req-94194699-2b76-44e7-903a-3c8d0c293084 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.380887 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d8ddfb3c-d516-4cf9-b2d5-33c186f81a26 req-94194699-2b76-44e7-903a-3c8d0c293084 service nova] Creating event network-vif-deleted:35bd777a-ea63-4209-8302-1c94c032d55f for instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e on n-h2-846470-15 Aug 24 05:27:19.386433 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d8ddfb3c-d516-4cf9-b2d5-33c186f81a26 req-94194699-2b76-44e7-903a-3c8d0c293084 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041752 Aug 24 05:27:19.387104 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4213/8155] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:27:19.728571 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:19.729865 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:19.738343 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.739148 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.740070 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.740802 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.741267 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.741693 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.815851 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:19.823998 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b4e10016-e634-4af9-a31d-0ce9df7953e1 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1218 microversion: 2.1 time: 0.099885 Aug 24 05:27:19.824784 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3943/8156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:19 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:20.847405 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:20.848045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:20.855027 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:20.855517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:20.855977 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:20.856747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:20.857110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:20.857553 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:20.923766 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:20.932369 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b60f7519-395d-4ab9-b966-057efd836038 tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1218 microversion: 2.1 time: 0.090287 Aug 24 05:27:20.932942 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4214/8157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:20 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:21.954480 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:21.955175 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:21.962905 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:21.963412 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:21.963902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:21.964649 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:21.965145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:21.965611 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:22.029475 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:22.038613 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ac0b1ebb-027e-4a05-9211-ff48ef6bf3af tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1218 microversion: 2.1 time: 0.088556 Aug 24 05:27:22.039232 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3944/8158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:21 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:23.060461 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:23.061152 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:23.068865 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:23.069648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:23.070416 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:23.071383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:23.072041 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:23.072645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:23.140352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a813ef974467c8d9e2570291c3c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1ecd0cc6db4fef90f0c36273f69e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:23.148851 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-1e252f2e-b662-447a-bc49-c86b9202aa1c tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 200 len: 1218 microversion: 2.1 time: 0.092506 Aug 24 05:27:23.149845 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4215/8159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:23 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:24.171124 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:24.172152 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [instance: 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:24.179966 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:24.180477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:24.180934 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:24.181637 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:24.182113 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:24.182565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:24.197325 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] HTTP exception thrown: Instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e could not be found. Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Request method failure captured: Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e HTTP/1.1 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBbQ9DD7pSFp7QGpQEEQnq4wUcBUkJ22FwyjTq2YZFZFlPmQGdlP0t0FCcLE7_hBBGC5k4CpDNRhAMxZFojhWj-vJTrjaHAWM-nDOxiuk-cKPZXkvvzHCOwJQYkAasRuwvmUIEhPSzWwYvNsJ1L6oeJnCPkLCMgX7uwwy2--KulNeqtQ Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: 5a1ecd0cc6db4fef90f0c36273f69e27 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestShelveInstance-2103984383 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5a1ecd0cc6db4fef90f0c36273f69e27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5a1ecd0cc6db4fef90f0c36273f69e27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5a1ecd0cc6db4fef90f0c36273f69e27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5a1ecd0cc6db4fef90f0c36273f69e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestShelveInstance-2103984383 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: 5a1ecd0cc6db4fef90f0c36273f69e27 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestShelveInstance-2103984383 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestShelveInstance-2103984383-project Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: e44a813ef974467c8d9e2570291c3c59 Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestShelveInstance-2103984383-project Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e could not be found. Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': '4b9aa9bb-56db-4aec-be9c-811ad75d9a0e'} Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e could not be found. Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e could not be found. Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:27:24.199037 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e could not be found. Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Returning 404 to user: Instance 4b9aa9bb-56db-4aec-be9c-811ad75d9a0e could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b587c628-3713-4264-80e1-4c1cdb7dd9ec tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e" status: 404 len: 111 microversion: 2.1 time: 0.033957 Aug 24 05:27:24.205008 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3945/8160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:24 2022] GET /compute/v2.1/servers/4b9aa9bb-56db-4aec-be9c-811ad75d9a0e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:27:24.373925 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-da475483-1856-4732-8ca7-83221f1f34cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] Calling method '.version_select at 0x7f1021b66c10>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:24.378711 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [None req-da475483-1856-4732-8ca7-83221f1f34cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:27:25.389273 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [None req-da475483-1856-4732-8ca7-83221f1f34cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] [cdb62c63-72a8-4ebc-be4f-828442f5df1a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35626. Aug 24 05:27:25.411733 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-da475483-1856-4732-8ca7-83221f1f34cb tempest-TestShelveInstance-2103984383 tempest-TestShelveInstance-2103984383-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-703256110" status: 202 len: 0 microversion: 2.1 time: 1.041468 Aug 24 05:27:25.415704 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4216/8161] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 05:27:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-703256110 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:27:43.855216 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=10 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:43.856520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=22 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:44.048613 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e85a22d7-e785-4e56-b6c8-06b870d69cf8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Action: 'create', calling method: .version_select at 0x7f102a76c820>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-24292991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvEu8E1X+3LHO62jsugYKrwGD0aI1cAswH/1opD8ii7yvxQrVt9DV/5qEuhWNZAQDfgD0gDZDBPaA2wpzkIikvG2pn5wqM9B5K22EvnjyqNViI93CTwdaEEIvvjSo2ZRw=="}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:27:44.065950 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e85a22d7-e785-4e56-b6c8-06b870d69cf8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Getting quotas for project b70ace330a1f468b835c45effbf41e2b. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:27:44.072661 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.quota [None req-e85a22d7-e785-4e56-b6c8-06b870d69cf8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Getting quotas for user af7a2f736f1349ecbf9ea2a6ab86032b and project b70ace330a1f468b835c45effbf41e2b. Resources: {'key_pairs'} {{(pid=122535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:27:44.105842 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e85a22d7-e785-4e56-b6c8-06b870d69cf8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.256093 Aug 24 05:27:44.106460 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3946/8162] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 24 05:27:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:27:45.131370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-564352494", "imageRef": "940ed0d3-700a-4ac5-a26b-97e9311e8ce3", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-24292991", "security_groups": [{"name": "tempest-secgroup-smoke-490349711"}], "networks": [{"uuid": "a3442f52-4e6e-484e-9505-48134a629ddf"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:27:45.139985 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:45.140638 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:45.250370 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] validate_networks() for [('a3442f52-4e6e-484e-9505-48134a629ddf', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:27:45.826392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:27:45.827434 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:27:45.827940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:27:45.828526 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:27:45.828947 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:27:45.838575 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:45.839305 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:45.839774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:45.840676 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:45.841130 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:45.841732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:45.860799 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Getting quotas for project b70ace330a1f468b835c45effbf41e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:27:45.866903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Getting quotas for user af7a2f736f1349ecbf9ea2a6ab86032b and project b70ace330a1f468b835c45effbf41e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:27:45.879450 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:27:45.882020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='940ed0d3-700a-4ac5-a26b-97e9311e8ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:27:45.932167 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-82109b91-6b55-4f8d-ba06-388a7a5ffe98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.806376 Aug 24 05:27:45.938754 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4217/8163] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:27:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:27:45.946131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3802e560-6caf-4140-a339-db43cb0eb244 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:45.946960 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3802e560-6caf-4140-a339-db43cb0eb244 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:46.008137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3802e560-6caf-4140-a339-db43cb0eb244 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:46.018663 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3802e560-6caf-4140-a339-db43cb0eb244 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1246 microversion: 2.1 time: 0.078210 Aug 24 05:27:46.019650 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3947/8164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:45 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:47.041273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7b73d52b-3356-4a5d-8383-eb3e627fd560 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:47.041930 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7b73d52b-3356-4a5d-8383-eb3e627fd560 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:47.099093 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7b73d52b-3356-4a5d-8383-eb3e627fd560 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:47.106913 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7b73d52b-3356-4a5d-8383-eb3e627fd560 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1246 microversion: 2.1 time: 0.070603 Aug 24 05:27:47.107770 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4218/8165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:47 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:48.129370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:48.131486 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:48.139977 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:48.140489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:48.140936 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:48.141652 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:48.142309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:48.142758 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:48.217333 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:48.225466 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1fc201e7-b99b-42c3-b567-d1b61c4e8076 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1316 microversion: 2.1 time: 0.101222 Aug 24 05:27:48.226059 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3948/8166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:48 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1316 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:49.247881 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:49.248607 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:49.258517 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.259078 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.259552 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.260894 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.261356 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.261788 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.472393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:49.481506 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4b7cb7fa-b4f5-4739-94fa-77aba6a03b89 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1371 microversion: 2.1 time: 0.238363 Aug 24 05:27:49.482187 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4219/8167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:49 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:49.698718 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-cf933e19-9a79-4926-8a65-60a5fbcb3c95 req-b6c54da5-6880-4c46-9ccc-5183e3b6357b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde799a6-3197-4554-8fa3-1e14283237b3", "tag": "0542b05d-a3f4-4e08-b1d0-44a74d56cba7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:27:49.708938 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cf933e19-9a79-4926-8a65-60a5fbcb3c95 req-b6c54da5-6880-4c46-9ccc-5183e3b6357b service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.709456 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cf933e19-9a79-4926-8a65-60a5fbcb3c95 req-b6c54da5-6880-4c46-9ccc-5183e3b6357b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.709906 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-cf933e19-9a79-4926-8a65-60a5fbcb3c95 req-b6c54da5-6880-4c46-9ccc-5183e3b6357b service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.721301 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-cf933e19-9a79-4926-8a65-60a5fbcb3c95 req-b6c54da5-6880-4c46-9ccc-5183e3b6357b service nova] Creating event network-changed:0542b05d-a3f4-4e08-b1d0-44a74d56cba7 for instance fde799a6-3197-4554-8fa3-1e14283237b3 on n-h2-846470-15 Aug 24 05:27:49.726655 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-cf933e19-9a79-4926-8a65-60a5fbcb3c95 req-b6c54da5-6880-4c46-9ccc-5183e3b6357b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085828 Aug 24 05:27:49.727346 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3949/8168] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:27:50.507587 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:50.508769 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:50.520822 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:50.521439 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:50.521859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:50.522597 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:50.523064 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:50.523494 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:50.680260 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:50.692758 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-2622d009-7705-4f1a-b4e0-f56c226ffffa tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1371 microversion: 2.1 time: 0.191468 Aug 24 05:27:50.693605 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4220/8169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:50 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:51.716625 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:51.717299 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:51.724682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:51.725171 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:51.725621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:51.726328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:51.726789 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:51.727219 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:51.880178 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:51.888017 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-3e08a978-87a6-47ee-8ffc-01f3f8bd51f8 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1371 microversion: 2.1 time: 0.176826 Aug 24 05:27:51.888623 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3950/8170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:51 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:52.909700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:52.910265 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:52.918950 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:52.919448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:52.919934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:52.920648 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:52.921117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:52.921550 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:53.062856 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:53.072040 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-bc43d5ec-7d10-413c-a85b-3f1e6e0650c0 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1371 microversion: 2.1 time: 0.166483 Aug 24 05:27:53.072635 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4221/8171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:52 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:54.093917 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:54.094525 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:54.102248 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:54.102755 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:54.103205 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:54.103963 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:54.104438 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:54.104878 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:54.247894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:54.256087 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-1a68dfa3-9762-4e2a-bb43-7a80ce580ebd tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1371 microversion: 2.1 time: 0.166059 Aug 24 05:27:54.256775 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3951/8172] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:54 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:55.277324 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:55.277912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:55.285592 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.286074 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.286512 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.287206 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.287683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.288115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.432254 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:55.440830 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7ab079d3-4bec-456d-8bff-0834ee8a039b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1371 microversion: 2.1 time: 0.167843 Aug 24 05:27:55.441421 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4222/8173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:55 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:55.883032 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-544425f2-0574-439d-b20f-1eebc7444af2 req-530c8f06-66f2-4138-90cd-2ff9403e6616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde799a6-3197-4554-8fa3-1e14283237b3", "name": "network-vif-plugged", "status": "completed", "tag": "0542b05d-a3f4-4e08-b1d0-44a74d56cba7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:27:55.892769 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-544425f2-0574-439d-b20f-1eebc7444af2 req-530c8f06-66f2-4138-90cd-2ff9403e6616 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.893273 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-544425f2-0574-439d-b20f-1eebc7444af2 req-530c8f06-66f2-4138-90cd-2ff9403e6616 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.893715 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-544425f2-0574-439d-b20f-1eebc7444af2 req-530c8f06-66f2-4138-90cd-2ff9403e6616 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.904646 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-544425f2-0574-439d-b20f-1eebc7444af2 req-530c8f06-66f2-4138-90cd-2ff9403e6616 service nova] Creating event network-vif-plugged:0542b05d-a3f4-4e08-b1d0-44a74d56cba7 for instance fde799a6-3197-4554-8fa3-1e14283237b3 on n-h2-846470-15 Aug 24 05:27:55.910181 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-544425f2-0574-439d-b20f-1eebc7444af2 req-530c8f06-66f2-4138-90cd-2ff9403e6616 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081449 Aug 24 05:27:55.910799 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3952/8174] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:27:56.464484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:56.465072 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:56.466988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:56.472873 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:56.473358 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:56.473796 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:56.474484 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:56.474940 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:56.475360 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:56.618990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:56.632705 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-50d600a4-d07f-4e1b-8ebd-82604a12aee9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1371 microversion: 2.1 time: 0.172843 Aug 24 05:27:56.633300 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4223/8175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:56 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:57.657445 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=6 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:57.662679 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:57.663864 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:57.670199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:57.670703 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:57.671159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:57.671920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:57.672370 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:57.672839 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:57.806928 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:57.815003 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-c54a6bfa-7b2a-4bc7-aa83-aac82c70ded9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1557 microversion: 2.1 time: 0.158689 Aug 24 05:27:57.815585 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3953/8176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:57 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:57.836899 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:57.838069 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:57.841150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=8 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:57.849199 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:57.849934 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:57.850562 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:57.851269 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:57.851838 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:57.852408 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:58.003392 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:58.011986 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-6457f81a-67ef-48c2-862b-7c1b2c02ccf5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1557 microversion: 2.1 time: 0.179552 Aug 24 05:27:58.012574 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4224/8177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:57 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:00.118876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-99bdbd04-e784-4c98-a3dc-7e81b0cbfa98 req-38523085-a558-4b58-9d9b-a1c49f412e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde799a6-3197-4554-8fa3-1e14283237b3", "tag": "0542b05d-a3f4-4e08-b1d0-44a74d56cba7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:00.129993 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99bdbd04-e784-4c98-a3dc-7e81b0cbfa98 req-38523085-a558-4b58-9d9b-a1c49f412e87 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:00.130563 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99bdbd04-e784-4c98-a3dc-7e81b0cbfa98 req-38523085-a558-4b58-9d9b-a1c49f412e87 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:00.131073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-99bdbd04-e784-4c98-a3dc-7e81b0cbfa98 req-38523085-a558-4b58-9d9b-a1c49f412e87 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:00.143041 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-99bdbd04-e784-4c98-a3dc-7e81b0cbfa98 req-38523085-a558-4b58-9d9b-a1c49f412e87 service nova] Creating event network-changed:0542b05d-a3f4-4e08-b1d0-44a74d56cba7 for instance fde799a6-3197-4554-8fa3-1e14283237b3 on n-h2-846470-15 Aug 24 05:28:00.148824 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-99bdbd04-e784-4c98-a3dc-7e81b0cbfa98 req-38523085-a558-4b58-9d9b-a1c49f412e87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033876 Aug 24 05:28:00.149432 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3954/8178] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:29:44.511349 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:29:44.512164 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:29:53.252532 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:29:53.253325 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:30:16.933805 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:30:16.934560 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:30:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:30:36.613687 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:30:36.614877 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:30:36.615718 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:36.616613 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=38 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:36.620674 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1456340019"}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:36.623271 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:36.633732 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:36.634217 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:36.634653 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:36.635349 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:36.635842 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:36.636264 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:36.849097 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-c7580b3d-547d-4936-bd3e-a8f6b351718c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "POST /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3/action" status: 202 len: 0 microversion: 2.1 time: 0.237062 Aug 24 05:30:36.849747 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4225/8179] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:30:36 2022] POST /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 05:30:44.615115 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:30:44.616017 n-d-846470-15 devstack@n-api.service[122535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:30:44.616650 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:44.617520 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=30 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:44.624121 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-23b8aea3-f94b-4170-bf66-ce25bfb1a5de req-4e73af77-ad88-4b81-83db-647e6b45efa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde799a6-3197-4554-8fa3-1e14283237b3", "name": "network-vif-plugged", "status": "completed", "tag": "0542b05d-a3f4-4e08-b1d0-44a74d56cba7"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:44.642670 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-23b8aea3-f94b-4170-bf66-ce25bfb1a5de req-4e73af77-ad88-4b81-83db-647e6b45efa8 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:44.643186 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-23b8aea3-f94b-4170-bf66-ce25bfb1a5de req-4e73af77-ad88-4b81-83db-647e6b45efa8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:44.643692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-23b8aea3-f94b-4170-bf66-ce25bfb1a5de req-4e73af77-ad88-4b81-83db-647e6b45efa8 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:44.658060 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-23b8aea3-f94b-4170-bf66-ce25bfb1a5de req-4e73af77-ad88-4b81-83db-647e6b45efa8 service nova] Creating event network-vif-plugged:0542b05d-a3f4-4e08-b1d0-44a74d56cba7 for instance fde799a6-3197-4554-8fa3-1e14283237b3 on n-h2-846470-15 Aug 24 05:30:44.663579 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-23b8aea3-f94b-4170-bf66-ce25bfb1a5de req-4e73af77-ad88-4b81-83db-647e6b45efa8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050071 Aug 24 05:30:44.664224 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3955/8180] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:55.566156 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:55.566944 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:55.571611 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2038874457", "imageRef": "fc3a282e-1fbf-4e1e-88f7-ddf691da1fd1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-24292991", "security_groups": [{"name": "tempest-secgroup-smoke-490349711"}], "networks": [{"uuid": "a3442f52-4e6e-484e-9505-48134a629ddf"}]}} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:55.588660 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36052. Aug 24 05:30:55.591800 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36050. Aug 24 05:30:55.889180 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.network.neutron [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] validate_networks() for [('a3442f52-4e6e-484e-9505-48134a629ddf', None, None, None, None, None)] {{(pid=122536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:30:56.307383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Flavor limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:30:56.307821 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Image limits 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:30:56.308276 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Flavor pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:30:56.308700 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Image pref 0:0:0 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:30:56.309110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.virt.hardware [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:30:56.320722 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:56.321202 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:56.321639 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:56.322363 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:56.323063 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:56.323571 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:56.340751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Getting quotas for project b70ace330a1f468b835c45effbf41e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:30:56.346299 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.quota [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Getting quotas for user af7a2f736f1349ecbf9ea2a6ab86032b and project b70ace330a1f468b835c45effbf41e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:30:56.358946 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Going to run 1 instances... {{(pid=122536) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:30:56.361508 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fc3a282e-1fbf-4e1e-88f7-ddf691da1fd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:30:56.412346 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-27167427-54f8-4e34-9d9d-4706027e7e02 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.848237 Aug 24 05:30:56.412987 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4226/8181] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 24 05:30:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:30:56.425057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5fc1c5c8-50eb-40dc-a19c-1418583c1072 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:56.425798 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5fc1c5c8-50eb-40dc-a19c-1418583c1072 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:56.431352 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:56.432190 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:56.447893 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [171dc193-3a8d-4bae-ad07-3c1b98f014b2] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36076. Aug 24 05:30:56.451073 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] [afca2c52-75ea-4e4c-9659-91a8f9107405] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36078. Aug 24 05:30:56.583842 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5fc1c5c8-50eb-40dc-a19c-1418583c1072 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:56.596137 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5fc1c5c8-50eb-40dc-a19c-1418583c1072 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1247 microversion: 2.1 time: 0.175042 Aug 24 05:30:56.596721 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3956/8182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:56 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1247 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:57.619134 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:57.619859 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:57.627797 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:57.628282 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:57.628723 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:57.629661 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:57.630124 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:57.630555 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:57.702827 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:57.712180 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-7556d5c2-7952-4436-96cf-6c9e68e35d2c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1307 microversion: 2.1 time: 0.098040 Aug 24 05:30:57.712756 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4227/8183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:57 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:58.738551 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:58.739247 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:58.751420 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-5d86d81b-5446-47c9-a43d-c6b9df365f44 req-7103159f-69a8-418f-88d3-65db47ba1ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde799a6-3197-4554-8fa3-1e14283237b3", "name": "network-vif-unplugged", "status": "completed", "tag": "0542b05d-a3f4-4e08-b1d0-44a74d56cba7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:58.764692 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:58.765161 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:58.765627 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:58.766369 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:58.766880 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:58.767415 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:58.769137 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5d86d81b-5446-47c9-a43d-c6b9df365f44 req-7103159f-69a8-418f-88d3-65db47ba1ed0 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:58.769912 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5d86d81b-5446-47c9-a43d-c6b9df365f44 req-7103159f-69a8-418f-88d3-65db47ba1ed0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:58.770837 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-5d86d81b-5446-47c9-a43d-c6b9df365f44 req-7103159f-69a8-418f-88d3-65db47ba1ed0 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:58.791565 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-5d86d81b-5446-47c9-a43d-c6b9df365f44 req-7103159f-69a8-418f-88d3-65db47ba1ed0 service nova] Creating event network-vif-unplugged:0542b05d-a3f4-4e08-b1d0-44a74d56cba7 for instance fde799a6-3197-4554-8fa3-1e14283237b3 on n-h2-846470-15 Aug 24 05:30:58.801820 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-5d86d81b-5446-47c9-a43d-c6b9df365f44 req-7103159f-69a8-418f-88d3-65db47ba1ed0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054364 Aug 24 05:30:58.803411 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4228/8184] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:30:58.987699 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:58.996687 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-bffb1692-3814-40f6-83e0-03902199dcb9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.262104 Aug 24 05:30:58.997305 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3957/8185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:58 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:00.019913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:00.020627 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:00.027824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.028421 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.028907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.029621 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.030221 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.030683 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.197131 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:00.206130 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-75b07b0a-7135-481f-8468-14453a7e2978 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.191398 Aug 24 05:31:00.206846 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4229/8186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:00 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:01.229270 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:01.229920 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:01.237222 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:01.237736 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:01.238198 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:01.238929 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:01.239407 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:01.239900 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:01.389492 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:01.397487 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-82ce6429-e7a1-4fb8-9401-77fd705dae37 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.172209 Aug 24 05:31:01.398210 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3958/8187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:01 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:02.418586 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:02.419300 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:02.426640 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:02.427115 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:02.427556 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:02.428295 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:02.428751 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:02.429177 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:02.584231 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:02.594988 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-90e4ad03-a985-412f-9691-341520ea50c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.180239 Aug 24 05:31:02.595773 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4230/8188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:02 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:03.622804 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:03.623615 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:03.631330 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:03.631884 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:03.632347 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:03.633274 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:03.633838 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:03.634389 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:03.794091 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:03.802320 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-6f9e452a-c0e9-4674-94f2-d462ebeb3297 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.183506 Aug 24 05:31:03.803188 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3959/8189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:03 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:04.823491 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:04.824326 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:04.832325 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.832820 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.833270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.833990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.834443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.835147 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:05.001425 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:05.009330 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-01db885f-5532-4617-902a-959de7912004 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.189862 Aug 24 05:31:05.009905 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4231/8190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:04 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:06.031556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:06.032235 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:06.039760 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:06.040261 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:06.040712 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:06.041419 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:06.041885 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:06.042324 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:06.190708 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:06.201359 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-8d49ea98-f392-4a69-b552-a9dc5f361b67 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.173545 Aug 24 05:31:06.202295 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3960/8191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:06 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:07.224583 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:07.225273 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:07.228501 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:07.229270 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell0:SELECT=6 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:07.236053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:07.236567 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:07.237040 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:07.237774 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:07.238253 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:07.238701 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:07.396777 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:07.404972 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4f5f4b3f-589c-48ca-bd54-270311a59dce tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.185447 Aug 24 05:31:07.405692 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4232/8192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:07 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:08.431578 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:08.432234 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:08.434309 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell0:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:08.442188 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:08.442696 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:08.443150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:08.443912 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:08.444378 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:08.444812 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:08.645771 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:08.654362 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-2998fcf2-0e47-4d4e-8ec3-9fae4fc4233b tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.226658 Aug 24 05:31:08.654940 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3961/8193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:08 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:09.333165 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-6c6de6dd-1bad-4e8f-9bc9-536008f1c958 req-2fa88f5b-9f40-48c3-8e2c-5f71cf4be27a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9561d9-396b-467f-b5d5-28c04e75c9ac", "tag": "bb681ef4-f356-429a-b069-ac75f074f5e2"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:09.342768 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6c6de6dd-1bad-4e8f-9bc9-536008f1c958 req-2fa88f5b-9f40-48c3-8e2c-5f71cf4be27a service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:09.343247 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6c6de6dd-1bad-4e8f-9bc9-536008f1c958 req-2fa88f5b-9f40-48c3-8e2c-5f71cf4be27a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:09.343808 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-6c6de6dd-1bad-4e8f-9bc9-536008f1c958 req-2fa88f5b-9f40-48c3-8e2c-5f71cf4be27a service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:09.354925 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-6c6de6dd-1bad-4e8f-9bc9-536008f1c958 req-2fa88f5b-9f40-48c3-8e2c-5f71cf4be27a service nova] Creating event network-changed:bb681ef4-f356-429a-b069-ac75f074f5e2 for instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac on n-h1-846470-15 Aug 24 05:31:09.360242 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-6c6de6dd-1bad-4e8f-9bc9-536008f1c958 req-2fa88f5b-9f40-48c3-8e2c-5f71cf4be27a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089214 Aug 24 05:31:09.361223 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4233/8194] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:09.677972 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:09.678591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:09.687361 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:09.687971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:09.688447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:09.689159 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:09.689645 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:09.690081 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:09.861943 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:09.870205 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-9524425b-0f1e-4ed7-bc11-79f87fa4f3c2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.198553 Aug 24 05:31:09.870931 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3962/8195] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:09 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:10.897218 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:10.898386 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:10.908896 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:10.909383 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:10.909818 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:10.910518 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:10.910959 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:10.911387 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:11.057186 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:11.066250 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-b552c248-3a40-4a25-9a19-0a17ed49e3b2 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.176260 Aug 24 05:31:11.066841 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4234/8196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:10 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:12.088265 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:12.088898 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:12.096554 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:12.097057 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:12.097504 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:12.098258 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:12.099052 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:12.099489 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:12.330531 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:12.338898 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-f63c9de7-b2d2-40ec-ae8d-7e221db91e66 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.254674 Aug 24 05:31:12.339459 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3963/8197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:12 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:13.363747 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:13.364618 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:13.375330 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:13.375942 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:13.376378 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:13.377080 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:13.377536 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:13.377962 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:13.528053 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:13.539573 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-fb42afd0-3495-4ebb-a901-c69f8f9e53ac tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.181750 Aug 24 05:31:13.540378 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4235/8198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:13 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:14.565778 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:14.566408 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:14.573794 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:14.574300 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:14.574754 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:14.575457 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:14.576345 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:14.576776 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:14.729414 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:14.737448 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-88d020c4-6f84-4c22-9967-f4444535fed1 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.177038 Aug 24 05:31:14.738033 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3964/8199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:14 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:15.758489 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:15.759191 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:15.766733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.767225 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.767762 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.768457 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.768956 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.769615 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.781212 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [req-abba0709-02ff-44cc-bf9a-29eeb6a31e0c req-4f434cec-5855-49a3-8ddb-4c053ee1e2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9561d9-396b-467f-b5d5-28c04e75c9ac", "name": "network-vif-plugged", "status": "completed", "tag": "bb681ef4-f356-429a-b069-ac75f074f5e2"}]} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:15.793179 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-abba0709-02ff-44cc-bf9a-29eeb6a31e0c req-4f434cec-5855-49a3-8ddb-4c053ee1e2ce service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.793753 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-abba0709-02ff-44cc-bf9a-29eeb6a31e0c req-4f434cec-5855-49a3-8ddb-4c053ee1e2ce service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.794168 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [req-abba0709-02ff-44cc-bf9a-29eeb6a31e0c req-4f434cec-5855-49a3-8ddb-4c053ee1e2ce service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.807406 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.compute.server_external_events [req-abba0709-02ff-44cc-bf9a-29eeb6a31e0c req-4f434cec-5855-49a3-8ddb-4c053ee1e2ce service nova] Creating event network-vif-plugged:bb681ef4-f356-429a-b069-ac75f074f5e2 for instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac on n-h1-846470-15 Aug 24 05:31:15.813177 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [req-abba0709-02ff-44cc-bf9a-29eeb6a31e0c req-4f434cec-5855-49a3-8ddb-4c053ee1e2ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035820 Aug 24 05:31:15.814143 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3965/8200] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:31:15.926246 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:15.934313 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-9d6459b6-a131-4c86-a5f3-cfe3248231c5 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.179775 Aug 24 05:31:15.934892 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4236/8201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:15 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:16.958339 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:16.959016 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:16.965971 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:16.966471 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:16.966919 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:16.967626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:16.968131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:16.968565 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.124394 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:17.137522 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-31cb7efc-9904-43e9-b1f5-00c54030c33a tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1372 microversion: 2.1 time: 0.184597 Aug 24 05:31:17.138336 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3966/8202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:16 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:18.161281 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:18.161903 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:18.169493 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:18.169988 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:18.170424 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:18.171123 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:18.171581 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:18.172045 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:18.321352 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:18.330322 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-5f76b44a-92a1-4c96-b9f0-003c7957ac40 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1558 microversion: 2.1 time: 0.173454 Aug 24 05:31:18.330828 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4237/8203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:18 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:18.351416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:18.352097 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:18.359657 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:18.360187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:18.360648 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:18.361447 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:18.361944 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:18.362416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:18.512073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:18.521362 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-edb6eaf9-acc9-4396-bb5d-7df3c7e14d98 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1558 microversion: 2.1 time: 0.173906 Aug 24 05:31:18.521974 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3967/8204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:18 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:20.211907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-bccf39ed-d722-4e2e-b725-cb76869f4443 req-314a74fc-673e-455c-b2fc-85de98ac5147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9561d9-396b-467f-b5d5-28c04e75c9ac", "tag": "bb681ef4-f356-429a-b069-ac75f074f5e2"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:20.222824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bccf39ed-d722-4e2e-b725-cb76869f4443 req-314a74fc-673e-455c-b2fc-85de98ac5147 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:20.223399 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bccf39ed-d722-4e2e-b725-cb76869f4443 req-314a74fc-673e-455c-b2fc-85de98ac5147 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:20.223897 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-bccf39ed-d722-4e2e-b725-cb76869f4443 req-314a74fc-673e-455c-b2fc-85de98ac5147 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:20.235981 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-bccf39ed-d722-4e2e-b725-cb76869f4443 req-314a74fc-673e-455c-b2fc-85de98ac5147 service nova] Creating event network-changed:bb681ef4-f356-429a-b069-ac75f074f5e2 for instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac on n-h1-846470-15 Aug 24 05:31:20.241818 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-bccf39ed-d722-4e2e-b725-cb76869f4443 req-314a74fc-673e-455c-b2fc-85de98ac5147 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 Aug 24 05:31:20.242431 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4238/8205] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:32:54.401526 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:32:54.402324 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:33:04.523950 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:33:04.525240 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:33:30.797809 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=26 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.799199 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=62 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.856069 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-462700346"}} {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:30.859894 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:30.866889 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:30.867396 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:30.867886 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:30.868599 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:30.869076 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:30.869509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:31.089156 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-e24f52cd-989b-4312-96c1-12ee82dee9c9 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "POST /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac/action" status: 202 len: 0 microversion: 2.1 time: 0.294684 Aug 24 05:33:31.089795 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3968/8206] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 24 05:33:30 2022] POST /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 05:33:36.948053 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:33:36.948816 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:33:38.542622 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 05:33:38.544168 n-d-846470-15 devstack@n-api.service[122536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 05:33:38.544990 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.545735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=62 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.607150 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-88730931-1eb7-422c-8c29-3d95ac8330d1 req-551d5e01-cfdf-4873-b4e0-937334400590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9561d9-396b-467f-b5d5-28c04e75c9ac", "name": "network-vif-plugged", "status": "completed", "tag": "bb681ef4-f356-429a-b069-ac75f074f5e2"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:38.621733 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-88730931-1eb7-422c-8c29-3d95ac8330d1 req-551d5e01-cfdf-4873-b4e0-937334400590 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:38.622214 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-88730931-1eb7-422c-8c29-3d95ac8330d1 req-551d5e01-cfdf-4873-b4e0-937334400590 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:38.622645 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-88730931-1eb7-422c-8c29-3d95ac8330d1 req-551d5e01-cfdf-4873-b4e0-937334400590 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:38.633718 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-88730931-1eb7-422c-8c29-3d95ac8330d1 req-551d5e01-cfdf-4873-b4e0-937334400590 service nova] Creating event network-vif-plugged:bb681ef4-f356-429a-b069-ac75f074f5e2 for instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac on n-h1-846470-15 Aug 24 05:33:38.639413 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-88730931-1eb7-422c-8c29-3d95ac8330d1 req-551d5e01-cfdf-4873-b4e0-937334400590 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098778 Aug 24 05:33:38.640158 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4239/8207] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:50.042626 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_api:SELECT=2 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.044854 n-d-846470-15 devstack@n-api.service[122535]: DEBUG dbcounter [-] [122535] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.046949 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_api:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.047906 n-d-846470-15 devstack@n-api.service[122536]: DEBUG dbcounter [-] [122536] Writing DB stats nova_cell1:SELECT=2 {{(pid=122536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.050328 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:50.051473 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:50.061808 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.062416 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.063131 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.063965 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.064810 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.065241 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [27107f32-6ba8-4f99-833b-8e7b417ec518] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36448. Aug 24 05:33:50.068553 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.077193 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e253d1e-d000-449d-b752-0a09d2be9fae] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36446. Aug 24 05:33:50.106876 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:33:50.130849 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-9277db2d-c76e-42ec-a622-b5a69d872cc4 req-8fb540c2-9e2f-467b-9e10-21c5b7b5ad42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9561d9-396b-467f-b5d5-28c04e75c9ac", "tag": "bb681ef4-f356-429a-b069-ac75f074f5e2"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:50.141354 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9277db2d-c76e-42ec-a622-b5a69d872cc4 req-8fb540c2-9e2f-467b-9e10-21c5b7b5ad42 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.141835 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9277db2d-c76e-42ec-a622-b5a69d872cc4 req-8fb540c2-9e2f-467b-9e10-21c5b7b5ad42 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.142436 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-9277db2d-c76e-42ec-a622-b5a69d872cc4 req-8fb540c2-9e2f-467b-9e10-21c5b7b5ad42 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.155903 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-9277db2d-c76e-42ec-a622-b5a69d872cc4 req-8fb540c2-9e2f-467b-9e10-21c5b7b5ad42 service nova] Creating event network-changed:bb681ef4-f356-429a-b069-ac75f074f5e2 for instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac on n-h1-846470-15 Aug 24 05:33:50.162345 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-9277db2d-c76e-42ec-a622-b5a69d872cc4 req-8fb540c2-9e2f-467b-9e10-21c5b7b5ad42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120013 Aug 24 05:33:50.163646 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4240/8208] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:50.211972 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-0026345c-9597-488c-86f3-7b5ba843dfee tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 204 len: 0 microversion: 2.1 time: 0.172371 Aug 24 05:33:50.212981 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3969/8209] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:33:50 2022] DELETE /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:50.222448 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:50.223545 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:50.230845 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.232107 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.232973 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.234044 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.234632 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.235255 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.409892 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:50.421676 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-cb000456-5114-4490-a224-c1c51398ebef tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1683 microversion: 2.1 time: 0.203893 Aug 24 05:33:50.422303 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4241/8210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:50 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:33:51.454591 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:51.455221 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:51.463902 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:51.464410 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:51.464850 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:51.465572 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:51.466044 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:51.466481 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:51.731895 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:51.740529 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-5eaa2da8-4d2b-46ca-a6f1-ad4ae41f4624 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1683 microversion: 2.1 time: 0.293398 Aug 24 05:33:51.741107 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3970/8211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:51 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1683 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:52.507504 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-82f101a6-0a2b-4ccd-a5ea-04c25469c9a7 req-c464e7e5-920e-47b8-a8bf-1fc149319b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9561d9-396b-467f-b5d5-28c04e75c9ac", "name": "network-vif-deleted", "tag": "bb681ef4-f356-429a-b069-ac75f074f5e2"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:52.518850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-82f101a6-0a2b-4ccd-a5ea-04c25469c9a7 req-c464e7e5-920e-47b8-a8bf-1fc149319b8c service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:52.519415 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-82f101a6-0a2b-4ccd-a5ea-04c25469c9a7 req-c464e7e5-920e-47b8-a8bf-1fc149319b8c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:52.520435 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-82f101a6-0a2b-4ccd-a5ea-04c25469c9a7 req-c464e7e5-920e-47b8-a8bf-1fc149319b8c service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:52.534017 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-82f101a6-0a2b-4ccd-a5ea-04c25469c9a7 req-c464e7e5-920e-47b8-a8bf-1fc149319b8c service nova] Creating event network-vif-deleted:bb681ef4-f356-429a-b069-ac75f074f5e2 for instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac on n-h1-846470-15 Aug 24 05:33:52.539916 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-82f101a6-0a2b-4ccd-a5ea-04c25469c9a7 req-c464e7e5-920e-47b8-a8bf-1fc149319b8c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036458 Aug 24 05:33:52.540541 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4242/8212] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:52.762904 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:52.763446 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:52.771120 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:52.771638 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:52.772145 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:52.772980 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:52.773509 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:52.774039 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:52.816187 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:52.817078 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:52.817644 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:52.818259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.objects.instance [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lazy-loading 'fault' on Instance uuid 6d9561d9-396b-467f-b5d5-28c04e75c9ac {{(pid=122535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:33:52.864137 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:52.872502 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-ab9d8714-42cb-4515-8789-02b14cdb548f tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 200 len: 1337 microversion: 2.1 time: 0.113735 Aug 24 05:33:52.873093 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3971/8213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:52 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 1337 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:53.898775 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:53.899706 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: 6d9561d9-396b-467f-b5d5-28c04e75c9ac] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:53.908266 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:53.908904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:53.909477 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:53.910393 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:53.910997 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:53.912062 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:53.925780 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.wsgi [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] HTTP exception thrown: Instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac could not be found. Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Request method failure captured: Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: request: GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac HTTP/1.1 Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: Accept: application/json Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: Accept-Encoding: identity Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: Connection: close Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: Content-Length: 0 Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: Content-Type: application/json Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: Host: 10.222.0.58 Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: Openstack-System-Scope: None Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Auth-Token: gAAAAABjBbbKbPnjduCs_mEXPisbyqb9D2pBQpTAe8W_L4GNT7GHHF_SCt-mmCMQn22Sx8QLgFhHbP2iGR2yepk779YIjaW3oqeg1eULZl0Ftq-raZ1NmWt4BLSaSWB76ankC-9n2dHzh1ZlUCnV-3DlF_2wcX1D7JDYO3hhqVQNmrYAWBbiV_U Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Id: None Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Domain-Name: None Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Identity-Status: Confirmed Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Is-Admin-Project: True Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Id: default Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Domain-Name: Default Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Id: b70ace330a1f468b835c45effbf41e2b Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Project-Name: tempest-TestSnapshotPattern-29042192 Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Role: member,reader Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Roles: member,reader Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b70ace330a1f468b835c45effbf41e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b70ace330a1f468b835c45effbf41e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b70ace330a1f468b835c45effbf41e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b70ace330a1f468b835c45effbf41e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant: tempest-TestSnapshotPattern-29042192 Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Id: b70ace330a1f468b835c45effbf41e2b Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-Tenant-Name: tempest-TestSnapshotPattern-29042192 Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-User: tempest-TestSnapshotPattern-29042192-project Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Id: default Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-User-Domain-Name: Default Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-User-Id: af7a2f736f1349ecbf9ea2a6ab86032b Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: X-User-Name: tempest-TestSnapshotPattern-29042192-project Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: method: > Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: exception: Instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac could not be found. Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: action_args: {'id': '6d9561d9-396b-467f-b5d5-28c04e75c9ac'} Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac could not be found. Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac could not be found. Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:53.927531 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac could not be found. Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: ERROR nova.api.openstack.wsgi Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Returning 404 to user: Instance 6d9561d9-396b-467f-b5d5-28c04e75c9ac could not be found. {{(pid=122536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-f0ec02fc-f3d5-4001-ae11-433d45f4c543 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac" status: 404 len: 111 microversion: 2.1 time: 0.037387 Aug 24 05:33:53.933110 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4243/8214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:53 2022] GET /compute/v2.1/servers/6d9561d9-396b-467f-b5d5-28c04e75c9ac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:55.732732 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:55.733259 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:55.738365 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-e951f475-8466-4a6f-87a4-aecdb35ac42a req-3c77f212-fc4d-40bb-94cd-f7b125897f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde799a6-3197-4554-8fa3-1e14283237b3", "tag": "0542b05d-a3f4-4e08-b1d0-44a74d56cba7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:55.741556 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:55.742164 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:55.742682 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:55.743477 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:55.744061 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:55.744546 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:55.749117 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e951f475-8466-4a6f-87a4-aecdb35ac42a req-3c77f212-fc4d-40bb-94cd-f7b125897f96 service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:55.749695 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e951f475-8466-4a6f-87a4-aecdb35ac42a req-3c77f212-fc4d-40bb-94cd-f7b125897f96 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:55.750190 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-e951f475-8466-4a6f-87a4-aecdb35ac42a req-3c77f212-fc4d-40bb-94cd-f7b125897f96 service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:55.762087 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-e951f475-8466-4a6f-87a4-aecdb35ac42a req-3c77f212-fc4d-40bb-94cd-f7b125897f96 service nova] Creating event network-changed:0542b05d-a3f4-4e08-b1d0-44a74d56cba7 for instance fde799a6-3197-4554-8fa3-1e14283237b3 on n-h2-846470-15 Aug 24 05:33:55.767693 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-e951f475-8466-4a6f-87a4-aecdb35ac42a req-3c77f212-fc4d-40bb-94cd-f7b125897f96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032860 Aug 24 05:33:55.768508 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4244/8215] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:55.774505 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Going to try to terminate instance {{(pid=122535) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:33:55.883065 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-829ddfe5-635b-4466-a3ca-3b6c9cf48d11 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 204 len: 0 microversion: 2.1 time: 0.153287 Aug 24 05:33:55.884530 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3972/8216] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 24 05:33:55 2022] DELETE /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:55.895020 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:55.903268 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.compute.api [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122536) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:55.911904 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:55.912907 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:55.913452 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:55.914280 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:55.914850 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:55.915443 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:56.076757 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.policy [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122536) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:56.085077 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-47926447-7b90-4a6f-9cdb-0cf43e2b899e tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1681 microversion: 2.1 time: 0.195499 Aug 24 05:33:56.085660 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4245/8217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:55 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:33:57.107646 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:57.108320 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:57.116037 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:57.116748 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:57.117835 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:57.119073 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:57.120180 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:57.120631 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:57.193379 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.policy [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7a2f736f1349ecbf9ea2a6ab86032b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70ace330a1f468b835c45effbf41e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122535) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:57.202230 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-cf2cf7b0-e8ac-4d24-ab59-a10f08204e97 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 200 len: 1496 microversion: 2.1 time: 0.099197 Aug 24 05:33:57.202822 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3973/8218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:57 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 1496 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:57.213824 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [req-d62a71d1-7493-4ee1-a88b-6a9ea6019455 req-54480d5f-fd56-402d-91bd-709fe2b18cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde799a6-3197-4554-8fa3-1e14283237b3", "name": "network-vif-deleted", "tag": "0542b05d-a3f4-4e08-b1d0-44a74d56cba7"}]} {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:57.224521 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d62a71d1-7493-4ee1-a88b-6a9ea6019455 req-54480d5f-fd56-402d-91bd-709fe2b18cfc service nova] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:57.225364 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d62a71d1-7493-4ee1-a88b-6a9ea6019455 req-54480d5f-fd56-402d-91bd-709fe2b18cfc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:57.225913 n-d-846470-15 devstack@n-api.service[122536]: DEBUG oslo_concurrency.lockutils [req-d62a71d1-7493-4ee1-a88b-6a9ea6019455 req-54480d5f-fd56-402d-91bd-709fe2b18cfc service nova] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:57.239159 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.compute.server_external_events [req-d62a71d1-7493-4ee1-a88b-6a9ea6019455 req-54480d5f-fd56-402d-91bd-709fe2b18cfc service nova] Creating event network-vif-deleted:0542b05d-a3f4-4e08-b1d0-44a74d56cba7 for instance fde799a6-3197-4554-8fa3-1e14283237b3 on n-h2-846470-15 Aug 24 05:33:57.244422 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [req-d62a71d1-7493-4ee1-a88b-6a9ea6019455 req-54480d5f-fd56-402d-91bd-709fe2b18cfc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034330 Aug 24 05:33:57.245262 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4246/8219] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 24 05:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:58.224581 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '>' {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:58.225606 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.compute.api [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] [instance: fde799a6-3197-4554-8fa3-1e14283237b3] Fetching instance by UUID {{(pid=122535) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:58.233150 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:58.233658 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:58.234111 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:58.234833 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Acquiring lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:58.235306 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:58.235784 n-d-846470-15 devstack@n-api.service[122535]: DEBUG oslo_concurrency.lockutils [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Lock "a4fd8389-7871-477a-a6e5-d1946f0ded8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:58.250411 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.wsgi [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] HTTP exception thrown: Instance fde799a6-3197-4554-8fa3-1e14283237b3 could not be found. Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Request method failure captured: Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: request: GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 HTTP/1.1 Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: Accept: application/json Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: Accept-Encoding: identity Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: Connection: close Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: Content-Length: 0 Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: Content-Type: application/json Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: Host: 10.222.0.58 Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: Openstack-System-Scope: None Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Auth-Token: gAAAAABjBbbKbPnjduCs_mEXPisbyqb9D2pBQpTAe8W_L4GNT7GHHF_SCt-mmCMQn22Sx8QLgFhHbP2iGR2yepk779YIjaW3oqeg1eULZl0Ftq-raZ1NmWt4BLSaSWB76ankC-9n2dHzh1ZlUCnV-3DlF_2wcX1D7JDYO3hhqVQNmrYAWBbiV_U Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Id: None Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Domain-Name: None Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Identity-Status: Confirmed Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Is-Admin-Project: True Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Id: default Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Domain-Name: Default Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Id: b70ace330a1f468b835c45effbf41e2b Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Project-Name: tempest-TestSnapshotPattern-29042192 Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Role: member,reader Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Roles: member,reader Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b70ace330a1f468b835c45effbf41e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b70ace330a1f468b835c45effbf41e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b70ace330a1f468b835c45effbf41e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b70ace330a1f468b835c45effbf41e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant: tempest-TestSnapshotPattern-29042192 Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Id: b70ace330a1f468b835c45effbf41e2b Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-Tenant-Name: tempest-TestSnapshotPattern-29042192 Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-User: tempest-TestSnapshotPattern-29042192-project Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Id: default Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-User-Domain-Name: Default Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-User-Id: af7a2f736f1349ecbf9ea2a6ab86032b Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: X-User-Name: tempest-TestSnapshotPattern-29042192-project Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: method: > Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: exception: Instance fde799a6-3197-4554-8fa3-1e14283237b3 could not be found. Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: action_args: {'id': 'fde799a6-3197-4554-8fa3-1e14283237b3'} Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: {{(pid=122535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde799a6-3197-4554-8fa3-1e14283237b3 could not be found. Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde799a6-3197-4554-8fa3-1e14283237b3 could not be found. Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:58.252074 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde799a6-3197-4554-8fa3-1e14283237b3 could not be found. Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: ERROR nova.api.openstack.wsgi Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: DEBUG nova.api.openstack.wsgi [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Returning 404 to user: Instance fde799a6-3197-4554-8fa3-1e14283237b3 could not be found. {{(pid=122535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: INFO nova.api.openstack.requestlog [None req-b21ab443-b906-41cf-b754-3cbd49a64bd6 tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3" status: 404 len: 111 microversion: 2.1 time: 0.033150 Aug 24 05:33:58.257621 n-d-846470-15 devstack@n-api.service[122535]: [pid: 122535|app: 0|req: 3974/8220] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:58 2022] GET /compute/v2.1/servers/fde799a6-3197-4554-8fa3-1e14283237b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:58.435735 n-d-846470-15 devstack@n-api.service[122536]: DEBUG nova.api.openstack.wsgi [None req-4ca56b54-99ae-41ba-ae39-5af9494d920c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] Calling method '.version_select at 0x7f1021ad3d30>' {{(pid=122536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:58.480016 n-d-846470-15 devstack@n-api.service[122536]: INFO nova.api.openstack.requestlog [None req-4ca56b54-99ae-41ba-ae39-5af9494d920c tempest-TestSnapshotPattern-29042192 tempest-TestSnapshotPattern-29042192-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-24292991" status: 202 len: 0 microversion: 2.1 time: 0.049869 Aug 24 05:33:58.480639 n-d-846470-15 devstack@n-api.service[122536]: [pid: 122536|app: 0|req: 4247/8221] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 24 05:33:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-24292991 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:36:14.405492 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:36:14.406349 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:36:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:36:24.539450 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:36:24.539450 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:36:33.407488 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:36:33.408271 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:36:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:36:56.959433 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:36:56.960278 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:39:34.416464 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:39:34.416464 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:39:34.417477 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:39:34.417756 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:39:44.554213 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:39:44.554855 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:39:53.271970 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:39:53.272780 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:39:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:39:53.418401 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:39:53.418996 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:39:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:40:16.971643 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:40:16.971643 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:42:54.431271 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:42:54.432206 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:42:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:42:54.451592 n-d-846470-15 devstack@n-api.service[122536]: Traceback (most recent call last): Aug 24 05:42:54.451924 n-d-846470-15 devstack@n-api.service[122536]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 05:42:54.451924 n-d-846470-15 devstack@n-api.service[122536]: timer() Aug 24 05:42:54.451924 n-d-846470-15 devstack@n-api.service[122536]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 05:42:54.451924 n-d-846470-15 devstack@n-api.service[122536]: cb(*args, **kw) Aug 24 05:42:54.451924 n-d-846470-15 devstack@n-api.service[122536]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 24 05:42:54.451924 n-d-846470-15 devstack@n-api.service[122536]: waiter.switch() Aug 24 05:42:54.451924 n-d-846470-15 devstack@n-api.service[122536]: greenlet.error: cannot switch to a different thread Aug 24 05:43:04.563544 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:43:04.564213 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:43:13.282342 n-d-846470-15 devstack@n-api.service[122536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:43:13.282922 n-d-846470-15 devstack@n-api.service[122536]: Wed Aug 24 05:43:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:43:13.431585 n-d-846470-15 devstack@n-api.service[122535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:43:13.432176 n-d-846470-15 devstack@n-api.service[122535]: Wed Aug 24 05:43:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!